Article management system and refrigerator

Abstract

Provided are an article management system and a refrigerator that are capable of suppressing a reduction in management accuracy of articles stored in the refrigerator. The article management system includes: a refrigerator including a main box; and an imaging device that is attached to the top surface of the main box and that captures an image of the refrigerator, the imaging device including a first wireless communication module capable of transmitting management data for managing articles stored in the refrigerator, and the first wireless communication module being capable of transmitting management data for managing the articles stored in the refrigerator in a state where the imaging device is attached to the main box. The first wireless communication module is located in front of the opening of the main case.

Description

Technical Field

[0001] The invention relates to an article management system and a cold storage. Background Art

[0002] Patent Document 1 discloses a technology in which a camera is installed on the upper part of a refrigerator, an image is taken when an object passing through an opening of the refrigerator is detected, and food stored in the refrigerator is managed based on the imaged result.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-070476 Summary of the invention

[0006] Problems to be solved by the invention

[0007] The present invention provides an article management system and a cold storage capable of suppressing a decrease in management accuracy of articles stored in a cold storage.

[0008] Technical solutions to solve problems

[0009] The present invention provides an item management system, which includes: a cold storage, which includes a main box; and a camera device, which is installed on the top surface of the main box to photograph the cold storage, the camera device includes a first wireless communication module that can send management data for managing items stored in the cold storage, and when the camera device is installed on the main box, the first wireless communication module is located in front of the opening of the main box.

[0010] In addition, the present invention provides a cold storage, including a main body, including a camera device arranged on the top surface of the main body and photographing the cold storage, the camera device includes a first wireless communication module, the first wireless communication module can send management data for managing items stored in the cold storage, and the first wireless communication module is located in front of the opening of the main body.

[0011] In addition, this specification contains all the contents of Japanese patent application No. 2022-165227 applied on October 14, 2022.

[0012] Effects of the Invention

[0013] The article management system and refrigerator of the present invention can suppress interference caused by the top surface of the main box in the radio waves sent and received by the first wireless communication module. Therefore, the first wireless communication module can stably send management data, thereby suppressing the reduction of article management accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a diagram showing the structure of the article management system in the first embodiment.

[0015] Figure 2 This is a perspective view of the refrigerator in Embodiment 1.

[0016] Figure 3 This is a plan view of the imaging device in Embodiment 1 as viewed from the right.

[0017] Figure 4 This is a perspective view of the restriction member abutting against the front end edge of the main housing in Embodiment 1 as viewed from the left front.

[0018] Figure 5 This is a plan view of the refrigerator and the imaging device in Embodiment 1 as seen from the front.

[0019] Figure 6 This is a plan view of the refrigerator and the imaging device in Embodiment 1 as seen from the right.

[0020] Figure 7 This is a plan view of the imaging device installed in the refrigerator in Embodiment 1, viewed from above.

[0021] Figure 8 This is a block diagram showing the structure of the imaging device in Embodiment 1.

[0022] Fig. 9 This is a block diagram showing the configuration of a terminal device and an item management server in the first embodiment.

[0023] Fig.10 This is a flowchart showing the operation of the imaging device in the first embodiment.

[0024] Fig.11 This is a flowchart showing the operations of the imaging device and the item management server in the first embodiment.

[0025] Fig.12 This is a flowchart showing the operations of the terminal device and the item management server in Implementation Example 1.

[0026] Fig.13 This is a diagram showing the structure of the article management system in Implementation Example 2.

[0027] Fig.14 This is a block diagram showing the structure of a cold storage in the second embodiment. DETAILED DESCRIPTION

[0028] (Foundation, etc. that forms the basis of the present invention)

[0029] When the inventors finally came up with the present invention, there was a technology that performs shooting when an object passing through the opening of a cold storage is detected, and manages the food stored in the cold storage based on the shooting results. In the prior art, a camera device sends management data for managing items stored in the cold storage to an external device through wireless communication.

[0030] However, since the top surface of the main box of the cold storage is usually made of metal, interference caused by the top surface may occur in the radio waves received and sent by the wireless communication module depending on the positional relationship between the wireless communication module included in the camera device and the top surface of the main box. Therefore, the inventors found the following problem: depending on the positional relationship between the wireless communication module included in the camera device and the top surface of the main box, the wireless communication module cannot stably send management data, which can be said to reduce the management accuracy of the items. In order to solve this problem, the subject of the present invention is finally formed.

[0031] Therefore, the present invention provides an article management system and a refrigerator capable of suppressing a decrease in management accuracy of articles stored in a refrigerator.

[0032] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. However, sometimes, more detailed descriptions than necessary will be omitted. For example, sometimes, detailed descriptions of already well-known matters or repeated descriptions of substantially the same structures will be omitted.

[0033] In addition, the drawings and the following description are provided for those skilled in the art to fully understand the present invention, and are not intended to limit the subject matter described in the patent claims.

[0034] (Implementation Method 1)

[0035] [1-1. Structure]

[0036] [1-1-1. Structure of the item management system]

[0037] Figure 1 This is a diagram showing the structure of the article management system 1 in the first embodiment.

[0038] The article management system 1 is a system for managing articles stored in the refrigerator 2. As an example of article management, the article management system 1 of the present embodiment manages images showing articles stored in the refrigerator 2.

[0039] In the present embodiment, the articles stored in the refrigerator 2 include food, containers for storing food, etc. The articles may be marked with a predetermined mark.

[0040] The article management system 1 includes a cold storage 2 .

[0041] The cold storage 2 includes a main body 20 with an open front surface. A refrigerating chamber 21, an ice making chamber 22, a fresh freezing chamber 23, a freezing chamber 24, and a vegetable chamber 25 are formed on the main body 20. These storage chambers are cooled by cold air. A revolving door 21A is provided at the opening 201 of the front surface of the refrigerating chamber 21. The door 21A includes a revolving right door 21B and a revolving left door 21C. Drawers 22A, 23A, 24A, and 25A capable of storing articles are provided in the ice making chamber 22, the fresh freezing chamber 23, the freezing chamber 24, and the vegetable chamber 25, respectively. In the setting state, the upper surface of each of the drawers 22A to 25A is open. In addition, a rotating partition 21D is provided on the left door 21C. The rotating partition 21D is a rectangular component that closes the gap between the right door 21B and the left door 21C in the closed state. Hereinafter, when the drawers 22A, 23A, 24A, and 25A are collectively referred to without distinguishing them, the reference numeral “ 26A” is given and described as “drawer 26A”.

[0042] The right door 21B corresponds to the "first door" of the present invention, and the left door 21C corresponds to the "second door" of the present invention.

[0043] The article management system 1 includes a camera 3. The camera 3 is provided on the top surface 20A of the main body 20 of the cold storage 2. In addition, the top surface 20A of the main body 20 is made of metal. In addition, the top surface 20A of the main body 20 is made of resin. The camera 3 photographs the cold storage 2. In addition, the camera 3 can also photograph articles passing through the opening 201 of the cold storage room 2.

[0044] The article management system 1 includes a terminal device 4. The terminal device 4 is a portable computer such as a smartphone. The terminal device 4 has an application program related to the management of articles stored in the refrigerator 2 installed therein, and communicates with the article management server 5 through the function of the application program.

[0045] In the following description, this application is described as an “article management application” and is denoted by the reference numeral “411”.

[0046] exist Figure 1 In FIG. 1 , a user P at home is indicated by a solid line, and a user P outside the home H is indicated by a dotted line. When the terminal device 4 is used by the user P at home, it communicates with the item management server 5 via the communication device 6 or not via the communication device 6. In addition, when the terminal device 4 is used by the user P outside the home H and a communication connection cannot be established with the communication device 6, the terminal device 4 communicates with the item management server 5 not via the communication device 6.

[0047] The communication device 6 is connected to a network NW formed by a public line network or the like, and communicates with the article management server 5 via the network NW. The communication device 6 functions as an interface device for connecting the refrigerator 2, the imaging device 3, and the terminal device 4 to the network NW. The communication device 6 constructs a local area network in the home H.

[0048] The article management system 1 includes an article management server 5. The article management server 5 is a device for managing articles stored in the cold storage 2. As an article management, the article management server 5 stores images of the articles. The article management server 5 is connected to the network NW. In addition, in each figure, the article management server 5 is represented by a single block, but this does not necessarily mean that the article management server 5 is composed of a single device.

[0049] [1-1-2. Structure of cold storage]

[0050] Figure 2 It is a perspective view of the refrigerator 2 in the installed state.

[0051] exist Figure 2 The figure shows an X-axis, a Y-axis, and a Z-axis. The X-axis, the Y-axis, and the Z-axis are orthogonal to each other. The Z-axis represents the up-down direction, which is equivalent to the height direction of the cold storage 2. The X-axis and the Y-axis are parallel to the horizontal direction. The X-axis represents the left-right direction. The left-right direction is equivalent to the width direction of the cold storage 2. The Y-axis represents the front-back direction. The positive direction of the X-axis represents the right direction. The positive direction of the Y-axis represents the front direction. The positive direction of the Z-axis represents the upward direction.

[0052] Refrigerator 2 includes a main body 20, a door 21A, and a drawer 26A.

[0053] The main box body 20 is a box-shaped component that forms the main body of the cold storage 2. The main box body 20 includes: an outer box 202 that is open on the front surface; an inner box 203 that is housed inside the outer box 202 and is open on the front surface; and a heat-insulating material that fills the space between the outer box 202 and the inner box 203. The outer box 202 is formed of, for example, a metal such as iron or a hard resin such as ABS. The upper surface of the outer box 202, that is, the top surface 20A of the main box 20, is formed of metal. The inner box 203 is formed of, for example, a hard resin such as ABS. The heat-insulating material is, for example, hard polyurethane foam. In addition, the heat-insulating material is not limited to this, and any material can be used as long as it has heat-insulating properties and can be filled in the space between the outer box 202 and the inner box 203.

[0054] The inner space of the inner box 203 is divided into a plurality of spaces by a partition member. In this embodiment, the inner space of the inner box 203 is divided into five spaces, which function as a refrigerating chamber 21, an ice making chamber 22, a fresh freezing chamber 23, a freezing chamber 24, and a vegetable chamber 25, respectively.

[0055] The right door 21B is rotatably supported by a right door hinge member 204, which is a hinge member provided on the top surface 20A of the main housing 20. The left door 21C is rotatably supported by a left door hinge member 205, which is a hinge member provided on the top surface 20A of the main housing 20.

[0056] The right door hinge member 204 corresponds to the "first hinge member" of the present invention. The left door hinge member 205 corresponds to the "second hinge member" of the present invention.

[0057] The second wireless communication module 206 is provided on the right door hinge part 204. The second wireless communication module 206 is a module that receives control data for controlling the cold storage 2 from an external device, or sends specified data to an external device. In addition, the second wireless communication module 206 is provided on the right door hinge part 204 instead of the left door hinge part 205 due to the following reasons. The rotating partition 21D included in the left door 21C has a heater for preventing condensation, in which AC (Alternating Current) power is supplied from the main box 20 via the left door hinge part 205 as driving power. Therefore, in order to prevent the radio waves from being affected by the power supplied to the heater, the second wireless communication module 206 is provided on the right door hinge part 204 instead of on the left door hinge part 205.

[0058] [1-1-3. Configuration of the imaging device]

[0059] Reference Figure 3-Figure 7 The imaging device 3 will be described.

[0060] exist Figure 3-Figure 7 The diagram and Figure 2 The X-axis, Y-axis, and Z-axis shown are the same as the X-axis, Y-axis, and Z-axis. The X-axis direction corresponds to the width direction of the imaging device 3 and the left-right direction of the imaging device 3. The Y-axis direction corresponds to the front-back direction of the imaging device 3. The Z-axis direction corresponds to the up-down direction of the imaging device 3.

[0061] Figure 3 It is a top view of the imaging device 3 attached to the refrigerator 2 as seen from the right. Figure 4 This is a perspective view of the restriction member 34 in contact with the front end edge 20B of the main housing 20 as viewed from the left front.

[0062] like Figure 3 and Figure 4 As shown in FIG. 1 , the camera device 3 includes a main body 30 disposed on the top surface 20A of the main housing 20 , and a photographing member 31 extending forward from the main body 30 . The photographing member 31 is disposed on the upper front portion of the main body 30 .

[0063] The main body 30 includes a power button 32 on the front surface for turning on and off the power of the imaging device 3. The power button 32 is provided with a first LED (Light emitting diode) 33 for notifying predetermined information.

[0064] The main body 30 includes a limiting component 34. The limiting component 34 limits the position of the shooting component 31 in the front-to-back direction of the cold storage 2 by abutting against the front end edge 20B of the main body 20. The limiting component 34 is a sheet extending from the bottom surface 30A of the main body 30. The limiting component 34 extends along the width direction of the main body 30 (the width direction of the camera device 3) on the front surface of the main body 30, and has a mark 35 at the center of the width direction of the main body 30. The mark 35 indicates the center of the width direction of the camera device 3. The length of the limiting component 34 extending from the bottom surface 30A is formed to be shorter than the length from the top surface 20A of the main body 20 to the door gasket provided on the upper inner surface of the door 21A and substantially parallel to the top surface 20A.

[0065] Figure 5 It is a plan view of refrigerator 2 and imaging device 3 attached to refrigerator 2 as seen from the front. Figure 5 Door 21A of refrigerator 2 is shown in an open state. Figure 6 It is a top view of refrigerator 2 and imaging device 3 attached to refrigerator 2 as seen from the right. Figure 6 Drawer 25A of refrigerator 2 is shown in an open state, that is, in a pulled-out state. Figure 7 It is a top view of imaging device 3 attached to refrigerator 2 as seen from above.

[0066] The camera device 3 includes a wide-angle camera 301 and a narrow-angle camera 302. The wide-angle camera 301 and the narrow-angle camera 302 are disposed at the front end portion of the bottom surface 31A of the imaging member 31. When the camera device 3 is installed in the cold storage 2 and the door 21A is closed, the wide-angle camera 301 and the narrow-angle camera 302 are located in front of the door 21A.

[0067] Wide-angle camera 301 is a camera having a wider angle than narrow-angle camera 302. In a state where imaging device 3 is attached to refrigerator 2, wide-angle camera 301 captures refrigerating room 21 from the upper front of refrigerator 2.

[0068] For example, when viewed from the front of the cold storage 2, the shooting range of the wide-angle camera 301 includes Figure 5 The range A1 is a range including the door shelves 21E of the right door 21B and the left door 21C and the opening 201 of the refrigerator 21 when the right door 21B and the left door 21C are opened to the maximum degree. In addition, the shooting range of the wide-angle camera 301 includes Figure 6Range A3 is a range from the front end of the right door 21B and the left door 21C in the open state to the front end of the shelf 21F in the front-rear direction, and includes the opening 201 of the refrigerating chamber 21 in the up-down direction.

[0069] Narrow-angle camera 302 is a camera having a narrower angle than wide-angle camera 301. In a state where imaging device 3 is mounted on refrigerator 2, narrow-angle camera 302 captures an image of drawer 26A from the upper front of refrigerator 2.

[0070] For example, when viewed from the front of the cold storage 2, the shooting range of the narrow-angle camera 302 includes Figure 5 The range A2 shown. When viewed from the front of the refrigerator 2, the range A2 includes the drawer 26A. In addition, for example, when viewed from the right of the refrigerator 2, the shooting range of the narrow-angle camera 302 includes Figure 6 The range A4 is a range including the drawer 26A in the state of being pulled out first in the front-rear direction.

[0071] The imaging device 3 includes a first optical sensor 303 and a second optical sensor 304 . The first optical sensor 303 and the second optical sensor 304 are provided on the main body 30 .

[0072] The first optical sensor 303 is a sensor for detecting the opening and closing of the right door 21B. The first optical sensor 303 is a reflective optical sensor. The first optical sensor 303 projects light to a predetermined portion of the right door 21B when the imaging device 3 is mounted on the refrigerator 2. Then, the first optical sensor 303 outputs a signal indicating the amount of light received.

[0073] The second optical sensor 304 is a sensor for detecting the opening and closing of the left door 21C. The second optical sensor 304 is a reflective optical sensor. The second optical sensor 304 projects light to a predetermined portion of the left door 21C when the imaging device 3 is mounted on the refrigerator 2. Then, the second optical sensor 304 outputs a detection value indicating the amount of received light.

[0074] The imaging device 3 includes a thermopile 305. The thermopile 305 is a sensor for detecting the opening and closing of the drawer 26A. The thermopile 305 is provided at the front end of the bottom surface 31A of the imaging member 31. The thermopile 305 outputs a detection value indicating the detected temperature.

[0075] The imaging device 3 includes a human sensor 306. The human sensor 306 may be an infrared sensor or an ultrasonic sensor. The human sensor 306 outputs a detection value. The human sensor 306 is provided at the front end of the bottom surface 31A of the imaging member 31.

[0076] The imaging device 3 includes an illuminance sensor 307. The illuminance sensor 307 is a sensor for adjusting the exposure of the wide-angle camera 301 and the narrow-angle camera 302. The illuminance sensor 307 outputs a detection value. The illuminance sensor 307 is provided at the front end of the imaging unit 31.

[0077] The imaging device 3 includes a second LED 308 and a third LED 309. The second LED 308 is provided at the right front end of the bottom surface 31A of the imaging member 31. The third LED 309 is provided at the left front end of the bottom surface 31A of the imaging member 31. The second LED 308 and the third LED 309 illuminate the refrigerator 2 on which the imaging device 3 is mounted from above.

[0078] like Figure 7 As shown, the imaging device 3 includes a first control substrate 311 and a second control substrate 312 .

[0079] The first control substrate 311 is a substrate for controlling various sensors included in the camera device 3 and the power supply of the camera device 3. The first control substrate 311 is provided inside the camera device 3. The power button 32, the first LED 33, the first light sensor 303, the second light sensor 304, the thermocouple 305, the human sensor 306, and the illuminance sensor 307 are connected to the first control substrate 311. And the first control substrate 311 controls these devices. The first control substrate 311 is provided behind the second control substrate 312 and the first wireless communication module 313.

[0080] The second control substrate 312 is a substrate that controls the wide-angle camera 301 and the narrow-angle camera 302, and also controls the first wireless communication module 313. The second control substrate 312 is provided inside the camera device 3. The wide-angle camera 301, the narrow-angle camera 302, and the first wireless communication module 313 are connected to the second control substrate 312. And the second control substrate 312 controls these devices. The second control substrate 312 is provided side by side with the first control substrate 311 in front of the first control substrate 311.

[0081] The first wireless communication module 313 is a device including hardware such as an antenna or a wireless communication circuit. The first wireless communication module 313 is provided inside the imaging component 31, to the left of the second control substrate 312. The first wireless communication module 313 is provided in the imaging device 3 so as to be located in front of the opening 201 of the main body 20 when the imaging device 3 is installed in the cold storage 2. More specifically, the first wireless communication module 313 is provided in front of the limiting component 34 in the imaging device 3.

[0082] Assuming that the first wireless communication module 313 is disposed behind the limiting member 34, when the camera device 3 is installed in the cold storage 2, the first wireless communication module 313 is located at a position overlapping with the top surface 20A when viewed from above. Since the top surface 20A of the main body 20 is usually formed of metal, if the first wireless communication module 313 and the top surface 20A overlap when viewed from above, interference caused by the top surface 20A may occur in the radio waves received and sent by the first wireless communication module 313. However, in this embodiment, since the first wireless communication module 313 and the top surface 20A do not overlap when viewed from above, interference caused by the top surface 20A in the radio waves received and sent by the first wireless communication module 313 can be suppressed. In addition, in this embodiment, when viewed from above, the first wireless communication module 313 overlaps with the door 21A. However, the frame of the door 21A is usually made of resin. Therefore, the possibility of interference with the radio waves received and sent by the first wireless communication module 313 is low.

[0083] Furthermore, in a state where the camera device 3 is installed in the cold storage 2, the first wireless communication module 313 may also be arranged to be located above the top surface of the door 21A. For example, the first wireless communication module 313 may also be located above one side of the door 21A. In addition, for example, the first wireless communication module 313 may also be located above the top surface 20A of the cold storage 2. In addition, for example, the first wireless communication module 313 may also be located above the front of the door 21A in a closed state. Thus, assuming that the frame of the door 21A is formed of metal, interference in the radio waves of the first wireless communication module 313 can also be suppressed.

[0084] When the camera device 3 is installed in the main housing 20, the first wireless communication module 313 is located on the opposite side of the position where the second wireless communication module 206 is provided. Figure 7 As shown, when the camera 3 is installed in the cold storage 2, the first wireless communication module 313 is arranged on the left side of the center ST of the camera 3 in the left-right direction of the cold storage 2 (the left-right direction of the camera 3). That is, when the camera 3 is installed in the cold storage 2, the first wireless communication module 313 is arranged on the left side of the door hinge member 205 than the center ST of the camera 3. Thus, since the distance between the first wireless communication module 313 and the second wireless communication module 206 can be ensured, the interference of radio waves generated between the first wireless communication module 313 and the second wireless communication module 206 can be suppressed.

[0085] In addition, the position on the opposite side of the position where the second wireless communication module 206 is provided is not limited to the position in the left-right direction of the cold storage 2 with the center ST of the camera device 3 as the reference. The reference may also be a prescribed portion of the camera device 3. For example, the reference may be the right side surface of the camera device 3, or may be a substrate included in the camera device 3. In addition, the reference may also be a prescribed portion of the cold storage 2.

[0086] The camera device 3 includes a metal portion 314. The metal portion 314 is provided on the opposite side of the position where the first wireless communication module 313 is provided when the camera device 3 is installed in the main housing 20. Figure 7 As shown, in a state where the camera device 3 is installed in the cold storage 2, a metal plate 314 is provided between the first wireless communication module 313 and the second wireless communication module 206 in the left-right direction. The metal plate 314 may also be provided to cover the entire area of ​​the right inner side surface 315 of the shooting component 31. In addition, the metal plate 314 may also be provided on the right inner side surface 315 of the shooting component 31 in a range including the first wireless communication module 313 when viewed from the side. In addition, the metal plate 314 may also be provided to cover the entire area of ​​the right inner side surface of the camera device 3. By providing the metal plate 314, heat dissipation in the camera device 3 can be achieved, and interference of radio waves generated between the first wireless communication module 313 and the second wireless communication module 206 can be further suppressed. In addition, safety can be improved by non-flammable design.

[0087] The metal plate 314 corresponds to the “metal portion” of the present invention.

[0088] In addition, the position of the metal portion 314 opposite to the position where the first wireless communication module 313 is provided is not limited to the right inner side surface 315 of the photographing component 31 or the right inner side surface of the camera device 3. The position opposite to the position where the first wireless communication module 313 is provided can be any position as long as it is based on a predetermined component in the camera device 3. For example, the reference may be the boundary between the first wireless communication module 313 and other components.

[0089] Figure 8 It is a block diagram showing the structure of the imaging device 3.

[0090] like Figure 8 As shown, the first control substrate 311 includes a first processor 320 such as a CPU (Central Processing Unit), a first memory 330, a first communication module 340, and an interface circuit to which other devices and sensors are connected.

[0091] The first memory 330 is a storage device that stores programs and data executed by the first processor 320. The first memory 330 is composed of a non-volatile storage device such as a ROM (Read Only Memory). The first memory 330 may also include a volatile storage device such as a RAM (Random Access Memory) that constitutes a working area of ​​the first processor 320. The first memory 330 stores data processed by the first processor 320 and a control program 331 executed by the first processor 320.

[0092] The first communication module 340 includes hardware such as a communication circuit or a connector in accordance with a predetermined wired communication standard, and communicates with the second control substrate 312 under the control of the first processor 320 .

[0093] The first processor 320 reads and executes the control program 331 , thereby turning the power of the imaging device 3 on and off in accordance with the operation of the power button 32 .

[0094] Furthermore, the first processor 320 reads out and executes the control program 331 to turn on and off the first LED 33 , the second LED 308 , and the third LED 309 .

[0095] Furthermore, the first processor 320 reads out and executes the control program 331 , thereby transmitting the detection values ​​output by each sensor connected to the first control board 311 to the second control board 312 via the first communication module 340 .

[0096] The second control substrate 312 includes a second processor 350 such as a CPU, a second memory 360, a second communication module 370, and an interface circuit for connecting to other devices or sensors.

[0097] The second memory 360 is a storage device that stores programs and data executed by the second processor 350. The second memory 360 is composed of a non-volatile storage device such as a ROM. In addition, the second memory 360 may also include a volatile storage device such as a RAM that constitutes a working area of ​​the second processor 350. The second memory 360 stores data processed by the second processor 350, a control program 361 executed by the second processor 350, and an imaging device ID (Identification) 362.

[0098] The imaging device ID 362 is information for uniquely identifying the imaging device 3 .

[0099] The second communication module 370 includes hardware such as a communication circuit or a connector in accordance with a predetermined wired communication standard, and communicates with the first control substrate 311 under the control of the second processor 350 .

[0100] The second processor 350 functions as a first communication control unit 351 , a second communication control unit 352 , an opening / closing determination unit 353 , a photographing control unit 354 , a recording control unit 355 , and a generating unit 356 by reading and executing a control program 361 stored in the second memory 360 .

[0101] The first communication control unit 351 communicates with the article management server 5 via the first wireless communication module 313 .

[0102] The second communication control unit 352 communicates with the first control board 311 via the second communication module 370. The second communication control unit 352 receives detection values ​​of various sensors connected to the first control board 311 from the first control board 311.

[0103] The opening / closing determination unit 353 determines whether the right door 21B is in the open state or the closed state based on the detection value of the first light sensor 303 received by the second communication control unit 352. When the second communication control unit 352 receives a detection value different from the detection value corresponding to the closed state, the opening / closing determination unit 353 determines that the right door 21B is in the open state. On the other hand, when the second communication control unit 352 receives a detection value corresponding to the closed state, the opening / closing determination unit 353 determines that the right door 21B is in the closed state.

[0104] Similar to the determination regarding the right door 21B, the opening / closing determination unit 353 determines whether the left door 21C is in the open state or the closed state based on the detection value of the second optical sensor 304 received by the second communication control unit 352 .

[0105] The opening and closing judgment unit 353 judges whether the drawer 26A is in an open state or a closed state based on the detection value of the thermopile 305 received by the second communication control unit 352. When the second communication control unit 352 receives the detection value of the thermopile 305 indicating a temperature below the specified temperature, the opening and closing judgment unit 353 judges that the drawer 26A is in an open state. On the other hand, when the second communication control unit 352 receives the detection value of the thermopile 305 indicating a temperature exceeding the specified temperature, the opening and closing judgment unit 353 judges that the drawer 26A is in a closed state.

[0106] When the opening / closing determination unit 353 determines that the door 21A or the drawer 26A is in the open state, the imaging control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to start imaging. In addition, when the imaging control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to start imaging, the second communication control unit 352 sends lighting request information to the first control substrate 311. The lighting request information is information requesting the lighting of the second LED 308 and the third LED 309. When the first processor 320 receives the lighting request information, it lights the second LED 308 and the third LED 309, and notifies the user P that imaging has started.

[0107] When the opening / closing determination unit 353 determines that the door 21A and the drawer 26A are in the closed state, the imaging control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to end imaging. In addition, when the imaging control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to end imaging, the second communication control unit 352 sends an extinguishing request information to the first control substrate 311. The extinguishing request information is information requesting the extinguishing of the second LED 308 and the third LED 309. When the first processor 320 receives the extinguishing request information, it turns off the second LED 308 and the third LED 309, and notifies the user P that imaging is ended.

[0108] When the opening / closing determination unit 353 determines that the door 21A or the drawer 26A is in the open state, the recording control unit 355 starts recording the shooting results of the wide-angle camera 301 and the narrow-angle camera 302. That is, the recording control unit 355 starts recording the recording data 363 in the second memory 360. The recording data 363 includes the first recording data indicating the shooting results of the wide-angle camera 301 and the second recording data indicating the shooting results of the narrow-angle camera 302.

[0109] When the opening / closing determination unit 353 determines that the door 21A and the drawer 26A are in the closed state, the recording control unit 355 ends the recording of the image capturing results of the wide-angle camera 301 and the narrow-angle camera 302 .

[0110] Generator 356 generates management data D1. Management data D1 is data uploaded to article management server 5 and is used to manage articles stored in refrigerator 2. First communication controller 351 transmits management data D1 generated by generator 356 to article management server 5.

[0111] [1-1-4. Structure of the item management server]

[0112] Fig. 9 It is a block diagram showing the configuration of the terminal device 4 and the item management server 5.

[0113] The article management server 5 includes a server processor 50 which is a processor such as a CPU, a server memory 51, and a server communication module 52. The server processor 50 is connected to the server memory 51 and the server communication module 52.

[0114] The server memory 51 is a storage device that stores programs and data executed by the server processor 50. The server memory 51 is composed of a non-volatile storage device. In addition, the server memory 51 may also include a non-volatile storage device that constitutes a work area of ​​the server processor 50. The server memory 51 stores data processed by the server processor 50, a control program 511 executed by the server processor 50, and an item management DB (database) 512.

[0115] The article management DB 512 has one record for each imaging device 3. Each record includes the imaging device ID 362, image data of a first captured image, and image data of a second captured image. The first captured image and the second captured image will be described later.

[0116] Server communication module 52 includes a communication circuit or a connector based on a predetermined communication standard, and communicates with refrigerator 2 , imaging device 3 , and terminal device 4 via network NW.

[0117] The server processor 50 functions as a server communication control unit 501 and a server processing unit 502 by reading and executing a control program 511 stored in the server memory 51 .

[0118] The server communication control unit 501 communicates with the refrigerator 2 , the imaging device 3 , and the terminal device 4 via the server communication module 52 .

[0119] The server processing unit 502 performs various information processing using the camera 3 and the terminal device 4 as clients. The server processing unit 502 may also use the refrigerator 2 as a client.

[0120] [1-1-5. Configuration of terminal device]

[0121] Next, the structure of the terminal device 4 is described.

[0122] The terminal device 4 includes a terminal processor 40 which is a processor such as a CPU, a terminal memory 41 , a terminal communication module 42 , and a touch panel 43 .

[0123] The terminal memory 41 is a storage device that non-volatilely stores programs and data executed by the terminal processor 40. The terminal memory 41 is composed of a non-volatile storage device. In addition, the terminal memory 41 may also include a RAM that constitutes a work area of ​​the terminal processor 40. The terminal memory 41 stores data processed by the terminal processor 40, a control program executed by the terminal processor 40, and an item management application 411.

[0124] The terminal communication module 42 includes a communication circuit or a connector based on a prescribed communication standard, and communicates with the item management server 5 under the control of the terminal processor 40 .

[0125] The touch panel 43 includes a display panel and a touch sensor overlapped with or provided integrally with the display panel.

[0126] The terminal processor 40 functions as an application execution unit 400 .

[0127] The application execution unit 400 communicates with the item management server 5 via the terminal communication module 42 .

[0128] The application execution unit 400 causes the touch panel 43 to display a user interface related to the management of the items stored in the refrigerator 2. In the following description, this user interface is referred to as "application UI." The display control unit 402 of this embodiment displays images of the items stored in the refrigerator 2 and the like by displaying the application UI.

[0129] The application execution unit 400 receives various inputs from the user P via the application UI.

[0130] [1-2. Action]

[0131] Next, the operation of each unit of the article management system 1 will be described.

[0132] [1-2-1. Actions related to video recording]

[0133] First, the operation of the imaging device 3 related to recording will be described.

[0134] Fig.10 FA is a flowchart showing the operation of the imaging device 3 .

[0135] The opening / closing determination unit 353 determines whether the door 21A or the drawer 26A is in the open state (step SA1 ).

[0136] When the opening / closing determination unit 353 determines that the door 21A or the drawer 26A is not in the open state (step SA1 : NO), the second processor 350 returns the process to step SA1 .

[0137] When the opening / closing determination unit 353 determines that the door 21A or the drawer 26A is in the open state (step SA1 : Yes), the imaging control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to start imaging (step SA2 ).

[0138] Next, the recording control unit 355 starts recording the image capturing results of the wide-angle camera 301 and the narrow-angle camera 302 (step SA3 ).

[0139] Next, the opening / closing determination unit 353 determines whether the door 21A and the drawer 26A are closed (step SA4). If the opening / closing determination unit 353 determines that the door 21A and the drawer 26A are not closed (step SA4: No), the determination in step SA4 is performed again.

[0140] On the other hand, when it is determined that the door 21A and the drawer 26A are closed (step SA4 : Yes), the recording control unit 355 ends the recording of the photographing result (step SA5 ). Thus, the recording data 363 is generated in the second memory 360 .

[0141] Next, the imaging control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to end imaging (step SA6 ).

[0142] [1-2-2. Operations related to transmission of management data]

[0143] Next, the operation related to the transmission of the management data D1 will be described.

[0144] Fig.11 This is a flowchart showing the operation of the imaging device 3 and the article management server 5 .

[0145] exist Fig.11 In the flowchart FB, the operation of the imaging device 3 is shown, and the flowchart FC shows the operation of the article management server 5 is shown.

[0146] The generation unit 356 determines whether the recorded data 363 is stored in the second memory 360 (step SB1). When the generation unit 356 determines that the recorded data 363 is not stored (step SB1: No), the determination of step SB1 is performed again.

[0147] On the other hand, when the generating unit 356 determines that the video data 363 is stored (step SB1: Yes), a captured image of a moving image represented by the first video data of the video data 363 stored in the second memory 360 is selected from the first video data stored in the second memory 360 (step SB2).

[0148] Step SB2 will be described in detail.

[0149] The first captured image is a captured image when the right door 21B and the left door 21C are opened at a rotation angle of α°≤θ≤β°, and is a captured image with the least image of the user P. α° is, for example, 60°, and β° is, for example, 100°.

[0150] The generation unit 356 selects a captured image in which a predetermined mark is marked on the door 21A from the dynamic image represented by the first video data. The predetermined mark is marked in advance so as to be captured in the captured image when the right door 21B and the left door 21C meet α°≤θ≤β°. Next, the generation unit 356 selects a captured image in which the user P is least reflected from the selected captured images as the first captured image. The generation unit 356 identifies the user P captured in the captured image by a method such as pattern matching, and sets the captured image in which the image of the identified user P has the smallest area as the captured image in which the user P is least reflected.

[0151] Returning to the description of flowchart FB, the generation unit 356 selects a second captured image from the moving images represented by the second recorded data of the stored recorded data 363 (step SB3 ).

[0152] Step SB3 will be described in detail.

[0153] The second captured image is a captured image of the drawer 26A having a pulled-out degree of γ% or more, when the pulled-out degree of the closed state is set to 0% and the pulled-out degree of the most opened state is set to 100%. The pulled-out degree refers to the degree of being pulled out. In addition, the second captured image is a captured image with the least image of the user P. γ% is, for example, 70%.

[0154] The generator 356 selects a captured image in which a predetermined mark is marked on the inside of the drawer 26A from the dynamic image represented by the second video data. The predetermined mark is marked in advance so as to be captured in the captured image when the drawer 26A is pulled out more than γ%. Next, the generator 356 selects a captured image in which the user P is least reflected from the selected captured images as the second captured image.

[0155] The generation unit 356 determines whether at least one of the first captured image and the second captured image can be selected (step SB4 ).

[0156] When the generation unit 356 determines that the first captured image and the second captured image cannot be selected (step SB4 : No), it performs the process of step SB7 .

[0157] On the other hand, when the generating unit 356 determines that at least one of the first captured image and the second captured image can be selected (step SB4 : Yes), it generates the management data D1 (step SB5 ).

[0158] When the first captured image and the second captured image are selectable, the generating unit 356 generates management data D1 including image data of the first captured image, image data of the second captured image, and the imaging device ID 362 .

[0159] When the first captured image can be selected but the second captured image cannot be selected, the generating unit 356 generates management data D1 including the image data of the first captured image and the imaging device ID 362 .

[0160] When the second captured image can be selected but the first captured image cannot be selected, the generating unit 356 generates management data D1 including the image data of the second captured image and the imaging device ID 362 .

[0161] Next, the first communication control unit 351 transmits the management data D1 generated by the generating unit 356 to the article management server 5 (step SB6).

[0162] Next, the generating unit 356 deletes the recorded data 363 to be processed from the second memory 360 after step SB2 (step SB7 ).

[0163] As shown in flowchart FC, the server communication control unit 501 determines whether the management data D1 is received from the camera device 3 (step SC1). When the server communication control unit 501 determines that the management data D1 is received (step SC1: Yes), the server processing unit 502 updates the item management DB 512 based on the management data D1 received by the server communication control unit 501 (step SC2).

[0164] Step SC2 will be described in detail.

[0165] The server processing unit 502 identifies the record including the camera ID 362 included in the management data D1 from the article management DB 512, and updates the image data of the first captured image of the identified record to the image data of the first captured image included in the management data D1.

[0166] The server processing unit 502 identifies the record including the camera ID 362 included in the management data D1 from the article management DB 512, and updates the image data of the second captured image of the identified record to the image data of the second captured image included in the management data D1.

[0167] [1-2-3. Actions related to application UI]

[0168] Next, the operation of the item management system 1 related to the application UI will be described.

[0169] Fig.124 is a flowchart showing the operation of the terminal device 4 and the article management server 5. Fig.12 Flowchart FD represents the operation of the terminal device 4, and flowchart FE represents the operation of the item management server 5.

[0170] As shown in flowchart FD, the application execution unit 400 determines whether to request image data stored in the article management DB 512 from the article management server 5 (step SD1). For example, when the article management application 411 is activated, the terminal communication control unit 401 makes an affirmative determination in step SD1.

[0171] When the application execution unit 400 determines that the image data stored in the article management DB 512 is requested (step SD1: Yes), it sends request data for requesting the image data to the article management server 5 (step SD2). The request data includes the camera ID 362 stored in the terminal memory 41. In addition, the terminal device 4 obtains the camera ID 362 at a predetermined time.

[0172] As shown in flowchart FE, the server communication control unit 501 receives the request data (step SE1). Next, the server processing unit 502 obtains the image data corresponding to the camera ID 362 included in the request data received by the server communication control unit 501 from the item management DB 512 (step SE2). Next, the server communication control unit 501 sends the image data obtained by the server processing unit 502 to the terminal device 4 as a response to the request data (step SE3).

[0173] Referring to flowchart FD, the application execution unit 400 receives image data from the item management server 5 (step SD3). Next, the application execution unit 400 causes the touch panel 43 to display an application UI including an image indicated by the image data received in step SD3 (step SD4).

[0174] [1-3. Effects, etc.]

[0175] As described above, the article management system 1 includes: a cold storage 2 including a main body 20; and a camera device 3 installed on the top surface 20A of the main body 20 to photograph the cold storage 2. The camera device 3 includes a first wireless communication module 313 capable of transmitting management data D1 for managing articles stored in the cold storage 2. The first wireless communication module 313 is located in front of the opening 201 of the main body 20 when the camera device 3 is installed in the main body 20.

[0176] This can suppress interference caused by the top surface 20A of the main body 20 in radio waves transmitted and received by the first wireless communication module 313. Therefore, the first wireless communication module 313 can stably transmit the management data D1, thereby suppressing a decrease in the management accuracy of the items.

[0177] The cold storage 2 includes a right door 21B and a left door 21C for opening and closing an opening 201, and a second wireless communication module 206 provided on a right door hinge member 204 pivotally supporting the right door 21B. The first wireless communication module 313 is located on the left door hinge member 205 side pivotally supporting the left door 21C than the center ST of the camera device 3 in the left-right direction of the cold storage 2 when the camera device 3 is mounted on the main body 20.

[0178] According to this, since the distance between the first wireless communication module 313 and the second wireless communication module 206 can be ensured, it is possible to suppress the interference of radio waves between the first wireless communication module 313 and the second wireless communication module 206. Therefore, the first wireless communication module 313 can send the management data D1 more stably, so it is possible to further suppress the reduction of the management accuracy of the items.

[0179] The cold storage 2 includes a right door 21B and a left door 21C for opening and closing the opening 201, and a second wireless communication module 206 provided on a right door hinge member 204 that pivotally supports the right door 21B. The camera device 3 includes a metal plate 314. The metal plate 314 is provided between the first wireless communication module 313 and the second wireless communication module 206 in the left-right direction of the cold storage 2 when the camera device 3 is mounted on the main body 20.

[0180] This can further suppress radio interference between the first wireless communication module 313 and the second wireless communication module 206. Therefore, the first wireless communication module 313 can transmit the management data D1 more stably, thereby further suppressing a decrease in the management accuracy of the items.

[0181] Refrigerator 2 includes door 21A that opens and closes opening 201. When imaging device 3 is attached to main body 20, first wireless communication module 313 is located in front of door 21A in a closed state.

[0182] According to this, it is possible to further suppress interference in the radio waves received and sent by the first wireless communication module 313. Therefore, the first wireless communication module 313 can stably send the management data D1, so it is possible to further suppress the reduction in the management accuracy of the items. In addition, assuming that the frame of the door 21A is made of metal, it is also possible to suppress interference in the radio waves received and sent by the first wireless communication module 313, so it is possible to suppress the reduction in the management accuracy of the items.

[0183] (Implementation Method 2)

[0184] Next, Embodiment 2 will be described. In the description of Embodiment 2, the same components as those of the respective components of the article management system 1 of Embodiment 1 are denoted by the same reference numerals, and detailed descriptions thereof will be omitted as appropriate.

[0185] [2-1. Structure]

[0186] Fig.13 This is a diagram showing the configuration of an article management system 1A in the second embodiment.

[0187] The article management system 1A in this embodiment includes a cold storage 2A, an article management server 5, and a terminal device 4. The cold storage 2 and the camera 3 in the above-mentioned embodiment 1 are separate bodies, but the cold storage 2A in the embodiment 2 includes the camera 3A. That is, the cold storage 2A and the camera 3A in this embodiment are not separate bodies.

[0188] Fig.14 It is a block diagram showing the configuration of refrigerator 2A in the present embodiment.

[0189] Refrigerator 2A includes third control board 220. Third control board 220 includes third processor 230 such as a CPU, third memory 240, third communication module 250, and an interface circuit for connecting to other devices or sensors.

[0190] The third memory 240 is a storage device that stores programs and data executed by the third processor 230. The third memory 240 is composed of a non-volatile storage device. In addition, the third memory 240 may also include a volatile storage device that constitutes a working area of ​​the third processor 230. The third memory 240 stores data processed by the third processor 230 and a control program 241 executed by the third processor 230.

[0191] The third communication module 250 includes communication hardware such as a communication circuit or a connector in accordance with a predetermined wired communication standard, and communicates with the first control substrate 311A ​​under the control of the third processor 230 .

[0192] The second wireless communication module 206 , the cooling unit 207 , the first opening / closing sensor 208 , the second opening / closing sensor 209 , the third opening / closing sensor 210 , the fourth opening / closing sensor 211 , the fifth opening / closing sensor 212 , and the sixth opening / closing sensor 213 are connected to the third control substrate 220 .

[0193] The cooling unit 207 includes a compressor or a condenser, a capillary tube, a cooler, a cooling fan for conveying cold air generated by the cooler to each storage room, and a damper for diverting the cold air conveyed by the cooling fan, etc., which are mechanisms for cooling each storage room of the cold storage 2A. The cooling unit 207 cools each storage room of the cold storage 2A under the control of the third control board 220.

[0194] The first opening / closing sensor 208 to the sixth opening / closing sensor 213 are constituted by, for example, a Hall IC.

[0195] The first opening / closing sensor 208 is a sensor for detecting the opening / closing of the right door 21B.

[0196] The second opening / closing sensor 209 is a sensor for detecting the opening / closing of the left door 21C.

[0197] The third opening / closing sensor 210 is a sensor for detecting the opening / closing of the drawer 22A.

[0198] The fourth opening / closing sensor 211 is a sensor for detecting the opening / closing of the drawer 23A.

[0199] The fifth opening / closing sensor 212 is a sensor for detecting the opening / closing of the drawer 24A.

[0200] The sixth opening / closing sensor 213 is a sensor for detecting the opening / closing of the drawer 25A.

[0201] Each opening and closing sensor outputs a detection value to the third control substrate 220 .

[0202] The third processor 230 reads out and executes the control program 241 to communicate with the external device via the second wireless communication module 206 .

[0203] Furthermore, third processor 230 reads out and executes control program 241 to cool each storage room of cold storage 2A using cooling unit 207 .

[0204] Furthermore, the third processor 230 reads out and executes the control program 241 , thereby transmitting the detection values ​​outputted from the first opening / closing sensor 208 to the sixth opening / closing sensor 213 to the first control substrate 311A.

[0205] Refrigerator 2A includes imaging device 3A. Compared with imaging device 3, imaging device 3A does not include first optical sensor 303, second optical sensor 304, thermopile 305, human detection sensor 306, second LED 308, and third LED 309.

[0206] The camera device 3A of the second embodiment includes a first control substrate 311A ​​instead of the first control substrate 311. The power button 32, the first LED 33, and the illuminance sensor 307 are connected to the first control substrate 311A. In addition, the camera device 3A of the second embodiment includes a second control substrate 312A instead of the second control substrate 312. The wide-angle camera 301, the narrow-angle camera 302, and the first wireless communication module 313 are connected to the second control substrate 312A.

[0207] The first control substrate 311A ​​is provided in the imaging device 3A at the same position as the first control substrate 311 in the imaging device 3 .

[0208] In addition, the second control substrate 312A is provided in the imaging device 3A at the same position as the installation position of the second control substrate 312 in the imaging device 3 .

[0209] In this embodiment, the wide-angle camera 301 , the narrow-angle camera 302 , the power button 32 , the first LED 33 , the illuminance sensor 307 , and the first wireless communication module 313 are disposed at the same positions as those in the first embodiment.

[0210] The first control substrate 311A ​​includes a first processor 320A such as a CPU, a first memory 330A, a first communication module 340A, and an interface circuit for connecting to other devices or sensors.

[0211] The first memory 330A is the same memory as the first memory 330. The first memory 330A stores data processed by the first processor 320A and a control program 331A executed by the first processor 320A.

[0212] The first communication module 340A includes communication hardware such as a communication circuit or a connector in compliance with a predetermined wired communication standard, and communicates with the second control board 312A and the third control board 220 via a cable.

[0213] The first processor 320A reads out and executes the control program 331A, thereby turning the power of the imaging device 3A on and off in accordance with the operation of the power button 32 .

[0214] The first processor 320A turns on and off the first LED 33 by reading and executing the control program 331A.

[0215] The first processor 320A reads out and executes the control program 331A, thereby transmitting the detection value output by the illuminance sensor 307 to the second control board 312A via the first communication module 340A.

[0216] The first processor 320A reads out and executes the control program 331A, thereby transmitting the detection values ​​of the first to sixth opening / closing sensors 208 to 213 received from the third control board 220 to the second control board 312A via the first communication module 340A.

[0217] The second control substrate 312A includes a second processor 350A such as a CPU, a second memory 360A, a second communication module 370A, and an interface circuit for connecting to other devices or sensors.

[0218] The second memory 360A is the same memory as the first memory 330. The second memory 360A stores data processed by the second processor 350A and a control program 361A executed by the second processor 350A.

[0219] The second communication module 370A includes communication hardware such as a communication circuit or a connector in compliance with a predetermined communication standard, and communicates with the first control substrate 311A ​​under the control of the second processor 350A.

[0220] The second processor 350A functions as the first communication control unit 351, the second communication control unit 352A, the opening / closing determination unit 353A, the imaging control unit 354, the recording control unit 355, and the generating unit 356 by reading and executing the control program 361A stored in the second memory 360A.

[0221] The second communication control unit 352A communicates with the first control board 311A ​​via the second communication module 370A. The second communication control unit 352A receives detection values ​​of various sensors from the first control board 311A.

[0222] The opening and closing determination unit 353A determines whether the right door 21B is in the open state or the closed state based on the detection value of the first opening and closing sensor 208 received by the second communication control unit 352A. When the second communication control unit 352A receives a detection value different from the detection value corresponding to the closed state, the opening and closing determination unit 353 determines that the right door 21B is in the open state. On the other hand, when the second communication control unit 352 receives a detection value corresponding to the closed state, the opening and closing determination unit 353 determines that the right door 21B is in the closed state.

[0223] Similar to the determination regarding the right door 21B, the opening / closing determination unit 353A determines whether the left door 21C is in the open state or the closed state based on the detection value of the second opening / closing sensor 209 received by the second communication control unit 352 .

[0224] The opening / closing determination unit 353A determines whether the drawer 26A is in the open or closed state based on the detection values ​​of the third opening / closing sensor 210 to the sixth opening / closing sensor 213 received by the second communication control unit 352. The opening / closing determination unit 353A makes the same determination as that of the right door 21B.

[0225] [2-2. Action]

[0226] The operation of each unit of the article management system 1A in this embodiment is the same as the operation of each unit of the article management system 1 in Embodiment 1. That is, the operation of the camera 3A related to recording is the same as the operation of the camera 3 in Embodiment 1. In addition, the operation of the camera 3A related to the management data D1 is the same as the operation of the camera 3 in Embodiment 1.

[0227] [2-3. Effects, etc.]

[0228] As described above, the cold storage 2A including the main body 20 is provided on the top surface 20A of the main body 20, and includes a camera 3A for photographing the cold storage 2A. The camera 3A includes a first wireless communication module 313 capable of transmitting management data D1 for managing items stored in the cold storage 2A. The first wireless communication module 313 is located in front of the opening 201 of the main body 20.

[0229] According to this, the same effects as those of the article management system 1 in the first embodiment are achieved.

[0230] (Other Embodiments)

[0231] As described above, the above-mentioned embodiments 1 and 2 are described as examples disclosed in this application. However, the technology in the present invention is not limited to this, and can also be applied to embodiments that have been changed, replaced, added, omitted, etc. In addition, the various components described in the above-mentioned embodiments 1 and 2 can also be combined to form a new embodiment. Therefore, other embodiments are exemplified below.

[0232] In the above-mentioned embodiments 1 and 2, the metal plate 314 is shown as an example of the "metal part" of the present invention. However, the "metal part" of the present invention is not limited to the metal plate 314. For example, in the case where the second control substrate 311 is shielded by metal, the "metal part" of the present invention may also be the shield. The second control substrate 311 is arranged between the first wireless communication module 313 and the second wireless communication module 206 in the left-right direction of the cold storage 2. Therefore, the shield has the same effect as the metal plate 314.

[0233] In the above-mentioned embodiments 1 and 2, the third LED 309, the illuminance sensor 307, the human sensor 306, the wide-angle camera 301, the narrow-angle camera 302, the thermopile 305, and the second LED 308 are arranged in sequence at the front end of the imaging unit 31. However, this arrangement order is only an example, and the arrangement order of these components is not limited to the embodiments 1 and 2.

[0234] In the above-mentioned second embodiment, the first optical sensor 303, the second optical sensor 304, the thermopile 305, the human sensor 306, the second LED 308, and the third LED 309 are not included. In other embodiments of the second embodiment, any of these devices may be included.

[0235] In the above-mentioned Embodiments 1 and 2, the right door 21B and the left door 21C have different widths. In other embodiments, the right door 21B and the left door 21C may have the same width, or the left door 21C may have a width greater than the right door 21B.

[0236] In the above-mentioned embodiments 1 and 2, the second wireless communication module 206 is provided on the right door hinge component 204. In other embodiments, the second wireless communication module 206 may be provided on the left door hinge component 205. In this case, the left door 21 is equivalent to the "first door" of the present invention, the right door 21B is equivalent to the "second door" of the present invention, the left door hinge component 205 is equivalent to the "first hinge component" of the present invention, and the right hinge component 204 is equivalent to the "second hinge component" of the present invention.

[0237] In the above-mentioned Embodiments 1 and 2, the imaging device 3 and 3A is configured to include the second LED 308 and the third LED 309. In other embodiments, the second LED 308 and the third LED 309 may be configured by a single LED.

[0238] In the above-mentioned embodiment 1, the case where the sensor for detecting the opening and closing of the drawer 26A is composed of the thermopile 305 is exemplified. However, the sensor for detecting the opening and closing of the drawer 26A may also be a distance sensor. In this case, the opening and closing judgment unit 353 judges whether the drawer 26A is in an open state or a closed state based on the detection value of the distance sensor. When the drawer 26A is pulled out, it is detected as having an action. In addition, the distance sensor may be an infrared method or an ultrasonic method.

[0239] In the above-mentioned second embodiment, the case where the first opening and closing sensor 208 to the sixth opening and closing sensor 213 are composed of Hall ICs is exemplified. However, the first opening and closing sensor 208 and the second opening and closing sensor 209 may also be other sensors such as distance sensors, angle sensors, cameras, and temperature sensors. In addition, the third opening and closing sensor 210 to the sixth opening and closing sensor 213 may also be other sensors such as acceleration sensors, mechanical switches, angle sensors, cameras, and temperature sensors.

[0240] In other embodiments, the following structure may be used: the video recording or shooting of the camera may be terminated after a specified time has passed since the door 21A or the drawer 26A is in the open state. For example, the specified time is 1 minute. In addition, the specified time may be extended when it is detected that the door 21A or the drawer 26A is in the open state, there are people around the cold storage 2, 2A, and the user P is taking out or putting in items. In addition, when it is detected that the door 21A or the drawer 26A is in the open state, there are people around the cold storage 2, 2A, and the user P is taking out or putting in items, the video recording or shooting of the camera may be terminated after a specified time has passed from the moment of detection.

[0241] In other embodiments, when the opening and closing judgment unit 353 judges that the door 21A or the drawer 26A is in the open state, the second LED 308 and the third LED 309 may be turned on. In addition, when the opening and closing judgment unit 353 judges that the door 21A or the drawer 26A is in the closed state, the second LED 308 and the third LED 309 may be turned off. In addition, the lighting or turning off of these LEDs may be controlled according to the shooting status of the camera. For example, in the case of a structure that ends the recording or shooting of the camera after a specified time has passed after the door 21A or the drawer 26A is in the open state, these LEDs are turned off when the recording of the camera is ended. In addition, similarly, these LEDs may be turned off when the shooting of the camera is ended.

[0242] In other embodiments, in addition to the functional units of the second processors 350 and 350A in Embodiments 1 and 2, the second processors 350 and 350A may also function as a detection unit for detecting an object. The detection unit may also cut out images of objects entering and leaving the refrigerating chamber 21 from the dynamic image during the period from the start to the end of the recording of the wide-angle camera 301 and the narrow-angle camera 302 by the recording control unit 355. In addition, when a mark is attached to the object, the detection unit may detect the marked object.

[0243] In other embodiments, in addition to the functional units of the second processor 350 in Embodiment 1, the second processor 350 may also function as a person presence determination unit. The person presence determination unit determines whether there is a person around the cold storage 2 based on the detection value of the human sensing sensor 306. More specifically, the person presence determination unit determines that there is a person around the cold storage 2 when the detection value of the human sensing sensor 306 is a detection value corresponding to the presence of a person, and determines that there is no person around the cold storage 2 when this is not the case. In the case where the second processor 350 functions as the person presence determination unit, when the person presence determination unit determines that there is a person, the shooting control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to start shooting, and when the person presence determination unit determines that there is no person, the shooting control unit 354 causes the wide-angle camera 301 and the narrow-angle camera 302 to end shooting. In addition, when the second processor 350 functions as a person presence determination unit, when the person presence determination unit determines that a person is present, the recording control unit 354 starts recording, and when the person presence determination unit determines that a person is not present, the recording control unit 355 ends recording. Thus, even when the opening and closing determination unit 353 makes an erroneous determination, the shooting results of the wide-angle camera 301 and the narrow-angle camera 302 can be properly recorded.

[0244] In other embodiments, in addition to the functional units of the second processors 350 and 350A in embodiments 1 and 2, the second processors 350 and 350A may also function as an entry and exit judgment unit. In this case, the entry and exit judgment unit changes the boundary line used for the entry and exit judgment according to the opening and closing angles of the left door 21C and the right door 21B, and judges the entry and exit of the article. In addition, the entry and exit judgment unit changes the boundary line used for the entry and exit judgment according to the pulling degree of the drawer 26A, and judges the entry and exit of the article.

[0245] In other embodiments, the first captured image may be subjected to image correction and uploaded to the article management server 5. As an example of image correction, correction of viewpoint conversion is exemplified.

[0246] In the above-described embodiment, the first captured image and the second captured image are used for display purposes of the terminal device 4. However, the first captured image and the second captured image may be used for other purposes such as detecting articles stored in the cold storage 2 or 2A.

[0247] In other embodiments, the compartments formed in the main body 20 of the refrigerator 2, 2A may have storage rooms other than the above five types, or may be fewer. In other embodiments, the number of doors provided in the opening 201 of the refrigerating chamber 21 may be one.

[0248] The first processor 320, 320A, the second processor 350, 350A, the server processor 50, and the terminal processor 40 may be composed of a single processor or a plurality of processors. These processors may also be hardware programmed in a manner to implement corresponding functional units. That is, these processors may also be composed of, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0249] Figure 8 , Fig. 9 ,and Fig.14 The structures of the camera device 3, 3A, the cold storage 2, 2A, the terminal device 4, and the article management server 5 shown are examples, and the specific installation form is not particularly limited. That is, it is not necessary to install the corresponding hardware for each part separately, and it is also possible to set the structure in which the functions of each part are realized by executing a program by a processor. In addition, part of the functions realized by software in the above-mentioned embodiment can also be set as hardware, or part of the functions realized by hardware can also be realized by software.

[0250] Fig.10 , Fig.11 and Fig.12 The step units of the actions shown are units that are divided according to the main processing content for the sake of ease of understanding the actions, and the actions are not limited by the division method or name of the processing units. It can also be divided into more step units according to the processing content. In addition, a step unit can also be divided into more processing. In addition, the order of the steps can also be appropriately replaced within the scope that does not hinder the purpose of the present invention.

[0251] Furthermore, since the above-described embodiments are provided to illustrate the technology of the present invention, various changes, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents.

[0252] (Note)

[0253] The following technology is disclosed through the description of the above embodiments.

[0254] (Technology 1) An item management system, comprising: a cold storage including a main body; and a camera device installed on the top surface of the main body to photograph the cold storage, the camera device including a first wireless communication module capable of transmitting management data for managing items stored in the cold storage, and when the camera device is installed on the main body, the first wireless communication module is located in front of an opening of the main body.

[0255] According to this configuration, interference caused by the top surface of the main housing in radio waves transmitted and received by the first wireless communication module can be suppressed. Therefore, the first wireless communication module can stably transmit management data, thereby suppressing a decrease in the management accuracy of items.

[0256] (Technology 2) According to the item management system described in Technology 1, the cold storage includes a second wireless communication module, and when the camera device is installed in the main box, the first wireless communication module is located on the opposite side of the position where the second wireless communication module is installed.

[0257] According to this structure, since the distance between the first wireless communication module and the second wireless communication module can be ensured, the interference of radio waves between the first wireless communication module and the second wireless communication module can be suppressed. Therefore, the first wireless communication module can stably send management data, so the reduction of the management accuracy of the items can be further suppressed.

[0258] (Technology 3) An article management system according to Technology 2, wherein the cold storage includes a first door and a second door for opening and closing the opening, the second wireless communication module is set on a first hinge member that pivotally supports the first door, and when the camera device is installed on the main box, the first wireless communication module is located on the side of the second hinge member that pivotally supports the second door closer to the center of the camera device in the left-right direction of the cold storage.

[0259] According to this structure, since the distance between the first wireless communication module and the second wireless communication module can be ensured, the interference of radio waves between the first wireless communication module and the second wireless communication module can be suppressed. Therefore, the first wireless communication module can stably send management data, so the reduction of the management accuracy of the items can be further suppressed.

[0260] (Technology 4) An item management system according to any one of Technologies 1 to 3, wherein the camera device includes a metal portion, and when the camera device is installed in the main box, the metal portion is arranged on the opposite side of the position where the first wireless communication module is arranged.

[0261] According to this structure, the heat in the camera device can be dissipated while preventing the radio waves transmitted and received by the first wireless communication module from being affected. As a result, the heat in the camera device can be prevented from affecting the processing of the camera device, so the first wireless communication module can stably send management data, and the reduction in the management accuracy of the items can be further suppressed. In addition, the safety can be improved by the non-combustible design, so the reduction in the management accuracy of the items can be further suppressed.

[0262] (Technology 5) An item management system according to any one of Technologies 1 to 4, wherein the cold storage includes a first door and a second door for opening and closing the opening, and a second wireless communication module arranged on a first hinge member axially supporting the first door, and the camera device includes a metal part, and when the camera device is installed on the main box, the metal part is arranged between the first wireless communication module and the second wireless communication module in the left and right directions of the cold storage.

[0263] According to this configuration, it is possible to further suppress the interference of radio waves between the first wireless communication module and the second wireless communication module. Therefore, the first wireless communication module can transmit the management data more stably, so it is possible to further suppress the reduction of the management accuracy of the article.

[0264] (Technology 6) An item management system according to any one of Technologies 1 to 5, wherein the cold storage includes a door for opening and closing the opening, and when the camera device is installed on the main box, the first wireless communication module is located above the top surface of the door.

[0265] According to this structure, interference in the radio waves received and sent by the first wireless communication module can be further suppressed. Therefore, the first wireless communication module can appropriately send management data, so the reduction in the management accuracy of the items can be further suppressed. In addition, even if the door is made of metal, interference in the radio waves received and sent by the first wireless communication module can be suppressed, so the reduction in the management accuracy of the items can be suppressed.

[0266] (Technology 7) A cold storage includes a main body, wherein a camera device is arranged on the top surface of the above-mentioned main body and takes pictures of the above-mentioned cold storage, the above-mentioned camera device includes a first wireless communication module, the above-mentioned first wireless communication module can send management data for managing items stored in the above-mentioned cold storage, and the above-mentioned first wireless communication module is located in front of the opening of the above-mentioned main body.

[0267] According to this structure, the same effect as the article management system described in technology 1 is achieved.

[0268] Industrial Applicability

[0269] As described above, the article management system and the refrigerator of the present invention can be used to suppress a decrease in the management accuracy of articles stored in the refrigerator.

[0270] Description of Reference Numerals

[0271] 1. 1A Item Management System

[0272] 2. 2A cold storage

[0273] 3. 3A Camera Device

[0274] 4 Terminal Devices

[0275] 5 Item Management Server

[0276] 20 Main box

[0277] 20A top surface

[0278] Door 21A

[0279] 21B Right Door (1st Door)

[0280] 21C Left Door (2nd Door)

[0281] 201 opening

[0282] 204 right door hinge component (first hinge component)

[0283] 205 Left door hinge component (second hinge component)

[0284] 206 2nd wireless communication module

[0285] 310 control substrate (shielding part)

[0286] 311, 311A ​​1st control substrate

[0287] 312, 312A Second control substrate

[0288] 313 1st wireless communication module

[0289] 320, 320A 1st processor

[0290] 330, 330A 1st memory

[0291] 331, 331A control program

[0292] 340, 340A 1st communication module

[0293] 350, 350A second processor

[0294] 351 1st Communication Control Unit

[0295] 352, 352A Second communication control unit

[0296] 353, 353A Open / Close Judgment Unit

[0297] 354 Shooting Control Unit

[0298] 355 Video Control Department

[0299] 356 Generation Department

[0300] 360, 360A 2nd Memory

[0301] 361, 361A control program

[0302] 362 Camera Device ID

[0303] 363 video data

[0304] 370, 370A second communication module

[0305] D1 Management data

[0306] Central ST.

Claims

1. An item management system, characterized in that: include: A cold storage comprising a main body; and A camera device is installed on the top surface of the main box to take pictures of the cold storage. The camera device includes a first wireless communication module capable of transmitting management data for managing items stored in the cold storage. When the imaging device is mounted on the main housing, the first wireless communication module is located in front of an opening of the main housing.

2. The article management system according to claim 1, characterized in that: The cold storage includes a second wireless communication module, When the imaging device is mounted on the main housing, the first wireless communication module is located on the opposite side of a position where the second wireless communication module is provided.

3. The article management system according to claim 2, characterized in that: The cold storage includes a first door and a second door for opening and closing the opening. The second wireless communication module is set on the first hinge member that axially supports the first door. When the imaging device is mounted on the main body, the first wireless communication module is located closer to the second hinge member pivotally supporting the second door than the center of the imaging device in the left-right direction of the refrigerator.

4. The article management system according to any one of claims 1 to 3, characterized in that: The camera device includes a metal part, The metal portion is provided on the opposite side of a position where the first wireless communication module is provided when the imaging device is mounted on the main housing.

5. The article management system according to claim 4, characterized in that: The refrigerator includes a first door and a second door for opening and closing the opening, and a second wireless communication module provided on a first hinge member that pivotally supports the first door. The camera device includes a metal part, The metal portion is provided between the first wireless communication module and the second wireless communication module in a left-right direction of the refrigerator in a state where the imaging device is mounted on the main body.

6. The article management system according to any one of claims 1 to 3, characterized in that: The cold storage includes a door for opening and closing the opening. When the imaging device is mounted on the main housing, the first wireless communication module is located above the top surface of the door.

7. A cold storage, comprising a main box, characterized in that: A camera device is provided on the top surface of the main box body and is used to photograph the cold storage. The camera device includes a first wireless communication module capable of transmitting management data for managing items stored in the cold storage. The first wireless communication module is located in front of the opening of the main housing.

Images