Refrigeration system and storage control device

The refrigerator system uses a camera-based image recognition system to interact with detachable stickers, addressing the cost and alignment limitations of projector-based systems, improving cooling performance and user convenience.

JP2026054372APending Publication Date: 2026-03-26HITACHI GLOBAL LIFE SOLUTIONS INC
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-09-13
Publication Date
2026-03-26

AI Technical Summary

Technical Problem

The existing refrigerator systems with projector-based projection display mechanisms increase manufacturing costs and limit the degree of freedom in projection display areas due to the need for a specific optical axis alignment.

Method used

A refrigerator system with a camera unit that captures images of detachable stickers displaying settings on the refrigerator surface, allowing users to interact with these settings by touch or proximity, eliminating the need for a physical operation panel and enhancing user convenience.

Benefits of technology

This solution reduces manufacturing costs, improves cooling performance by allowing thicker insulation, and enhances user convenience by enabling customizable sticker placement and operation via image recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026054372000001_ABST
    Figure 2026054372000001_ABST
Patent Text Reader

Abstract

We provide highly convenient refrigerator systems and other related products. [Solution] The refrigerator system comprises a refrigerator body 10 having a housing 1 and refrigerator doors 211, 212 that together form a refrigerator compartment 21 with the housing 1, and a camera unit 3 that takes pictures of a sticker 4 attached to the outer or inner surface of the refrigerator body 10, which is detachable from the outer or inner surface of the refrigerator body 10 and displays predetermined settings related to the control of the refrigerator 100 including the refrigerator body 10 in a way that is visible to the user, and a control unit that, based on the image taken by the camera unit 3, detects an operation on the sticker 4 by a user touching or bringing their fingers close to the sticker 4, and changes the settings to the settings specified by the user's fingers in that operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a refrigerator system and a storage control device.

Background Art

[0002] Regarding a refrigerator system, for example, the technology described in Patent Document 1 is known. That is, Patent Document 1 describes that "the display unit has a projection display mechanism for projecting and displaying an image of the operation unit and the display unit, and an operation recognition mechanism for recognizing that the operation unit projected on the front surface of the door has been operated by the projection display mechanism."

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology described in Patent Document 1, since a projector is provided as a projection display mechanism, the manufacturing cost increases. Further, in order to project and display a predetermined image on the door of the refrigerator, the optical axis of the projector needs to have a predetermined angle with respect to the surface of the door of the refrigerator. As a result, the degree of freedom of the projection display area is lowered.

Means for Solving the Problems

[0005] The refrigerator system according to this disclosure comprises a refrigerator body having a housing and a door that together with the housing forms a storage compartment; a camera unit that takes pictures with a display unit attached to the outer or inner surface of the refrigerator body, which is detachable from the outer or inner surface of the refrigerator body and displays predetermined settings related to the control of the refrigerator, including the refrigerator body, so that they can be seen by the user; and a control unit that, based on the image taken by the camera unit, detects an operation on the display unit by a user touching or bringing their fingers close to the display unit, and changes the settings to those specified by the user's fingers in that operation. [Brief explanation of the drawing]

[0006] [Figure 1] This is a front view of a refrigerator included in the refrigerator system according to the embodiment. [Figure 2] This is an explanatory diagram showing an example of a sticker for a refrigerator system according to an embodiment. [Figure 3] This is a side view of a refrigerator included in the refrigerator system according to the embodiment. [Figure 4] This is a front view of the refrigerator system according to the embodiment, with the left and right refrigerator compartment doors open. [Figure 5] This is a perspective view of the camera unit of the refrigerator system according to the embodiment, viewed from diagonally below. [Figure 6] This is a diagram illustrating the configuration of a refrigerator system according to the embodiment. [Figure 7] This is an example of the image capture result from the camera unit of the refrigerator system according to the embodiment, before any image processing has been performed. [Figure 8] This is a flowchart relating to the sticker presence / absence detection mode of the refrigerator system according to the embodiment. [Figure 9] This is a flowchart relating to the sticker touch detection mode of the refrigerator system according to the embodiment. [Figure 10] This is a front view of a refrigerator included in the refrigerator system according to the first modified example. [Figure 11A]This is an example of a front view of a refrigerator included in the refrigerator system according to the second modified example. [Figure 11B] This is another example of a front view of a refrigerator in the refrigerator system according to the second modified example. [Modes for carrying out the invention]

[0007] <<Embodiment>> Figure 1 is a front view of a refrigerator 100 included in the refrigerator system according to the embodiment. The refrigerator 100 (storage unit) shown in Figure 1 is a device for storing food and other items at low temperatures, and in addition to the housing 1, it comprises multiple doors such as refrigerator doors 211 and 212, and a camera unit 3. The housing 1 is constructed by filling the space between a steel plate outer box 11 and a resin inner box 12 (see Figure 4) with insulating material such as vacuum insulation material or foamed urethane. The housing 1 is provided with multiple storage compartments. In the example in Figure 1, the multiple storage compartments, from top to bottom, are a refrigerator compartment 21, ice-making compartments 22 and an upper freezer compartment 23 arranged on the left and right, a lower freezer compartment 24, and a vegetable compartment 25.

[0008] Furthermore, the refrigerator 100 is equipped with multiple doors that form a storage compartment together with the housing 1, including refrigerator compartment doors 211, 212, an ice-making compartment door 221, an upper freezer compartment door 231, a lower freezer compartment door 241, and a vegetable compartment door 251. The refrigerator compartment doors 211, 212 are described in this embodiment as a pair of left and right French-style doors that form the refrigerator compartment 21 by closing the opening H1 (see Figure 3) on the front side of the housing 1, but they are not particularly limited and may be single-leaf doors. In addition, the design surfaces of the multiple doors may be glass plates (colored, mirror, gradient, etc.) or painted steel plates.

[0009] The remaining doors—the ice-making compartment door 221, the upper freezer compartment door 231, the lower freezer compartment door 241, and the vegetable compartment door 251—are all pull-out doors. For example, a vegetable compartment container (not shown) is installed behind the vegetable compartment door 251. The vegetable compartment door 251 and the vegetable compartment container are designed to be pulled out together (the same applies to the other pull-out doors). The refrigerator body 10 (storage compartment body) of the refrigerator 100 (storage compartment) consists of a casing 1 and a number of doors that, together with the casing 1, form a storage compartment.

[0010] Refrigerator 100, although not shown in the diagram, is equipped with a compressor, a heat sink (condenser), a capillary tube (throttling mechanism), and a cooler (evaporator). The refrigerant circulates sequentially through the compressor, heat sink, capillary tube, and cooler, and the air in each storage compartment is cooled by heat exchange with the refrigerant flowing through the cooler.

[0011] The sticker 4 shown in Figure 1 is a sheet-like "display unit" that shows predetermined settings related to the control of the refrigerator 100 (storage compartment) so that the user can see them, and is detachable from the outer surface (design surface) or inner surface of the refrigerator body 10 (storage compartment body). The inner surface of the refrigerator body 10 includes the inner side walls, bottom surface, and front surface of the refrigerator compartment 21 (chiller compartment lid D1: see Figure 4), multiple shelves 213 (see Figure 4), inner panels (side walls) 211b, 212b of the refrigerator compartment doors 211, 212 (see Figure 4), multiple door pockets (bottom surface, side walls) 211c, 212c (see Figure 4), as well as the inner side walls of the ice maker door 221, the upper freezer compartment door 231, the lower freezer compartment door 241, and the vegetable compartment door 251, and the side walls and bottom surfaces of each storage container (not shown). Such stickers 4 may be provided by the manufacturer of the refrigerator 100 (as an accessory or separately sold item for the refrigerator 100), or they may be provided by the user. In addition to printed displays, there are various other methods of display using stickers 4, such as stamping, engraving, and electronic displays.

[0012] Furthermore, the material of the sticker 4 is not limited to any particular material. For example, as the sticker 4 for the "display area," in addition to a magnetic sheet, resin sheets, metal sheets, or paper may be used as appropriate. When a magnetic sheet is used as the sticker 4, steel plates are used for each door of the refrigerator 100 so that magnetic attraction is generated. On the other hand, when glass plates are used for each door, a thin magnetic sheet (not shown) may be attached to a part of the surface of each door with a sticker or the like, and the sticker 4 may be placed on that surface. As a means of attaching the sticker 4 to the refrigerator body 10, in addition to the magnetic attraction force of the magnetic sheet mentioned above, stickers, Velcro, adhesive tape, suction cups, etc. may be used as appropriate.

[0013] In this embodiment, the user can attach the sticker 4 to a location of their choice within the imaging range of the camera unit 3 installed on the top surface of the refrigerator body 10. In the example shown in Figure 1, the sticker 4 is attached to the outer surface of the left refrigerator door 211 (i.e., the outer surface of the refrigerator body 10). It is also possible for the user to remove the sticker 4 from the refrigerator door 211 and reattach it to, for example, the upper freezer door 231.

[0014] Sticker 4 displays (printed, etc.) predetermined settings for the refrigerator 100, including the operating mode, refrigeration / freezing adjustment (strong, standard, weak), ice making start / stop, and power saving mode, in a way that is easily visible to the user (see Figure 2). Examples of "strong, standard, weak" displays may include "↑·→·↓", "△·□·▽", "◎·〇·△", and "+·N·-". The user touches or brings their fingers close to the area of ​​Sticker 4 corresponding to their desired setting. "Close to" Sticker 4 means that the user's fingers are slightly away from Sticker 4. When the camera unit 3 detects contact or proximity of the user's fingers to Sticker 4 based on the captured image, the setting corresponding to that operation is changed (e.g., set / deactivate).

[0015] By using the sticker 4 in this way, it becomes unnecessary to install an operation panel (not shown) on the refrigerator main body 10. Therefore, it becomes possible to provide a heat insulating material (to improve the cooling performance) in the areas where the operation panel and wiring were installed in conventional refrigerators (inside the refrigerating compartment 21 or on the outer surface of the refrigerator main body 10). In addition, since it becomes possible to reduce the thickness of the wall of the refrigerator main body 10 by the thickness of the operation panel (including the storage part), a part of the internal volume of the refrigerator main body 10 also becomes larger. Further, the user can attach the sticker 4 at a position of their preference.

[0016] The camera unit 3 installed on the top surface of the refrigerator main body 10 shown in FIG. 1 is a device that photographs an area including the sticker 4 attached to the outer surface or the inner surface of the refrigerator main body 10, the foodstuffs in a plurality of storage compartments, and the human body around the refrigerator. Note that the photographing result of the foodstuffs in the storage compartment is appropriately used for foodstuff management. Also, the photographing result of the human body around the refrigerator is appropriately used for human body detection. Details of the camera unit 3 will be described later.

[0017] FIG. 2 is an explanatory diagram showing an example of the sticker 4. In the example of FIG. 2, the setting contents related to "refrigeration", the setting contents related to "freezing", "ice making", and "power saving" are displayed (printed, etc.) side by side on the sticker 4. Also, as the setting contents related to refrigeration, the characters "Refrigeration: Strong", "Refrigeration: Standard", and "Refrigeration: Weak" are displayed (printed, etc.) vertically on the sticker 4. The same applies to the setting contents related to freezing. Also, regarding the display mode when displaying predetermined setting contents on the sticker 4, instead of displaying with characters such as Chinese characters or alphabet letters (or together with characters), it may be displayed with something like emoji or illustrations.

[0018] In sticker 4, a single area that indicates a predetermined setting, such as "Refrigeration: Strong," is called a small display section 4a. The text in each small display section 4a is surrounded by a dotted-dotted rectangular frame. Each small display section 4a surrounded by a dotted-dotted rectangular frame may be configured to be detachably positioned on the magnetic sheet surface of sticker 4. Furthermore, the placement of each small display section 4a is not particularly limited, and the user may place them in a position of their choice. In the example in Figure 2, the user's fingers are in contact with (or close to) the small display section 4a that displays "Refrigeration: Weak."

[0019] Figure 3 is a side view of refrigerator 100. As shown in Figure 3, the camera unit 3 comprises a main body 31 and a support part 32. The main body 31 has the function of acquiring captured images of the area within the field of view of the lens 31a. The support part 32 supports the main body 31 and is installed on the top surface of the housing 1. As an example, the camera unit 3 may also be configured to be detachable.

[0020] A lens 31a is provided near the front end of the main body 31. The lens 31a is an optical element that refracts light and focuses it onto an image sensor (not shown). For example, a fisheye lens can be used as such a lens 31a.

[0021] As shown in Figure 3, the lens 31a is positioned in front of the front of the closed refrigerator doors 211 and 212 and faces downwards. This makes it easier for the camera unit 3 to capture, for example, a sticker 4 (see Figure 1) attached to the refrigerator door 211 (see Figure 1). In addition to the other refrigerator door 212, stickers 4 may also be attached to the ice maker door 221, the upper freezer door 231, the lower freezer door 241, and the vegetable compartment door 251 (see Figure 1). As a result, the camera unit 3 performs automatic imaging (image recognition) by photographing the refrigerator 21 when the refrigerator doors 211 and 212 are opened to a predetermined opening angle, and by detecting the open state of the ice maker door 221, the upper freezer door 231, the lower freezer door 241, and the vegetable compartment door 251 with the door sensor 6 (see Figure 6) and performing image recognition with the camera unit 3.

[0022] Figure 4 is a front view of the refrigerator 100 with the left and right refrigerator doors 211 and 212 open (at a predetermined opening angle). As shown in Figure 4, the refrigerator compartment 21 is provided with multiple shelves 213 that divide the compartment into predetermined sections. The inner panel 211b of the left refrigerator compartment door 211 is provided with multiple door pockets 211c for storing food and other items (the same applies to the right refrigerator compartment door 212). When the left and right refrigerator compartment doors 211 and 212 are opened, the food and other items in the refrigerator compartment 21 and the door pockets 211c and 212c are brought into the field of view of the lens 31a of the camera unit 3 from an overhead perspective.

[0023] Furthermore, as an example of this embodiment, one camera button 7 may be provided on each of the left and right refrigerator doors 211 and 212. These camera buttons 7 are buttons that the user presses when manually taking pictures of the storage compartment with the camera unit 3. In the example shown in Figure 4, on the left refrigerator door 211, the camera button 7 is provided on the lower part of the surface opposite to the axis of the hinge (not shown) of the refrigerator door 211 (the same applies to the right camera button 7).

[0024] Furthermore, users can attach stickers 4 (see Figure 1) to the inside of the refrigerator body 10 according to their preferences. For example, stickers 4 may be attached to the inside side of the refrigerator compartment 21 (especially near the edge of the opening of the refrigerator compartment 21) or to the lid D1 of the chiller compartment. In these locations, the stickers 4 are not particularly obscured by food or other items from the perspective of the camera unit 3, so the user can photograph the stickers 4 with the refrigerator doors 211 and 212 open. The location of the stickers 4 is not particularly limited as long as they are not obscured by food or other items.

[0025] Figure 5 is a perspective view of the camera unit 3 when viewed from diagonally below. The main body 31 of the camera unit 3 includes, in addition to the lens 31a described above, a case 31b, an illumination cover 31c, and a human presence sensor 31d. The case 31b is elongated in the front-to-back direction and has a rectangular parallelepiped shape. A circular hole (not shown in the diagram) is provided on the lower surface near the front end of the case 31b, and the lens 31a is exposed through this hole.

[0026] In case 31b, an elongated hole (not shown in the diagram) is provided on the rear side of the lens 31a in the left-right direction, and the illumination cover 31c is fitted into this hole. The illumination cover 31c is a translucent resin component that protects the light-emitting part 31e (see Figure 6) and diffuses the light emitted from the light-emitting part 31e.

[0027] In case 31b, a circular hole (not shown in the diagram) is provided on the rear side of the lighting cover 31c, and a motion sensor 31d is fitted into this hole. The motion sensor 31d detects people approaching the refrigerator body 10 (see Figure 1).

[0028] The arrangement of the lens 31a, the lighting cover 31c, and the motion sensor 31d can be changed as appropriate. For example, the motion sensor 31d may be installed in a predetermined location on the outside of the camera unit 3 on the refrigerator body 10 (see Figure 1) (for example, around the front end in front of the lens 31a). In addition, the motion sensor 31d may be installed in a predetermined location on the outside of the refrigerator 100 (see Figure 1), as well as in the lateral partition between each door of the refrigerator 100 (see Figure 1) or around the hinge cover on the ceiling.

[0029] Figure 6 is a diagram showing the configuration of the refrigerator system W1. As shown in Figure 6, the refrigerator system W1 consists of a refrigerator 100, a router 51, a network 52, a server 53, and a mobile terminal 54. The refrigerator 100 also includes a camera unit 3, a door sensor 6, and a control unit 8 (refrigerator control). The door sensor 6 is a sensor for detecting the open / closed state of each door of the refrigerator 100. When the open / closed state of each door of the refrigerator 100 is detected by the door sensor 6, and door open information is transmitted to the camera / wireless communication control unit 31g via a signal line, the camera / wireless communication control unit 31g acquires an image via the image sensor of the shooting unit M1. Here, automatic shooting may be repeated when a predetermined open (angle) state is reached. The image information recognized by the internal processing of the camera / wireless communication control unit 31b is transmitted wirelessly from the antenna 31h and sent to the mobile terminal 54 via the server 53. This notifies the user of the setting information of the sticker 4 (see Figure 2). Meanwhile, the camera / wireless communication control unit 31g detects the presence or absence of the sticker 4 and the touch detection information of the sticker 4, and transmits this information to the refrigerator's control unit 8 via signal lines. Furthermore, the refrigerator is controlled appropriately based on the setting information. For example, the method of photographing sticker 4 is not limited to automatic shooting; it may also be done by pressing the shooting button 7, which is operated when manual shooting is performed by the camera unit 3.

[0030] The control unit 8 (refrigerator control) is, for example, a microcontroller and, although not shown in the diagram, is composed of electronic circuits including a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and various interfaces. It reads the program stored in the ROM, loads it into the RAM, and the CPU executes various processes. The "storage control device" attached to the refrigerator 100 (storage compartment) that stores items in a predetermined internal environment is composed of a camera unit 3 and the control unit 8.

[0031] As shown in Figure 6, the camera unit 3 comprises an imaging unit M1, a human presence sensor 31d, a light-emitting unit 31e, a sound-emitting unit 3f, a camera / wireless communication control unit 31g, and an antenna 31h. The imaging unit M1 includes a lens 31a (see Figure 5) and an image sensor (not shown). The image sensor is an element that converts light incident through the lens 31a into photoelectric data to generate captured image data.

[0032] The motion sensor 31d is a sensor that detects when a user approaches the refrigerator body 10 (see Figure 1). For example, an infrared sensor (pyroelectric sensor, etc.) can be used as such a motion sensor 31d. The motion sensor 31d will continue to operate as long as power is supplied to the refrigerator 100. In addition, the motion sensor 31d may be provided with a cover or other means to give directionality to its detection range, so as to detect users who are likely to bring their fingers close to the sticker 4, that is, so as not to detect people who are just passing in front of the refrigerator 100. The location of the motion sensor 31d is not limited to the camera unit 3 side, but may also be on the refrigerator body 10 side.

[0033] The light-emitting unit 31e is a light source that illuminates the sticker 4 (display unit: see Figure 1). The light-emitting unit 31e is turned on when the motion sensor 31d detects a user approaching the refrigerator body 10 (see Figure 1). For example, an LED (Light Emitting Diode) is used as such a light-emitting unit 31e. The light-emitting unit 31e is located inside the case 31b (see Figure 5) and is positioned above the lighting cover 31c (see Figure 5). When the light-emitting unit 31e is turned on, the sticker 4 (see Figure 1) can be photographed with adequate brightness even when the area around the refrigerator 100 is dark.

[0034] The sound-producing unit 31f is a functional unit that emits a predetermined sound when the camera unit 3 takes a picture. Furthermore, the sound-producing unit 31f may be configured to output a predetermined sound when information regarding the sticker 4 (see Figure 1) is registered in the control unit 8 (or server 53), or when the image of the sticker 4 is poor.

[0035] The camera / wireless communication control unit 31g communicates with the control unit 8 at predetermined intervals and outputs a shooting command to the image sensor (not shown) of the shooting unit M1. As a result, the camera / wireless communication control unit 31g receives the captured image data from the image sensor. The antenna 31h has the function of transmitting the captured image data as radio waves and receiving data transmitted from the server 53 via the router 51. In this embodiment, the camera / wireless communication control unit 31g and the antenna 31h, which are provided in the camera unit 3, are shown as independent configurations, but this is not the only configuration. For example, the camera control unit and the wireless communication unit (including the antenna) may be in an independent configuration, or the camera unit 3 (camera control unit) and the wireless communication unit (including the antenna) may be provided in an independent configuration.

[0036] Router 51 is a communication relay device that transmits the captured image data received via antenna 31h to server 53 via network 52. Server 53 performs predetermined image processing on the captured image data and stores it in association with the refrigerator 100's identification information. Furthermore, when server 53 receives a request signal for an in-fridge image from a mobile terminal 54 (terminal), it transmits the captured image data to the mobile terminal 54. Such a mobile terminal 54 could be, for example, a smartphone or a tablet. A predetermined pairing setting is assumed to be performed between the mobile terminal 54 and the refrigerator 100. The pairing setting is not particularly limited.

[0037] Figure 7 shows an example of the results captured by the camera unit before any image processing has been performed. Note that in Figure 7, the top of the page is considered the front and the bottom of the page is considered the rear, so the left and right are reversed compared to Figure 1. In the example in Figure 7, the image is taken with each door closed. As mentioned above, a fisheye lens is used as the lens 31a (see Figure 5) of the camera unit 3 (see Figure 5), so it is possible to capture images with a wide field of view. Alternatively, the captured image shown in Figure 7 may be converted into a predetermined unfolded image (an image of the refrigerator 100 viewed from the front) by the server 53 (see Figure 6).

[0038] In this embodiment, when the result of the internal processing (image recognition) of the camera / wireless communication control unit 31g (sticker information if sticker 4 is attached) is transmitted as a signal to the control unit 8 (refrigerator control) (see Figure 6), the control unit 8 (refrigerator control) performs a "sticker presence / absence detection mode" (see Figure 8) and then a "sticker touch detection mode" (see Figure 9). Here, the "sticker presence / absence detection mode" is a mode that detects whether or not sticker 4 (see Figure 1) is attached to the refrigerator body 10 (see Figure 1). The "sticker touch detection mode" is a mode that identifies the area on sticker 4 (see Figure 1) that is in contact with or close to the user's fingers.

[0039] Figure 8 is a flowchart related to the sticker presence / absence detection mode (see also Figure 6 as appropriate). Note that at the "START" stage in Figure 8, the doors of the refrigerator 100 may be closed, or a designated door may be open. The series of processes shown in Figure 8 begins, for example, when the power to the refrigerator 100 is turned on. The instruction manual for the refrigerator 100 (not shown) states that after the power to the refrigerator 100 is turned on, the user should attach the sticker 4 to a location of their choice.

[0040] In step S101, the control unit 8 (refrigerator control) acquires a captured image (or sticker information based on internal processing (image recognition) if a sticker 4 is attached) from the camera unit 3. That is, the control unit 8 (refrigerator control) acquires a captured image (or sticker information based on internal processing (image recognition)) by outputting a predetermined shooting command after adjusting the exposure of the camera unit 3.

[0041] In step 102, the control unit 8 (refrigerator control) determines whether or not a sticker 4 (see Figure 1) is attached to the refrigerator body 10 (see Figure 1). That is, the control unit 8 (refrigerator control) determines whether or not a sticker 4 is visible in the image captured in step S101 based on sticker information obtained from the internal processing (image recognition) of the camera / wireless communication control unit 31g. A predetermined marker (not shown) may be displayed on the sticker 4. In this case, the presence or absence of the sticker 4 is determined using the predetermined marker as a guide (S102).

[0042] If, in step S102, the sticker 4 (see Figure 1) is not attached to the refrigerator body 10 (see Figure 1) (S102: No), the control unit 8 (refrigerator control) repeats the process of step S101. If, in step S102, the sticker 4 is attached to the refrigerator body 10 (S102: Yes), the control unit 8 (refrigerator control) proceeds to step S103. For example, if the sticker 4 is attached to the refrigerator door 211 as shown in Figure 1, the control unit 8 (refrigerator control) determines that the sticker is present (S102: Yes) and proceeds to the process of step S103.

[0043] In step S103, the control unit 8 (refrigerator control) notifies the user (mobile terminal 54) of the determination result in step S102 via the wireless communication unit (camera / wireless communication control unit 31g and antenna 31h) and the server 53. For example, a message such as "Sticker recognized" may be displayed as a pop-up on the user's mobile terminal 54. This allows the user to confirm that the sticker 4 has been recognized by the control unit 8 (refrigerator control). Alternatively, the control unit 8 (refrigerator control) may notify the user that the sticker 4 has been recognized by, for example, flashing the light-emitting unit 31e in a predetermined light-emitting pattern or outputting a predetermined sound from the sound-producing unit 31f.

[0044] Next, in step S104, the control unit 8 (refrigerator control) transitions to the sticker touch detection mode (see Figure 9). As described above, the "sticker touch detection mode" is a mode that identifies the area on the sticker 4 (see Figure 2) that is in contact with or near the user's fingers.

[0045] Note that the series of processes related to the sticker presence / absence detection mode are not limited to the example in Figure 8. For example, when the motion sensor 31d detects a user approaching the refrigerator body 10, the control unit 8 (refrigerator control) may acquire the captured image (sticker information and sticker touch information) that has been internally processed (image recognition) by the camera / wireless communication control unit 31g (S101). This is because a user usually approaches the refrigerator body 10 when a sticker 4 (see Figure 1) is attached to it. This prevents the process in step S101 from being unnecessarily repeated when the sticker 4 is not attached, and consequently reduces the power consumption of the refrigerator 100.

[0046] Furthermore, if a user is detected by the motion sensor 31d, the control unit 8 (refrigerator control) may be configured to illuminate the light-emitting unit 31e of the camera unit 3 and acquire the captured image (sticker information and sticker touch information) (S101). By illuminating the light-emitting unit 31e when a user is detected, the sticker 4 (see Figure 1) can be photographed under appropriate brightness.

[0047] Furthermore, the vertical and horizontal dimensions of the sticker 4 (see Figure 2), the vertical and horizontal dimensions of each small display unit 4a (see Figure 2), the vertical dimension from the top edge of the sticker 4 to each small display unit 4a, the horizontal dimension from the left edge of the sticker 4 to each small display unit 4a, and the arrangement pattern of the small display units 4a may be pre-registered in the control unit 8 (refrigerator control) and server 53. In this case, the settings displayed on each small display unit 4a and the aforementioned "characteristics" will be linked as registered information. Such registration processing is performed, for example, on the user's mobile terminal 54 prior to the series of processes shown in Figure 8.

[0048] Specifically, the user may take a picture of the sticker 4 (see Figure 2) with a mobile terminal 54 and send the picture to the server 53. Alternatively, for example, a predetermined one-dimensional code (not shown) or two-dimensional code (not shown) may be displayed on the sticker 4 (display section). The aforementioned one-dimensional code or two-dimensional code is associated with features including the arrangement pattern of the settings on the sticker 4 (i.e., the arrangement pattern of the small display section 4a). For example, a barcode may be used as the one-dimensional code. For example, a QR code (registered trademark) may be used as the two-dimensional code.

[0049] The user reads the one-dimensional or two-dimensional code displayed on the sticker 4 with their mobile terminal 54 and sends the reading result to the server 53. The server 53 (or control unit 8) registers features, including the arrangement pattern of the settings on the sticker 4 (see Figure 2), based on the reading result of the one-dimensional or two-dimensional code by the user's mobile terminal 54 (terminal). By pre-registering the features of the sticker 4 in this way, the small display unit 4a (see Figure 2) specified by the user with their finger can be identified with high accuracy based on a comparison of these features with the captured image.

[0050] Figure 9 is a flowchart related to the sticker touch detection mode (see also Figure 6 as appropriate). In addition, when "START" is displayed in Figure 9, it is assumed that the sticker 4 (see Figure 1) is attached to a designated location on the refrigerator body 10 (see Figure 1). Furthermore, when "START" is displayed in Figure 9, the doors of the refrigerator 100 may be closed, or a designated door may be open.

[0051] In step S201, the control unit 8 (refrigerator control) determines whether a user has been detected based on the captured image (sticker information and sticker touch information) processed internally (image recognition) by the human presence sensor 31d and the camera / wireless communication control unit 31g. If no user is detected by the human presence sensor 31d in step S201 (S201: No), the control unit 8 (refrigerator control) repeats the process in step S201. If a user is detected by the human presence sensor 31d in step S201 (S201: Yes), the control unit 8 (refrigerator control) proceeds to step S202.

[0052] In step S202, the control unit 8 (refrigerator control) acquires the captured image (sticker information and sticker touch information) that has been internally processed (image recognition) by the camera / wireless communication control unit 31g. That is, the control unit 8 (refrigerator control) acquires the captured image (sticker information and sticker touch information) by outputting a predetermined shooting command after exposure adjustment in the camera unit 3 (camera / wireless communication control unit 31g). Note that the shooting by the camera unit 3 may be repeated at a predetermined cycle (automatic shooting). This makes it easier to acquire a captured image (sticker information and sticker touch information) at the moment when the user's fingers touch or come close to the sticker 4.

[0053] Although not shown in Figure 9, when the motion sensor 31d detects a user approaching the refrigerator body 10 (S201:), the control unit 8 (refrigerator control) should turn on the light-emitting part 31e of the camera unit 3. In this case, the control unit 8 (refrigerator control) takes a picture with the camera unit 3 while the light-emitting part 31e is lit. This allows the sticker 4 and the user's fingers to be photographed in adequate brightness, even when the room (the room where the refrigerator 100 is located) is dark at night and the area around the refrigerator 100 is dark.

[0054] In step S203, the control unit 8 (refrigerator control) determines whether or not there has been an operation (sticker information) on the small display unit 4a (see Figure 2) of the sticker 4 (see Figure 2). In other words, the control unit 8 determines whether or not there has been an operation (sticker touch information) in which the user's fingers have come into contact with or come close to the small display unit 4a of the sticker 4, based on the captured image processed internally (image recognition) by the camera / wireless communication control unit 31g. If there is no operation on the small display unit 4a in step S203 (S203: No), the control unit 8 terminates the series of processes (END). If there is an operation on the small display unit 4a in step S203 (S203: Yes), the control unit 8 proceeds to step S204.

[0055] Furthermore, if a feature including the arrangement pattern of the settings on sticker 4 (display unit) (i.e., the arrangement pattern of the small display unit 4a) is registered, the control unit 8 (refrigerator control) performs the following processing. That is, based on the feature including the arrangement pattern of the settings on sticker 4 and the image captured by the camera unit 3 (sticker information and sticker touch information), the control unit 8 (refrigerator control) identifies the settings at the location on sticker 4 that the user's fingers are touching or close to.

[0056] To give a specific example, the control unit 8 (refrigerator control) calculates the ratio of the horizontal pixel count of sticker 4 in the captured image (sticker information and sticker touch information) to the horizontal pixel count from the left edge of sticker 4 to a predetermined small display unit 4a (a small display unit 4a specified by the user). Then, the control unit 8 identifies the one among the multiple pre-registered small display units 4a whose ratio of the actual horizontal dimension of sticker 4 to the actual horizontal dimension from the left edge of sticker 4 to the small display unit 4a is closest to the ratio on the captured image. The control unit 8 also performs similar processing for the vertical pixel count and dimensions of sticker 4. In this way, the control unit 8 identifies the one among the multiple small display units 4a that the user's fingers are touching or are close to. Note that the above method is just one example and is not limited to this.

[0057] Next, in step S204, the control unit 8 (refrigerator control) changes the settings. Specifically, based on the image captured by the camera unit 3 (sticker information and sticker touch information), if the control unit 8 (refrigerator control) detects that a user has touched or brought close to the sticker 4 (display unit) with their fingers (S203: Yes), it changes the settings to those specified by the user with their fingers during that operation (S204). In the example in Figure 2, the user's fingers are in contact with (or close to) the small display unit 4a that says "Refrigerate: Weak". When such an image is captured, the control unit 8 reduces the degree to which the refrigerator compartment 21 (see Figure 1) is cooled. Also, for example, if the user's fingers are in contact with (or close to) the small display unit 4a that says "Energy Saving", the control unit 8 will perform energy saving when cooling each storage compartment.

[0058] In step S205, the control unit 8 (refrigerator control) notifies the user of the change in settings. For example, the control unit 8 (refrigerator control) displays a message such as "The level of refrigeration has been changed to a weaker setting" as a pop-up on the user's mobile terminal 54 via the server 53 through the wireless communication unit (camera / wireless communication control unit 31g and antenna 31h). This allows the user to confirm that the settings of the refrigerator 100 have been changed by operating on the sticker 4. In addition, the user may also notify the user of the change in settings by, for example, flashing the light-emitting unit 31e in a predetermined light-emitting pattern or outputting a predetermined sound from the sound-producing unit 31f. After performing the process in step S205, the control unit 8 (refrigerator control) terminates the series of processes (END).

[0059] Although not shown in Figure 9, when the door sensor 5 detects that a storage room door (for example, refrigerator doors 211, 212) has been opened, the control unit 8 (refrigerator control) acquires a captured image (sticker information and sticker touch information) via the camera unit 3 (automatic shooting). Also, as an example, when the user presses the shooting button 7 (see Figure 4), the control unit 8 acquires a captured image (sticker information and sticker touch information) via the camera unit 3 (manual shooting). These captured images are subjected to predetermined image processing and then displayed on the user's mobile terminal 54 as images of food items in the storage room.

[0060] Furthermore, the control unit 8 (refrigerator control) may include a condition in which, when reflecting a user's operation on the sticker 4 (see Figure 2) in a change of settings (S204), a predetermined trigger operation by the user immediately before or after the operation is detected based on the captured image (sticker information and sticker touch information). The aforementioned trigger operation may be the user's finger touching or approaching a predetermined small display unit 4a or marker (not shown) on the sticker 4, or it may be another predetermined action (for example, a gesture). This prevents the settings from being changed against the user's intention even if the user accidentally touches or brings their finger close to the small display unit 4a of the sticker 4.

[0061] According to this embodiment, the control unit 8 (refrigerator control) identifies user operations based on images of stickers 4 attached to the refrigerator body 10. By using stickers 4 in this way, it becomes unnecessary to install an operation panel on the refrigerator body 10, allowing for a thicker insulation material. Therefore, it is possible to improve cooling performance without increasing the external dimensions of the refrigerator body 10. In addition, since the stickers 4 can be attached to the refrigerator body 10 at the user's preferred location, convenience can be enhanced.

[0062] ≪Variations≫ The refrigerator system W1 and refrigerator 100 described above have been illustrated with embodiments, but the invention is not limited to these descriptions, and various modifications can be made. For example, the embodiments described a case where there is one sticker 4 (see Figure 2), but as explained in Figure 10, it is also possible to use multiple stickers.

[0063] Figure 10 is a front view of the refrigerator 100 included in the refrigerator system according to the first modified example. In the example shown in Figure 10, a sticker 41 (display) indicating the setting "Refrigeration: Strong" is attached to the outside of the refrigerator door 211. Another sticker 42 indicating the setting "Freezing: Strong" is attached to the outside of the lower freezer door 241. In addition to these stickers 41 and 42, it is assumed that other stickers such as "Refrigeration: Standard," "Refrigeration: Weak," "Freezing: Standard," "Freezing: Weak," and "Ice Making" are also individually provided.

[0064] In this case, the control unit 8 (see Figure 6) changes the settings of the refrigerator compartment 21 (storage compartment) inside the refrigerator door 211 (a designated door) to which the sticker 41 (display unit) is attached, to the settings corresponding to the sticker 41. Specifically, the control unit 8 increases the degree to which the refrigerator compartment 21 is cooled based on the sticker 41 with the setting "Refrigeration: Stronger". Similarly, the control unit 8 increases the degree to which the lower freezer compartment 24 is cooled based on the sticker 42 with the setting "Freezing: Stronger". Incidentally, the settings of each storage compartment other than the refrigerator compartment 21 and the lower freezer compartment 24 are maintained without any particular change. With this configuration, the user can individually change the settings of each storage compartment using multiple stickers. In addition, since the settings of the refrigerator compartment 21 are changed simply by the user attaching the sticker 41 to the refrigerator door 211, convenience for the user is enhanced. Furthermore, a process to detect contact or proximity of the user's fingers to the sticker 41 based on the captured image may be added as a condition when changing the settings.

[0065] Furthermore, although the embodiment described a case where the positions of the refrigerator and freezer compartments are fixed, it is not limited to this, and predetermined switching compartments 26 and 27 may be provided as shown in Figures 11A and 11B.

[0066] Figure 11A is an example of a front view of a refrigerator 100A included in the refrigerator system according to the second modified example. In the example shown in Figure 11A, the refrigerator 100A has multiple storage compartments, from top to bottom: a refrigerator compartment 21, ice-making compartments 22 and an upper freezer compartment 23 arranged on the left and right, a switching compartment 26, and another switching compartment 27. The switching compartment 26 is a storage compartment that can be switched from one of the refrigerator compartments or the freezer compartment to the other (the other switching compartment 27 is similar). Also, a sticker 43 with the word "refrigerated" is attached to the door 261 of the switching compartment 26. Similarly, another sticker 44 with the word "refrigerated" is attached to the door 271 of the other switching compartment 27.

[0067] These stickers 43 and 44 are "first indicators" that specify the control corresponding to the refrigerator compartment. In addition, although not specifically shown in Figure 11A, another sticker 45 and 46 (see Figure 11B) displaying the word "freeze" is also provided. These stickers 45 and 46 (see Figure 11B) are "second indicators" that specify the control corresponding to the freezer compartment. The control unit 8 (see Figure 6) will, for example, make the switching compartment 26 function as a refrigerator compartment if the refrigeration sticker 43 (first indicator) is attached to the door 261 of the switching compartment 26 (the same applies to the other switching compartment 27).

[0068] Figure 11B is another example of a front view of the refrigerator 100A included in the refrigerator system according to the second modified example. In the example shown in Figure 11B, a sticker 45 (second display unit) bearing the word "Freezing" is attached to the door 261 of the switching compartment 26. Similarly, another sticker 46 (second display unit) bearing the word "Freezing" is attached to the door 271 of another switching compartment 27. The control unit 8 (see Figure 6) will, for example, cause the switching compartment 26 to function as a freezer if a freezing sticker 45 (second display unit) is attached to the door 261 of the switching compartment 26 (the same applies to the other switching compartment 27). With this configuration, the user only needs to attach the sticker for their desired operating mode (refrigeration or freezing) to the switching compartments 26 and 27, thus increasing the user's freedom in settings. Furthermore, for example, the user can make the switching compartment 26 function as a freezer simply by attaching a sticker 45 to the door 261 of the switching compartment 26, thus increasing convenience for the user. Furthermore, a process to detect contact or proximity of the user's fingers to the sticker 45 based on the captured image may be added as a condition for enabling the switching chamber 26 to function as a freezer. In addition, a separate sticker (not shown) for the vegetable compartment may be provided.

[0069] Furthermore, the control unit 8 (refrigerator control) (see Figure 6) may also determine the quality of the image of the sticker 4 (display unit: see Figure 1) in the captured image (image recognition information) from the camera unit 3 (see Figure 6). For example, the control unit 8 (refrigerator control) performs edge extraction processing on the captured image processed internally (image recognition) by the camera / wireless communication control unit 31g and determines whether or not the rectangular frame-shaped edge of the sticker 4 has been extracted as an edge. If the rectangular frame-shaped edge of the sticker 4 has been extracted as an edge, the control unit 8 (refrigerator control) determines that the image quality of the captured image processed internally (image recognition) by the camera / wireless communication control unit 31g is good. Conversely, if the rectangular frame-shaped edge of the sticker 4 has not been extracted as an edge (for example, part of the edge is missing in the captured image), the control unit 8 (refrigerator control) determines that the image quality of the captured image processed internally (image recognition) by the camera / wireless communication control unit 31g is poor. After making such a determination, the control unit 8 (refrigerator control) notifies the user of the result regarding the quality of the sticker 4's image. For example, the control unit 8 (refrigerator control) notifies the user of the result via a pop-up display on the user's mobile terminal 54 (see Figure 6) via the server 53 through the wireless communication unit (camera / wireless communication control unit 31g and antenna 31h). Alternatively, the result may be notified by the light-emitting unit 31e (see Figure 6) or the sound-emitting unit 31f (see Figure 6). If the image quality of the sticker 4 (display unit) is poor, the control unit 8 (refrigerator control) prompts the user to reattach the sticker 4. This allows the user to be prompted to reattach the sticker 4, for example, if part of the sticker 4 is hidden by a calendar or memo that the user has attached.

[0070] Furthermore, the control unit 8 (refrigerator control) may retain the registration of features, including the arrangement pattern of the settings on the sticker 4 (display unit: see Figure 1), even if the sticker 4 is removed from the refrigerator body 10. Even when the sticker 4 is not attached to the refrigerator body 10, users often remember the arrangement of the sticker 4 when it was attached, so they can operate the refrigerator based on that arrangement. In this way, the aesthetic appeal of the refrigerator 100 can be enhanced by not attaching the sticker 4 to the refrigerator body 10. Then, when the control unit 8 (refrigerator control) detects, based on the captured image (sticker information and sticker touch information), that the user's fingers are touching or approaching the area on the refrigerator body 10 where the sticker 4 was attached, with the sticker 4 (display unit) removed from the refrigerator body 10, it changes the settings to predetermined values ​​based on the sticker 4. In addition, when the sticker 4 is removed, the most recent installation location of the sticker 4 may be displayed on the user's mobile terminal 54. This allows the user to check the most recent location of the sticker 4 on their mobile terminal 54, even if they forget the most recent location where the sticker 4 was attached.

[0071] Furthermore, although the embodiment describes a case where the sticker 4 is provided by the manufacturer of the refrigerator 100, it is not limited to this. For example, the sticker may be one made by the user, or a sticker purchased separately from the refrigerator 100 may be used. In such cases, the control unit 8 (refrigerator control) registers features including the arrangement pattern of the settings on the sticker. For example, if the user takes a picture of the sticker with their mobile terminal 54 (see Figure 6) and sends the captured image to the server 53 (see Figure 6), the server 53 (or control unit 8) extracts the features of the sticker and registers these features.

[0072] Furthermore, if the position of the sticker shifts after the control unit 8 (refrigerator control) has registered features including the arrangement pattern of the sticker (display unit), it may be configured to send a notification prompting the user to re-register the features including the sticker arrangement pattern. This notification may be sent by the user's mobile terminal 54 (see Figure 6), or by the light-emitting unit 31e (see Figure 6) or the sound-producing unit 31f (see Figure 6). Re-registration of the sticker's position is performed, for example, when the control unit 8 (refrigerator control) receives a notification of permission to re-register from the user's mobile terminal 54, by taking a picture of the sticker 4 with the camera unit 3 and re-registering the features of the sticker 4 based on the captured image (sticker information and sticker touch information). This ensures that even if the position of the sticker 4 prepared by the user shifts from the previous registration, the image recognition of the sticker 4 can be performed appropriately by re-registering it.

[0073] Furthermore, when the control unit 8 (refrigerator control) determines whether the position of sticker 4 has shifted, an EVS (Event-based Vision Sensor) may be used as appropriate. The EVS has the function of detecting changes in brightness within the field of view of the camera unit 3. By using the EVS in this way, the processing for detecting the shift in the position of sticker 4 can be simplified.

[0074] Furthermore, although the embodiment described a case in which the camera unit 3 includes a control unit 8 (refrigerator control) (see Figure 6), it is not limited to this. For example, at least part of the functions of the control unit 8 (refrigerator control) may be handled by a microcontroller (not shown) or a server 53 (see Figure 6) located outside the camera unit 3. Furthermore, although the embodiment described a case in which the camera unit 3 is included in the refrigerator 100, it is not limited to this case. For example, the embodiment can also be applied when the camera unit 3 is separate from the refrigerator 100 (sold separately).

[0075] Furthermore, although the embodiment described a case where the sticker 4 is attached to the door of the refrigerator 100 (for example, the refrigerator compartment door 211), it is not limited to this. For example, the sticker 4 can also be attached to the side of the housing 1. In this case, the camera unit 3 should be appropriately positioned so that the side of the refrigerator body 10 can also be photographed.

[0076] Furthermore, although the embodiment describes a refrigerator 100 equipped with French-style refrigerator doors 211, 212 (see Figure 1), it is not limited to this. For example, the embodiment can be applied to various types of refrigerators, such as refrigerators equipped with single-opening refrigerator doors (not shown). Furthermore, the embodiment is not limited to refrigerators, but can also be applied to storage facilities with functions other than refrigeration and freezing (warming cabinets, drying cabinets, temperature-controlled storage cabinets, humidity-controlled storage cabinets, etc.). In addition, since it has the function of an external (retrofitted) operation panel, it is also possible to apply the storage facility control device (camera unit 3 and control unit 8 (refrigerator control)) as a user interface for operating the storage facility. Moreover, the camera unit 3 can be configured as a "storage facility control device" in which the control unit 8 for controlling the refrigerator (storage facility) is built into the camera unit 3.

[0077] Furthermore, the programs executed by the control unit 8 (refrigerator control) (see Figure 6) and the server 53 (see Figure 6) can be provided via a communication line, or they can be written to a recording medium such as a CD-ROM and distributed. In addition, the history of the settings of the sticker 4 can be viewed on the user's mobile terminal 54 via the server 53. Furthermore, the embodiments are described in detail to clearly illustrate the present invention and are not necessarily limited to those comprising all the configurations described. In addition, it is possible to add, delete, or replace some of the configurations in the embodiments with other configurations. Furthermore, the mechanisms and configurations described above are those deemed necessary for explanatory purposes and do not necessarily represent all of the mechanisms and configurations shown in the actual product. [Explanation of symbols]

[0078] 1 cabinet 3. Camera Unit (Storage Control Device) 4. Sticker (display area) 4a Small display 6 Door Sensors 7. Shoot button 8. Control Unit (Storage Control Unit) 10. Refrigerator unit (storage unit) 21. Refrigerated room (storage room) 22 Ice-making room (storage room) 23 Upper freezer compartment (storage room) 24. Lower freezer compartment (storage compartment) 25. Vegetable compartment (storage room) 26,27 Switching room (storage room) 31d Human Motion Sensor 31e Light-emitting part 31f Pronunciation section 31g Camera / Wireless Communication Control Unit 31h antenna 41, 42 Sticker (display section) 43, 44 Stickers (display section, first display section) 45, 46 Stickers (display section, second display section) 51 Routers 52 Networks 53 Servers 54 Mobile devices (devices) 211,212 Refrigerator door (door) 221 Ice maker door (door) 231 Upper freezer door (door) 241 Lower freezer door (door) 251 Vegetable compartment door (door) 261,271 doors 100, 100A Refrigerator (Storage Unit) M1 Photography Department W1 Refrigerator System

Claims

1. The refrigerator body comprises a casing and a door that together with the casing forms a storage compartment, A camera unit that takes photographs with a display unit attached to the outer or inner surface of the refrigerator body, which is detachable from the outer or inner surface of the refrigerator body and displays predetermined settings related to the control of the refrigerator, including the refrigerator body, so that they can be visually seen by the user, A refrigerator system comprising: a control unit that, based on an image captured by the camera unit, detects an operation on the display unit by a user touching or bringing their fingers close to the display unit, and changes the settings to those specified by the user's fingers during the operation.

2. The refrigerator body has a plurality of doors, The control unit changes the settings corresponding to the display unit for the storage room inside a predetermined door to which the display unit is attached. A refrigerator system according to claim 1, characterized by the following:

3. The storage room includes a switching room that can be switched between a refrigerator and a freezer. The display unit includes a first display unit for specifying control corresponding to the refrigerator compartment and a second display unit for specifying control corresponding to the freezer compartment. The control unit, If the first display unit is attached to the door of the switching compartment, the switching compartment will function as a refrigerator compartment. If the second display unit is attached to the door of the switching chamber, the switching chamber will function as a freezer. A refrigerator system according to claim 1, characterized by the following:

4. A light-emitting unit that illuminates the display unit, The refrigerator is equipped with a motion sensor that detects a user approaching the refrigerator body, The control unit, when the motion sensor detects a user approaching the refrigerator body, turns on the light-emitting unit and takes a picture with the camera unit while the light-emitting unit is lit. A refrigerator system according to claim 1, characterized by the following:

5. The conditions for reflecting the user's operation in the changes to the settings include the condition that a predetermined trigger operation performed by the user immediately before or after the operation is detected based on the captured image. A refrigerator system according to claim 1, characterized by the following:

6. The control unit notifies the user of the result of determining the quality of the display unit in the image captured by the camera unit, and prompts the user to reattach the display unit if the display unit is in poor condition. A refrigerator system according to claim 1, characterized by the following:

7. The display unit displays a one-dimensional code or a two-dimensional code associated with features including the arrangement pattern of the settings in the display unit. The features are registered based on the reading result of the one-dimensional code or the two-dimensional code by the user's terminal. A refrigerator system according to claim 1, characterized by the following:

8. The control unit identifies the settings on the display unit where the user's fingers are touching or in close proximity, based on the features including the arrangement pattern of the settings on the display unit and the image captured by the camera unit. A refrigerator system according to claim 1, characterized by the following:

9. The control unit, Even if the display unit is removed from the refrigerator body after the aforementioned features have been registered, the registration of said features will be retained. When the display unit is removed from the refrigerator body, and the system detects, based on the captured image, that a user's fingers are touching or approaching the area on the refrigerator body where the display unit was attached, the system changes the settings to predetermined values ​​based on the display unit. The refrigerator system according to claim 8, characterized by the following:

10. If the position of the display unit shifts from the time of registration of the feature after the feature has been registered, the control unit shall provide a notification prompting the user to re-register the feature. The refrigerator system according to claim 8, characterized by the following:

11. A storage control device to be installed in a storage facility that includes a storage facility body having an enclosure and a door, and which stores articles in a predetermined internal environment, A camera unit that takes photographs with a display unit attached to the outer or inner surface of the storage unit body, which is detachable from the outer or inner surface of the storage unit body and displays predetermined settings related to the control of the storage unit including the storage unit body so that they can be visually viewed by the user, A storage control device comprising: a control unit that, based on an image captured by the camera unit, detects an operation on the display unit by a user touching or bringing their fingers close to the display unit, and changes the settings to those specified by the user's fingers during the operation.

Citation Information

Patent Citations

  • Refrigerator

    JP2014240730A