Method and device for controlling refrigerator, refrigerator and computer readable storage medium

Abstract

The invention relates to the technical field of intelligent household appliances, and discloses a method for controlling a refrigerator, and the refrigerator comprises a refrigerator body, and an open drawer and a storage device which are arranged in the refrigerator body; the open drawer is arranged on one side of the storage device and can be controlled to pop out or retract; the storage device is provided with a shelf which can be controlled to stretch out and draw back. The method for controlling the refrigerator comprises the steps that under the condition that a refrigerator door is opened, an image of an article in the hand of a user is obtained; identifying the category of the article according to the image of the article; and the states of the open drawer and the shelf are controlled according to the types of the articles. In this way, the pattern of the containing space in the refrigerator is automatically changed according to the types of the objects, and manual adjustment of a user is not needed. And the use convenience of a user is improved when the storage space of the refrigerator is fully utilized. The invention further discloses a device for controlling the refrigerator, the refrigerator and a computer readable storage medium.

Description

Technical Field

[0001] The present application relates to the technical field of smart home appliances, for example, to a method and device for controlling a refrigerator, a refrigerator, and a computer-readable storage medium. Background Art

[0002] At present, refrigerators have become a common household appliance in life. With the improvement of living standards, users are paying more and more attention to the storage capacity of refrigerators.

[0003] In order to solve the problem of increasing the storage capacity of a refrigerator, the relevant technology discloses a storage device, including: a drawer cabinet and a storage rack, the storage rack is arranged on the upper side of the drawer cabinet, the storage rack includes a main frame and a shelf, a slide groove is provided on the inner periphery of the main frame, a crossbeam is provided at the middle position of the main frame, the crossbeam is provided with a mezzanine, the mezzanine is communicated with the slide groove, and the height is the same as the slide groove height, the shelf is arranged in the slide groove and the mezzanine, can be telescopically slid in the slide groove and the mezzanine, a shelf is provided on the shelf, a fixed partition is provided on the main frame on one side of the crossbeam, an empty slot is provided in the main frame on the other side of the crossbeam, and an opening is provided on the main frame at a position corresponding to the empty slot.

[0004] During the implementation of the embodiments of the present disclosure, it was found that at least the following problems exist in the related art:

[0005] Although the related art can increase the storage space of the refrigerator by pushing the telescopic bracket to slide within the main frame, the position of the telescopic bracket needs to be manually adjusted by the user, which is inconvenient for the user.

[0006] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of this application, and therefore may include information that does not constitute prior art known to ordinary technicians in this field. Summary of the Invention

[0007] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical elements or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0008] The embodiments of the present disclosure provide a method and apparatus for controlling a refrigerator, a refrigerator, and a computer-readable storage medium, so as to improve user convenience while fully utilizing the refrigerator space.

[0009] In some embodiments, the refrigerator includes: a refrigerator body, an open drawer and a storage device arranged in the refrigerator body; the open drawer is arranged on one side of the storage device and can be popped out or retracted in a controlled manner; the storage device is provided with a shelf that can be controlled to extend and retract; the method for controlling the refrigerator includes: when the door is open, obtaining an image of an item in the user's hand; identifying the category of the item based on the image of the item; and controlling the status of the open drawer and the shelf based on the category of the item.

[0010] In some embodiments, the status of open drawers and shelves is controlled according to the category of the item, including: when the category of the item does not meet the preset category conditions, controlling the open drawers and shelves to maintain the current state; when the category of the item meets the preset category conditions, obtaining the size information of the item; and controlling the status of the open drawers and shelves according to the size information of the item.

[0011] In some embodiments, the status of open drawers and shelves is controlled according to the size information of the items, including: determining the main target storage area according to the size information of the items; and controlling the status of open drawers and shelves according to the main target storage area when the main target storage area is not full.

[0012] In some embodiments, when the shelf is extended, the shelf is located above the open drawer to turn the open drawer into a non-open state; the main target storage area is determined based on the size information of the item, including: when the size information of the item meets the first set size, the main target storage area is determined to be the first area; when the size information of the item meets the second set size, the main target storage area is determined to be the second area; when the size information of the item meets the third set size, the main target storage area is determined to be the third area; when the size information of the item meets the fourth set size, the main target storage area is determined to be the fourth area; wherein, the first area is the accommodation area when the open drawer is in a non-open state; the second area is the accommodation area when the open drawer is in an open state; the third area is the accommodation area longitudinally above the storage device when the shelf is retracted; and the fourth area is the accommodation area longitudinally above the storage device when the shelf is extended.

[0013] In some embodiments, the status of open drawers and shelves is controlled according to the main target storage area, including: when the main target storage area is the first area, controlling the open drawer to pop out and the shelf to maintain the current state; when the main target storage area is the second area, controlling the status of the open drawer and shelf according to the status of items on the shelf; when the main target storage area is the third area, controlling the open drawer and shelf to maintain the current state; when the main target storage area is the fourth area, controlling the open drawer to maintain the current state and controlling the status of the shelf according to the status of items in the second area.

[0014] In some embodiments, after determining the primary target storage area based on the size information of the items, controlling the status of the open drawers and shelves based on the size information of the items also includes: determining the secondary target storage area when the primary target storage area is full; and controlling the status of the open drawers and shelves based on the storage status of the secondary target storage area.

[0015] In some embodiments, determining the secondary target storage area includes: when the main target storage area is the first area and is full, determining the secondary target storage area as the third area or the fourth area; when the main target storage area is the second area and is full, determining the secondary target storage area as the third area or the fourth area; when the main target storage area is the third area and is full, determining the secondary target storage area as the fourth area.

[0016] In some embodiments, when the main target storage area is the second area, the status of the open drawers and shelves is controlled according to the status of items on the shelves, including: when there are no items on the shelves, controlling the open drawers to pop out and the shelves to be retracted; when there are items on the shelves, controlling the open drawers and shelves to maintain the current status.

[0017] In some embodiments, when the primary target storage area is the fourth area, controlling the state of the shelf according to the state of items in the second area includes: controlling the shelf to be extended when no items are stored in the second area, and controlling the shelf to maintain the current state when items are stored in the second area.

[0018] In some embodiments, if there are two secondary target storage areas, the ability of each secondary target storage area to accommodate the items in the user's hand is determined in sequence according to the area number order; if the small-numbered area can accommodate the items, the status of the open drawers and shelves is controlled according to the small-numbered area; if the small-numbered area cannot accommodate the items and the large-numbered area can accommodate the items, the status of the open drawers and shelves is controlled according to the large-numbered area.

[0019] In some embodiments, the state of the open drawers and shelves is controlled based on the storage status of the secondary target storage area, including: if the secondary target storage area is the third area or the fourth area, if the third area can accommodate items, the open drawers and shelves are controlled to maintain their current state; if the third area cannot accommodate items, the open drawers are controlled to maintain their current state and the shelf states are controlled based on the item status of the second area. If the secondary target storage area is the fourth area, if the fourth area can accommodate items, the open drawers are controlled to maintain their current state and the shelf states are controlled based on the item status of the shelves; if the fourth area cannot accommodate items, the user is notified.

[0020] In some embodiments, the apparatus for controlling a refrigerator includes: a processor and a memory storing program instructions, and the processor is configured to execute the aforementioned method for controlling a refrigerator when running the program instructions.

[0021] In some embodiments, the refrigerator includes: a refrigerator body; a storage device, which is arranged in the refrigerator body; and the storage device is provided with a shelf that can be controlled to extend and retract; an open drawer, which is arranged in the refrigerator body and located on one side of the storage device, and the open drawer can be controlled to pop out or retract; the device for controlling the refrigerator as mentioned above is installed on the refrigerator body.

[0022] In some embodiments, the computer-readable storage medium stores program instructions, and when the program instructions are run, the aforementioned method for controlling a refrigerator is executed.

[0023] The method and apparatus for controlling a refrigerator, the refrigerator, and the computer-readable storage medium provided by the embodiments of the present disclosure can achieve the following technical effects:

[0024] When the refrigerator door is opened, an image of the item in the user's hand is captured to identify the item's category. Based on the item's category, the system controls the open drawers and shelves, automatically changing the refrigerator's internal storage layout based on the item's type, without the user having to manually adjust it. This improves user convenience while fully utilizing the refrigerator's storage space.

[0025] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] One or more embodiments are exemplarily described by corresponding drawings. These exemplary descriptions and drawings do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a scale limitation. In addition,

[0027] Figure 1 is a schematic diagram of the interior of a refrigerator provided by an embodiment of the present disclosure;

[0028] Figure 2 is a schematic diagram of an open drawer and a storage device in a refrigerator provided by an embodiment of the present disclosure;

[0029] Figure 3-1 is a schematic diagram of a first area in a refrigerator provided by an embodiment of the present disclosure;

[0030] Figure 3-2 is a schematic diagram of a second area in a refrigerator provided by an embodiment of the present disclosure;

[0031] Figure 3-3is a schematic diagram of a third area in a refrigerator provided by an embodiment of the present disclosure;

[0032] Figure 3-4 is a schematic diagram of a fourth area in a refrigerator provided by an embodiment of the present disclosure;

[0033] Figure 4 This is a schematic diagram of the dimensions of a first area, a second area, a third area, and a fourth area in a refrigerator provided by an embodiment of the present disclosure;

[0034] Figure 5-1 This is a schematic diagram of a refrigerator provided by an embodiment of the present disclosure, with a shelf extended;

[0035] Figure 5-2 This is a schematic diagram of a refrigerator provided by an embodiment of the present disclosure, with shelves retracted;

[0036] Figure 5-3 This is a schematic diagram of an open drawer popping out of a refrigerator provided by an embodiment of the present disclosure;

[0037] Figure 6 is a schematic diagram of a method for controlling a refrigerator provided by an embodiment of the present disclosure;

[0038] Figure 7 is a schematic diagram of another method for controlling a refrigerator provided by an embodiment of the present disclosure;

[0039] Figure 8 is a schematic diagram of another method for controlling a refrigerator provided by an embodiment of the present disclosure;

[0040] Figure 9 is a schematic diagram of another method for controlling a refrigerator provided by an embodiment of the present disclosure;

[0041] Figure 10 is a schematic diagram of a device for controlling a refrigerator provided by an embodiment of the present disclosure;

[0042] Figure 11 is a schematic diagram of another device for controlling a refrigerator provided by an embodiment of the present disclosure;

[0043] Figure 12 It is a schematic diagram of another refrigerator provided by an embodiment of the present disclosure.

[0044] Reference numerals:

[0045] 10. Refrigerator body; 11. Storage plate; 20. Storage device; 21. Shelf; 30. Open drawer; 40. First area; 50. Second area; 60. Third area; 70. Fourth area; 80. Infrared sensor; 90. Camera device;

[0046] 100. Device for controlling a refrigerator; 101. Acquisition module; 102. Identification module; 103. Control module;

[0047] 110. Device for controlling a refrigerator; 111. Processor; 112. Memory; 113. Communication interface; 114. Bus;

[0048] 120. Refrigerator. DETAILED DESCRIPTION

[0049] In order to be able to understand the features and technical content of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The accompanying drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the sake of convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0050] In the description and claims of the embodiments of the present disclosure, as well as in the accompanying drawings, the terms "first," "second," and the like are used to distinguish similar items and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate to describe the embodiments of the present disclosure herein. In addition, the terms "including," "having," and any variations thereof are intended to cover non-exclusive inclusions.

[0051] Unless otherwise stated, the term "plurality" means two or more.

[0052] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B means: A or B.

[0053] The term "and / or" describes an association between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or A and B.

[0054] The term "correspondence" may refer to an association relationship or a binding relationship. The correspondence between A and B means that there is an association relationship or a binding relationship between A and B.

[0055] Combine Figure 1 and Figure 2As shown, the embodiment of the present disclosure provides a refrigerator 120, comprising: a refrigerator body 10, a storage device 20 and an open drawer 30. The storage device 20 and the open drawer 30 are both arranged in the refrigerator body 10. A shelf 21 that can be controlled to extend and retract is provided on the top of the storage device 20. The open drawer 30 is provided on one side of the storage device 20 and can be controlled to pop out or retract. When the shelf 21 is controlled to extend, the shelf 21 is located above the open drawer 30, thereby dividing the original storage space of the open drawer 30 into two storage areas, an upper and a lower area. At this time, the open drawer 30 becomes a closed state. See Figure 3-1 The lower storage area is the first area 40, which is enclosed by the bottom of the open drawer 30, the inner wall of the refrigerator body 10, the side walls of the storage device 20, and the shelf 21. The first area 40 is used to accommodate items that meet the first set size. Optionally, the items of the first set size are items with a height less than the first set height H1 and a width less than the first set width W1. Optionally, see Figure 5-1 , the first set size of items is bucket ice cream, canned beverages, canned beer and other small items. Figure 4 The first set height H1 is the distance between the bottom of the open drawer 30 and the storage plate 11 above it. The first set width W1 is the horizontal width of the open drawer 30. Optionally, H1 is 166 mm.

[0056] When the shelf 21 is controlled to be retracted, the open drawer 30 is in an open state. Figure 3-2 The upper longitudinal area of the bottom of the open drawer 30 is the second area 50. The second area 50 is used to accommodate items that meet the first set size or the second set size. Optionally, the items of the second set size are items whose height is greater than or equal to the first set height H1 and less than the second set height H2, and whose width is less than the first set width W1. Figure 5-2 and 5-3 , the second set size of items is bottles of wine and other items when placed upright, which are relatively tall. Figure 4 The second set height H2 is the distance between the bottom of the open drawer 30 and the storage plate 11 above the open drawer 30. Optionally, H2 is 380 mm.

[0057] When the shelf 21 is controlled to be retracted, see Figure 3-3 The area above the top of the storage device 20 is a third area 60. The third area 60 is used to accommodate items that meet the third set size. Figure 4Items of the third set size are those with a height less than the third set height H3 and a width greater than or equal to the first set width W1 and less than the second set width W2. Optionally, items of the third set size include items with larger horizontal dimensions, such as drinks in a row (multiple bottles of drinks arranged and packaged in one or more rows) or "lying" bottles of wine. Optionally, the third set height is the distance between the top of the storage device 20 and the storage plate 11. The second set width is the horizontal width of the storage device 20.

[0058] When the shelf 21 is extended under control, see Figure 3-4 The area above the top of the storage device 20 (including the extended shelf 21) and the area above the extended shelf 21 are the fourth area 70. The fourth area 70 is used to accommodate items that meet the third set size or the fourth set size. Figure 4 Items of the fourth set size are items with a height less than the third set height H3 and a width less than the third set width W3 and greater than or equal to the second set width W2. Optionally, the third set width is the sum of the lateral width of the storage device 20 and the extended length of the shelf 21.

[0059] The open drawer 30 can utilize the depth of the drawer to store items, making it easy to pick out items from deep inside the refrigerator. This avoids the problems of conventional refrigerators where the depth of the drawer cannot be changed and objects in the front row are blocked, resulting in poor visibility.

[0060] Optionally, see again Figure 1 An infrared sensor 80 is provided on the inner side wall of the refrigerator body 10 at a position corresponding to the extended position of the shelf 21. The infrared sensor 80 can detect whether there are items stored in the second area 50. If the infrared sensor 80 detects that there are items stored in the second area 50, the shelf 21 is controlled to be retracted.

[0061] It should be noted that the structure capable of popping out or retracting the open drawer 30 and the shelf 21 is a prior art and will not be described in detail here.

[0062] Optionally, see again Figure 1 The refrigerator body 10 further includes: a camera device 90 for acquiring images of items in the user's hand.

[0063] Combine Figure 6 As shown, an embodiment of the present disclosure provides a method for controlling a refrigerator, comprising:

[0064] S601: When the door of the box is open, the processor obtains an image of the item in the user's hand.

[0065] S602: The processor identifies the category of the object based on the image of the object.

[0066] S603: The processor controls the status of the open drawers and shelves according to the category of the items.

[0067] A camera device is provided inside the refrigerator body, which can be controlled to open or close. The image of the items in the user's hand is captured by the camera device. If the user has no items in his hand, it means that the user has no need to store items in the refrigerator, and the open drawers and shelves are controlled to maintain the current state, that is, the open drawers and shelves are controlled not to move. If the user has items in his hand, the category of the item is identified based on the image of the item. Optionally, the refrigerator's memory stores a database of the association between item images and categories. The category of the item can then be matched based on the image of the item. Based on the category of the item, the status of the open drawers and shelves is controlled. As can be seen from the foregoing, the open drawers can be controlled to pop out or retract, and the shelves can be controlled to extend or retract. Therefore, controlling the status of the open drawers and shelves here refers to controlling the open drawers to pop out or retract, and controlling the shelves to extend or retract.

[0068] Using the refrigerator control method provided by the disclosed embodiments, when the refrigerator door is opened, an image of the item in the user's hand is captured, and the item's category is identified. The state of the open drawers and shelves is then controlled based on the item's category, automatically changing the refrigerator's internal storage space layout based on the item's category, without the user having to manually adjust it. This improves user convenience while fully utilizing the refrigerator's storage space.

[0069] Optionally, the refrigerator body is also equipped with a door sensor for detecting whether the refrigerator door is open or closed. When the door is detected to be open, the camera is activated to capture an image of the item in the user's hand. When the door is detected to be closed, the camera is deactivated. This protects the user's privacy by activating the camera when the item type needs to be identified.

[0070] Combine Figure 7 As shown, the embodiment of the present disclosure provides another method for a user to control a refrigerator, including:

[0071] S601: When the door of the box is open, the processor obtains an image of the item in the user's hand.

[0072] S602: The processor identifies the category of the object based on the image of the object.

[0073] S613: When the category of the item does not meet the preset category condition, the processor controls the open drawer and the shelf to maintain the current state.

[0074] S623: If the category of the item meets the preset category condition, the processor obtains the size information of the item.

[0075] S633: The processor controls the states of the open drawers and shelves according to the size information of the items.

[0076] The refrigerator's memory pre-stores preset category conditions. The category of the identified item is compared with the preset category conditions. If the category of the item does not meet the preset category conditions, it means that the item in the user's hand does not meet the conditions for being placed on the open drawers and shelves. Therefore, at this time, the open drawers and shelves are controlled to maintain the current state, that is, the open drawers and shelves are controlled not to move. If the category of the item meets the preset category conditions, the size information of the item is further obtained through the camera device. Then, based on the size information of the item, the state of the open drawers and shelves is controlled. In this way, when the category of the item meets the preset category conditions, the state of the open drawers and shelves is controlled based on the size information of the item, so that the internal storage space of the refrigerator is adaptively changed, thereby facilitating the user to make full use of the space in the refrigerator. At the same time, ineffective actions of the open drawers and shelves can also be avoided.

[0077] Optionally, the preset category condition is that the category of the item is beverages, which include water, milk, wine, and drinks.

[0078] Optionally, the category of the item is learned based on the categories of items that the user frequently picks up and puts down over a period of time.

[0079] Optionally, at S633, the processor controls the states of open drawers and shelves based on the size information of the item, including:

[0080] The processor determines the primary target storage area based on the size information of the item.

[0081] The processor controls the states of the open drawers and the shelves according to the main target storage area when the main target storage area is not full.

[0082] As can be seen from the above, by controlling the state of the shelves of the open drawer, different sizes of storage areas can be formed to accommodate items of different sizes. There may be one or more areas that can accommodate the same item. For example, see Figure 5-1 and 5-2 , items that can be accommodated in the first area can also be accommodated in the second area, and can also be accommodated in the third area and the fourth area. Therefore, the main target storage area is first determined based on the size information of the items. If the main target storage area is not full, the status of the open drawers and shelves is controlled according to the main target storage area. Here, the main target storage area is not full, including: no items are stored in the main target storage area, and items are stored in the main target storage area but the remaining space is sufficient to accommodate the items in the user's hand. Optionally, whether the main target storage area is full is determined by a camera device.

[0083] Optionally, at S633, the processor controls the states of open drawers and shelves based on the size information of the item, including:

[0084] The processor determines the primary target storage area based on the size information of the item.

[0085] The processor controls the states of the open drawers and the shelves according to the main target storage area when the main target storage area is not full.

[0086] The processor determines a secondary target storage area when the primary target storage area is full.

[0087] The processor controls the states of the open drawers and shelves according to the storage state of the secondary target storage area.

[0088] If the primary target storage area is full, a secondary target storage area is determined. A full primary target storage area includes either no remaining space in the primary target storage area or space remaining in the primary target storage area, but insufficient to accommodate the user's item. The state of the open drawers and shelves is controlled based on the storage status of the secondary target storage area—that is, whether it is full. This distinction between primary and secondary target storage areas maximizes the storage of items within the refrigerator while also preventing wasted storage space caused by small items in larger target storage areas.

[0089] Optionally, the processor determines the primary target storage area based on the size information of the item, including:

[0090] When the size information of the item meets the first set size, the processor determines that the primary target storage area is the first area.

[0091] When the size information of the item meets the second set size, the processor determines that the main target storage area is the second area.

[0092] When the size information of the item meets the third set size, the processor determines that the main target storage area is the third area.

[0093] When the size information of the item meets the fourth set size, the processor determines that the main target storage area is the fourth area.

[0094] If the item's size information meets the first set size, indicating that both the height and width of the item are small, the primary target storage area is determined to be the first area. If the item's size information meets the second set size, indicating that the item's height is large but its width is small, the primary target storage area is determined to be the second area. If the item's size information meets the third set size, indicating that the item's height is small but its width is large, the primary target storage area is determined to be the third area. If the item's size information meets the fourth set size, indicating that the item's height is small but its width is large, the primary target storage area is determined to be the fourth area. In this way, matching the appropriate target storage area based on the item's size information makes item storage more reasonable and compact, avoiding space waste. This not only maximizes the use of the refrigerator's storage space, but also provides optimal storage space based on the size and height of the items.

[0095] Optionally, the processor controls the states of open drawers and shelves according to the primary target storage area, including:

[0096] When the primary target storage area is the first area, the processor controls the open drawer to pop out and the shelf to maintain a current state.

[0097] When the primary target storage area is the second area, the processor controls the status of the open drawer and the shelf according to the status of items on the shelf.

[0098] When the primary target storage area is the third area, the processor controls the open drawers and the shelves to maintain a current state.

[0099] When the primary target storage area is the fourth area, the processor controls the open drawer to maintain a current state and controls the state of the shelf according to the state of items in the second area.

[0100] If the primary storage area is the first area, indicating that the height of the items is lower than the height of the storage device, the shelf's extension or retraction will not affect the placement of the items. Therefore, the shelf is controlled to remain in its current state, meaning it is inactive. Meanwhile, if the items need to be placed in an open drawer, the open drawer is controlled to pop out. This allows users to easily place items in the open drawer without bending or reaching, greatly improving user convenience.

[0101] If the primary target storage area is the second area, and the height is higher than the height of the storage device, the shelf needs to be retracted to accommodate the items. However, the shelf may be extended and there may be items placed on it. If the shelf is directly retracted, the items on the shelf will fall. Therefore, the shelf state is further controlled based on the status of the items on the shelf. Moreover, if there are items on the shelf, the second area cannot be used to store items. Therefore, the state of the open drawer is further controlled based on the status of the items on the shelf.

[0102] If the primary storage area is the third area, the items are larger in width but smaller in height. The shelf's extended or retracted state does not affect the placement of items in the third area, and items are not placed in open drawers. Therefore, the open drawers and shelves are controlled to maintain their current state, meaning they are not moved.

[0103] If the primary target storage area is the fourth area, the items are wider. The shelf needs to be extended to provide adequate space for the items. However, whether the shelf can be extended depends on whether items are stored in the second area. If there are items in the second area, they will block the shelf, preventing it from extending. Therefore, the shelf status is further controlled based on the status of the items in the second area. At the same time, items do not need to be placed in the open drawer. Therefore, the open drawer is controlled to maintain its current state, that is, it is controlled to be inactive.

[0104] Optionally, when the primary target storage area is the second area, the processor controls the state of the open drawer and the shelf according to the state of items on the shelf, including:

[0105] When there is nothing on the shelf, the processor controls the open drawer to pop out and the shelf to be retracted.

[0106] The processor controls the open drawers and the shelves to maintain their current states when there are items on the shelves.

[0107] If there are no items on the shelf, items can be placed in the open drawer, which then controls the open drawer to pop out. Simultaneously, the shelf is retracted to avoid items in the second area. If there are items on the shelf, they cannot be placed in the open drawer. Therefore, the open drawer and shelf are controlled to maintain their current state, that is, they are controlled to remain inactive. In this way, if the shelf needs to be retracted, whether the shelf can be retracted is determined based on whether there are items on the shelf, and the state of the open drawer and shelf is then controlled. This prevents items on the shelf from falling.

[0108] Optionally, when the primary target storage area is the fourth area, the processor controls the state of the shelf according to the state of items in the second area, including:

[0109] When no items are stored in the second area, the processor controls the shelf to be in an extended state.

[0110] When items are stored in the second area, the processor controls the shelf to maintain a current state.

[0111] If the second area is empty, the extended shelf will not interfere with the items. Therefore, controlling the shelf to be extended includes: controlling the shelf to switch from a retracted state to an extended state, and controlling the shelf to maintain the extended state. If the second area is empty and the extended shelf would interfere with the items in the second area, the shelf is controlled to remain in its current state.

[0112] Optionally, when the primary target storage area is full, the processor determines the secondary target storage area, including:

[0113] When the primary target storage area is the first area and is full, the processor determines that the secondary target storage area is the third area or the fourth area.

[0114] When the primary target storage area is the second area and is full, the processor determines that the secondary target storage area is the third area or the fourth area.

[0115] When the primary target storage area is the third area and is full, the processor determines that the secondary target storage area is the fourth area.

[0116] If the primary target storage area is the first area and is full, it means that the height and width of the item in the user's hand are both small and can be accommodated in the third or fourth area. Therefore, the secondary target storage area is determined to be the third or fourth area.

[0117] In addition to being placed upright, items can also be placed "lying down." For example, beer bottles are generally tall. The bottom of the bottle can be used as the placement surface, which is considered upright placement and the most common placement method. If the storage space is not high enough, the bottle can be placed using its sidewalls as the placement surface, which is called "lying down" or "squatting." Therefore, if the primary target storage area is the second area and it is full, the secondary target storage area is determined to be the third or fourth area. These two areas can accommodate items that are tall when placed upright and "lying down."

[0118] If the primary storage area is the third area and it's full, indicating the width of the item in the user's hand is larger, the secondary storage area is determined to be the fourth area. Compared to the third area, the fourth area has a larger storage area above the extended shelf and a wider storage area, thus providing more storage space for items.

[0119] Optionally, if there are two secondary target storage areas, the processor determines in sequence according to the area number whether each secondary target storage area can accommodate the items in the user's hand. If the small-numbered area can accommodate the items, the processor controls the state of the open drawers and shelves according to the small-numbered area. If the small-numbered area cannot accommodate the items, but the large-numbered area can accommodate the items, the processor controls the state of the open drawers and shelves according to the large-numbered area. For example, when it is determined that the secondary target storage area is the third area or the fourth area, first determine whether the third area can accommodate the items. If so, control the open drawers and shelves to maintain the current state. If not, determine whether the fourth area can accommodate the items. If so, control the open drawers to maintain the current state, and control the state of the shelves according to the state of the items in the second area. The specific control logic can be found in the previous text and will not be repeated here.

[0120] Optionally, the processor controls the states of the open drawers and shelves according to the storage state of the secondary target storage area, including:

[0121] When the secondary target storage area is the third area or the fourth area, if the third area can accommodate items, the processor controls the open drawers and shelves to maintain their current state; if the third area cannot accommodate items, the processor controls the open drawers to maintain their current state and controls the state of the shelves according to the state of the items in the second area.

[0122] When the secondary target storage area is the fourth area, if the fourth area can accommodate items, the processor controls the open drawer to maintain the current state and controls the state of the shelf according to the state of the items in the second area; if the fourth area cannot accommodate items, the user is notified.

[0123] If the secondary target storage area is the third area or the fourth area, first determine whether the third area can accommodate items. If it can, control the open drawers and shelves to maintain their current state. If not, determine whether the fourth area can accommodate items. If the fourth area can accommodate items, control the open drawers to maintain their current state, and control the state of the shelves according to the state of the items in the second area. The specific control logic can be found in the previous text and will not be repeated here. If the secondary target storage area is the fourth area, and the fourth area can accommodate items, control the open drawers to maintain their current state. At the same time, further control the state of the shelves according to the state of the items in the second area, that is, control the state of the shelves according to whether there are items in the second area. The specific control logic can be found in the previous text and will not be repeated here. If the fourth area cannot accommodate items, notify the user that there is no space in the open drawers and shelves to store items at this time. Optionally, the user is notified by voice, client program push message, etc.

[0124] Optionally, when the camera device detects that an object in the user's hand is placed in the open drawer, the open drawer is controlled to retract.

[0125] Combine Figure 8 As shown, the embodiment of the present disclosure provides another method for controlling a refrigerator, including:

[0126] S601: When the door of the box is open, the processor obtains an image of the item in the user's hand.

[0127] S602: The processor identifies the category of the object based on the image of the object.

[0128] S613: When the category of the item does not meet the preset category condition, the processor controls the open drawer and the shelf to maintain the current state.

[0129] S623: If the category of the item meets the preset category condition, the processor obtains the size information of the item.

[0130] S633: The processor controls the states of the open drawers and shelves according to the size information of the items.

[0131] S604: When the category of the item does not satisfy a preset category condition, the processor determines a target drawer according to the category of the item.

[0132] S605: The processor controls the target drawer to pop up.

[0133] If the item's category doesn't meet the preset conditions, the system determines the target drawer based on the item's category. The system then controls the target drawer to pop out. For example, if the item in the user's hand is meat, the meat refrigeration drawer will pop out; if the item in the user's hand is vegetables or fruit, the vegetable or fruit drawer will pop out. This makes it easy for users to store their items in the corresponding drawer.

[0134] Combine Figure 9 As shown, the embodiment of the present disclosure provides another method for controlling a refrigerator, including:

[0135] S601: When the door of the box is open, the processor obtains an image of the item in the user's hand.

[0136] S602: The processor identifies the category of the object based on the image of the object.

[0137] S613: When the category of the item does not meet the preset category condition, the processor controls the open drawer and the shelf to maintain the current state.

[0138] S623: If the category of the item meets the preset category condition, the processor obtains the size information of the item.

[0139] S633: The processor controls the states of the open drawers and shelves according to the size information of the items.

[0140] S604: When the category of the item does not satisfy a preset category condition, the processor determines a target drawer according to the category of the item.

[0141] S605: The processor controls the target drawer to pop up.

[0142] S606: When the item is placed in the target drawer, the processor controls the target drawer to be retracted.

[0143] S607: The processor controls the temperature of the target drawer to reach a storage temperature corresponding to the item category.

[0144] After the target drawer is popped out, the system continuously captures images of the item in the user's hand. If the image captures an image indicating that the item is being placed in the target drawer, the system retracts the target drawer, effectively closing it. The system then controls the temperature of the target drawer to the appropriate storage temperature for the item. For example, the temperature in the target drawer can be adjusted to a suitable temperature for meat, vegetables, or fruit. This intelligent temperature control facilitates storage and user convenience.

[0145] Optionally, the refrigerator has a pre-stored food preservation knowledge base in its memory. After acquiring an image of an item in the user's hand, the processor controls a display screen, a voice module, or a terminal device provided by the user to provide the user with recommendations on the best preservation method and storage time for the item.

[0146] In the embodiments of the present disclosure, a terminal device refers to an electronic device with a wireless connection function. The terminal device can communicate with the refrigerator as described above by connecting to the Internet, or can communicate with the refrigerator as described above directly through Bluetooth, Wi-Fi, etc. In some embodiments, the terminal device is, for example, a mobile device, a computer, or a vehicle-mounted device built into a hover car, or any combination thereof. Mobile devices may include, for example, mobile phones, smart home devices, wearable devices, smart mobile devices, virtual reality devices, etc., or any combination thereof, wherein wearable devices include, for example, smart watches, smart bracelets, pedometers, etc.

[0147] Optionally, the user can also control the opening or retraction of open drawers and the extension or retraction of shelves through the voice module. Specifically, the user speaks a voice command, and the voice module interprets the voice command after receiving it, and then controls the open drawers and shelves to perform corresponding actions.

[0148] Combine Figure 10As shown, an embodiment of the present disclosure provides a device 100 for controlling a refrigerator, comprising: an acquisition module 101, an identification module 102, and a control module 103. Acquisition module 101 is configured to acquire an image of an item in a user's hand when the refrigerator door is open. Identification module 102 is configured to identify the category of the item based on the image. Control module 103 is configured to control the status of open drawers and shelves based on the category of the item.

[0149] Using the refrigerator control device 100 provided in an embodiment of the present disclosure, when the refrigerator door is opened, an image of the item in the user's hand is captured, and the category of the item is identified. The device then controls the state of the open drawers and shelves based on the item's category, automatically changing the refrigerator's internal storage space layout based on the item's category without requiring manual adjustment by the user. This improves user convenience while fully utilizing the refrigerator's storage space.

[0150] Combine Figure 11 As shown, an embodiment of the present disclosure provides a device 110 for controlling a refrigerator, comprising a processor 111 and a memory 112. Optionally, the device 110 may further include a communication interface 113 and a bus 114. The processor 111, the communication interface 113, and the memory 112 may communicate with each other via the bus 114. The communication interface 113 may be used for information transmission. The processor 111 may call the logic instructions in the memory 112 to execute the method for controlling a refrigerator of the above embodiment.

[0151] In addition, the logic instructions in the memory 112 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0152] Memory 112, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of the present disclosure. Processor 111 executes the program instructions / modules stored in memory 112 to execute functional applications and process data, thereby implementing the refrigerator control method in the above-described embodiments.

[0153] The memory 112 may include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function; the data storage area may store data generated based on the use of the terminal device. Furthermore, the memory 112 may include high-speed random access memory and non-volatile memory.

[0154] Combine Figure 12As shown, the embodiment of the present disclosure provides a refrigerator 120, comprising: a refrigerator body; a storage device, which is arranged in the refrigerator body; and the storage device is provided with a shelf that can be controlled to extend and retract; an open drawer, which is arranged in the refrigerator body and is located on one side of the storage device, and the open drawer can be controlled to pop out or retract; and the above-mentioned device 100 (110) for controlling the refrigerator. The device 100 (110) for controlling the refrigerator is installed on the refrigerator body. The installation relationship described here is not limited to placement inside the refrigerator body, but also includes installation connections with other components of the refrigerator 120, including but not limited to physical connections, electrical connections or signal transmission connections, etc. It can be understood by those skilled in the art that the device 100 (110) for controlling the refrigerator can be adapted to a feasible product body, thereby realizing other feasible embodiments.

[0155] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for controlling a refrigerator.

[0156] The technical solutions of the embodiments of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiments of the present disclosure. The aforementioned storage medium may be a non-transitory storage medium, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, among other media capable of storing program code.

[0157] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible variations. Unless explicitly required, individual components and functions are optional, and the order of operations may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to also include plural forms. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of one or more associated listings. In addition, when used in this application, the term "comprise" and its variations "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups of these. In the absence of further restrictions, an element defined by the sentence "comprising a..." does not exclude the presence of other identical elements in the process, method or device that includes the element. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments can be referenced to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can be found in the description of the method part.

[0158] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present disclosure. The technicians will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0159] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units can be merely a logical functional division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, and can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected to implement this embodiment according to actual needs. In addition, the functional units in the embodiments of the present disclosure may be integrated into a processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0160] The flowcharts and block diagrams in the accompanying drawings show the possible implementation architectures, functions and operations of the systems, methods and computer program products according to the embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment or part of the code, and the module, program segment or part of the code contains one or more executable instructions for implementing the specified logical functions. In some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, or they can sometimes be executed in the opposite order, which can depend on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in an order different from that disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, or they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified function or action, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for controlling a refrigerator, characterized in that: Refrigerator includes: A refrigerator body, an open drawer and a storage device arranged in the refrigerator body; The open drawer is arranged on one side of the storage device and can be popped out or retracted in a controlled manner; The storage device is provided with shelves capable of controlled extension and retraction; The method comprises: When the door is open, obtain the image of the item in the user's hand; Identify the category of an object based on its image; Control the status of open drawers and shelves based on the category of items.

2. The method according to claim 1, characterized in that Control the status of open drawers and shelves based on the category of items, including: When the category of the item does not meet the preset category conditions, the open drawers and shelves are controlled to maintain the current state; When the category of the item meets the preset category conditions, obtain the size information of the item; Control the state of open drawers and shelves based on the size information of the items.

3. The method according to claim 2, characterized in that Control the state of open drawers and shelves based on the item's size information, including: Determine the primary target storage area based on the item's size information; When the main target storage area is not full, the states of the open drawers and shelves are controlled according to the main target storage area.

4. The method according to claim 3, characterized in that When the shelf is extended, the shelf is located above the open drawer to convert the open drawer into a closed one; based on the size information of the items, the primary target storage area is determined, including: When the size information of the item meets the first set size, determining the primary target storage area as the first area; When the size information of the item meets the second set size, determining the primary target storage area as the second area; When the size information of the item meets the third set size, determining the primary target storage area as the third area; When the size information of the item meets the fourth set size, determining the primary target storage area as the fourth area; Among them, the first area is the storage area when the open drawer is in a non-open position; the second area is the storage area when the open drawer is in an open position; the third area is the storage area longitudinally above the storage device when the shelf is retracted; the fourth area is the storage area longitudinally above the storage device when the shelf is extended.

5. The method according to claim 4, characterized in that Control the state of open drawers and shelves based on primary target storage areas, including: When the primary target storage area is the first area, the open drawer is controlled to pop out and the shelf remains in the current state; When the primary target storage area is the second area, controlling the states of the open drawers and shelves according to the states of items on the shelves; When the primary target storage area is the third area, the open drawers and shelves are controlled to maintain the current state; When the main target storage area is the fourth area, the open drawer is controlled to maintain the current state, and the state of the shelf is controlled according to the state of the items in the second area.

6. The method according to claim 3, characterized in that After determining the primary target storage area based on the size information of the items, controlling the states of open drawers and shelves based on the size information of the items also includes: When the primary target storage area is full, determine the secondary target storage area; Control the status of open drawers and shelves based on the storage status of the secondary storage area.

7. The method according to claim 6, characterized in that Identify secondary target storage areas, including: When the primary target storage area is the first area and is full, determining the secondary target storage area to be the third area or the fourth area; When the primary target storage area is the second area and is full, determining the secondary target storage area to be the third area or the fourth area; When the primary target storage area is the third area and is full, the secondary target storage area is determined to be the fourth area.

8. A device for controlling a refrigerator, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to execute the method for controlling a refrigerator according to any one of claims 1 to 7 when running the program instructions.

9. A refrigerator, characterized in that: include: Refrigerator body; The storage device is arranged in the refrigerator body; and the storage device is provided with a shelf capable of controlled extension and contraction; An open drawer is provided in the refrigerator body and is located on one side of the storage device, and the open drawer can be controlled to pop out or retract; The device for controlling a refrigerator according to claim 8, is mounted on the refrigerator body.

10. A computer-readable storage medium storing program instructions, characterized in that: When the program instructions are executed, the computer is configured to execute the method for controlling a refrigerator according to any one of claims 1 to 7.

Images