Method of controlling a storage device and storage device

Abstract

The application discloses a method for controlling a storage device and the storage device. The method comprises the following steps: acquiring first image information of each storage space in the storage device; determining a storage category of a storage article in the storage space according to the first image information; controlling a preset switch to adjust a communication state between adjacent storage spaces according to the storage category; and adjusting the operation state of a corresponding motor of the adjacent storage spaces according to the communication state. By dividing the storage area of the storage device into multiple storage spaces, the use experience of the user is optimized. By adjusting the communication state between two storage spaces, the same temperature is achieved in the two storage spaces, and by adjusting the operation state of the corresponding motor of the storage space, the problem of excessive power consumption caused by the large number of motors due to the excessive number of storage spaces is avoided.

Description

Technical Field

[0001] This invention relates to the field of intelligent control technology, and in particular to a method for controlling storage equipment and the storage equipment itself. Background Technology

[0002] A refrigerator is a storage device that keeps food or other items at a constant low temperature. Current refrigerators typically have separate cooling and freezing compartments for temperature control. Larger refrigerators often only divide the cooling compartment into left and right sections, and the temperature of these two sections cannot be adjusted according to the different items being stored. When different items are stored in the same area, their varying temperature tolerances can easily cause spoilage or prevent them from reaching their intended storage time, negatively impacting the user experience. Summary of the Invention

[0003] This invention provides a method for controlling a storage device and a storage device that can optimize the user experience of the storage device.

[0004] In one aspect of the present invention, a method for controlling a storage device is provided. The method includes: acquiring first image information captured from each storage space within the storage device; determining the storage category of stored items within the storage space based on the first image information; controlling a preset switch to adjust the connectivity between adjacent storage spaces based on the storage category; and adjusting the operating state of corresponding motors in adjacent storage spaces based on the connectivity.

[0005] In another aspect of the invention, a storage device is provided. The device includes: an intelligent control unit and a plurality of storage spaces, with adjustable partitions disposed between adjacent storage spaces; each storage space is provided with a motor and a camera; the intelligent control unit is electrically connected to the adjustable partitions, the motors, and the cameras respectively; the intelligent control unit is configured to perform various steps in the method for controlling the storage device described above.

[0006] According to the technical solution of the present invention, by dividing the storage area of ​​the storage device into multiple storage spaces, the preservation of items is avoided due to a single storage temperature, thus optimizing the user experience. Simultaneously, first image information of each storage space is acquired. Based on this first image information, the storage category of the current storage space can be automatically identified and determined, thereby adjusting the connectivity between the storage spaces according to the different storage categories. When two adjacent storage spaces contain similar or identical storage categories, the required temperatures for these two storage spaces are similar. Therefore, the two storage spaces can be connected to achieve the same temperature. At the same time, the operating state of the corresponding motor in each storage space is adjusted, ensuring proper storage of items while avoiding excessive energy consumption due to a large number of motors caused by too many storage spaces. Attached Figure Description

[0007] Figure 1 A flowchart of a method for controlling a storage device according to an embodiment of the present invention;

[0008] Figure 2 This is another flowchart of a method for controlling a storage device according to an embodiment of the present invention;

[0009] Figure 3 This is a schematic diagram of the structure of a storage device according to an embodiment of the present invention. Detailed Implementation

[0010] To explain in detail the technical content, objectives, and effects of the present invention, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0011] In existing technologies, temperature differentiation is typically achieved by dividing the storage area into refrigeration and freezing compartments. However, within the refrigeration compartment, items are simply stored in two separate zones, and the temperature of these zones cannot be adjusted according to the specific items being stored. When different items are stored in the same area, their varying temperature tolerances can easily lead to spoilage or prevent them from reaching their intended shelf life. If storage is divided into zones based on the type of items, the diverse range of items and the increasing number of zones, each with its own temperature, can result in excessive energy consumption for the storage equipment.

[0012] To address at least the aforementioned technical problems, this disclosure provides a method for controlling a storage device. According to this disclosure, the storage area of ​​the storage device is divided into multiple storage spaces. First image information of each storage space is simultaneously acquired. Based on the first image information, the storage category of the current storage space can be automatically identified and determined, thereby adjusting the connectivity between the storage spaces according to the different storage categories. When two adjacent storage spaces contain similar or identical storage categories, the required temperatures for these two storage spaces are similar. Therefore, the two storage spaces can be connected to reach the same temperature, and the operating state of the corresponding motor in each storage space can be adjusted. In this way, according to the embodiments of this disclosure, the preservation of items can be avoided due to a single storage temperature, optimizing the user experience; at the same time, while ensuring proper storage of items, the problem of excessive power consumption due to a large number of motors caused by too many storage spaces can be avoided.

[0013] In the following, the technical solutions according to this disclosure will be described with reference to specific embodiments and in conjunction with the accompanying drawings.

[0014] Figure 1 This is a flowchart illustrating a method 100 for controlling a storage device according to an embodiment of the present disclosure. (Refer to...) Figure 1 The method 100 includes the following steps 102 to 108.

[0015] In step 102, the first image information captured by each storage space in the storage device is obtained.

[0016] In step 104, the storage category of the stored items in the storage space is determined based on the first image information.

[0017] In some embodiments, the storage categories of the storage space can be adjusted according to the different attributes of the items placed by the user. Before the user places items in the storage space, the user is reminded in advance that only items of the same attribute can be placed in the same storage space, to avoid the problem of inconsistent storage categories in the same storage space due to placing items of different attributes, which could lead to incompatible storage temperatures.

[0018] In some embodiments, branches for different storage categories are created in a pre-built general convolutional neural network. These categories may include vegetables, fruits, seafood, beverages, and frozen products. After creating the corresponding storage category branches in the general convolutional neural network, a softmax layer is added to the end of the fully connected layer of each branch to obtain the initial convolutional neural network. Then, an image dataset containing labeled vegetables, fruits, seafood, beverages, and frozen products is input into the initial convolutional neural network for training and validation to obtain the optimal storage classification model. Subsequently, the first image information acquired in real-time is input into the trained storage classification model to determine the corresponding category one by one. For example, first, it is determined whether the first image information belongs to the vegetable category; if not, it is determined whether the first image information belongs to the fruit category; if not, it is determined whether the first image information belongs to the seafood category, and so on, until the storage category of the first image information is determined, thus determining the storage category of the storage space.

[0019] In step 106, the connection between adjacent storage spaces is adjusted by controlling a preset switch according to the storage category.

[0020] In some embodiments, it is determined whether adjacent storage spaces contain the same type of items. If they do, it is checked whether the connectivity between adjacent storage spaces is interconnected; if not, a preset switch is controlled to adjust the connectivity to interconnectedness. If they do not, it is checked whether the connectivity between adjacent storage spaces is isolated; if not, a preset switch is controlled to adjust the connectivity to isolation. In this way, based on the attributes of the items stored by the user in different storage spaces, the internal storage space of the storage device is automatically adjusted to determine whether it forms a shared space. That is, the internal storage space of the storage device is dynamically divided according to the different stored items, making space utilization more rational. Furthermore, the temperature in each storage space is different, avoiding the impact of a single storage temperature on item preservation, and also avoiding the problem of excessive power consumption due to too many storage spaces.

[0021] Specifically, the storage categories of adjacent storage spaces can be determined based on the attributes of the items stored within those spaces. For example, if storage space A contains milk, and adjacent storage space B contains beverages, then storage space A and storage space B can be considered to have the same storage category.

[0022] Specifically, it can also determine whether adjacent storage spaces have similar storage categories. If they are similar, a preset control switch is executed to adjust the connection state to interconnection. If they are not similar, a preset control switch is executed to adjust the connection state to isolation. For example, if storage space A stores fruit, and adjacent storage space B stores vegetables, it can be determined that adjacent storage spaces A and B have similar storage categories, and the connection state between storage spaces A and B can be adjusted to interconnection.

[0023] In step 108, the operating status of the corresponding motors in adjacent storage spaces is adjusted according to the connectivity status. In some embodiments, adjacent storage spaces are divided into at least one space set according to the connectivity status, and at least one motor in each of the at least one space set is selected as the working motor. The operating status of the working motor is adjusted to "start," and the operating status of the corresponding motors in other storage spaces within the same space set is adjusted to "off." In this way, when adjacent storage spaces are interconnected, only one motor is kept in operation, while the motors in other storage spaces are turned off. This allows interconnected storage spaces to share a single motor, avoiding resource consumption caused by multiple motors operating simultaneously and improving resource utilization.

[0024] In some embodiments, interconnected and adjacent storage spaces are grouped into the same space set. This method groups interconnected storage spaces into one space set and non-interconnected storage spaces into different space sets, facilitating the management of the operating status of the motor corresponding to each storage space and avoiding energy consumption.

[0025] Specifically, when storage space A is interconnected with its adjacent storage space B, and storage space B is disconnected from its adjacent storage space C, then storage spaces A and B are assigned to the same space set U1. Storage spaces B and C, which are disconnected, are assigned to different space sets, with storage space C assigned to space set U2. This results in two space sets, U1 and U2. In this case, the motor Wa of storage space A in space set U1 can be used as the working motor, and its operating state can be set to "on." The motor Wb of storage space B can be set to "off," allowing storage spaces A and B in space set U1 to share a single motor Wa. Similarly, in space set U2, the motor Wc of storage space C can be used as the working motor, and its operating state can be set to "on." When storage space B is also interconnected with the adjacent storage space C, storage spaces A, B, and C are assigned to the same space set U1. At this time, the motor Wa of storage space A in space set U1 is still used as the working motor, and the operating state of the working motor Wa is adjusted to start. At the same time, the operating states of the motor Wb of storage space B and the motor Wc of storage space C are adjusted to be off. Storage spaces A, B, and C in space set U1 share a single motor Wa.

[0026] In some embodiments, second image information of the stored items is acquired at preset time intervals, and the second image information is compared with historical image information acquired in the previous preset time interval. If the comparison is inconsistent, it is determined whether any stored items have entered the storage space. If so, the attributes of the stored items are determined based on the second image information, and the operating efficiency of the corresponding motor in the storage space is adjusted according to the attributes of the stored items. The operating efficiency of the motor is used to adjust the storage temperature in the storage space, and the storage temperature in the storage space can be adjusted individually. In this way, the storage temperature of each storage space is dynamically adjusted, and the storage temperature of each storage space is automatically set according to the attributes of the items, so that the preservation of the items will not be affected by a single storage temperature.

[0027] Specifically, when the second image information is inconsistent with the historical image information, it means that there are stored items that have been taken out or put into the current storage space. Therefore, it is necessary to count the number of all stored items in the second image information and the historical image information respectively, and judge whether there are stored items entering the storage space by the change in the number of stored items in the two image information.

[0028] Specifically, assuming each storage space is empty of any stored items (i.e., no stored items), the storage category of each storage space is undetermined. Only after an item enters the storage space, and its attributes are determined based on the second image information, is the storage category of the current storage space set to the attribute of that item. For example, when storage space A is empty, its storage category is undetermined. However, once an apple is placed in storage space A, and the second image information determines that the item's attribute is fruit, the storage category of storage space A is also set to fruit accordingly.

[0029] Specifically, each type of stored item has a preset suitable storage temperature range. Once the storage item's attributes are confirmed, the storage temperature range T1 of the newly entered item is compared with the current storage temperature range T2. The intersection of T1 and T2 is selected as the new storage temperature range T3, thus ensuring compatibility with the storage temperatures of all items within the current storage space. If no intersection exists, the user is prompted to change storage spaces for placement.

[0030] In some embodiments, before determining the attributes of the stored items based on the second image information, the storage time of the stored items is determined based on the second image information; the effective storage time of the stored items is calculated based on the storage temperature in the storage space and the storage time; and a first reminder message is generated periodically based on the effective storage time and sent to the client. In this way, the storage time of the stored items is recorded, the effective storage time of the stored items is estimated, and a first reminder message is generated to remind the user, preventing items from expiring or deteriorating due to user forgetfulness. This effectively manages the stored items inside the storage device, making the storage process more user-friendly and optimizing the user experience.

[0031] Specifically, a first reminder message can be generated when the effective storage time is reached to remind the user to take out the item, thereby enhancing the item's shelf life and utilization rate.

[0032] Specifically, a first reminder message can be generated at a certain time before the effective storage time to remind the user that the item has been left for too long, prompting the user to use it and making it less likely to forget the stored items, thus making the storage device more intelligent.

[0033] In some embodiments, third image information captured by cameras in the storage space is acquired at preset intervals, and the storage items in the storage space are determined based on the third image information to determine whether they have spoiled. If so, a second prompt message is generated based on the third image information and sent to the client. In this way, when a stored item spoils, the user is promptly reminded to clean up the spoiled item through the second prompt message, preventing the spoiled item from affecting other stored items and ensuring a hygienic environment inside the storage equipment.

[0034] Specifically, the similarity between the acquired third image and the second image obtained when the stored item was first placed in the storage space can be calculated using a trained neural network model. If the similarity between the two images is low, it is determined that the stored item has spoiled. Alternatively, the acquired third image can be used to identify whether the stored item shows signs of mold, mildew spots, or other moldy characteristics; if so, it is determined that the stored item has spoiled.

[0035] In some embodiments, after acquiring third image information of each storage space according to a preset period, a preset odor sensor detects whether the odor information of each storage space is abnormal. If the odor information detection result is abnormal, a third prompt message is generated and sent to the client. In this way, it is possible to quickly detect whether the items inside the storage space have deteriorated, realize comprehensive item storage monitoring and management, and optimize the user's storage experience.

[0036] In some embodiments, after determining whether the stored items in the storage space have deteriorated based on the third image information, the storage category of each storage space is obtained; if the storage category of the storage space is plants, it is determined whether the stored items have entered a withered state based on the third image information; and if so, a preset watering device is controlled to perform watering. In this way, the preservation time of plant items inside the storage space is extended, and by controlling the watering device to perform automatic watering, effective management and storage of stored items are achieved.

[0037] Specifically, the stored item can be identified by using the acquired third image information and a trained neural network model to determine whether it has features such as yellow leaves or curled edges. If so, the stored item is determined to be in a dried-out state.

[0038] The first image information, the second image information, and the third image information can all be processed using steps S102 to S108.

[0039] Figure 2 This is a flowchart illustrating a method for controlling a storage device according to an embodiment of the present invention. (Refer to...) Figure 2 As shown, the first, second, and third image information are input into the storage classification model to determine the corresponding category of the stored items within each image. Specifically, it first determines whether the stored item belongs to the vegetable category; if not, it determines whether the stored item belongs to the fruit category; if not, it determines whether the stored item belongs to the seafood category, and so on, until the storage category of the stored item is determined. After determining the storage category of the stored item, the storage temperature of the storage space corresponding to that item is adjusted, and the storage time of the stored item is recorded according to the image information. The effective storage time of the stored item is calculated based on the storage temperature in the storage space and the storage time. It is periodically checked whether the storage time of the stored item has exceeded the effective storage time, and at the same time, it is checked whether the stored item has deteriorated. Based on the results of the judgment, corresponding prompt information is generated to remind the user to take appropriate measures to handle the stored item.

[0040] According to another aspect of the invention, Figure 3 This is a schematic diagram illustrating the structure of a storage device according to an embodiment of the present invention. (Refer to...) Figure 3 The storage device 200 includes an intelligent control unit and multiple storage spaces 201. Adjustable partitions 202 are provided between adjacent storage spaces 201. Each storage space 201 contains a motor 203 and a camera 204. The intelligent control unit is electrically connected to the adjustable partitions 202, the motors 203, and the cameras 204, respectively. The intelligent control unit is configured to execute the various steps of the method for controlling the storage device described above. The intelligent control unit does not... Figure 3 As shown in the image. Figure 3As an example of a storage space implementation that differs from existing technologies, the size and number of individual storage spaces can be adjusted according to the size of the refrigerator; additionally, Figure 3 The sealing strip and other structures, which are consistent with those in existing refrigerators, are not shown.

[0041] Specifically, a through hole 2011 is provided between adjacent storage spaces 201, and an adjustable partition 202 is provided on one side of the through hole 2011. The adjustable partition 202 covers the through hole 2011 so that the connection state between adjacent storage spaces can be switched to interconnection or separation.

[0042] In some embodiments, the storage device further includes an odor sensor 205 and a water spraying device 206. The odor sensor 205 is disposed on the side wall of the storage space 201, and the water spraying device 206 is disposed on the top wall of the storage space 201. In this way, odor monitoring inside the storage device and preservation treatment of plant items can be achieved.

[0043] In summary, the method and storage device for controlling the storage equipment provided by this invention firstly divide the storage area of ​​the storage device into multiple storage spaces, each with an independently adjustable storage temperature. This avoids the impact of a single storage temperature on item preservation and optimizes the user experience. Simultaneously, it acquires first image information of each storage space, automatically identifying and determining the storage category of the current storage space based on this information. The connectivity between storage spaces is then adjusted accordingly. When two adjacent storage spaces contain similar or identical storage categories, they require similar temperatures. Therefore, they can be connected to achieve the same temperature. Simultaneously, the operating status of the motors corresponding to each storage space is adjusted, ensuring proper item storage while avoiding excessive energy consumption due to a large number of motors in the storage space. Secondly, by monitoring whether items enter the storage space and recording the corresponding entry time, the storage time of the items is determined, preventing spoilage caused by prolonged storage. Simultaneously, it can effectively empty the stored items within the storage space, ensuring their proper storage. Finally, by monitoring the state of the stored items through image processing, it can determine whether any items have spoiled, thus extending their freshness and maintaining a hygienic environment within the storage equipment. This achieves intelligent and user-friendly storage, enhancing the user's storage experience.

[0044] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A method of controlling a storage device, characterized by, include: Acquire first image information captured by each storage space within the storage device; The storage category of the stored items in the storage space is determined based on the first image information; The connection between adjacent storage spaces is adjusted by controlling a preset switch according to the storage category. as well as Based on the connectivity status, the operating status of the corresponding motors in adjacent storage spaces is adjusted respectively. The method of controlling a preset switch to adjust the connectivity between adjacent storage spaces according to the storage category includes: determining whether the storage categories of adjacent storage spaces are the same; If they are the same, then it is detected whether the connection state between adjacent storage spaces is interconnected; if not, the preset switch is controlled to adjust the connection state to interconnected. If they are different, then it is detected whether the connection state between adjacent storage spaces is isolated; if not, the preset switch is controlled to adjust the connection state to isolated.

2. The method according to claim 1, characterized in that, Adjusting the operating status of the corresponding motors in adjacent storage spaces according to the connectivity status includes: Based on the connectivity state, adjacent storage spaces are divided into at least one space set; and For each of the at least one space set, select at least one motor corresponding to the storage space as the working motor, adjust the operating state of the working motor to start, and adjust the operating state of the corresponding motors of other storage spaces under the same space set to stop.

3. The method according to claim 2, characterized in that, Dividing adjacent storage spaces into at least one space set based on the connectivity status includes: The interconnected and adjacent storage spaces are grouped into the same space set.

4. The method according to claim 1, characterized in that, Also includes: Acquire second image information of the stored items at preset time intervals; The second image information is compared with the historical image information obtained in the previous preset time period; If the comparison is inconsistent, it is determined whether any stored items have entered the storage space; If so, the attributes of the stored items are determined based on the second image information; as well as The operating efficiency of the corresponding motor in the storage space is adjusted according to the properties of the stored items. The operating efficiency of the motor is used to adjust the storage temperature in the storage space, which can be adjusted independently.

5. The method according to claim 4, characterized in that, Before determining the attributes of the stored item based on the second image information, the process also includes: The storage time of the stored items is determined based on the second image information; The effective storage time of the stored items is calculated based on the storage temperature within the storage space and the storage time; and A first prompt message is generated periodically based on the effective storage time, and the first prompt message is sent to the client.

6. The method according to claim 1, characterized in that, Also includes: The third image information captured by the storage space is acquired according to a preset period; Based on the third image information, determine whether the stored items in the storage space have deteriorated; as well as If so, a second prompt message is generated based on the third image information, and the second prompt message is sent to the client.

7. The method according to claim 6, characterized in that, After acquiring the third image information captured by the storage space according to a preset period, the method further includes: The storage space is detected for any abnormal odor information using a pre-set odor sensor; and If the detection result of the odor information is abnormal, a third prompt message is generated and sent to the client.

8. The method according to claim 6, characterized in that, After determining whether the stored items in the storage space have deteriorated based on the third image information, the process further includes: Obtain the storage category of the storage space; If the storage category is plants, then the third image information is used to determine whether the stored items have entered a dried-out state; and If so, the preset water spraying device will be controlled to perform water spraying.

9. A storage device, characterized in that, The device includes an intelligent control unit and multiple storage spaces. Adjustable partitions are provided between adjacent storage spaces. Each storage space contains a motor and a camera. The intelligent control unit is electrically connected to the adjustable partitions, the motors, and the cameras, respectively. The intelligent control unit is configured to perform the method according to any one of claims 1 to 8.

10. The storage device according to claim 9, characterized in that, It also includes an odor sensor and a water spraying device, wherein the odor sensor is disposed on the side wall of the storage space and the water spraying device is disposed on the top wall of the storage space.

Images