Drink storage management method for storage cabinet, storage cabinet, and storage medium

Abstract

This invention discloses a beverage storage management method, a storage cabinet, and a storage medium, comprising: upon identifying a beverage to be stored, acquiring a first appearance image of the beverage; performing feature recognition on the first appearance image to extract key information in at least two feature dimensions, wherein the feature dimensions include at least beverage color, beverage texture, packaging material, and packaging text, and the key information is associated with the beverage type to which the beverage to be stored belongs; determining the target beverage type to which the beverage to be stored belongs based on the key information; determining a recommended refrigerated compartment based on the target beverage type and displaying the recommended refrigerated compartment on a display screen, wherein the storage cabinet is provided with at least two refrigerated compartments, each of which has an independent temperature control system, and the indoor environment of the recommended refrigerated compartment matches the recommended storage conditions for the target beverage type.

Description

Technical Field

[0001] This invention relates to the field of smart home appliance technology, and in particular to a method for managing beverage storage in a locker, the locker itself, and a storage medium. Background Technology

[0002] Nowadays, there are many types of beverages on the market, and the optimal storage temperature for each type of beverage varies greatly.

[0003] In related technologies, images are captured by a camera in front of the refrigerator, and the volume and type of food and beverages are determined based on an intelligent recognition system, which then suggests whether to place them in the refrigerator or freezer.

[0004] However, the solutions provided by related technologies often only classify food and beverages into broad categories through intelligent recognition systems. For example, by taking a picture of the item to be stored, the intelligent recognition system can only determine whether it is a vegetable, meat, or beverage. It cannot determine the different types of beverages. Therefore, the accuracy of beverage type identification provided by related technologies is low, resulting in inaccurate storage suggestions. Summary of the Invention

[0005] The purpose of this invention is to provide a beverage storage management method, a storage cabinet, and a storage medium. This method enables automatic classification of various beverages and selection of optimal storage compartments. Based on ingredient list discrimination strategies and dynamically updated database information, it accurately identifies beverage types and their optimal storage temperature conditions, allowing users to place different types of beverages in suitable refrigerated environments without manual intervention, and providing timely reminders when expiration dates are approaching.

[0006] To achieve one of the aforementioned objectives, one embodiment of this application provides a beverage storage management method for a locker, comprising:

[0007] Upon identifying a beverage to be stored, a first appearance image of the beverage to be stored is obtained; feature recognition is performed on the first appearance image to extract key information in at least two feature dimensions, wherein the feature dimensions include at least beverage color, beverage texture, packaging material and packaging text, and the key information is associated with the beverage type to which the beverage to be stored belongs.

[0008] Based on the aforementioned key information, the target beverage type of the beverage to be stored is determined;

[0009] Based on the target beverage type, a recommended refrigerated room is determined and displayed on a display screen. The storage cabinet is equipped with at least two refrigerated rooms, each with an independent temperature control system. The indoor environment of the recommended refrigerated room matches the recommended storage conditions for the target beverage type.

[0010] As a further improvement to this application, the step of determining the target beverage type of the beverage to be stored based on the key information includes:

[0011] Based on key information from at least one feature dimension, a similarity comparison is made with the beverage type information corresponding to each candidate beverage type to obtain type similarity.

[0012] The candidate beverage type with the highest type similarity and the type similarity reaching the similarity threshold is determined as the target beverage type.

[0013] As a further improvement to this application, the method also includes:

[0014] If the type similarity of each candidate beverage type does not reach the similarity threshold, identify whether there is ingredient list information in the first appearance image;

[0015] If not, a first prompt message is displayed on the display screen, which prompts the user to rotate the beverage so that the surface of the ingredients faces the camera component; and a second appearance image is captured by the camera component.

[0016] If so, then the keywords of the packaging text dimension are obtained from the ingredient list information, and the keywords are used to indicate the category of the main ingredients in the beverage to be stored;

[0017] The process of determining the target beverage type of the beverage to be stored based on the key information includes:

[0018] Based on the keywords, the target beverage type to which the beverage to be stored belongs is determined.

[0019] As a further improvement to this application, when at least two sets of the keywords are identified, determining the target beverage type to which the beverage to be stored belongs based on the keywords includes:

[0020] The target beverage type to which the beverage to be stored belongs is determined based on the primary keyword from at least two sets of the keywords, wherein the primary keyword is located before the other keywords in the ingredient list.

[0021] As a further improvement to this application, after determining the target beverage type to which the beverage to be stored belongs based on the keyword, the method further includes:

[0022] Identify key information in each feature dimension of the second appearance image;

[0023] Based on the aforementioned key information, supplement the beverage type information corresponding to the target beverage type.

[0024] As a further improvement to this application, the method also includes:

[0025] Determine the spoilage date of the beverage to be stored;

[0026] If the beverage to be stored is detected to be stored in the recommended cold storage room, the beverage information of the beverage to be stored is stored in the list of stored beverages, and the beverage information includes the spoilage date;

[0027] The system iterates through the list of stored beverages. If a stored beverage reaches its reminder time, a second reminder message is displayed on the screen. The second reminder message is used to remind the user that the stored beverage is about to spoil.

[0028] As a further improvement to this application, determining the spoilage date of the beverage to be stored includes:

[0029] The shelf life of the beverage to be stored is determined based on the target beverage type corresponding to the beverage to be stored;

[0030] A third prompt message is displayed on the display screen, which prompts the user to move the beverage to be stored and shows the production date to the camera component.

[0031] The spoilage date is determined based on the production date and the shelf life.

[0032] As a further improvement of this application, when the third prompt information is displayed, an input method switching control is also displayed on the display screen;

[0033] The method further includes:

[0034] Upon receiving a trigger operation on the input method switching control, a keyboard control is displayed on the display screen, along with a fourth prompt message, which prompts the user to manually enter the production date.

[0035] As a further improvement to this application, the beverage information in the stored beverage list also includes the first appearance image of the stored beverage, and the method further includes:

[0036] When the removal of the stored beverage is detected, a third appearance image of the removed stored beverage is acquired;

[0037] Based on the third appearance image, the image features are compared with the first appearance image of the stored beverage in the stored beverage list to determine the beverage information corresponding to the beverage to be taken out.

[0038] Remove the beverage information corresponding to the retrieved beverage from the stored beverage list.

[0039] As a further improvement to this application, the method also includes:

[0040] If the stored beverage is not detected to have been removed after the reminder time, a second reminder will be given to the user according to a preset mode, which includes at least one of voice reminder and terminal message push reminder.

[0041] On the other hand, one embodiment of this application provides a storage medium having a computer program stored thereon, which, when executed by a processor, performs the beverage storage management method for a locker as described in any of the above aspects.

[0042] On the other hand, one embodiment of this application provides a locker including at least two refrigerated compartments, a display screen, a camera assembly, and a processor, the processor being used to execute a computer program to implement the beverage storage management method for the locker as described in any of the above aspects.

[0043] Compared with the solutions provided by related technologies, the beneficial effects of the present invention are as follows:

[0044] In this embodiment, by capturing an image of the beverage to be stored and analyzing its appearance using multi-dimensional features, the type of beverage to be stored is determined, improving the accuracy and robustness of beverage type identification. Furthermore, after determining the beverage category, suggestions for refrigerator compartments are provided based on different beverage categories, which helps to store different types of beverages at the most suitable temperature to ensure beverage quality. Moreover, no additional information needs to be entered by the user or repeated adjustments to the refrigerator settings, achieving intelligent and automated management of the entire beverage storage process. Attached Figure Description

[0045] Figure 1 A schematic diagram of an implementation environment provided by an illustrative embodiment of this application is shown;

[0046] Figure 2 A flowchart illustrating a beverage storage management method for a locker provided in an illustrative embodiment of this application is shown.

[0047] Figure 3 A flowchart illustrating a process for determining a target beverage type according to an illustrative embodiment of this application is shown;

[0048] Figure 4 A flowchart illustrating a spoilage alert process provided in an illustrative embodiment of this application is shown.

[0049] Figure 5 This application illustrates a flowchart of a beverage storage management process according to an illustrative embodiment.

[0050] Figure 6 A schematic diagram of the structure of a locker provided in an illustrative embodiment of this application is shown. Detailed Implementation

[0051] The present invention will now be described in detail with reference to the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and any structural, methodological, or functional modifications made by those skilled in the art based on these embodiments are included within the scope of protection of the present invention.

[0052] It should be noted that the term "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Furthermore, the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0053] Please refer to Figure 1 The diagram illustrates an implementation environment provided by an exemplary embodiment of this application, including a locker 110 and a server 120.

[0054] The locker 110 includes a camera assembly 111, a display screen 112, a processor 113, and at least two refrigerated compartments (not shown in the figure). The camera assembly 111, possibly located on the locker door, captures an image of the beverage to be stored. This image is then transmitted to the processor 113, which performs feature recognition on the image, extracting key information from at least two feature dimensions to determine the target beverage type and identify a recommended refrigerated compartment. After the processor 113 determines the target beverage type, it controls the display screen 112 to display the recommended refrigerated compartment, thus providing a prompt to the user.

[0055] Server 120 can be a standalone server supporting various services, or it can be configured as a server cluster. A communication connection exists between the locker and the server. This connection can be wired, such as a serial port connection, or wireless, such as a Wi-Fi (Wireless Fidelity) connection or a Bluetooth connection. When processor 113 determines the target beverage type based on key information in the first appearance image, it can send a beverage type information retrieval request to server 120 through this communication connection, thereby retrieving the beverage type information corresponding to each beverage type from the beverage database stored on server 120.

[0056] This is illustrative; please refer to it. Figure 1 When the storage locker identifies the beverage to be stored based on the camera component 111, it captures a first appearance image of the beverage. Subsequently, the processor 113 performs feature recognition on the first appearance image and obtains beverage type information from the server 120 to determine the target beverage type. Finally, based on the target beverage type, it determines a suggested refrigerated compartment and displays the suggested refrigerated compartment on the display screen 112. Alternatively, when the processor 113 acquires the first appearance image, it sends the first appearance image to the server 120. The server 120 determines the target beverage type based on the first appearance image and beverage type information in the beverage database, and returns the determined target beverage type to the processor 113, which then determines the suggested refrigerated compartment.

[0057] It should be noted that, in this application, at least two cold storage rooms each have independent temperature control systems. Therefore, when storing different types of beverages, the indoor environments of the at least two cold storage rooms will be different, and the indoor environment may include temperature and humidity.

[0058] Please refer to Figure 2 The illustration shows a flowchart of a beverage storage management method for a locker provided in an illustrative embodiment of this application. The method is performed by the locker and includes the following steps:

[0059] Step 201: If the beverage to be stored is identified, obtain a first appearance image of the beverage to be stored.

[0060] When a camera component installed on the door of the locker detects the presence of a beverage to be stored, it acquires a first visual image of the beverage.

[0061] Step 202: Perform feature recognition on the first appearance image and extract key information from at least two feature dimensions.

[0062] The feature dimensions include at least the beverage color, texture, packaging material, and packaging text, with key information related to the beverage type to be stored. The packaging text can be obtained using optical character recognition (OCR) technology. The locker uses OCR technology to preprocess the initial appearance image, extract and classify text features, thereby obtaining key information from different feature dimensions.

[0063] Different beverages have certain characteristic patterns in terms of color, texture, and packaging material. For example, milk-based beverages are usually milky white in color, and the packaging is usually paper-based. The text on the packaging may include the word "milk." Milk and yogurt may have the same color, packaging material, and key text on the packaging. However, the texture of the beverage can be used as an auxiliary judgment condition to more accurately determine the type of beverage to be stored. Therefore, obtaining key information from at least two characteristic dimensions is beneficial for accurately determining the target beverage type of the beverage to be stored.

[0064] Step 203: Based on key information, determine the target beverage type to which the beverage to be stored belongs.

[0065] Key information can characterize the beverage to be stored in at least two dimensions. Therefore, the key information of the beverage to be stored can be compared with the general characteristics corresponding to different beverage types to determine the target beverage type to which the beverage to be stored belongs.

[0066] Step 204: Based on the target beverage type, determine the recommended refrigerated room and display the recommended refrigerated room on the display screen.

[0067] The locker is equipped with at least two refrigerated compartments, each with its own independent temperature control system. It is recommended that the indoor environment of the refrigerated compartments be matched with the recommended storage conditions for the target beverage type.

[0068] To meet the optimal storage needs of different beverages, the storage cabinet can be divided into multiple independent temperature-controlled compartments. For example, compartment 1 corresponds to a temperature of approximately 1-2℃ for milk and dairy products, compartment 2 to approximately 3-4℃ for carbonated beverages, compartment 3 to approximately 5-6℃ for fruits, vegetables, and teas, and compartment 4 to approximately 7-8℃ for coffee. Once the user places the identified beverage into the corresponding compartment, it will achieve ideal storage conditions, improving the taste and shelf life of the beverage. Furthermore, users do not need to manually adjust the temperature settings or input additional information, enhancing the level of intelligence and convenience.

[0069] It should be noted that the at least two refrigerated compartments involved in the embodiments of this application are mainly used for refrigerating beverages. In addition, there may be other refrigerated compartments or freezer compartments in the storage cabinet.

[0070] In summary, this embodiment of the application improves the accuracy and robustness of beverage type identification by capturing images of the beverage's appearance and analyzing its multi-dimensional features. Furthermore, after determining the beverage category, suggestions for refrigerator compartments are provided based on different beverage categories, which helps to store different types of beverages at the most suitable temperature to ensure beverage quality. Moreover, it eliminates the need for users to input additional information or repeatedly adjust refrigerator settings, achieving intelligent and automated management of the entire beverage storage process.

[0071] Since the target beverage type is determined based on key information in the first appearance image of the item to be stored in this embodiment, and the recommended refrigerated room needs to be determined based on the confirmed target beverage type, the accuracy of determining the target beverage type is particularly important. The following illustrative embodiment will illustrate the method for determining the target beverage type.

[0072] Please refer to Figure 3 The illustration shows a flowchart of a process for determining a target beverage type according to an illustrative embodiment of this application, the process including the following steps:

[0073] Step 301: Based on key information of at least one feature dimension, compare the similarity with the beverage type information corresponding to each candidate beverage type to obtain the type similarity.

[0074] The beverage type information may be stored in the local beverage database of the locker or in a beverage database on a cloud server. The beverage type information for each candidate beverage type includes the appearance information of each candidate beverage type under normal circumstances. For example, the beverage type information for milk beverages may include color dimension features describing its color as milky white, packaging dimension features describing its packaging as paper, and so on.

[0075] Optionally, the beverage database stores information on each candidate beverage type under different feature dimensions. For example, the beverage database stores data as shown in the table below:

[0076] Beverage color Beverage texture Packaging material Packaging text milk milky thin Paper, plastic "Milk" or "cow's milk" yogurt milky Thick Paper, plastic "Yogurt" "Lactic acid"

[0077] Based on the table above, it can be seen that different candidate beverage types have corresponding information in different feature dimensions. Therefore, based on the obtained key information, similarity matching can be performed with the information in the feature dimensions corresponding to the candidate beverage types to obtain the type similarity between the beverage to be stored and different candidate beverage types.

[0078] Step 302: The candidate beverage type with the highest type similarity and the type similarity reaching the similarity threshold is determined as the target beverage type.

[0079] The candidate beverage type that has the highest similarity to the type of beverage to be stored indicates that the type of beverage to be stored is most likely to belong to that candidate beverage type.

[0080] In one possible implementation, the type similarity among the candidate beverage types may be relatively low, meaning that even candidate beverage types with similarity cannot be identified as the target beverage type. Therefore, a preset similarity threshold can be used to further limit the target beverage type.

[0081] By comparing the similarity of different types and using the similarity threshold as a condition, the target beverage type can be quickly determined, which helps to improve the accuracy of the matching.

[0082] Optionally, regularly updating the type information of each candidate beverage type in the beverage database based on new beverages appearing on the market can help maintain matching accuracy.

[0083] In another possible implementation, the locker identifies brand identifiers, such as trademarks, in the packaging based on the first appearance image, and the beverage type information corresponding to each candidate beverage type includes brands that may produce that beverage type and their brand identifiers. Therefore, in the process of determining the target beverage type, if the locker identifies a brand identifier contained in the first appearance image, it can filter candidate beverage types produced by that brand identifier from the beverage database based on the brand identifier, and then determine the target beverage type based on type similarity.

[0084] Step 303: If the type similarity of each candidate beverage type does not reach the similarity threshold, identify whether there is ingredient list information in the first appearance image.

[0085] If the type similarity of each candidate beverage type is greater than the similarity threshold, it indicates that there is no target beverage type among the candidate beverage types to which the beverage to be stored belongs.

[0086] Since the main ingredients of a beverage are listed in the product's ingredients list—for example, vegetables are always included in the ingredients list of a fruit juice—the type of beverage to be stored can be determined based on the ingredient list of the beverage to be stored.

[0087] First, it is necessary to determine whether the ingredient list is present or absent in the first appearance image taken. The following will explain the two judgment results separately.

[0088] Scenario A: If not, a first prompt message is displayed on the screen, prompting the user to rotate the beverage so that the topping surface faces the camera component; a second appearance image is captured by the camera component.

[0089] If the ingredient list is not present in the first appearance image, a first prompt message is displayed on the screen to guide the user to rotate the beverage so that the ingredient surface faces the camera component, and the camera component captures the second appearance image. At this time, optical character recognition (OCR) technology is used to recognize and extract the ingredient list text content in the second appearance image.

[0090] Scenario B: If so, then obtain the keywords from the packaging text dimension of the ingredient list information.

[0091] Keywords are used to indicate the category of the main ingredients in the beverage to be stored. For example, the keyword could be "milk," "dairy," "carbon dioxide," "fruit and vegetables," "tea," or "coffee," which can also indicate the type of beverage to be stored.

[0092] Step 304: Based on keywords, determine the target beverage type to which the beverage to be stored belongs.

[0093] Once keywords are identified, the target beverage type can be determined based on the ingredients list keywords. For example, if the ingredients list contains "carbon dioxide", the beverage to be stored is most likely a sparkling beverage. If the ingredients list contains "coffee", the beverage to be stored is most likely a coffee beverage.

[0094] With regular updates and improvements to the database, even new products or beverages that cannot be directly matched through similarity analysis can have their target beverage type accurately determined through ingredient list analysis, and the appropriate cold storage room can be recommended.

[0095] In one possible implementation, if at least two sets of keywords are identified, the target beverage type to which the beverage to be stored belongs is determined based on the primary keyword among the at least two sets of keywords.

[0096] In the ingredient list, the main keyword is placed before the other keywords.

[0097] For example, after keyword identification of the ingredient list, if two sets of keywords are obtained: "fruits and vegetables" and "tea," and "fruits and vegetables" appears earlier in the ingredient list, then the beverage type is determined to be fruit and vegetable beverage. As another example, when both "milk" and "fruits and vegetables" appear in the ingredient list, if the keyword "milk" appears before "fruits and vegetables," then "milk" is considered the primary keyword, and the beverage is classified as a milk, dairy product, or beverage type.

[0098] Based on the logic of determining the order of keywords in the ingredient list, the system effectively avoids ambiguity in the classification of multi-ingredient beverages. Furthermore, combined with a strategy of regularly updated cloud databases, the processor can quickly determine the optimal storage room recommendation even when dealing with emerging or multi-category beverages. Moreover, it eliminates the need for users to manually input beverage type information, thus enhancing its level of automation.

[0099] In one possible implementation, after determining the target beverage type using ingredient list keywords, the photographic component identifies key information in each feature dimension of the second appearance image, and supplements the beverage type information corresponding to the target beverage type based on this key information. That is, when a second appearance image has already been captured, key information in each feature dimension of the previously captured second appearance image can be identified and analyzed. By obtaining feature information such as packaging material, text content, color, and texture from the second appearance image and comparing it with beverage type information in the beverage database, the beverage type information corresponding to the determined target beverage type can be further supplemented and improved.

[0100] In this embodiment, determining the type matching degree between the beverage to be stored and candidate beverage types based on key information to identify the target beverage type is a diverse beverage identification method that can effectively improve the accuracy of beverage type identification. Furthermore, when candidate beverage types in the database cannot be successfully matched, the target beverage type can be determined based on ingredient list information, resulting in a higher degree of automation and making the method provided in this embodiment more applicable. Moreover, supplementing the beverage type information based on a second appearance image improves the robustness and accuracy of identification, which is beneficial for the implementation of subsequent storage management and reminder mechanisms.

[0101] In another possible implementation, after the beverage is stored in the corresponding refrigerated room, since the beverage has a certain shelf life and different types of beverages have different shelf lives, in order to prevent forgetting, users can be reminded in a timely manner when it is about to spoil, so as to avoid waste.

[0102] The following illustrative example will illustrate the process of providing spoilage date reminders. Please refer to [link / reference]. Figure 4 The illustration shows a flowchart of a spoilage alert process provided in an illustrative embodiment of this application. The process includes:

[0103] Step 401: Determine the spoilage date of the beverage to be stored.

[0104] First, based on the target beverage type, determine the shelf life and production date of the beverage to be stored. Then, the spoilage date of the beverage can be determined, that is, the spoilage date is determined based on the production date and shelf life.

[0105] On the one hand, when determining shelf life, since the beverage type is already determined before it is stored in the refrigerated room, and the typical shelf life range for the same type of beverage is fixed. Optionally, the typical shelf life range for that type of beverage can be pre-stored in a database; for example, the shelf life of dairy beverages is usually 7-15 days, and the processor can automatically retrieve the corresponding data.

[0106] In some embodiments, the shelf life of the same beverage may differ depending on the packaging. For example, milk in paper packaging and milk in bottled packaging may have different shelf lives. Therefore, the electronic device can further determine the shelf life of the beverage based on the characteristics of the packaging material dimension identified from the first appearance image.

[0107] Optionally, if it is necessary to determine the specific shelf life, the presence of shelf life information in the second appearance image can be identified. Typically, this shelf life information is located below the ingredient list information, thus allowing for the determination of the accurate shelf life.

[0108] On the other hand, the shelf life of the beverage to be stored can be determined through the following two methods.

[0109] I. Camera Recognition

[0110] When storing the beverage, a third prompt message is displayed on the screen. This prompt message instructs the user to move the beverage so that its production date is facing the camera component. In other words, when the production date information is needed, the third prompt message guides the user to move the beverage so that its production date is facing the camera component for identification. By recognizing the production date using OCR and calculating it against the known shelf life, the spoilage date can be accurately determined.

[0111] Once the spoilage date of the beverage to be stored is recorded, the process of determining the spoilage date can be controlled more precisely. Spoilage dates determined through camera recognition are more reliable and accurate, and users no longer need to manually input the date. This effectively reduces the risk of misjudgment and operational complexity, improving ease of use while ensuring beverage quality.

[0112] II. Manual Input

[0113] Optionally, when displaying the third prompt message, an input method switching control can also be displayed on the screen. That is, when displaying the third prompt message, in order to accommodate the input habits of different users, an input method switching control can also be displayed on the screen.

[0114] Upon receiving a trigger operation on the input method switching control, the keyboard control is displayed on the screen, along with a fourth prompt message.

[0115] The fourth prompt message is used to prompt the user to manually enter the production date.

[0116] This human-computer interaction method allows users to manually input production dates when the camera component cannot accurately identify them due to privacy, lighting, or angle issues. During this process, the established cloud database and OCR recognition mechanism provide basic information support to quickly calculate spoilage dates and add them to the stored beverage list after the user inputs the date. This method improves compatibility and gives users more freedom of choice. Whether through automatic recognition or manual input, it ensures accurate management of spoilage dates for stored beverages and provides reminders when spoilage is approaching, enhancing user experience and reliability.

[0117] Step 402: If the beverage to be stored is detected to be stored in the recommended refrigerated room, the beverage information of the beverage to be stored is added to the list of stored beverages.

[0118] The beverage information includes the expiration date. For example, when consumers store beverages with short shelf lives, such as milk, dairy products, and related drinks, the shelf life of these beverages can be pre-recorded in a cloud database. After the door camera identifies the production date, the expiration date is calculated and recorded in the beverage information.

[0119] Optionally, after determining the spoilage date, the processor calculates the reminder time that needs to be given to the user based on the spoilage date. For example, if the spoilage date is December 23, 2024, and the reminder is given three days before the spoilage date, then the reminder time is December 20, 2024.

[0120] Optionally, beverage information may include the type of beverage, multiple dimensions of features of the first appearance image, the second appearance image, the third appearance image, the time the beverage was stored, the refrigerated room where the beverage was stored, and the date of spoilage, etc.

[0121] Step 403: Iterate through the list of stored drinks. If a stored drink reaches the reminder time, display a second reminder message on the display screen.

[0122] The second notification message is used to alert users that their stored beverages are about to spoil.

[0123] To ensure users access or retrieve their beverages at the appropriate time, the locker can cycle through the list of stored beverages daily to find the expiration date for each beverage. For example, if the list of stored beverages is checked at 8:00 AM every day, a second reminder message will be displayed on the screen if a stored beverage is detected to be nearing its expiration date, indicating that the beverage is about to spoil.

[0124] In some embodiments, if the beverage is stored in the locker after the reminder time has passed, the processor can directly control the display screen to show the first reminder message at the time the beverage is stored, thereby reminding the user that it is about to spoil.

[0125] Step 404: If no stored beverage is detected to have been removed after the reminder time, a second reminder is sent to the user according to the preset mode.

[0126] The preset modes include at least one of voice reminders and terminal message push reminders.

[0127] If the user does not remove the beverage in time, the processor can also provide a second reminder through sound and push notifications from the smart home app, thereby reducing waste and improving the user experience without requiring cumbersome user operations.

[0128] For example, if the locker issues its initial warning but the user hasn't retrieved a beverage nearing spoilage, the processor can emit a "tick" sound via a built-in buzzer or speaker, and then send a notification to the user's mobile device via the smart home app, ensuring the user is aware of the information even when not near the locker. By combining beverage type identification, categorization, spoilage date calculation, and inventory management, this implementation provides intelligent, timely, and diverse reminders throughout the entire process, reducing beverage waste and improving user convenience.

[0129] In one possible implementation, after the beverage information (including the spoilage date and first appearance image) of the beverage to be stored is stored in the list of stored beverages, the dynamic management of the stored beverages can be further achieved through the following steps.

[0130] When a stored beverage is detected to have been removed, a third appearance image of the removed stored beverage is acquired. Then, based on this third appearance image, an image feature comparison is performed with the first appearance images of stored beverages in the stored beverage list to determine the beverage information corresponding to the removed beverage. Finally, the beverage information corresponding to the removed beverage is deleted from the stored beverage list.

[0131] By comparing the features of the third appearance image with the first appearance image of the beverage previously stored in the list, the beverage information corresponding to the retrieved beverage can be accurately determined, ensuring consistency between the retrieved beverage and the recorded information. Once a match is successful, the beverage information corresponding to the retrieved beverage is deleted from the stored beverage list, realizing dynamic updates to the list, thereby accurately tracking and managing various beverages stored in the refrigerated room. This is combined with the aforementioned identification, classification, and reminder functions.

[0132] In this embodiment, it can be ensured that users do not need to manually record or search for information throughout the entire beverage storage cycle. The information synchronization and list maintenance during storage, identification, reminders, and retrieval can be completed automatically, reducing the management burden and improving the convenience and reliability of use.

[0133] Please refer to Figure 5 The illustration shows a flowchart of a beverage storage management process provided in an illustrative embodiment of this application. First, the user points the beverage at the camera component, and the processor automatically extracts the color, texture, and text features of the beverage packaging. Then, the processor quickly identifies the target beverage type through feature comparison and displays a suggested refrigerated compartment on the display screen. Simultaneously, the user is reminded to show the production date. The user rotates the bottle with the camera, and the processor uses OCR technology to identify the production date, calculates the spoilage date based on the shelf life, and records a list of stored beverages. Furthermore, without any additional user intervention, the processor controls the display screen to show a reminder message when the beverage is nearing spoilage, prompting the user to remove it. If the user does not remove the beverage in time, an audible alert is issued, and a near-expiration notification is pushed to the terminal.

[0134] Please refer to Figure 6 The illustration shows a schematic diagram of a storage cabinet provided in an illustrative embodiment of this application, including a first refrigerator compartment 611, a second refrigerator compartment 612, a display screen 620, a camera assembly 630, and a processor (not shown in the figure).

[0135] The camera component 630 can be installed at the door to acquire an image of the beverage to be stored and to identify and analyze its features (including beverage color, texture, packaging material, and packaging text). The processor executes a computer program stored in a storage medium to implement the beverage storage management method described above for the locker.

[0136] When a user points the beverage to be stored at the camera component 630, the processor determines the beverage type based on image features. If a direct match is not possible, it categorizes the beverage by identifying keywords such as "milk," "dairy," "carbon dioxide," "fruit and vegetable," "tea," and "coffee" in the ingredient list, and, if necessary, determines the target beverage type based on the order in which these keywords appear. After determining the target beverage type, the processor controls the display screen 620 to show a suggested refrigerated compartment. The first and second refrigerated compartments 611 and 612 in the locker have independent temperature control systems to match the optimal storage temperature for the corresponding beverage type. After storing the information of the beverages to be stored (including the spoilage date) in the stored beverage list, when a beverage is nearing its spoilage date, the processor controls the display screen 620 to display a corresponding prompt. If the user does not retrieve the beverage in time, a reminder can be sent again via preset modes such as voice prompts and mobile terminal push notifications. When the user retrieves the beverage from the locker, the camera component 630 takes another picture of the retrieved beverage's appearance and compares it with the first appearance image in the stored list, thereby automatically updating the list information. The above functions eliminate the need for users to manually input cumbersome information. They enable intelligent identification and classification of beverages, automatic matching of the most suitable storage room, dynamic list updates, and reminders of impending spoilage at the locker device level, thus meeting consumers' dual needs for beverage quality and convenience.

[0137] This application embodiment also provides a non-transitory computer-readable storage medium storing computer instructions. This storage medium stores at least one piece of program code, which is loaded and executed by a processor to implement the beverage storage management method for the locker as described in any of the above embodiments. In implementing the storage medium of this invention, non-volatile storage devices or removable storage media (such as flash memory, memory cards, optical discs, or hard disks) can be used to store the computer program instructions. When the computer program is executed by the processor, the above-described beverage storage management method for the locker will be executed sequentially. Through the program instructions carried by the storage medium, the processor can control the camera component to acquire an image of the beverage to be stored, and perform feature recognition and analysis on the image to determine the target beverage type and the corresponding recommended refrigerated compartment. In cases where direct matching is not possible, the program can perform keyword determination based on the ingredient list, using OCR technology to classify words such as "milk," "dairy," "carbon dioxide," "fruits and vegetables," "tea," and "coffee," and, if necessary, determine based on the order of keywords. Simultaneously, the computer program can record the beverage spoilage date, update the list of stored beverages, and provide reminders via display screen, sound, or terminal message push at the expiration time. When a user retrieves their beverage, the program automatically updates the inventory list by taking a third visual image and comparing its features. Through this automated process, users can achieve automatic beverage identification, optimal storage room matching, spoilage date reminders, and dynamic inventory management within the smart locker without requiring additional input or operation. This simplifies user operations, reduces waste, and enhances convenience and user experience.

[0138] As can be seen from the above embodiments, the solution provided in this application greatly simplifies the process of users manually adjusting the storage environment of different beverages in actual use, and realizes intelligent management of the whole process, such as automatic identification, partitioned storage, near-expiration reminders, and dynamic list management, which effectively improves storage convenience and beverage quality and reduces waste.

[0139] It should be understood that although this specification describes embodiments, not every embodiment contains only one independent technical solution. This way of describing the specification is only for clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.

[0140] The detailed descriptions listed above are merely specific descriptions of feasible embodiments of the present invention, and are not intended to limit the scope of protection of the present invention. All equivalent embodiments or modifications made without departing from the spirit of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for managing beverage storage in a locker, characterized in that, The method includes: Upon identifying the beverage to be stored, a first appearance image of the beverage to be stored is acquired; The first appearance image is subjected to feature recognition to extract key information in at least two feature dimensions. The feature dimensions include at least the beverage color, beverage texture, packaging material, and packaging text. The key information is associated with the beverage type to which the beverage to be stored belongs. Based on the aforementioned key information, the target beverage type of the beverage to be stored is determined; Based on the target beverage type, a recommended refrigerated room is determined and displayed on a display screen. The storage cabinet is equipped with at least two refrigerated rooms, each with an independent temperature control system. The indoor environment of the recommended refrigerated room matches the recommended storage conditions for the target beverage type.

2. The method according to claim 1, characterized in that, The process of determining the target beverage type of the beverage to be stored based on the key information includes: Based on key information from at least two feature dimensions, the similarity is compared with the beverage type information corresponding to each candidate beverage type to obtain the type similarity. The candidate beverage type with the highest type similarity and the type similarity reaching the similarity threshold is determined as the target beverage type.

3. The method according to claim 2, characterized in that, The method further includes: If the type similarity of each candidate beverage type does not reach the similarity threshold, identify whether there is ingredient list information in the first appearance image; If not, a first prompt message is displayed on the display screen, which prompts the user to rotate the beverage so that the surface of the ingredients faces the camera component; and a second appearance image is captured by the camera component. If so, then the keywords of the packaging text dimension are obtained from the ingredient list information, and the keywords are used to indicate the category of the main ingredients in the beverage to be stored; The process of determining the target beverage type of the beverage to be stored based on the key information includes: Based on the keywords, the target beverage type to which the beverage to be stored belongs is determined.

4. The method according to claim 3, characterized in that, If at least two sets of the keywords are identified, determining the target beverage type to which the beverage to be stored belongs based on the keywords includes: The target beverage type to which the beverage to be stored belongs is determined based on the primary keyword from at least two sets of the keywords, wherein the primary keyword is located before the other keywords in the ingredient list.

5. The method according to claim 3, characterized in that, After determining the target beverage type to which the beverage to be stored belongs based on the keyword, the method further includes: Identify key information in each feature dimension of the second appearance image; Based on the aforementioned key information, supplement the beverage type information corresponding to the target beverage type.

6. The method according to claim 1, characterized in that, The method further includes: Determine the spoilage date of the beverage to be stored; If the beverage to be stored is detected to be stored in the recommended cold storage room, the beverage information of the beverage to be stored is stored in the list of stored beverages, and the beverage information includes the spoilage date; The system iterates through the list of stored beverages. If a stored beverage reaches its reminder time, a second reminder message is displayed on the screen. The second reminder message is used to remind the user that the stored beverage is about to spoil.

7. The method according to claim 6, characterized in that, Determining the spoilage date of the beverage to be stored includes: The shelf life of the beverage to be stored is determined based on the target beverage type corresponding to the beverage to be stored; A third prompt message is displayed on the display screen, which prompts the user to move the beverage to be stored and shows the production date to the camera component. The spoilage date is determined based on the production date and the shelf life.

8. The method according to claim 7, characterized in that, When the third prompt message is displayed, an input method switching control is also displayed on the display screen; The method further includes: Upon receiving a trigger operation on the input method switching control, a keyboard control is displayed on the display screen, along with a fourth prompt message, which prompts the user to manually enter the production date.

9. The method according to claim 6, characterized in that, The beverage information in the stored beverage list also includes the first appearance image of the stored beverage, and the method further includes: When the removal of the stored beverage is detected, a third appearance image of the removed stored beverage is acquired; Based on the third appearance image, the image features are compared with the first appearance image of the stored beverage in the stored beverage list to determine the beverage information corresponding to the beverage to be taken out. Remove the beverage information corresponding to the retrieved beverage from the stored beverage list.

10. The method according to claim 6, characterized in that, The method further includes; If the stored beverage is not detected to have been removed after the reminder time, a second reminder will be given to the user according to a preset mode, which includes at least one of voice reminder and terminal message push reminder.

11. A storage medium having a computer program stored thereon, which, when executed by a processor, performs a beverage storage management method for a locker as described in any one of claims 1 to 10.

12. A locker comprising at least two refrigerated compartments, a display screen, a camera assembly, and a processor, the processor being configured to execute a computer program to implement the beverage storage management method for the locker as described in any one of claims 1 to 10.

Images