Article information reminding method, refrigeration equipment and computer storage medium

By setting a camera and deep learning algorithm on the top of the refrigerator bottle holder to identify the types and production dates of dairy products, combining the habit model of family members, reminding users of items that are about to expire, solving the problem of insufficient dairy product management in the existing technology and achieving effective results item reminders and nutrition management.

CN119222940APending Publication Date: 2024-12-31QINDAO HAIER REFRIGERATOR CO LTD +2
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310801783.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-06-30
Publication Date
2024-12-31

AI Technical Summary

Technical Problem

Existing refrigerator food management devices are difficult to effectively manage the production date and shelf life of dairy products, making it difficult for users to identify items that are about to expire in a timely manner, which may lead to waste and improper drinking habits.

Method used

By setting a camera on the top of the refrigerator bottle holder to obtain a bird's eye view image, using algorithms such as YOLO v4, Resnet, DBnet and CRNN to identify the types of items and production dates, calculate the expiration date, and remind users of the items that are about to expire through display lights, and build a family with deep learning. Members took habit models to monitor daily dairy and sugar intake.

Benefits of technology

It has achieved effective expired reminders for dairy products and beverages, reduced waste, helped users drink reasonably, and ensured that nutritional intake is within the appropriate range.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119222940A_ABST
    Figure CN119222940A_ABST
Patent Text Reader

Abstract

The invention discloses an article information reminding method, refrigeration equipment and a computer storage medium. The method comprises the following steps: acquiring an aerial view image of a space in a bottle holder; identifying the type information of each article and the production date information of each article in the aerial view image; calculating expiration date information of the article according to the production date information of the article and a preset shelf life of the article; and according to the preset reminding day number of each article before the expiration date information, a display device is controlled to display the articles in the bottle holder within the corresponding reminding day number. Information of articles about to be expired is transmitted to the user through the display device, the user is reminded to eat the articles as soon as possible, and waste is avoided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of refrigeration devices, and in particular to a method for reminding item information, refrigeration equipment and a computer storage medium. Background Art

[0002] In recent years, with the continuous improvement of the quality of life, the demand for beverages and dairy products has continued to increase, and dairy products have become an indispensable part of the residents' dining table. Since many dairy products or beverages do not contain preservatives, the shelf life is very short. Generally, they need to be stored at 0-8℃. Depending on the type of beverage and the packaging method, the shelf life ranges from 2 days to 10 days. The current consumption habits of users for dairy products and beverages are usually to centrally purchase the amount of dairy products needed by the entire family within a week. In this case, it is very easy to cause the purchased dairy products and beverages to not be consumed within the appropriate date, and it is also likely to cause users to consume excessive amounts of dairy products and beverages in order to consume the beverages within the specified date, which is not good for the user's health.

[0003] The current refrigerator food management capabilities have been able to be very smart. For example, the refrigerator food clip assembly includes multiple clips for meat, eggs, vegetables, etc. Each clip has a different expiration date depending on the type of food. By placing the clip on the food that needs to be managed, the smart clip is bound to the mobile phone APP, and then the display where the clip is placed will show different colors according to the time the food is close to the expiration date. In addition, this clip can also be customized by the user to change the type of food and the expiration date.

[0004] However, this food management solution has pain points. First, users need to use food tube clamps. Many dairy products are cylindrical in shape, and tube clamps are not easy to operate. The dairy products need to be put into the bag first, and then the bag is clamped with the food tube clamp, which makes the actual operation of the user very complicated; second, the food tube clamp is set for milk for 60 days, so after many short-term dairy products are put in, it is necessary to use the mobile phone APP to set the shelf life of the dairy products. Third, the management of food ingredients by the food tube clamp is calculated from the time the ingredients are placed in the refrigerator, without taking into account the production date. For example, the shelf life management of milk by the food tube clamp is 60 days, but it cannot be changed according to the production date of different milks, and the user must set it through the mobile phone APP. Summary of the invention

[0005] The purpose of the present invention is to provide a reminder method for item information, a refrigeration device and a computer storage medium, which can timely transmit information about items that are about to expire to users, reminding users to drink them as soon as possible to avoid waste.

[0006] To achieve the above-mentioned object of the invention, an embodiment of the present invention provides a method for reminding item information, the method comprising:

[0007] Get a bird's-eye view of the space inside the bottle holder;

[0008] Identifying the type information of each object and the production date information of each object in the bird's-eye view image;

[0009] Calculate the expiration date information of the item according to the production date information of the item and the preset shelf life of the item;

[0010] According to the preset reminder days before the expiration date information of each item, the display device is controlled to display the items in the bottle holder within the corresponding reminder days.

[0011] As a further improvement of an embodiment of the present invention, the identifying the type information of each object and the production date information of each object in the bird's-eye view image specifically includes:

[0012] Using the YOLO v4 target detection algorithm, detect objects in the bird's-eye view image and generate corresponding object detection frames at the objects;

[0013] Using the Resnet target recognition algorithm, identifying information corresponding to the object in the object detection frame;

[0014] Using the DBnet text area detection algorithm, locate the production date area in the bird's-eye view image and generate a plurality of identification frames, each of which contains the production date information of an object surface;

[0015] Utilize CRNN and CTC text content recognition algorithms to detect all production date information within the recognition frame.

[0016] As a further improvement of an embodiment of the present invention, the preset reminder days for each item before its expiration date information specifically include:

[0017] When the item is yogurt, the reminder days before the expiration date of the item are set to 3 days;

[0018] When the item is pure milk, the reminder days before the expiration date of the item is set to 30 days;

[0019] When the item is a beverage, the reminder days before the expiration information of the item is set to 30 days.

[0020] As a further improvement of an embodiment of the present invention, the control display device displays the items in the bottle holder within the corresponding reminder days, specifically including:

[0021] A plurality of positions for placing items are arranged in the bottle holder, and a display device is arranged on the side wall of the bottle holder corresponding to each position for placing items, and the display device is a display light;

[0022] According to the preset number of reminder days before the expiration date information of each item, the display lights corresponding to the item placement positions where the items within the corresponding number of reminder days are located are controlled to light up.

[0023] As a further improvement of an embodiment of the present invention, the control of the display device to display the items in the bottle holder within the corresponding reminder days according to the preset reminder days before the expiration date information of each item specifically includes:

[0024] According to the preset number of reminder days before the expiration date of each item, and according to the preset interval reminder time corresponding to the item, each interval corresponds to the preset interval reminder time, and the item information in the bottle holder within the corresponding reminder days is transmitted to the user.

[0025] As a further improvement of an embodiment of the present invention, the method further includes:

[0026] Preset family member information, including the number of family members, gender, age, facial information and physical health status, as well as the daily dairy product intake and daily beverage sugar intake control range for different family members;

[0027] Preset the milk content and sugar content of each item;

[0028] Through deep learning, a habit model of each family member taking items from the bottle holder is constructed, and the habit model includes type information, time information, and frequency information of each family member taking items from the bottle holder every day.

[0029] As a further improvement of an embodiment of the present invention, the method further includes:

[0030] Obtaining information of the family member who takes the item from the bottle holder;

[0031] Record the information on the types of items taken by the family member every day, and based on the preset milk content and sugar content corresponding to the item, as well as the preset daily dairy product needs and daily beverage sugar intake control range of the family member, determine whether the daily milk content and sugar content consumed by the family member are appropriate, and send a reminder message to the mobile terminal.

[0032] As a further improvement of an embodiment of the present invention, the obtaining of information of the family member who takes the item in the bottle holder specifically includes:

[0033] Obtaining facial information of the family member who takes the item from the bottle holder;

[0034] The facial information of the preset family members is matched, and the corresponding information of the family member who takes the item in the bottle holder is output.

[0035] To achieve the above-mentioned purpose, an embodiment of the present invention provides a refrigeration device, including: a bottle holder, at least one camera, at least one display device, a memory and a processor, wherein:

[0036] The bottle holder is provided with a plurality of positions for placing items, and each position for placing items corresponds to placing an item;

[0037] A camera is arranged at the top of the bottle seat corresponding to each object placement position, and the camera is arranged downwards to photograph the objects in the corresponding object placement position;

[0038] A display device is provided on the side wall of the bottle seat corresponding to each object placement position;

[0039] The memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps of the method for reminding item information as described above are implemented.

[0040] To achieve the above-mentioned purpose of the present invention, one embodiment of the present invention provides a computer storage medium, in which a computer program is stored, characterized in that when the computer program is running, the device where the computer storage medium is located causes the steps of the reminder method according to the item information as described above.

[0041] The benefits of the present invention lie in that a camera is arranged on the top of the bottle holder to obtain a bird's-eye view image of the space inside the bottle holder, the type information and production date information of each item in the bottle holder are identified, and the expiration date information of the items placed in the bottle holder is calculated according to the shelf life of each type of item preset in the database. The information of the items that are about to expire is transmitted to the user through the display device, reminding the user to consume them as soon as possible to avoid waste. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 is a flow chart of a method for reminding item information in one embodiment of the present invention;

[0043] Figure 2 is a schematic structural diagram of the space inside the bottle holder in one embodiment of the present invention;

[0044] Figure 3 It is a flowchart of an item information reminder method combined with family member information in one embodiment of the present invention. DETAILED DESCRIPTION

[0045] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in combination with the specific implementation methods of this application and the corresponding drawings. Obviously, the described implementation methods are only part of the implementation methods of this application, not all of the implementation methods. Based on the implementation methods in this application, all other implementation methods obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0046] The embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0047] like Figure 1 As shown, the present embodiment provides a method for reminding item information, including:

[0048] S1: Obtain a bird's-eye view image of the space inside the bottle holder.

[0049] S2: Identify the type information of each item and the production date information of each item in the bird's-eye view image.

[0050] S3: Calculate the expiration date information of the item according to the production date information of the item and the preset shelf life of the item.

[0051] S4: According to the preset reminder days before the expiration date information of each item, the display device is controlled to display the items in the bottle holder within the corresponding reminder days.

[0052] Specifically, a camera is arranged on the top of the bottle holder, and the camera lens is arranged in a direction to photograph the inner space of the bottle holder, and the inner space of the bottle holder is photographed from above to obtain a bird's-eye view image, so as to avoid mutual occlusion between objects in the bottle holder, which is not conducive to the detection and identification of object information.

[0053] In one embodiment of the present invention, a camera can be arranged at the middle position of the top of the bottle holder to capture a complete image of the space inside the bottle holder. Of course, this embodiment is only for bottle holders with a small space, and the camera arranged at the middle position of the top can include all items placed in the bottle holder in its viewing angle.

[0054] In another embodiment of the present invention, a plurality of cameras are arranged on the top of the bottle holder, such as Figure 2As shown, a plurality of positions for placing items are provided in the bottle holder, each of which corresponds to an item, and a camera 1 is provided at the top of the bottle holder corresponding to each of which, and the lens of the camera 1 is provided facing downward. In this embodiment, for each bird's-eye view image acquired by the camera 1, only the type information and production date information of the item located in the middle of the bird's-eye view image are identified in step S2. Of course, in this embodiment, for each bird's-eye view image acquired by the camera 1, an image fusion algorithm can also be used to fuse and splice the multiple images acquired by the multiple cameras 1 into an overall bird's-eye view image containing all item information, and in step S2, the fused and spliced ​​bird's-eye view image can be identified.

[0055] In step S2, the type information of each object and the production date information of each object in the bird's-eye view image are identified, specifically including:

[0056] The YOLO v4 target detection algorithm is used to detect objects in the bird's-eye view image and generate corresponding object detection frames at the objects.

[0057] The Resnet target recognition algorithm is used to identify the information of the corresponding object in the object detection box.

[0058] The DBnet text region detection algorithm is used to locate the production date region in the bird's-eye view image and generate multiple identification frames, each of which contains the production date information on the surface of an object.

[0059] Utilize CRNN and CTC text content recognition algorithms to detect all production date information within the recognition box.

[0060] In this embodiment, the items placed in the bottle holder include yogurt, milk, and beverages. Generally, the corresponding production date numbers are marked on the bottle caps or on the bottle bodies of the items, and the digital information can be recognized using a text recognition algorithm. The YOLO v4 target detection algorithm, Resnet target recognition algorithm, DBnet text area detection algorithm, CRNN and CTC text content recognition algorithms mentioned above are all prior arts, and the present invention will not be elaborated here.

[0061] Furthermore, the method further comprises:

[0062] Preset shelf life information for multiple items.

[0063] For yogurt, the shelf life is generally 7 days to 15 days; for pure milk, the shelf life is generally 6 months to 12 months; for beverages, the shelf life is generally 6 months to 12 months. Of course, different brands and types of yogurt, pure milk and beverages have different shelf lives. The system presets the shelf life information of many different brands and types of yogurt, pure milk and beverages to facilitate the subsequent accurate calculation of the expiration date of the items. The more types of items entered in the system, the more accurate the calculation of the expiration date of the items.

[0064] In step S3, the expiration date information of the item is calculated based on the production date information of the item and the preset shelf life of the item. For example, the item is identified as xx brand yogurt, and the production date information is xxxx / xx / xx. At the same time, the shelf life corresponding to the item pre-stored in the system is 7 days. Then, the expiration date of the item can be calculated to be xxxx / xx / xx (xx+7).

[0065] Of course, in other embodiments of the present invention, for some items whose bottle caps or bottle bodies are marked with both the production date and the expiration date, the expiration date information of the item can be directly identified and obtained through a text detection algorithm.

[0066] Exemplarily, in step S4, the preset reminder days for each item before its expiration date information specifically include:

[0067] When the item is yogurt, the reminder days before the expiration information of the item is set to 3 days.

[0068] When the item is pure milk, the reminder days before the expiration information of the item is set to 30 days.

[0069] When the item is a beverage, the reminder days before the expiration information of the item is set to 30 days.

[0070] Of course, the number of reminder days before the expiration date information of each item can be customized by the user, and the present invention is not limited to this.

[0071] Exemplarily, in step S4, item A placed in the bottle holder is output as xx brand yogurt according to the detection and calculation results of steps S2 and S3, and its calculated expiration time is March 20, 2023. According to the system preset reminder days of 3 days for the corresponding xx brand yogurt, the display device is controlled to display the information of item A in the bottle holder from March 17, 2023 to March 20, 2023, to remind the user that item A is about to expire and needs to be consumed as soon as possible.

[0072] Specifically, a plurality of positions for placing items are arranged in the bottle holder, and a display device 2 is arranged on the side wall of the bottle holder corresponding to each position for placing items, and the display device 2 is a display light.

[0073] According to the preset number of reminder days before the expiration date information of each item, the display light corresponding to the item placement position where the item is located within the corresponding reminder days is controlled to light up. For example, taking the item A described above as an example, the display light corresponding to the item placement position where the item A is located is controlled to light up. When the user opens the refrigerator door and sees the corresponding display light on, he or she can realize that the item at the display light position is about to expire and needs to be consumed as soon as possible.

[0074] In other embodiments of the present invention, the display device 2 may also be a display screen to display the information of items that are about to expire in more detail.

[0075] Further, in step S4, according to the preset reminder days before the expiration date information of each item, the display device is controlled to display the items in the bottle holder within the corresponding reminder days, which specifically includes:

[0076] According to the preset number of reminder days before the expiration date of each item, and according to the preset interval reminder time corresponding to the item, each interval corresponds to the preset interval reminder time, and the information of the items in the bottle holder within the corresponding reminder days is transmitted to the user.

[0077] In addition to setting a display light on the bottle holder to remind users to drink the expired items as soon as possible, the control system can also send reminder information to the mobile terminal connected to it. For example, if item A is about to expire in three days, the information will be sent to the mobile terminal to remind the user. More specifically, the system also presets the interval reminder time required for each item. For example, the shelf life of yogurt is relatively short, and the interval reminder time of yogurt can be set to 1 day, that is, a reminder message will be sent every other day within 3 days before its expiration; while the shelf life of pure milk and beverages is relatively long, the interval reminder time of pure milk and beverages can be set to 10 days, that is, a reminder message will be sent every 10 days within 1 month before its expiration.

[0078] Of course, the preset interval reminder time can be customized by the user, and the present invention is not limited to this.

[0079] In order to improve the interactive experience between the smart bottle holder and the user and provide more humane services to the user, the reminder method of the item information in this embodiment also includes:

[0080] Preset family member information, including number of family members, gender, age, facial information and physical health status, as well as preset daily dairy product requirements and daily beverage sugar intake control range for different family members.

[0081] Preset the milk and sugar content for each item.

[0082] Through deep learning, a habit model of each family member taking items from the bottle holder is constructed. The habit model includes the type, time, and frequency information of each family member taking items from the bottle holder every day.

[0083] Exemplarily, family members A, B and C are preset, and the gender, age, facial information and health status of the three family members are input. The collected health status includes whether the person is pregnant, whether the person is intolerant to dairy products, whether the person has diabetes, etc.

[0084] Furthermore, based on the age and health conditions of family members A, B and C, it can be recommended to set the daily dairy product intake and daily beverage sugar intake control range for the three family members.

[0085] For example, according to the new version of the "Dietary Guidelines for Chinese Residents" in 2022, the intake of milk and dairy products has been changed from no less than 300 grams per person per day to 300-500 grams per person per day. Especially for pregnant women and adolescents, the demand for nutrients such as calcium and protein increases, and it is best to ensure the intake of 500 grams of dairy products per person per day, so the daily intake of dairy products for family members can be set to no less than 500 grams.

[0086] For example, the dietary guidelines recommend that the daily sugar intake of minors should not exceed 50 grams, and it is best to control it below 25 grams. Therefore, if there are minors in the family, the sugar content of the daily drinks of this family member can be controlled to no more than 25 grams, and the sugar content of the daily drinks of adult family members can be controlled to no more than 50 grams.

[0087] In combination with the milk and sugar content of each item preset in the system, the milk and sugar content consumed by a family member in a day is calculated based on the information of items taken by the family member in a day. This is compared with the preset daily dairy product demand and daily beverage sugar intake control range to determine whether the family member's daily dairy product demand is met and whether the member has controlled the daily beverage sugar intake within the preset range.

[0088] So, further, Figure 3 As shown, the method also includes:

[0089] Get information about the family member who took the item from the bottle holder.

[0090] Record the information on the types of items taken by the family member every day, and based on the preset milk content and sugar content corresponding to the item, as well as the preset daily dairy product needs and daily beverage sugar intake control range of the family member, determine whether the daily milk content and sugar content consumed by the family member are appropriate, and send a reminder message to the mobile terminal.

[0091] The step of "obtaining information of the family member who takes the item from the bottle holder" specifically includes:

[0092] Obtain facial information of the family member who takes the item from the bottle holder.

[0093] Match the facial information with the preset family members and output the corresponding information of the family member who takes the item in the bottle holder.

[0094] Specifically, a camera is installed on the top of the refrigerator. When a family member opens the refrigerator to take items from the bottle holder, the camera will collect the family member's facial information, upload the collected facial information to the system, and then match it with the pre-stored family member's facial information to output the corresponding family member information who opened the refrigerator and took the items from the bottle holder. At the same time, after the refrigerator door is closed, the bird's-eye view image collected by the camera in the bottle holder is analyzed to output the type of items taken from the bottle holder by the family member.

[0095] For example, if the preset family member A is male, 12 years old, and in good health, the daily milk content that should be consumed by family member A is recommended to be no less than 500 grams, and the daily sugar content that should be consumed is no more than 25 grams. The total milk content and sugar content of the items in the bottle holder taken by family member A in one day are compared with the preset values ​​to determine whether the daily milk content and sugar content consumed by family member A are appropriate, and a reminder message is sent to the mobile terminal.

[0096] Furthermore, when the total sugar content of items taken by the same family member on the same day exceeds the preset value, a reminder message will be sent immediately to remind the family member that the sugar content today has exceeded the standard and not to drink too much sugary drinks.

[0097] In another embodiment of the present invention, see Figure 2 The bottle holder is also provided with a button 3 for selecting a family member. The button 3 can be connected to the display device 2 for communication. By pressing the button 3, the family member information can be switched, and the family member information can be displayed on the display device 2. No face recognition technology is required. The button 3 can be used to select which family member is taking the item in the bottle holder. For example, if family member A does not take item A for himself to drink, but for family member B, when family member A takes the item in the bottle holder, he can adjust the corresponding button 3 to select family member B, and the system can record the milk content and sugar content contained in item A in the information of family member B.

[0098] Furthermore, a button 3 is provided at each corresponding position of the item on the bottle holder, and when the user takes the item at the corresponding position, the corresponding button can be controlled to record which family member has taken the item.

[0099] Of course, the daily dairy product intake and daily beverage sugar intake control range of each family member are customized by the user according to their own circumstances, and the present invention does not impose any restrictions on this.

[0100] Furthermore, through deep learning, a habit model of each family member taking items from the bottle holder is constructed. The habit model includes the type information, time information, and frequency information of each family member taking items from the bottle holder every day. For example, the system learns that family member A usually takes milk at 6:15 a.m. on weekdays. If family member A does not take milk in the morning, the control system will remind family user A to drink milk at 6:30 a.m.

[0101] This embodiment provides a refrigeration device, including a bottle holder, at least one camera, at least one display device, a memory, and a processor.

[0102] Refrigeration equipment includes smart refrigerators, freezers, beverage cabinets, etc.

[0103] The bottle holder is provided with a plurality of positions for placing items, and each position for placing an item corresponds to the position for placing an item.

[0104] A camera is arranged at the top of the bottle seat corresponding to each object placement position, and the camera is arranged downwards to photograph the objects in the corresponding object placement position.

[0105] A display device is arranged on the side wall of the bottle seat corresponding to each object placement position.

[0106] In one embodiment of the present invention, the display device is a display light.

[0107] In another embodiment of the present invention, the display device is a display screen.

[0108] The memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps of the method for reminding the item information in any one of the above embodiments are implemented.

[0109] This embodiment also provides a computer storage medium, in which a computer program is stored, and when the computer program is run, the device where the computer storage medium is located executes the steps of the method for reminding item information in any of the above embodiments.

[0110] In summary, the present invention obtains a bird's-eye view image of the space inside the bottle holder by setting a camera on the top of the bottle holder, identifies the type information and production date information of each item in the bottle holder, and then calculates the expiration date information of the items placed in the bottle holder according to the shelf life of each type of item preset in the database, and transmits the information of the items that are about to expire to the user through the display device, reminding the user to eat them as soon as possible to avoid waste. In addition, by monitoring the items taken from the bottle holder by each user every day, the milk content and sugar content of the user's daily intake are calculated, and compared with the preset values ​​recommended in the system, it is determined whether the user's daily intake of milk products and sugar content is within the control range, and a reminder message is sent to the user.

[0111] It should be understood that although this specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each implementation mode may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

[0112] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present invention. They are not intended to limit the scope of protection of the present invention. Any equivalent implementation methods or changes that do not deviate from the technical spirit of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for reminding item information, characterized in that: The method comprises: Get a bird's-eye view of the space inside the bottle holder; Identifying the type information of each object and the production date information of each object in the bird's-eye view image; Calculate the expiration date information of the item according to the production date information of the item and the preset shelf life of the item; According to the preset reminder days before the expiration date information of each item, the display device is controlled to display the items in the bottle holder within the corresponding reminder days.

2. The method for reminding item information according to claim 1, characterized in that: The identifying the type information of each object and the production date information of each object in the bird's-eye view image specifically includes: Using the YOLO v4 target detection algorithm, detect objects in the bird's-eye view image and generate corresponding object detection frames at the objects; Using the Resnet target recognition algorithm, identifying information corresponding to the object in the object detection frame; Using the DBnet text area detection algorithm, locate the production date area in the bird's-eye view image and generate a plurality of identification frames, each of which contains the production date information of an object surface; Utilize CRNN and CTC text content recognition algorithms to detect all production date information within the recognition frame.

3. The method for reminding item information according to claim 1, characterized in that: The preset reminder days for each item before its expiration date information specifically include: When the item is yogurt, the reminder days before the expiration date of the item are set to 3 days; When the item is pure milk, the reminder days before the expiration date of the item is set to 30 days; When the item is a beverage, the reminder days before the expiration information of the item is set to 30 days.

4. The method for reminding item information according to claim 1, characterized in that: The control and display device displays the items in the bottle holder within the corresponding reminder days, specifically including: A plurality of positions for placing items are arranged in the bottle holder, and a display device is arranged on the side wall of the bottle holder corresponding to each position for placing items, and the display device is a display light; According to the preset number of reminder days before the expiration date information of each item, the display lights corresponding to the item placement positions where the items within the corresponding number of reminder days are located are controlled to light up.

5. The method for reminding item information according to claim 1, characterized in that: According to the preset reminder days before the expiration date information of each item, controlling the display device to display the items in the bottle holder within the corresponding reminder days specifically includes: According to the preset number of reminder days before the expiration date of each item, and according to the preset interval reminder time corresponding to the item, each interval corresponds to the preset interval reminder time, and the item information in the bottle holder within the corresponding reminder days is transmitted to the user.

6. The method for reminding item information according to claim 1, characterized in that: The method further comprises: Preset family member information, including the number of family members, gender, age, facial information and physical health status, as well as the daily dairy product intake and daily beverage sugar intake control range for different family members; Preset the milk content and sugar content of each item; Through deep learning, a habit model of each family member taking items from the bottle holder is constructed, and the habit model includes type information, time information, and frequency information of each family member taking items from the bottle holder every day.

7. The method for reminding item information according to claim 6, characterized in that: The method further comprises: Obtaining information of the family member who takes the item from the bottle holder; Record the information on the types of items taken by the family member every day, and based on the preset milk content and sugar content corresponding to the item, as well as the preset daily dairy product needs and daily beverage sugar intake control range of the family member, determine whether the daily milk content and sugar content consumed by the family member are appropriate, and send a reminder message to the mobile terminal.

8. The method for reminding item information according to claim 7, characterized in that: The obtaining of information of the family member who takes the item in the bottle holder specifically includes: Obtaining facial information of the family member who takes the item from the bottle holder; The facial information of the preset family members is matched, and the corresponding information of the family member who takes the item in the bottle holder is output.

9. A refrigeration device comprising: A bottle holder, at least one camera, at least one display device, a memory and a processor, characterized in that: The bottle holder is provided with a plurality of positions for placing items, and each position for placing items corresponds to placing an item; A camera is arranged at the top of the bottle seat corresponding to each object placement position, and the camera is arranged downwards to photograph the objects in the corresponding object placement position; A display device is provided on the side wall of the bottle seat corresponding to each object placement position; The memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps of the method for reminding the item information according to any one of claims 1 to 8 are implemented.

10. A computer storage medium storing a computer program, characterized in that: When the computer program is executed, the device where the computer storage medium is located causes the device to execute the steps of the method for reminding item information according to any one of claims 1-8.