Full-automatic intelligent fresh refrigerator system and operation method

By integrating high-resolution cameras, image processing chips, RFID tags and cloud servers in smart refrigerators, combined with deep learning models, the problem that smart refrigerators are difficult to meet the elderly's healthy diet needs, real-time monitoring and personalization of food freshness is achieved Reduce food waste and improve user experience.

CN119042920AActive Publication Date: 2024-11-29SUZHOU CITY UNIV

Patent Information

Application Number
CN202411551960.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-01
Publication Date
2024-11-29
Estimated Expiration
2044-11-01

AI Technical Summary

Technical Problem

Existing smart refrigerators are difficult to meet the specific healthy dietary needs of the elderly, especially in food management caused by memory loss, cognitive lag and saving habits.

Method used

A fully automatic intelligent smart refrigerator system was designed, integrating high-resolution cameras, image processing chips and edge computing devices, RFID tags and RFID reader modules, cloud servers and interactive interfaces, through deep learning models and Internet of Things technology, Realize real-time monitoring and freshness prediction of food in the refrigerator, and provide personalized dietary advice and alarm information.

Benefits of technology

Realize instant monitoring of the food status in the refrigerator and accurate prediction of freshness, reduce food waste, provide personalized healthy diet suggestions, and enhance user experience and product competitiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119042920A_ABST
    Figure CN119042920A_ABST
Patent Text Reader

Abstract

The invention provides a full-automatic intelligent refrigerator system and an operation method, and relates to the technical field of intelligent home furnishing.The system comprises a high-resolution camera, an image processing chip and edge computing equipment module, an RFID tag and RFID reader module, a cloud server and an interactive interface. According to the method, the deep learning model and the Internet of Things technology are combined, and real-time monitoring and accurate prediction of the freshness of the food in the refrigerator are achieved. The method has the advantages that the food state can be automatically identified, the expired food can be early warned in time, the food waste is effectively reduced, the prediction precision is continuously optimized through adaptive learning, personalized diet suggestions and health management are provided for users, and the convenience and health of smart home life are greatly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of smart home technologies, and in particular to a fully automatic smart fresh-keeping refrigerator system and an operating method thereof. Background Art

[0002] As an important branch of artificial intelligence, computer vision technology simulates and improves human visual ability through digital image processing and deep learning models, covering image acquisition, preprocessing, and advanced image analysis and understanding, and has shown great application potential in areas such as smart homes. Embedded systems have improved the communication intelligence and flexibility of devices by deeply integrating network technology and communication technology, especially in the field of image processing, providing strong technical support for smart home devices.

[0003] However, existing smart refrigerators still have shortcomings in meeting the specific needs of the elderly, such as memory loss, cognitive lag and food management problems caused by frugal habits, which require further attention and improvement. Summary of the invention

[0004] To this end, an embodiment of the present invention provides a fully automatic intelligent fresh-food refrigerator system and an operating method, which are used to solve the problem that existing intelligent refrigerators in the prior art are difficult to meet specific healthy dietary needs.

[0005] In order to solve the above problems, an embodiment of the present invention provides a fully automatic intelligent fresh refrigerator system, which includes: High-resolution camera, used to collect image information of food in the refrigerator in real time; An image processing chip and edge computing device module, connected to the high-resolution camera, includes an image processing chip and an edge computing device, and is used to pre-process the collected image information; An RFID tag and RFID reader module is connected to the image processing chip and edge computing device module, wherein the RFID tag and RFID reader module includes an RFID tag and an RFID reader, and is used to embed the RFID tag into each plate and read the RFID tag information through the RFID reader; A cloud server, connected to the RFID tag and RFID reader modules, includes a deep learning module, a database management system, an image recognition module, and an anomaly detection and alarm system, for receiving RFID tag information read by the RFID reader, and using the read RFID tag information to perform adaptive learning, database matching algorithm processing, and generate feedback information, including food freshness prediction results, personalized dietary recommendations, and alarm information; The interactive interface includes a refrigerator touch screen, a voice prompt module and a mobile phone APP, which is used to receive feedback information generated by the cloud server and provide users with real-time monitoring and alarm reminder services; The deep learning module includes a cuisine prediction and recommendation system, which uses a cuisine classification strategy to perform deep learning training, specifically including: Define the main function, and the input parameters include prediction results, initial confidence, user feedback, seasonal factors, user preferences and market trends; Find the index with the highest probability from the prediction results, obtain the corresponding cuisine from the cuisine list based on the index, and use the highest probability value as the confidence score; Create a feedback dictionary containing the predicted cuisine and confidence score; Update confidence based on user feedback; Traverse the list of dishes and calculate the weight of each dish based on seasonal factors, user preferences, and market trends, and adjust the updated confidence according to the weight; If there are non-cuisine related cooking methods in user feedback, then make adjustments, i.e., adjust the updated confidence according to the non-cuisine feedback; otherwise, proceed to the next step; Calculate the freshness score of dishes based on updated confidence, user preferences, seasonal factors and market trends; Add the updated confidence and freshness scores to the feedback dictionary and return the feedback dictionary.

[0006] Preferably, the image processing chip and edge computing device module include an image processing chip and an edge computing device, the image processing chip includes filtering, denoising and feature extraction modules for pre-processing the image; the edge computing device includes a data compression and encryption module for compressing the data before transmission to reduce the amount of data, and encrypting to ensure the security of data transmission.

[0007] Preferably, updating the confidence level according to user feedback specifically includes: Get the index of the predicted cuisine in the cuisine list; Get the actual cuisine in the user feedback and its index in the cuisine list; Adjust the initial confidence level based on whether the prediction is accurate: If the prediction is correct, increase the confidence of the predicted cuisine; If the prediction is wrong, reduce the confidence of the predicted cuisine and increase the confidence of the actual cuisine; Normalize the updated confidence.

[0008] Preferably, the updated confidence is expressed as: ; In the formula, is the updated confidence, is the initial confidence, is the weight, is the adjustment factor.

[0009] Preferably, the freshness score of the dish is expressed as: ; In the formula, is the freshness score, A collection of all cuisines. is the updated confidence, is the weight of user preference, is the weight of seasonal factors, is the weight of the market trend.

[0010] Preferably, the abnormality detection and alarm system includes a preset threshold judgment module, which is used to compare the real-time monitored data with the preset threshold and trigger an alarm once the preset threshold is exceeded.

[0011] Preferably, the refrigerator touch screen is used to display real-time food freshness monitoring results, personalized dietary recommendations and alarm information, and supports users to perform interactive operations through the touch screen.

[0012] Preferably, the voice prompt module can broadcast food freshness status, personalized dietary recommendations and alarm information to the user by voice according to the instructions of the cloud server.

[0013] Preferably, the mobile phone APP can remotely receive food freshness data and alarm information sent by the cloud server, and support users to perform remote control and parameter setting through the mobile phone APP.

[0014] The embodiment of the present invention further provides an operation method of a fully automatic intelligent fresh-keeping refrigerator system, which uses the fully automatic intelligent fresh-keeping refrigerator system described above, and specifically includes: Use a high-resolution camera to collect image information of food in the refrigerator in real time; Use image processing chips and edge computing device modules to pre-process the collected image information; The RFID tag is embedded into each plate using the RFID tag and RFID reader module, and the RFID tag information is read by the RFID reader; The cloud server receives the RFID tag information read by the RFID reader, and uses the read RFID tag information to perform adaptive learning and database matching algorithm processing, and generate feedback information, including food freshness prediction results, personalized dietary recommendations and alarm information; Receive feedback information generated by the cloud server through the interactive interface and provide users with real-time monitoring and alarm reminder services.

[0015] It can be seen from the above technical solutions that the present invention has the following beneficial effects: (1) Real-time monitoring and accurate prediction: The present invention integrates high-resolution cameras, image processing technology, RFID recognition and cloud-based deep learning to achieve real-time monitoring of the status of food in the refrigerator and accurate prediction of its freshness, effectively reducing food waste and promoting healthy eating.

[0016] (2) Multimodal data fusion and intelligent decision-making: This invention improves the comprehensiveness and accuracy of data processing by integrating multimodal information such as images and RFID tag data and combining it with cloud-based intelligent analysis. At the same time, the adaptive learning mechanism continuously optimizes the model, improving the system's intelligent decision-making ability and prediction accuracy.

[0017] (3) Continuous self-optimization capability: The system of the present invention can automatically verify the recognition accuracy and adjust the model parameters for retraining when necessary to cope with changes in different environments and food states. This self-optimization mechanism ensures the stability and adaptability of the system in long-term operation.

[0018] (4) Personalized user experience and services: The present invention provides multiple interactive modes such as touch screen, voice prompts and mobile phone APP, which facilitate users to check the status of the refrigerator in real time and receive alarm reminders. At the same time, based on user eating habits and feedback, customized dietary suggestions and services are provided to enhance user experience and improve product competitiveness.

[0019] (5) Cuisine recognition-driven deep learning optimization: This paper adopts a scenario-based training method based on cuisine classification, which reduces the internal differences in data and enables the model to focus more on learning the features of specific cuisines. This strategy significantly improves the accuracy of the model in identifying and predicting dishes, and enhances the effectiveness and value of the model in practical applications. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the implementation cases of the present invention or the technical solutions in the prior art, the following is a brief description of the drawings required for use in the embodiments. By referring to the drawings, the features and advantages of the present invention will be more clearly understood. The drawings are schematic and should not be understood as limiting the present invention in any way. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them: Figure 1 It is a structural block diagram of a fully automatic intelligent fresh refrigerator system provided in an embodiment; Figure 2 It is a flow chart of an operating method of a fully automatic intelligent fresh refrigerator system provided in an embodiment; DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Embodiment 1

[0022] In order to solve the problem that the existing smart refrigerators in the prior art are difficult to meet the specific healthy diet needs. Figure 1 As shown, an embodiment of the present invention proposes a fully automatic intelligent fresh refrigerator system, which includes: High-resolution camera, used to collect image information of food in the refrigerator in real time; An image processing chip and edge computing device module, connected to a high-resolution camera, includes an image processing chip and an edge computing device, and is used to pre-process the collected image information; An RFID tag and RFID reader module is connected to the image processing chip and edge computing device module. The RFID tag and RFID reader module includes an RFID tag and an RFID reader, and is used to embed the RFID tag into each plate and read the RFID tag information through the RFID reader; A cloud server, connected to the RFID tag and RFID reader modules, includes a deep learning module, a database management system, an image recognition module, and an anomaly detection and alarm system, for receiving RFID tag information read by the RFID reader, and using the read RFID tag information to perform adaptive learning, database matching algorithm processing, and generate feedback information, including food freshness prediction results, personalized dietary recommendations, and alarm information; The interactive interface, including the refrigerator touch screen, voice prompt module and mobile phone APP, is used to receive feedback information generated by the cloud server and provide real-time monitoring and alarm reminder services to users.

[0023] From the above technical solution, it can be seen that the present invention proposes a fully automatic intelligent fresh refrigerator system, which integrates high-resolution cameras, image processing chips and edge computing device modules, RFID tags and RFID reader modules, cloud servers and other advanced equipment, combined with deep learning models and Internet of Things technology, to achieve real-time monitoring and accurate prediction of the freshness of food in the refrigerator. Its advantages are that it can automatically identify the state of food, timely warn of expired food, effectively reduce food waste, and continuously optimize the prediction accuracy through adaptive learning, providing users with personalized dietary advice and health management, greatly improving the convenience and health of smart home life.

[0024] This embodiment describes in detail how to build a fully automatic intelligent fresh-food refrigerator system that integrates advanced computer vision technology, Internet of Things (IoT) technology, and artificial intelligence algorithms to provide users with an intelligent food management experience.

[0025] 1. Hardware module integration: High-resolution camera: A high-resolution (e.g. 4K) camera is installed on the top of the refrigerator to ensure that it can clearly capture image information of each layer of food in the refrigerator, such as color, shape, and texture. The camera is connected to the image processing chip via a USB interface.

[0026] Image processing chip: A dedicated image processing chip with integrated filtering, denoising and feature extraction modules is selected and installed in the control panel on the back of the refrigerator. The chip is responsible for receiving image data transmitted by the camera and performing preliminary image preprocessing, including removing noise, enhancing contrast and extracting key features (such as color, shape, etc.).

[0027] Edge computing device: An edge computing server is deployed inside the refrigerator, including a data compression and encryption module, which is used to compress data before transmission to reduce the amount of data, and encrypt it to ensure the security of data transmission.

[0028] RFID tag and RFID reader module: RFID tags are embedded in each plate to enable quick identification under the scanning of RFID readers. In addition, the RFID tag and RFID reader module also includes a Bluetooth module for transmitting the RFID tag information read by the RFID reader to the cloud server.

[0029] In the smart refrigerator system, the integrated RFID tags work closely with high-resolution cameras to achieve instant and accurate monitoring of the status of food in the refrigerator. The RFID tags quickly identify the items in each plate through the refrigerator's built-in RFID reader, while the high-definition camera captures the appearance details of the food, such as color, shape and texture, and uses advanced image processing algorithms for analysis. This process not only quickly determines the type of food, storage time and current status, but also builds a detailed food information library.

[0030] 2. Software modules and cloud services: Cloud server: A high-performance server is deployed in the cloud, which includes a deep learning module, a database management system, an image recognition module, and an anomaly detection and alarm system. The server receives the RFID tag information read by the RFID reader through the Bluetooth module, and uses the read RFID tag information for adaptive learning and database matching algorithm processing, and generates feedback information, including food freshness prediction results, personalized dietary recommendations, and alarm information.

[0031] Deep learning model: A deep learning model is trained using a large amount of food images and freshness data to enable it to accurately identify food types and predict their freshness. The model regularly learns from user feedback and continuously optimizes parameters to improve prediction accuracy.

[0032] Abnormal detection and alarm system: The system has built-in preset thresholds, such as the remaining days of food shelf life, temperature range, etc. Once the real-time monitoring data exceeds the threshold, the system will automatically trigger the alarm mechanism.

[0033] Specifically, the system uses a deep learning model to continuously optimize its recognition capabilities. By regularly comparing and verifying newly collected data with previous recognition results, the system can evaluate the recognition accuracy in real time, and automatically adjust the model parameters for retraining when the accuracy is found to be lower than the preset standard. This adaptive learning mechanism ensures that the system can flexibly respond to changes in different environments and food states, thereby maintaining a high level of recognition accuracy.

[0034] In order to further improve the recognition effect and application value of the deep learning model, the present invention adopts a strategy of classifying by cuisine to train the deep learning model. This method effectively reduces the differences between data samples, allowing the model to focus on the unique flavor characteristics and cooking skills of each cuisine. Specifically, by carefully classifying mainstream cuisines such as Sichuan cuisine, Cantonese cuisine, and Shandong cuisine, and collecting and annotating rich image data, the deep learning model can deeply learn and reflect the characteristics of each cuisine during the training process, thereby improving the recognition and prediction accuracy of dishes. The following is a detailed description of the algorithm: S1: Define the main function, and the input parameters include prediction results, initial confidence, user feedback, seasonal factors, user preferences and market trends.

[0035] S2: Find the index with the highest probability from the prediction results, obtain the corresponding cuisine from the cuisine list based on the index, and use the highest probability value as the confidence score.

[0036] S3: Create a feedback dictionary containing the predicted cuisine and confidence scores.

[0037] S4: Update the confidence according to user feedback, including the following steps: S41: Obtaining the index of the predicted cuisine in the cuisine list; S42: Obtaining the actual cuisine in the user feedback and its index in the cuisine list; S43: Adjust the initial confidence level based on whether the prediction is accurate: If the prediction is correct, increase the confidence of the predicted cuisine; If the prediction is wrong, reduce the confidence of the predicted cuisine and increase the confidence of the actual cuisine; S44: normalize the updated confidence.

[0038] S5: traverse the cuisine list, calculate the weight of each cuisine, the weight is based on seasonal factors, user preferences and market trends, and adjust the updated confidence according to the weight, where the updated confidence is expressed as: ; In the formula, is the updated confidence, is the initial confidence, is the weight, is the adjustment factor.

[0039] S6: If there are non-cuisine related cooking methods in the user feedback, then make adjustments, that is, adjust the updated confidence level according to the non-cuisine feedback; otherwise, execute step S7.

[0040] S7: Calculate the freshness score of the dish based on the updated confidence, user preference, seasonal factors, and market trends, where the freshness score of the dish is expressed as: ; Where FS is the freshness score, C is the set of all cuisines, is the weight of user preference, is the weight of seasonal factors, is the weight of the market trend.

[0041] In actual applications, high-resolution cameras use image recognition technology to accurately analyze the dishes on the plate, identify their types and ingredients, and combine historical data with the user's dietary preferences to evaluate the freshness and nutritional value of the food. Based on this, the system generates personalized dietary recommendations for users, such as replacement or adjustment recommendations for foods that are about to expire or do not meet health needs. At the same time, the system can also customize exclusive diet plans based on the user's specific health conditions (diabetes, hypertension, etc.) to achieve precise health management. In addition, by continuously collecting user feedback and food status data, the system can dynamically adjust its recommendation strategy and prediction model. Every choice and preference of the user is recorded in detail and used as valuable training data to improve the recognition and prediction capabilities of the deep learning model. This mechanism ensures that the system can evolve as user needs change and continue to provide dietary recommendations and health management services that fit the actual individual.

[0042] 3. Interactive interface implementation: Refrigerator touch screen: A high-resolution touch screen is installed on the outside of the refrigerator door to display real-time food freshness monitoring results, personalized dietary recommendations, alarm information, and user operation interface. Users can check food status, receive alarm reminders, and perform simple interactive operations (such as setting reminders, adjusting parameters, etc.) through the touch screen.

[0043] Voice prompt module: Integrate intelligent voice assistant (such as technology based on Amazon Alexa or Google Assistant) to inform users of relevant information through voice when it detects that food is about to expire or the temperature is abnormal, which provides great convenience for users with poor eyesight or limited mobility.

[0044] Mobile APP: Develop a smartphone application that supports iOS and Android systems. Users can remotely receive food freshness data and alarm information sent by the cloud server through the mobile APP, and perform remote control (such as adjusting the refrigerator temperature, setting reminders, etc.) and personalized parameter settings.

[0045] Through the above specific embodiments, the present invention constructs a fully functional and intelligent fully automatic smart fresh refrigerator system, which effectively improves the user's food management experience, reduces food waste, and ensures dietary health. Embodiment 2

[0046] like Figure 2 As shown, the present invention provides an operation method of a fully automatic intelligent fresh refrigerator system, which uses the fully automatic intelligent fresh refrigerator system of the above-mentioned embodiment 1 to implement the above-mentioned embodiment, and specifically includes: Use a high-resolution camera to collect image information of food in the refrigerator in real time; Use image processing chips and edge computing device modules to pre-process the collected image information; The RFID tag is embedded into each plate using the RFID tag and RFID reader module, and the RFID tag information is read by the RFID reader; The cloud server receives the RFID tag information read by the RFID reader, and uses the read RFID tag information to perform adaptive learning and database matching algorithm processing, and generate feedback information, including food freshness prediction results, personalized dietary recommendations and alarm information; Receive feedback information generated by the cloud server through the interactive interface and provide users with real-time monitoring and alarm reminder services.

[0047] In this embodiment, a high-resolution camera regularly scans the inside of the refrigerator to collect food image information; the RFID reader reads the information in the RFID tag in real time. The image processing chip preprocesses the image, and the edge computing device further processes the data and compresses and encrypts it before transmitting it to the cloud server via the Bluetooth module. After receiving the data, the cloud server uses a deep learning model to predict the freshness of the food and verifies the results through a database matching algorithm. Subsequently, feedback information is generated, including freshness prediction results, personalized dietary recommendations, and alarm information. The feedback information is displayed to the user through the refrigerator touch screen, voice prompt module, and mobile phone APP, providing real-time monitoring and alarm reminder services.

[0048] The operating method of a fully automatic intelligent fresh-keeping refrigerator system of the present embodiment uses the aforementioned fully automatic intelligent fresh-keeping refrigerator system. Therefore, the specific implementation method of the operating method of the fully automatic intelligent fresh-keeping refrigerator system can be seen in the embodiment part of the fully automatic intelligent fresh-keeping refrigerator system in the previous text. Therefore, its specific implementation method can refer to the description of the corresponding embodiments of each part. In order to avoid redundancy, it will not be repeated here.

[0049] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0050] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0051] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0052] Obviously, the above embodiments are merely examples for clear explanation and are not intended to limit the implementation methods. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the implementation methods here. The obvious changes or modifications derived from them are still within the protection scope of the invention.

Claims

1. A fully automatic intelligent fresh refrigerator system, characterized in that: include: High-resolution camera, used to collect image information of food in the refrigerator in real time; An image processing chip and edge computing device module, connected to the high-resolution camera, includes an image processing chip and an edge computing device, and is used to pre-process the collected image information; An RFID tag and RFID reader module is connected to the image processing chip and edge computing device module, wherein the RFID tag and RFID reader module includes an RFID tag and an RFID reader, and is used to embed the RFID tag into each plate and read the RFID tag information through the RFID reader; A cloud server, connected to the RFID tag and RFID reader modules, includes a deep learning module, a database management system, an image recognition module, and an anomaly detection and alarm system, for receiving RFID tag information read by the RFID reader, and using the read RFID tag information to perform adaptive learning, database matching algorithm processing, and generate feedback information, including food freshness prediction results, personalized dietary recommendations, and alarm information; The interactive interface includes a refrigerator touch screen, a voice prompt module and a mobile phone APP, which is used to receive feedback information generated by the cloud server and provide users with real-time monitoring and alarm reminder services; The deep learning module includes a cuisine prediction and recommendation system, which uses a cuisine classification strategy to perform deep learning training, specifically including: Define the main function, and the input parameters include prediction results, initial confidence, user feedback, seasonal factors, user preferences and market trends; Find the index with the highest probability from the prediction results, obtain the corresponding cuisine from the cuisine list based on the index, and use the highest probability value as the confidence score; Create a feedback dictionary containing the predicted cuisine and confidence score; Update confidence based on user feedback; Traverse the list of dishes and calculate the weight of each dish based on seasonal factors, user preferences, and market trends, and adjust the updated confidence according to the weight; If there are non-cuisine related cooking methods in user feedback, then make adjustments, i.e., adjust the updated confidence according to the non-cuisine feedback; otherwise, proceed to the next step; Calculate the freshness score of dishes based on updated confidence, user preferences, seasonal factors and market trends; Add the updated confidence and freshness scores to the feedback dictionary and return the feedback dictionary.

2. The fully automatic intelligent fresh refrigerator system according to claim 1 is characterized in that: The image processing chip and edge computing device module include an image processing chip and an edge computing device. The image processing chip includes filtering, denoising and feature extraction modules for pre-processing images; the edge computing device includes a data compression and encryption module for compressing data before transmission to reduce the amount of data, and encrypting to ensure the security of data transmission.

3. The fully automatic intelligent fresh refrigerator system according to claim 1 is characterized in that: The updating of the confidence level according to the user feedback specifically includes: Get the index of the predicted cuisine in the cuisine list; Get the actual cuisine in the user feedback and its index in the cuisine list; Adjust the initial confidence level based on whether the prediction is accurate: If the prediction is correct, increase the confidence of the predicted cuisine; If the prediction is wrong, reduce the confidence of the predicted cuisine and increase the confidence of the actual cuisine; Normalize the updated confidence.

4. The fully automatic intelligent fresh refrigerator system according to claim 1 is characterized in that: The updated confidence is expressed as: ; In the formula, is the updated confidence, is the initial confidence, is the weight, is the adjustment factor.

5. The fully automatic intelligent fresh refrigerator system according to claim 1 is characterized in that: The freshness score of the dish is expressed as: ; In the formula, is the freshness score, A collection of all cuisines. is the updated confidence, is the weight of user preference, is the weight of seasonal factors, is the weight of the market trend.

6. The fully automatic intelligent fresh refrigerator system according to claim 1 is characterized in that: The abnormality detection and alarm system includes a preset threshold judgment module, which is used to compare the real-time monitored data with the preset threshold and trigger an alarm once the preset threshold is exceeded.

7. The fully automatic intelligent fresh refrigerator system according to claim 1 is characterized in that: The refrigerator touch screen is used to display real-time food freshness monitoring results, personalized diet suggestions and alarm information, and supports users to perform interactive operations through the touch screen.

8. The fully automatic intelligent fresh refrigerator system according to claim 1 is characterized in that: The voice prompt module can broadcast food freshness status, personalized dietary suggestions and alarm information to users through voice according to the instructions of the cloud server.

9. The fully automatic intelligent fresh refrigerator system according to claim 1, characterized in that: The mobile phone APP can remotely receive food freshness data and alarm information sent by the cloud server, and supports users to perform remote control and parameter setting through the mobile phone APP.

10. A method for operating a fully automatic intelligent fresh refrigerator system, characterized in that: The method uses the fully automatic intelligent fresh-keeping refrigerator system according to any one of claims 1 to 9, and specifically comprises: Use a high-resolution camera to collect image information of food in the refrigerator in real time; Use image processing chips and edge computing device modules to pre-process the collected image information; The RFID tag is embedded into each plate using the RFID tag and RFID reader module, and the RFID tag information is read by the RFID reader; The cloud server receives the RFID tag information read by the RFID reader, and uses the read RFID tag information to perform adaptive learning and database matching algorithm processing, and generate feedback information, including food freshness prediction results, personalized dietary recommendations and alarm information; Receive feedback information generated by the cloud server through the interactive interface and provide users with real-time monitoring and alarm reminder services.

Citation Information

Patent Citations

  • Diet management system and construction method thereof, and food material management method

    CN108766528A

  • Intelligent menu recommendation method for refrigerator and intelligent refrigerator system

    CN116434912A

  • Intelligent refrigerator with multifunctional detection and management functions

    CN117109244A

  • Cloud intelligent restaurant service management system

    CN117710157A

  • Intelligent kitchen electric equipment information interaction method and system

    CN118612005A

Cited By

  • Intelligent refrigerator sticker food material management system and method based on AI large model

    CN119939020A