Foodstuff monitoring method and device

[0115] The exemplary embodiments will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present invention. Rather, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0116] The technical solutions provided by the embodiments of the present disclosure involve a refrigerator and a terminal. The refrigerator is equipped with a camera to send the captured food image to the terminal. The terminal analyzes the food condition through the food image to remind the user. The terminal can be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and any other device with image recognition function.

[0117] figure 1 Is a flowchart of a food monitoring method according to an exemplary embodiment, such as figure 1 As shown, the food monitoring method used in the terminal includes the following steps S11-S13.

[0118] In step S11, a food image inside the refrigerator is acquired.

[0119] In step S12, the food image is analyzed to obtain food information of each type of food.

[0120] In step S13, a reminder is given based on the food information.

[0121] In this embodiment, the terminal analyzes the food images inside the refrigerator to obtain information such as the type, quantity, storage time, freshness, and consumption speed of each food, and reminds the user based on the information. In this way, the user can clearly and accurately know the food situation inside the refrigerator without personally checking the food inside the refrigerator, such as which foods are about to expire, which foods need to be purchased, etc., and the food monitoring is more convenient, fast, and accurate, and the food is improved. The safety and health of the user’s diet, the user experience is better.

[0122] In another embodiment, to obtain the food image inside the refrigerator, the food image inside the refrigerator may be obtained through a camera provided inside the refrigerator, and the food image inside the refrigerator may be obtained through the camera in the following two ways:

[0123] method one

[0124] figure 2 It is a flowchart of a camera acquiring food images inside a refrigerator according to an exemplary embodiment, such as figure 2 As shown, the following steps are included.

[0125] In step S21, the brightness of the light inside the refrigerator is monitored.

[0126] In step S22, when the brightness of the light exceeds the preset brightness value, the current time is recorded, and an image of the food inside the refrigerator is taken.

[0127] In method 1, if a non-infrared camera is used inside the refrigerator, the camera cannot capture clear and usable food images when the refrigerator door is not opened. Only when the user opens the refrigerator door and the internal lighting of the refrigerator turns on, The camera can capture clear food images. Therefore, controlling the camera to capture images when the light inside the refrigerator reaches a certain value can not only ensure the effectiveness of the video images, but also get the time for the user to take out or put the food in Follow-up analysis of food information.

[0128] Way two

[0129] The food images inside the refrigerator are periodically captured through an infrared camera set inside the refrigerator.

[0130] In the second method, if an infrared camera is used inside the refrigerator, there is no need to consider the brightness of the light inside the refrigerator. The infrared camera can also capture clear video images even in the case of insufficient light. The infrared camera periodically captures food images inside the refrigerator for subsequent analysis of food information.

[0131] In another embodiment, the food image is analyzed to obtain the food information of each type of food, and the food information can be obtained in the following ways:

[0132] Way A

[0133] According to the food image, identify the type and quantity of the food.

[0134] In method A, the video image is cut and identified, and the types of food in the refrigerator are counted, such as vegetables, fruits, eggs, milk, meat, snacks, drinks, etc., as well as the quantity of each food, so that the user is Have a basic understanding of the food situation.

[0135] Way B

[0136] Obtain the food image taken last time, compare the food image taken this time with the food image taken last time, and obtain the type, quantity and time of the food that the user took out or put in.

[0137] In mode B, by analyzing and identifying the food images taken twice adjacently, the changes in the food inside the refrigerator can be learned, that is, the information of the food taken out or put in by the user is recorded. The user's consumption rate of the food in the refrigerator and the balance of the user's dietary nutrition can be analyzed in the follow-up to improve the user's dietary health.

[0138] Way C

[0139] The quality of the food is determined according to the food image. The quality of the food includes the storage time or freshness of the food.

[0140] Among them, determining the quality of the food according to the food image includes: obtaining the color of the food according to the food image, and determining the freshness corresponding to the color of the food according to the preset correspondence between the color and the freshness of the food. Or, obtain the time when the food is put in according to the food image, calculate the time interval between the time when the food is put in and the current time, and obtain the put time of the food.

[0141] In the method C, the storage time of the food in the refrigerator can be determined according to the recorded time when the user puts the food, or the freshness of the video can be determined according to the color of the food in the food image. In this way, the user can be reminded of the stale food in the follow-up, avoiding the user from eating the stale food, and ensuring the user's food safety and healthy eating.

[0142] Way D

[0143] Calculate the consumption speed and remaining quantity of each food according to the type, quantity and time of the food that the user takes out or put in.

[0144] In mode D, through the analysis results in the above mode B, the consumption rate and remaining quantity of food can be further analyzed, which facilitates the calculation of various nutrients ingested by the user and improves the user's dietary health.

[0145] In the above-mentioned way of analyzing food images to obtain food information, various food information required by the user can be obtained comprehensively and accurately, so that the food inside the refrigerator can be effectively monitored, and the food safety and diet monitoring of the user can be ensured.

[0146] In another embodiment, after the food information is obtained, the information required by the user can be fed back to the user according to the user's preset settings. image 3 It is a flowchart of reminding based on food information according to an exemplary embodiment, such as image 3 As shown, reminding based on food information includes the following steps:

[0147] In step S31, user information is acquired. The user information includes at least one of the following information of the user: age, gender, height, weight, medical history, physical condition, and allergy information.

[0148] In step S32, the nutritional information of the user is analyzed based on the user information and food information. Among them, the nutrition information includes at least one of the following information: whether the user's nutrition is balanced, the food to be supplemented, and the intake of each food.

[0149] In step S33, the user's nutrition information is reminded.

[0150] Figure 4 It is a schematic diagram showing an interface for inputting user information according to an exemplary embodiment, such as Figure 4 As shown, the user can be allowed to input related information of the user in advance, such as age, gender, height, weight, medical history, physical condition, allergy information, and so on. Among them, the physical condition includes the user's physical development level (body size, body posture, nutritional status, etc.), physiological and biochemical function level (that is, the body's metabolic function and the work efficiency of various human systems and organs), physical fitness and athletic ability (that is, body The physical qualities such as strength, speed, endurance, agility, flexibility, and walking, running, jumping, throwing, climbing, climbing, draping, support and other sports abilities shown in life, labor, and sports), adaptability (that is, the ability to The external environment and the ability to resist cold and heat, the ability to resist diseases) and so on. Allergy information includes the user's allergens, allergic season, allergic reactions, and so on.

[0151] For example, in the allergy information input by the user, the allergen is peanuts. According to the food image, it is recognized that there are peanut butter and biscuits in the refrigerator. Both of these foods contain peanuts, the user is reminded not to eat these two foods.

[0152] For another example, according to the physique input by the user, it is determined that the user needs calcium supplementation. According to the food image, it is recognized that there are foods such as milk, eggs, beef, etc. in the refrigerator. These foods are rich in calcium, and the user is reminded to eat these foods regularly.

[0153] In this embodiment, after the terminal obtains the user information, combined with the user information and food information, it can analyze the user's nutritional information, that is, whether the user is nutritionally balanced, what kind of food needs to be eaten, what is the amount consumed, and which foods include user allergies Substances, users need to prohibit or reduce the consumption of these foods, thereby reminding users. In addition, the terminal can obtain user information of multiple users and remind different users. In this way, the user can be reminded of the food according to the user's own situation, making the reminder more accurate and effective, more intelligent, further improving the user's dietary health, and better user experience.

[0154] In another embodiment, the user may be further reminded of which foods to consume or which foods to reduce according to natural factors such as the user's location, season, climate, etc. Figure 5 It is a flowchart of reminding based on food information according to another exemplary embodiment, such as Figure 5 As shown, reminding based on food information also includes:

[0155] In step S51, at least one item of current geographic location information, seasonal information, and climate information is acquired.

[0156] In step S52, the nutritional information of the user is analyzed according to at least one of the current geographic location information, seasonal information, and climate information and food information.

[0157] In step S53, the user's nutritional information is reminded.

[0158] For example, if the user is currently located in a coastal city and recognizes that there are seafood such as fish and shrimp in the refrigerator according to the food image, the user is reminded to eat these seafood.

[0159] For another example, it is currently in summer and it is recognized that there are seasonal fruits such as watermelons and peaches in the refrigerator according to the food images, and the user is reminded to eat these seasonal foods.

[0160] For another example, the current climate is dry, and it is recognized that there are foods such as pears and radishes in the refrigerator according to the food images, and the user is reminded to eat these foods that promote body fluid and nourish the lungs.

[0161] In this embodiment, the terminal automatically acquires natural factors, and reminds the user to eat according to the natural factors. The food reminder to the user is more accurate and effective, smarter, and further improves the user's diet health, and the user experience is better.

[0162] In another embodiment, the user can pre-customize the required reminder information. For example, if the user only needs to be reminded of the quantity of a certain food, or the food is expired or is about to expire, the terminal will remind according to the information customized by the user. Image 6 It is a flowchart of reminding based on food information according to another exemplary embodiment, such as Image 6 As shown, reminding based on food information also includes:

[0163] In step S61, the preset food information to be monitored by the user is acquired, the preset food information includes at least one of the following information of the preset food type: preset food quantity and preset food quality.

[0164] In step S62, when it is determined according to the food information that the quantity of the preset food category exceeds or falls below the preset quantity of food, the user is reminded according to the quantity of the preset food category.

[0165] In step S63, when it is determined according to the food information that the food quality of the preset food category is lower than the preset food quality, the user is reminded according to the food quality of the preset food category.

[0166] For example, when the user sets the number of milk in the refrigerator to be less than 3 bottles, the user is reminded. When the terminal obtains that the number of milk in the refrigerator is 2 bottles, the user can be reminded to purchase milk in time.

[0167] For another example, the user sets a reminder when the yogurt in the refrigerator is 3 days before the expiration date or has expired. When the terminal determines that the yogurt in the refrigerator is 3 days before the expiration date, it reminds the user to consume the yogurt as soon as possible, and if it is determined that the yogurt has expired, it reminds the user to clean up the expired yogurt.

[0168] In this embodiment, reminders are provided according to user needs, so that the user can accurately know the food situation inside the refrigerator, and the food in the refrigerator can be supplemented or cleaned in time, which more effectively ensures the user's food safety and healthy eating, and has a better user experience.

[0169] The following are device embodiments of the present disclosure, which can be used to implement the method embodiments of the present disclosure.

[0170] Figure 7 It is a block diagram showing a food monitoring device according to an exemplary embodiment. The device can be implemented as part or all of an electronic device through software, hardware or a combination of both. Such as Figure 7 As shown, the food monitoring device includes:

[0171] The acquiring module 71 is configured to acquire food images inside the refrigerator.

[0172] The analysis module 72 is configured to analyze food images to obtain food information of each type of food.

[0173] The reminding module 73 is configured to remind based on food information.

[0174] In this embodiment, the image of the food inside the refrigerator acquired by the acquisition module is analyzed by the analysis module to obtain the type, quantity, storage time, freshness, consumption rate and other information of each food, and the reminder module will inform the user based on these information Make a reminder. In this way, the user can clearly and accurately know the food situation inside the refrigerator without personally checking the food inside the refrigerator, such as which foods are about to expire, which foods need to be purchased, etc., and the food monitoring is more convenient, fast, and accurate, and the food is improved. The safety and health of the user’s diet, the user experience is better.

[0175] Optionally, the acquisition module 71 is configured to acquire food images inside the refrigerator through a camera provided inside the refrigerator.

[0176] Figure 8 Is a block diagram of the acquisition module according to an exemplary embodiment, such as Figure 8 As shown, optionally, the obtaining module 71 includes:

[0177] The monitoring sub-module 81 is configured to monitor the brightness of the light inside the refrigerator.

[0178] The recording sub-module 82 is configured to record the current time when the light brightness exceeds a preset brightness value.

[0179] The photographing sub-module 83 is configured to photograph food images inside the refrigerator when the light brightness exceeds a preset brightness value.

[0180] In the optional solution, if a non-infrared camera is used inside the refrigerator, the camera cannot capture clear and usable food images when the refrigerator door is not opened, and only when the user opens the refrigerator door and the lighting inside the refrigerator turns on , The camera can capture clear food images. Therefore, the monitoring module controls the shooting sub-module to capture images when the internal light intensity of the refrigerator reaches a certain value. This not only ensures the effectiveness of shooting video images, but also allows users to be obtained by the recording sub-module. The time to take out or put in food for subsequent analysis of food information.

[0181] Picture 9 Is a block diagram showing an acquisition module according to another exemplary embodiment, such as Picture 9 As shown, optionally, the acquisition module 71 includes a photographing sub-module 91 configured to periodically photograph food images inside the refrigerator through an infrared camera arranged inside the refrigerator.

[0182] In an optional solution, if an infrared camera is used inside the refrigerator, there is no need to consider the brightness of the light inside the refrigerator, and the infrared camera can also capture clear video images in the case of insufficient light. The infrared camera periodically captures food images inside the refrigerator for subsequent analysis of food information.

[0183] Picture 10 Is a block diagram showing the analysis module according to an exemplary embodiment, such as Picture 10 As shown, optionally, the analysis module 72 includes:

[0184] The recognition sub-module 101 is configured to recognize the type and quantity of food according to the food image.

[0185] Picture 11 Is a block diagram of an analysis module according to another exemplary embodiment, such as Picture 11 As shown, optionally, the analysis module 72 further includes:

[0186] The acquiring sub-module 102 is configured to acquire the food image taken last time.

[0187] The comparison sub-module 103 is configured to compare the food image taken this time with the food image taken last time to obtain the type, quantity, and time of the food taken out or put in by the user.

[0188] Picture 12 Is a block diagram of an analysis module according to another exemplary embodiment, such as Picture 12 As shown, optionally, the analysis module 72 further includes:

[0189] The determining sub-module 104 is configured to determine the quality of the food according to the image of the food, and the quality of the food includes the storage time or freshness of the food.

[0190] Optionally, the freshness determining unit of the determining sub-module 104 may be a storage time determining unit, wherein. The freshness determining unit is configured to obtain the color of the food according to the food image, and determine the freshness corresponding to the color of the food according to a preset correspondence between the color and the freshness of the food. The placing time determining unit is configured to obtain the time when the food is put in according to the food image, calculate the time interval between the time when the food is put in and the current time, and obtain the put time of the food.

[0191] Figure 13 Is a block diagram of an analysis module according to another exemplary embodiment, such as Figure 13 As shown, optionally, the analysis module 72 further includes:

[0192] The calculation sub-module 105 is configured to calculate the consumption speed and remaining quantity of each food according to the type, quantity and time of the food taken out or put in by the user.

[0193] In the above-mentioned optional solution, the various sub-modules in the analysis module can be used to comprehensively and accurately obtain various food information required by the user, so that the food inside the refrigerator can be effectively monitored to ensure the user's food safety and diet monitoring .

[0194] Figure 14 Is a block diagram of a reminder module according to an exemplary embodiment, such as Figure 14 As shown, optionally, the reminding module 73 includes:

[0195] The first acquisition submodule 141 is configured to acquire user information, and the user information includes at least one of the following information of the user: age, gender, weight, medical history, physical condition, and allergy information.

[0196] The first analysis sub-module 142 is configured to analyze the nutrition information of the user according to the user information and food information.

[0197] The reminding submodule 143 is configured to remind the user of nutrition information.

[0198] In an optional solution, after the reminder module obtains the user information, combined with the user information and food information, the user's nutritional information can be analyzed, that is, whether the user is nutritionally balanced, what kind of food needs to be eaten, what is the amount of food, and which foods include The user is allergic to substances, and the user needs to prohibit or reduce the consumption of these foods, thereby reminding the user. In addition, the terminal can obtain user information of multiple users and remind different users. In this way, the user can be reminded of the food according to the user's own situation, making the reminder more accurate and effective, more intelligent, further improving the user's dietary health, and better user experience.

[0199] Figure 15 Is a block diagram of a reminder module according to another exemplary embodiment, such as Figure 15 As shown, optionally, the reminding module 73 further includes:

[0200] The second obtaining sub-module 144 is configured to obtain at least one of current geographic location information, seasonal information, and climate information.

[0201] The second analysis sub-module 145 is configured to analyze the nutrition information of the user according to at least one item of current geographic location information, seasonal information, and climate information and food information.

[0202] The reminding submodule 143 is configured to remind the user of nutrition information.

[0203] In an optional solution, the reminder module obtains natural factors, and reminds the user to eat according to the natural factors. The food reminder to the user is more accurate and effective, smarter, and further improves the user's diet health and the user experience is better.

[0204] Optionally, the nutritional information includes at least one of the following information:

[0205] Whether the user’s nutrition is balanced, the foods that need to be supplemented, and the intake of each food.

[0206] Figure 16 Is a block diagram of a reminder module according to another exemplary embodiment, such as Figure 16 As shown, optionally, the reminding module 73 includes:

[0207] The third acquisition sub-module 161 is configured to acquire preset food information to be monitored by the user. The preset food information includes at least one of the following information of the preset food type: preset food quantity and preset food quality.

[0208] The reminding sub-module 162 is configured to remind the user according to the food quantity of the preset food type when it is determined according to the food information that the quantity of the food of the preset food type exceeds or falls below the preset food quantity. When it is determined according to the food information that the food quality of the preset food category is lower than the preset food quality, the user is reminded according to the food quality of the preset food category.

[0209] In an optional solution, the reminder module reminds users according to user needs, so that users can accurately know the food situation inside the refrigerator, and can promptly replenish or clean the food in the refrigerator, which can more effectively ensure the user's food safety and healthy diet, and the user experience is better .

[0210] The present disclosure also provides a food monitoring device, including:

[0211] A processor and a memory for storing executable instructions of the processor.

[0212] Wherein, the processor is configured to:

[0213] Acquire food images inside the refrigerator.

[0214] The food image is analyzed to obtain food information of each type of food.

[0215] Remind based on the food information.

[0216] Regarding the device in the foregoing embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, and a detailed description will not be given here.

[0217] Figure 17 It is a block diagram showing a device for food monitoring according to an exemplary embodiment, and the device is suitable for terminal equipment. For example, the apparatus 1700 may be a camera, a recording device, a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0218] The device 1700 may include one or more of the following components: a processing component 1702, a memory 1704, a power supply component 1706, a multimedia component 1708, an audio component 1710, an input/output (I/O) interface 1712, a sensor component 1714, and a communication component 1716 .

[0219] The processing component 1702 generally controls the overall operations of the device 1700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 1702 may include one or more processors 1720 to execute instructions to complete all or part of the steps of the foregoing method. In addition, the processing component 1702 may include one or more modules to facilitate the interaction between the processing component 1702 and other components. For example, the processing component 1702 may include a multimedia module to facilitate the interaction between the multimedia component 1708 and the processing component 1702.

[0220] The memory 1704 is configured to store various types of data to support operations in the device 1700. Examples of such data include instructions for any application or method operating on the device 1700, contact data, phone book data, messages, pictures, videos, etc. The memory 1704 can be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

[0221] The power supply component 1706 provides power to various components of the device 1700. The power supply component 1706 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the device 1700.

[0222] The multimedia component 1708 includes a screen that provides an output interface between the device 1700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or slide action, but also detect the duration and pressure related to the touch or slide operation. In some embodiments, the multimedia component 1708 includes a front camera and/or a rear camera. When the device 1700 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0223] The audio component 1710 is configured to output and/or input audio signals. For example, the audio component 1710 includes a microphone (MIC), and when the device 1700 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive external audio signals. The received audio signal may be further stored in the memory 1704 or transmitted via the communication component 1716. In some embodiments, the audio component 1710 further includes a speaker for outputting audio signals.

[0224] The I/O interface 1712 provides an interface between the processing component 1702 and a peripheral interface module. The peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0225] The sensor component 1714 includes one or more sensors for providing the device 1700 with various aspects of status assessment. For example, the sensor component 1714 can detect the on/off status of the device 1700 and the relative positioning of the components. For example, the component is the display and the keypad of the device 1700. The sensor component 1714 can also detect the position change of the device 1700 or a component of the device 1700. , The presence or absence of contact between the user and the device 1700, the orientation or acceleration/deceleration of the device 1700, and the temperature change of the device 1700. The sensor assembly 1714 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact. The sensor component 1714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 1714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0226] The communication component 1716 is configured to facilitate wired or wireless communication between the device 1700 and other devices. The device 1700 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1716 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0227] In an exemplary embodiment, the apparatus 1700 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable Implemented by a gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components, for performing the above-mentioned methods.

[0228] In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as a memory 1704 including instructions, which can be executed by the processor 1720 of the device 1700 to complete the foregoing method. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0229] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the device 1700, so that the device 1700 can execute the above food monitoring method, including:

[0230] Acquire food images inside the refrigerator.

[0231] The food image is analyzed to obtain food information of each type of food.

[0232] Remind based on the food information.

[0233] Optionally, the acquiring food images inside the refrigerator includes:

[0234] The image of the food inside the refrigerator is acquired through a camera arranged inside the refrigerator.

[0235] Optionally, the acquiring food images inside the refrigerator through a camera provided inside the refrigerator includes:

[0236] Monitor the brightness of the light inside the refrigerator.

[0237] When the brightness of the light exceeds a preset brightness value, the current time is recorded, and an image of the food inside the refrigerator is taken.

[0238] Optionally, the acquiring food images inside the refrigerator through a camera provided inside the refrigerator includes:

[0239] The food images inside the refrigerator are periodically captured by an infrared camera arranged inside the refrigerator.

[0240] Optionally, it is characterized in that the analyzing the food image to obtain the food information of each type of food includes:

[0241] According to the food image, the type and quantity of the food are recognized.

[0242] Optionally, the analyzing the food image to obtain food information of each type of food further includes:

[0243] Get the last food image taken.

[0244] The food image taken this time is compared with the food image taken last time to obtain the type, quantity and time of the food that the user took out or put in.

[0245] Optionally, the analyzing the food image to obtain food information of each type of food further includes:

[0246] The quality of the food is determined according to the food image, and the quality of the food includes the storage time or freshness of the food.

[0247] Optionally, the determining the quality of the food according to the food image includes:

[0248] The color of the food is obtained according to the food image, and the freshness corresponding to the color of the food is determined according to the preset correspondence between the color and the freshness of the food.

[0249] or,

[0250] The time when the food is put in is obtained according to the food image, and the time interval between the time when the food is put in and the current time is calculated to obtain the putting time of the food.

[0251] Optionally, the analyzing the food image to obtain food information of each type of food further includes:

[0252] Calculate the consumption speed and remaining quantity of each food according to the type, quantity and time of the food that the user takes out or put in.

[0253] Optionally, the reminding based on the food information includes:

[0254] Obtain user information, where the user information includes at least one of the following information of the user: age, gender, height, weight, medical history, physical condition, and allergy information.

[0255] According to the user information and the food information, the nutritional information of the user is analyzed.

[0256] The nutritional information of the user is reminded.

[0257] Optionally, the reminding based on the food information further includes:

[0258] Obtain at least one of current geographic location information, seasonal information, and climate information.

[0259] The nutritional information of the user is analyzed according to at least one of the current geographic location information, seasonal information, and climate information and the food information.

[0260] The nutritional information of the user is reminded.

[0261] Optionally, the nutritional information includes at least one of the following information:

[0262] Whether the user’s nutrition is balanced, the foods that need to be supplemented, and the intake of each food.

[0263] Optionally, the reminding based on the food information includes:

[0264] Acquire preset food information to be monitored by the user, where the preset food information includes at least one of the following information of the preset food category: preset food quantity and preset food quality.

[0265] When it is determined according to the food information that the quantity of the preset food category exceeds or falls below the preset quantity of food, the user is reminded according to the quantity of the preset food category.

[0266] When it is determined according to the food information that the food quality of the preset food category is lower than the preset food quality, the user is reminded according to the food quality of the preset food category.

[0267] After considering the specification and practicing the disclosure disclosed herein, those skilled in the art will easily think of other embodiments of the present disclosure. This application is intended to cover any variations, uses, or adaptive changes of the present disclosure. These variations, uses, or adaptive changes follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure. . The description and the embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0268] It should be understood that the present disclosure is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.