Visual interaction system and method for food material management and storage equipment
By rendering 3D models of food ingredients in storage devices and displaying their location and status based on user actions, the problem of unclear food ingredient management in storage devices is solved, achieving intelligent food ingredient management and improving user experience and storage efficiency.
Patent Information
- Application Number
- CN202410612254.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-16
- Publication Date
- 2025-11-18
AI Technical Summary
Existing storage equipment (such as household refrigerators and freezers) lacks effective food management methods, resulting in unclear information on the location and status of food, making it difficult to optimize storage space utilization and ensure food safety.
By rendering 3D models of food ingredients in storage devices and displaying the position and status of the ingredients based on user actions (such as rotation, translation, and scaling), combined with visual prompts for expired and improperly stored ingredients, an intelligent food management system is provided.
It improves users' intuitive understanding of the location and condition of ingredients, reduces waste and food safety issues, and optimizes the utilization of storage space.
Smart Images
Figure CN120973263A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of household appliance technology, and in particular relates to a visual interactive system, method and storage device for food management. Background Technology
[0002] With the accelerating pace of life and the improvement of living standards, storage equipment (such as household refrigerators and freezers) has become an essential appliance for storing food and keeping ingredients fresh.
[0003] In related technologies, the neglect of food management inside storage devices results in a lack of intuitive and dynamic visualization of the food inside the storage devices, making it difficult to provide users with clear information on the location and status of the food. Summary of the Invention
[0004] This application aims to address at least one of the technical problems existing in the prior art. To this end, this application proposes a visual interactive system, method, and storage device for food ingredient management. By rendering a 3D model of the food ingredient into a 3D model of the storage device based on the storage compartment and physical dimensions of the food ingredient, and based on the user's initial input of actions (e.g., rotation, translation, and scaling) on the 3D model of the storage device, the corresponding 3D model of the food ingredient is displayed to the user. This allows the user to intuitively and clearly see the position and status of the food ingredient through interaction with the display interface, improving the user's interactive experience.
[0005] In a first aspect, this application provides a visual interactive system for food ingredient management, the system comprising:
[0006] The user interaction module is used to receive the first input from the user to the target 3D model in the display interface. The first input is used to instruct the user to operate on the target 3D model. The target 3D model is obtained by rendering the 3D model corresponding to each food item into the 3D model corresponding to the storage device according to the storage compartment in the storage device where each food item is located and the physical size of each food item.
[0007] The response module is used to respond to the first input, execute the operation action, and display the three-dimensional model corresponding to each ingredient to the user.
[0008] According to the visual interactive system for food management in this application, the three-dimensional model of the food is rendered into the three-dimensional model of the storage device based on the storage compartment and physical dimensions of the food. Based on the user's first input of the operation action (e.g., rotation, translation, and scaling) on the three-dimensional model of the storage device, the three-dimensional model corresponding to the food is displayed to the user. This allows the user to intuitively and clearly see the position and status of the food through interaction with the display interface, thereby improving the user's interactive experience.
[0009] According to one embodiment of this application, it also includes:
[0010] The display module is used to highlight the three-dimensional model corresponding to the first ingredient, which is either expired or an ingredient in a storage compartment that does not meet the storage conditions.
[0011] According to the visual interactive system for food ingredient management proposed in this application, by highlighting expired and improperly stored ingredients, the system can attract the user's attention to a greater extent, thereby reducing errors and waste and ensuring food safety.
[0012] According to one embodiment of this application, the response module is further configured to:
[0013] The 3D models of each ingredient are displayed to the user in the form of icons;
[0014] The size relationship between the icons corresponding to each ingredient is determined based on the physical size of each ingredient.
[0015] According to the visual interactive system for food management in this application, the size relationship between the icons of each food item displayed to the user is determined based on the physical size of each food item. For example, food items with larger physical sizes are displayed with relatively larger icons, and food items with smaller physical sizes are displayed with relatively smaller icons, so that users can intuitively perceive the usage of storage space in the storage device.
[0016] According to one embodiment of this application, the user interaction module is further configured to:
[0017] Receive a second input from the user on the display interface, the second input being used to determine the target storage compartment selected by the user;
[0018] Accordingly, the response module is also configured to respond to the second input by displaying the icon corresponding to the second ingredient in the target storage compartment to the user.
[0019] According to one embodiment of this application, the user interaction module is further configured to:
[0020] Receive the user's command to move the icon corresponding to the second ingredient;
[0021] Accordingly, the response module is also configured to respond to the movement command by moving the icon corresponding to the second ingredient to the target position in the display interface.
[0022] According to the visual interactive system for food ingredient management disclosed in this application, the system displays icons corresponding to the food ingredients in the target storage compartment to the user through interaction with the display interface. Based on the user's received movement command for the icon, the system moves the icon to the target position on the display interface, thereby enabling the user to manage the icons corresponding to the food ingredients and improving the convenience of managing the icons corresponding to the food ingredients.
[0023] According to one embodiment of this application, the user interaction module is further configured to:
[0024] The system receives a third input from the user on the display interface. The third input is used to determine the optimal storage conditions for each ingredient, the physical size of each ingredient, and the frequency of the user's use of each ingredient.
[0025] Accordingly, the response module is also used to determine the optimal storage compartment for each ingredient in response to the third input.
[0026] According to the visual interactive system for food management in this application, by combining the optimal storage conditions, physical dimensions, and user frequency of each food item, the system can find the best storage compartment for each food item. This not only optimizes the storage location of the food items and effectively prevents cross-contamination between food items, but also improves the utilization efficiency of the internal storage space of the storage equipment.
[0027] According to one embodiment of this application, it also includes:
[0028] The data acquisition module is used to determine the storage compartments of each ingredient in the storage equipment and the physical dimensions of each ingredient.
[0029] According to one embodiment of this application, it also includes:
[0030] The reminder module is used to send reminder messages to users when it is determined that the storage compartment where the food is located does not meet the storage conditions or the food is nearing its expiration date.
[0031] According to the visual interactive system for food management proposed in this application, by providing users with feedback on food that is nearing its expiration date and food that is not stored properly, it helps users to better store food, further reduce food waste, and promote food safety and freshness in household consumption.
[0032] Secondly, this application provides a visual interactive method for food ingredient management, which is applied to the visual interactive system for food ingredient management as described in the first aspect above, including:
[0033] The system receives a first input from the user to the target 3D model in the display interface. The first input is used to instruct the user to operate on the target 3D model. The target 3D model is obtained by rendering the 3D model corresponding to each food ingredient into the 3D model corresponding to the storage device based on the storage compartment in the storage device where each food ingredient is located and the physical size of each food ingredient.
[0034] In response to the first input, the operation is performed to display the three-dimensional models corresponding to each ingredient to the user.
[0035] According to the visual interactive method for food management in this application, the three-dimensional model of the food is rendered into the three-dimensional model of the storage device based on the storage compartment and physical dimensions of the food. Based on the user's first input of the operation action (e.g., rotation, translation, and scaling) on the three-dimensional model of the storage device, the three-dimensional model corresponding to the food is displayed to the user. This allows the user to intuitively and clearly see the position and status of the food through interaction with the display interface, thereby improving the user's interactive experience.
[0036] Thirdly, this application provides a storage device, including a visual interactive system for food management as described in the first aspect above.
[0037] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description
[0038] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which:
[0039] Figure 1 This is one of the structural schematic diagrams of a visual interactive system for food ingredient management provided in the embodiments of this application;
[0040] Figure 2 This is a second schematic diagram of the structure of the visual interactive system for food ingredient management provided in the embodiments of this application;
[0041] Figure 3 This is the third schematic diagram of the structure of the visual interactive system for food ingredient management provided in the embodiments of this application;
[0042] Figure 4 This is the fourth structural schematic diagram of the visual interactive system for food ingredient management provided in the embodiments of this application;
[0043] Figure 5 This is the fifth schematic diagram of the structure of the visual interactive system for food ingredient management provided in the embodiments of this application;
[0044] Figure 6This is a flowchart illustrating the visual interactive method for food ingredient management provided in an embodiment of this application;
[0045] Figure 7 This is a schematic diagram of the structure of the storage device provided in the embodiments of this application. Detailed Implementation
[0046] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0047] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0048] In related technologies, the long-term neglect of the internal management of storage devices (such as household refrigerators and freezers) and the methods of food storage has led to many families facing food waste, food expiration, or food safety issues caused by improper storage. Although refrigerator technology has continued to advance, such as from single-door to double-door and then to multi-door designs, and the introduction of frost-free technology and inverter technology, related technologies still fall short in effectively managing and optimizing the storage of food.
[0049] Traditional refrigerator internal management relies on user experience and habits, lacking intelligent assistance. Users often struggle to accurately remember all the food stored in the refrigerator and its expiration dates, leading to expired food going unnoticed or fresh food spoiling due to being crushed by older items. Furthermore, due to the lack of effective storage strategies, the internal space of the refrigerator is often underutilized, and the placement of food can affect its preservation and the refrigerator's energy efficiency.
[0050] In recent years, with the development of Internet of Things (IoT) technology and the popularization of the smart home concept, refrigerators have also begun to develop in the direction of "intelligence." This includes using hardware such as built-in cameras and temperature and humidity sensors, combined with the mobile internet, to achieve remote monitoring and control of the refrigerator's internal conditions. However, these technologies usually only provide basic information about the refrigerator's interior and fail to deeply address fundamental issues in food management, such as real-time visual management of food, expiration alerts, and storage optimization.
[0051] Therefore, this application provides a visual interactive system, method, and storage device for food ingredient management to solve the aforementioned technical problems and improve the intelligence level of food ingredient management in storage devices (such as household refrigerators and freezers). This requires not only innovation in hardware but also in-depth research at the software and algorithm levels to achieve functions such as three-dimensional visual management of food ingredients, intelligent storage optimization, and instant alerts for expired food ingredients, thereby reducing food waste, improving food safety, and optimizing user experience.
[0052] The following description, in conjunction with the accompanying drawings, details the visual interactive system, visual interactive method, and storage device for food ingredient management provided in this application, through specific embodiments and application scenarios.
[0053] like Figure 1 As shown, the visual interactive system for food ingredient management includes a user interaction module 100 and a response module 200.
[0054] The user interaction module 100 is used to receive a first input from the user to the target 3D model in the display interface. The first input is used to instruct the user to operate on the target 3D model. The target 3D model is obtained by rendering the 3D model corresponding to each food ingredient into the 3D model corresponding to the storage device according to the storage compartment in the storage device where each food ingredient is located and the physical size of each food ingredient.
[0055] The response module 200 is used to respond to the first input, execute the operation action, and display the three-dimensional model corresponding to each ingredient to the user.
[0056] Understandably, this target 3D model visually reflects the actual physical structure inside the storage device 300 (such as a household refrigerator), ensuring that users can accurately understand the internal space and layout of the refrigerator based on this target 3D model. Specifically, this target 3D model is obtained by rendering the 3D model corresponding to each food item onto the corresponding 3D model of the refrigerator, based on the location information of each food item (i.e., its storage compartment within the refrigerator) and the physical dimensions of each food item (including shape and volume). Both the 3D models of each food item and the 3D model of the refrigerator are pre-stored in the built-in database of the storage device 300, such as the household refrigerator. The volume of each food item can be estimated based on its shape and physical dimensions.
[0057] This display interface can be used to show users the aforementioned target 3D model.
[0058] See Figure 2 The display interface allows users to rotate, scale, and translate the target 3D model through the built-in touch screen of the home refrigerator, so as to view the 3D model corresponding to the food in the target 3D model.
[0059] In a specific implementation, the user interaction module 100 receives the user's first input on the target 3D model on the display interface. This first input is used to instruct the user on the operation of the target 3D model, such as rotation, scaling, translation, etc.
[0060] The first input can be implemented in at least one of the following ways:
[0061] Firstly, the first input method can be implemented as touch input, including but not limited to click input, swipe input, and press input.
[0062] In this embodiment, receiving the user's first input on the display interface of the storage device 300 can be manifested as receiving the user's touch operation on the display interface of the storage device 300.
[0063] Secondly, the first input can be implemented as voice command input.
[0064] In this embodiment, receiving the user's first input on the display interface can be manifested as receiving the user's voice input from the voice assistant 400 on the display interface, such as natural language expressions like "rotate left," "rotate right," and "zoom in." When the user receives the aforementioned voice commands such as rotation, scaling, and translation of the target 3D model, the first input is triggered, allowing the user to intuitively see the position and status information of each food item inside the storage device 300 even when their hands are occupied.
[0065] Of course, in other embodiments, the first input can also be implemented in other forms, including but not limited to motion gesture input (for example, a user can control the viewing of any angle inside the storage device 300 through gestures), etc. The specific implementation can be determined according to actual needs, and this application embodiment does not limit it.
[0066] By allowing users to easily operate the refrigerator via touchscreen or voice commands—such as rotating, zooming, and panning the 3D model, as well as simply selecting specific compartments and adjusting food placement—this intuitive and interactive user interface significantly enhances the user experience while helping users manage and optimize refrigerator space more efficiently.
[0067] The response module 200 processes the user's first input regarding the operation actions of the target 3D model and executes the corresponding operation actions, performing operations such as rotation, scaling, and translation on the target 3D model, and fully displaying the 3D models corresponding to each ingredient in the target 3D model to the user.
[0068] According to the embodiments of this application, the visual interactive system for food management renders the three-dimensional model of the food into the three-dimensional model of the storage device based on the storage compartment and physical dimensions of the food. Based on the user's first input of the operation action (e.g., rotation, translation, and scaling) on the three-dimensional model of the storage device, the three-dimensional model corresponding to the food is displayed to the user. This allows the user to intuitively and clearly see the position and status of the food through interaction with the display interface, thus improving the user's interactive experience.
[0069] In some embodiments, the visual interactive system for food ingredient management may further include:
[0070] The display module is used to highlight the three-dimensional model corresponding to the first ingredient, which is either expired or an ingredient in a storage compartment that does not meet the storage conditions.
[0071] Optionally, the visual interactive system for food ingredient management also includes a display module.
[0072] The display module is specifically used to highlight the 3D model corresponding to the first ingredient. The first ingredient can be expired food in the storage device 300, or food in the storage compartment of the storage device 300 that does not meet the storage conditions (including storage temperature, humidity requirements, etc.), i.e., improperly stored food.
[0073] Expired and improperly stored ingredients can be distinguished by different methods of highlighting. For example, the corresponding 3D model of expired ingredients can be highlighted in red, while the corresponding 3D model of improperly stored ingredients can flash. Alternatively, a simple LED lighting system can be used instead of a screen display to indicate the condition of the ingredients. For instance, an LED light next to expired ingredients flashes red, while an LED light next to ingredients unsuitable for storage emits yellow light. Of course, other different forms of highlighting can also be used in this embodiment, and this application does not impose specific limitations on them. In a real-world scenario, when ingredients are placed in the storage device 300, a camera deployed inside the storage device 300 captures an image of the ingredients. This image includes the expiration date of the ingredients and the storage compartment where the ingredients are located. When expired ingredients are detected, the corresponding 3D model of the ingredients is highlighted in red; when improperly stored ingredients are detected, the corresponding 3D model of the ingredients flashes.
[0074] This application addresses the problem of traditional storage equipment struggling to provide timely warnings about expired food or indicate improper storage conditions. By visually displaying the expiration date of food and its storage environment (e.g., highlighting expired food in red and flashing warnings for food unsuitable for storage), it effectively reminds users of food expiration dates and storage conditions, thereby reducing food waste and preventing food safety issues caused by improper storage.
[0075] For example, the storage device 300 stores food items including milk, eggs, watermelon, and apples. Based on the attributes of each food item, the corresponding storage conditions can be determined. For instance, the temperature requirement for the storage compartment containing milk, eggs, and apples is 4 degrees Celsius, and the humidity requirement is 70%–85%. The temperature requirement for the storage compartment containing watermelon is 7 degrees Celsius, and the humidity requirement is 40%–60%. The storage device 300 includes a total of eight storage compartments with different temperature and humidity settings. Only storage compartments 1 and 2 can have their temperature set to 4 degrees Celsius and their humidity set to 75%. Storage compartment 3 can have its temperature set to 7 degrees Celsius and its humidity set to 50%. If the storage compartments containing milk, eggs, and apples are not storage compartments 1 and 2, and the watermelon is in storage compartment 3, then milk, eggs, and apples are determined to be improperly stored food items. The corresponding 3D models of milk, eggs, and apples will then be displayed in a flashing manner.
[0076] The visual interactive system for food ingredient management provided in the embodiments of this application can attract users' attention to a greater extent by highlighting expired and improperly stored ingredients, thereby reducing errors and waste and ensuring food safety.
[0077] In some embodiments, the response module 200 can also be used for:
[0078] The 3D models of each ingredient are displayed to the user in the form of icons;
[0079] The size relationship between the icons corresponding to each ingredient is determined based on the physical size of each ingredient.
[0080] Optionally, the response module 200 displays the 3D models corresponding to each ingredient to the user in the form of icons. The shape of the icon can be based on the shape of the ingredient, and the size of the icon is determined by the physical size of the ingredient. For example, ingredients with larger physical sizes are displayed with relatively larger icons, and ingredients with smaller physical sizes are displayed with relatively smaller icons.
[0081] To allow users to clearly see the storage location of ingredients, icons corresponding to each ingredient are placed in its respective storage compartment. For example... Figure 3 As shown, assuming that storage compartment 500 of storage device 300 stores eggs, apples, and milk, and another compartment stores watermelons, the 3D models corresponding to eggs, apples, and milk are displayed as icons on the display interface. The four items are ordered from smallest to largest physical size as eggs, milk, apples, and watermelons. Therefore, the icon 501 corresponding to eggs is the smallest, the icon 502 corresponding to milk is the second largest, the icon 504 corresponding to watermelons is the largest, and the icon 503 corresponding to apples is between the sizes of the icons 502 and 504 corresponding to milk and watermelons, respectively.
[0082] According to the embodiments of this application, the visual interactive system for food management determines the size relationship between the icons of each food item displayed to the user based on the physical size of each food item. For example, food items with larger physical sizes are displayed with relatively larger icons, and food items with smaller physical sizes are displayed with relatively smaller icons, so that users can intuitively perceive the usage of storage space in the storage device.
[0083] In some embodiments, the user interaction module 100 can also be used for:
[0084] Receive a second input from the user on the display interface, the second input being used to determine the target storage compartment selected by the user;
[0085] Accordingly, the response module 200 is also configured to respond to the second input by displaying the icon corresponding to the second ingredient in the target storage compartment to the user.
[0086] Understandably, this second input is used to determine the target storage compartment selected by the user. The target storage compartment can be any of the storage compartments in the storage device 300.
[0087] The user interaction module 100 can also receive a second input from the user on the display interface.
[0088] The second input can be implemented in at least one of the following ways:
[0089] Firstly, the second input method can be implemented as touch input, including but not limited to click input, swipe input, and press input.
[0090] In this embodiment, receiving the second input from the user on the display interface of the storage device 300 can be manifested as receiving the user's touch operation on the display interface of the storage device 300.
[0091] Secondly, the second input can be implemented as voice command input.
[0092] In this embodiment, receiving the second input from the user on the display interface can be manifested as receiving the user's voice input from the voice assistant 400 on the display interface, such as natural language expressions like "first storage compartment" or "second storage compartment". When the user's voice command input regarding selecting any storage compartment 500 is received, the second input is triggered.
[0093] Of course, in other embodiments, the second input can also be implemented in other forms, including but not limited to motion-sensing gesture input, which can be determined according to actual needs. This application embodiment does not limit this.
[0094] After receiving the second input from the user on the display interface, the response module 200 pops up an icon corresponding to the food ingredient (i.e., the second food ingredient) in the target storage compartment selected by the user on the display interface.
[0095] like Figure 4 As shown, when the user interaction module 100 receives a double-click or single-click action from the user on the display interface for the target storage compartment in the storage device 300, it selects the target storage compartment and pops up an icon of the food inside the target storage compartment on the display interface.
[0096] In some embodiments, the user interaction module 100 can also be used for:
[0097] Receive the user's command to move the icon corresponding to the second ingredient;
[0098] Accordingly, the response module 200 is also configured to, in response to the movement command, move the icon corresponding to the second ingredient to the target position in the display interface.
[0099] Optionally, the target location can be the storage compartment where the icon corresponding to the second ingredient is located after being moved, or it can be the trash can in the display interface. Users can drag and drop to adjust the storage compartment where the icon corresponding to the ingredient is located; the display interface provides a magnetic attachment function to facilitate dragging the icon into the designated storage compartment. Simultaneously, a "trash can" icon is displayed on the display interface, allowing users to drag the icon corresponding to the ingredient into the "trash can" to delete it.
[0100] In the specific implementation, the user interaction module 100 receives the user's movement command for the icon corresponding to the second ingredient.
[0101] The movement command can be implemented in at least one of the following ways:
[0102] Firstly, movement commands can be implemented through touch input, including but not limited to click input, swipe input, and press input.
[0103] In this embodiment, receiving a user's movement command on the display interface of the storage device 300 can be manifested as receiving a user's touch operation on the display interface of the storage device 300.
[0104] Secondly, movement commands can be implemented through voice command input.
[0105] In this embodiment, receiving a user's movement command on the display interface can be manifested as receiving the user's voice input to the voice assistant 400 on the display interface, such as natural language expressions like "move the icon corresponding to ingredient A from storage compartment B to storage compartment C" or "move the icon corresponding to ingredient A from storage compartment B to the trash can." When the user's voice command input regarding moving the icon corresponding to ingredient A is received, the movement command is triggered.
[0106] Of course, in other embodiments, the movement command can also be implemented in other forms, including but not limited to motion gesture input, which can be determined according to actual needs. This application embodiment does not limit this.
[0107] After receiving the user's instruction to move the second ingredient, the response module 200 moves the icon corresponding to the second ingredient to the target position on the display interface.
[0108] After the user confirms the new location of the food, the storage information in the storage device is updated. Food that has not been rearranged will remain in its original state by default.
[0109] According to the embodiments of this application, the visual interactive system for food ingredient management displays icons corresponding to the food ingredients in the target storage compartment to the user through interaction between the user and the display interface. Based on the received user's movement command for the icon, the system moves the icon to the target position on the display interface, thereby enabling the user to manage the icons corresponding to the food ingredients and improving the convenience of managing the icons corresponding to the food ingredients for the user.
[0110] In some embodiments, the user interaction module 100 can also be used for:
[0111] The system receives a third input from the user on the display interface. The third input is used to determine the optimal storage conditions for each ingredient, the physical size of each ingredient, and the frequency of the user's use of each ingredient.
[0112] Accordingly, the response module 200 is also configured to determine the optimal storage compartment for each ingredient in response to the third input.
[0113] Understandably, the user interaction module 100 can also be used to receive a third input from the user on the display interface, which can be used to determine the optimal storage conditions for each ingredient, the physical size of each ingredient, and the frequency of the user's use of each ingredient.
[0114] The third input can be implemented in at least one of the following ways:
[0115] Firstly, the third input method can be implemented as touch input, including but not limited to click input, swipe input, and press input.
[0116] In this embodiment, receiving a third input from the user on the display interface of the storage device 300 can manifest as receiving a touch operation from the user on the display interface of the storage device 300. For example, such as Figure 5 As shown, a "One-Click Organize" control is set in the display interface. When the user double-clicks or clicks the "One-Click Organize" control, the third input is triggered.
[0117] Secondly, the third input can be implemented as voice command input.
[0118] In this embodiment, receiving the third input from the user on the display interface can be manifested as receiving the user's voice input from the voice assistant 400 on the display interface.
[0119] Of course, in other embodiments, the third input can also be implemented in other forms, including but not limited to motion-sensing gesture input, etc. The specific implementation can be determined according to actual needs, and this application embodiment does not limit it.
[0120] After receiving the third input from the user to determine the optimal storage compartment for each ingredient, the physical dimensions of each ingredient, and the frequency of the user's use of each ingredient, the response module 200 obtains the optimal storage compartment for each ingredient.
[0121] In practice, the system analyzes the optimal storage conditions (including temperature and humidity) and physical dimensions of each food item. Considering user habits, frequently used items are prioritized for easier access. Different sized icons visually represent the volume differences of the food items, enabling users to make informed storage decisions. When a user activates the "One-Click Organize" function, the system automatically identifies the food items inside the storage unit, analyzes their volume, temperature requirements, and usage frequency, and determines the optimal storage compartment for each item based on the following process:
[0122] Ingredient attribute input:
[0123] The input attributes for each ingredient include optimal storage temperature, humidity, volume (which can be estimated based on the physical dimensions of the ingredient), and the user's frequency of use for each ingredient. The user's frequency of use is derived by analyzing past usage history.
[0124] Storage space allocation within the storage equipment:
[0125] The storage unit is divided into multiple storage compartments (such as refrigerators and freezers), each with a specific temperature and humidity range. Each compartment is further divided into 4x2 equal-area zones for planning food storage. This compartmentalization can be based on the refrigerator's physical design; for example, many household refrigerators already have dedicated vegetable and fruit compartments and freezers.
[0126] Storage location planning:
[0127] Create a priority queue and sort ingredients based on their usage frequency. Starting with the highest priority ingredient, select an optimal storage compartment for each ingredient, prioritizing spaces that meet optimal temperature and humidity conditions. If multiple locations are available, choose the easiest to access (based on user usage frequency). If an ingredient cannot be placed in the preferred location due to its size, move it to the next suitable location and update the available space. Furthermore, within eligible storage compartments, larger ingredients occupy more blocks (e.g., watermelons occupy 4 blocks, apples occupy 1 block).
[0128] Storage information update:
[0129] When a user drags the icon corresponding to an ingredient on the display screen, the system will suggest the best storage compartment for that ingredient. When the user approaches any suggested best storage compartment, a magnetic attraction effect will appear on the display screen to help the user place the ingredient into that compartment. After the user confirms the ingredient's location, the system updates the storage location information in the ingredient management system.
[0130] Imagine a user opens their refrigerator and finds milk, eggs, watermelon, and several apples. The user wants to use the one-click organization feature to rearrange these ingredients to optimize storage space and make them easier to use.
[0131] Ingredient attribute input:
[0132] Milk: Refrigerated at 4℃ and 70% humidity, frequently used;
[0133] Eggs: Refrigerated at 4°C and 75% humidity, used at a moderate frequency;
[0134] Watermelon: Refrigeration room temperature 7℃, humidity 40%~60%, low usage frequency;
[0135] Apples: Refrigeration temperature 4℃, humidity 70%, moderate usage frequency.
[0136] Cold storage area allocation:
[0137] The refrigerator compartment is divided into 8 zones, each with different temperatures and humidity levels to suit different ingredients.
[0138] Storage location planning:
[0139] The system sorts ingredients based on their attributes and the frequency of user usage. For example, milk, being used most frequently, is placed in the most easily accessible location. Watermelon, being larger, is placed in the appropriate temperature zone due to its lower usage frequency, thus occupying more space. Eggs and apples are arranged in their respective positions based on their usage frequency and size.
[0140] Storage information update:
[0141] When a user activates the one-click organization function, the system automatically determines the optimal storage location for the food. Milk is placed at the front of the refrigerator compartment, watermelon is placed in the middle section, occupying four compartments. Eggs are prioritized for easy access, and apples are placed in the remaining space. After the user confirms the food placement, the system automatically updates the storage location information in the refrigerator's food management system. Through this function, the refrigerator not only ensures optimal food preservation but also improves space utilization and user convenience through intelligent planning.
[0142] It should be noted that this application can also employ machine learning algorithms based on past user behavior to automatically recommend the optimal placement of ingredients, rather than solely based on the physical size and storage requirements of the ingredients. The introduction of robotic arm technology enables fully automated ingredient handling. After the user inputs commands through a display interface, the robotic arm automatically moves the ingredients from one location to another, eliminating the need for manual adjustment by the user.
[0143] This application uses a one-click sorting function to analyze the optimal storage conditions for ingredients and the potential cross-contamination between ingredients, optimize the storage location and environment of ingredients, maintain the best freshness and safety of ingredients, further reduce waste, and improve food utilization.
[0144] It should be noted that after users manually adjust the location of ingredients or use the one-click organization function, the system will automatically analyze the rationality of the new food storage plan. For example, apples release ethylene gas when stored, which accelerates the ripening process of certain vegetables; therefore, it is recommended that users store them separately. Improvement suggestions will be provided promptly through text or graphics. This real-time feedback mechanism ensures that the food storage plan remains optimized at all times, while also providing opportunities to help users improve and understand how to better store food.
[0145] The system also provides shelf-life management and optimization reminders: the intelligent storage optimization engine has a built-in monitoring function for food shelf-life, which can automatically identify and remind users to prioritize or replace foods that are about to expire. By predicting the remaining freshness of ingredients, food waste can be effectively reduced, and the food safety and freshness of family consumption can be ensured. In this embodiment, real-time data streams and big data analysis can also be combined to conduct in-depth analysis of the whole family's eating habits, thereby providing more personalized food storage suggestions and menu recommendations to help users make more effective use of ingredients.
[0146] This application analyzes the physical characteristics and shelf life of ingredients, combined with user habits, to provide intelligent and personalized storage suggestions. Through a real-time feedback mechanism, the system can automatically analyze the rationality of the new ingredient arrangement after the user adjusts the ingredient's position or uses the one-click organization function, and provide timely improvement suggestions. This intelligent analysis and suggestion feedback mechanism ensures that the ingredient storage plan remains optimized at all times and helps users learn how to store ingredients more effectively, improving overall ingredient management efficiency.
[0147] The user recently purchased eggs, beef, fresh tofu, and various vegetables and stored them in the refrigerator. To ensure these ingredients remain at their best for up to a week, the system provides storage recommendations based on the characteristics of each ingredient. For example, the system detects that beef has a relatively short shelf life and needs to be consumed within a few days of purchase or frozen. The system will remind the user via push notification, suggesting they plan a beef meal in the next few days or freeze it to extend its shelf life. Similarly, recognizing the short shelf life and unsuitability for freezing of fresh tofu, the system recommends consuming it within a few days of purchase and provides some simple tofu recipes for inspiration. In this way, the ingredient storage recommendation system not only helps families effectively manage the shelf life of their ingredients but also encourages them to try new dishes while reducing food waste.
[0148] According to the embodiments of this application, the visual interactive system for food management can find the best storage compartment for each food by combining the optimal storage conditions, physical size, and frequency of use of each food by the user. This can not only optimize the storage location of the food and effectively prevent cross-contamination of food, but also improve the utilization efficiency of the internal storage space of the storage equipment.
[0149] In some embodiments, the system may further include:
[0150] The data acquisition module is used to determine the storage compartments of each ingredient in the storage equipment and the physical dimensions of each ingredient.
[0151] In some embodiments, the system may further include:
[0152] The reminder module is used to send reminder messages to users when it is determined that the storage compartment where the food is located does not meet the storage conditions or the food is nearing its expiration date.
[0153] Optionally, the visual interactive system for food ingredient management may also include a data acquisition module, which may be used to determine the storage compartments in the storage equipment where each food ingredient is located and the physical dimensions (e.g., shape) of each food ingredient.
[0154] The data acquisition module can include imaging sensors or cameras, distributed on the top and side walls of the storage unit, to capture the physical size and location information of food items from all angles. Alternatively, the module can use radio frequency identification (RFID) tags instead of imaging sensors for food identification. Each food item is identified upon entering the refrigerator by attaching an RFID tag, and its physical size and location information are recorded by an RFID reader inside the refrigerator. The module can also utilize QR code or barcode scanning, combined with the refrigerator's built-in scanner, to identify and manage food items. Users can manually scan the QR codes or barcodes of newly purchased food items to record their physical size and location information.
[0155] This application embodiment captures the shape and position information of food ingredients through multiple imaging sensors inside the storage device, and can interact with the target three-dimensional model through touch screen or voice commands, so as to realize the rotation, scaling and translation of the target three-dimensional model, providing users with an intuitive and interactive way of managing food ingredients.
[0156] This application embodiment uses color coding (such as highlighting expired ingredients in red and flashing to indicate ingredients that are not suitable for storage) to intuitively express the state and storage suitability of ingredients, thereby improving the user experience and food safety management.
[0157] This application embodiment automatically proposes the optimal food storage solution by combining complex data analysis of food type, optimal storage conditions, physical size, and user frequency of food use. This involves food classification, generation of optimized storage schemes, adjustment of weight distribution and operational efficiency, as well as prevention of cross-contamination and preservation.
[0158] In this embodiment of the application, after the user manually adjusts the position of the ingredients or uses the one-click sorting function, the system automatically analyzes the rationality of the new ingredient storage plan and provides real-time improvement suggestions and shelf-life management reminders.
[0159] The visual interactive system for food management provided in the embodiments of this application helps users better store food by providing feedback on food that is about to expire and food that is not stored properly, thereby reducing food waste and promoting food safety and freshness in household consumption.
[0160] The visualization and interactive method for food ingredient management provided in this application can be executed by a visualization and interactive system for food ingredient management. This application uses a visualization and interactive system for food ingredient management as an example to illustrate the visualization and interactive method for food ingredient management provided in this application.
[0161] This application also provides a visual interactive method for food ingredient management.
[0162] like Figure 6 As shown, the visual interactive method for food ingredient management includes: step 110 and step 120.
[0163] Step 110: Receive the user's first input on the target 3D model in the display interface. The first input is used to instruct the user on the operation of the target 3D model. The target 3D model is obtained by rendering the 3D model corresponding to each food ingredient into the 3D model corresponding to the storage device according to the storage compartment in the storage device where each food ingredient is located and the physical size of each food ingredient.
[0164] Step 120: In response to the first input, perform the operation to display the three-dimensional models corresponding to each ingredient to the user.
[0165] According to the visualization and interaction method for food management provided in the embodiments of this application, the three-dimensional model of the food is rendered into the three-dimensional model of the storage device based on the storage compartment and physical size of the food. Based on the user's first input of the operation action (e.g., rotation, translation, and scaling) on the three-dimensional model of the storage device, the three-dimensional model corresponding to the food is displayed to the user. This allows the user to intuitively and clearly see the position and status of the food through interaction with the display interface, thereby improving the user's interactive experience.
[0166] The visual interactive method for food ingredient management provided in this application embodiment can be applied to... Figures 1 to 5 To avoid repetition, the system will not be described in detail here.
[0167] This application also provides a storage device.
[0168] like Figure 7 As shown, the storage device 300 includes the aforementioned visual interactive system 301 for food management.
[0169] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0170] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0171] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
[0172] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.
[0173] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the claims and their equivalents.
Claims
1. A visual interactive system for food ingredient management, characterized in that, include: The user interaction module is used to receive the first input from the user to the target 3D model in the display interface. The first input is used to instruct the user to operate on the target 3D model. The target 3D model is obtained by rendering the 3D model corresponding to each food item into the 3D model corresponding to the storage device according to the storage compartment in the storage device where each food item is located and the physical size of each food item. The response module is used to respond to the first input, execute the operation action, and display the three-dimensional model corresponding to each ingredient to the user.
2. The visual interactive system for food ingredient management according to claim 1, characterized in that, Also includes: The display module is used to highlight the three-dimensional model corresponding to the first ingredient, which is either expired or an ingredient in a storage compartment that does not meet the storage conditions.
3. The visual interactive system for food ingredient management according to claim 1, characterized in that, The response module is also used for: The 3D models of each ingredient are displayed to the user in the form of icons; The size relationship between the icons corresponding to each ingredient is determined based on the physical size of each ingredient.
4. The visual interactive system for food ingredient management according to claim 3, characterized in that, The user interaction module is also used for: Receive a second input from the user on the display interface, the second input being used to determine the target storage compartment selected by the user; Accordingly, the response module is also configured to respond to the second input by displaying the icon corresponding to the second ingredient in the target storage compartment to the user.
5. The visual interactive system for food ingredient management according to claim 4, characterized in that, The user interaction module is also used for: Receive the user's command to move the icon corresponding to the second ingredient; Accordingly, the response module is also configured to respond to the movement command by moving the icon corresponding to the second ingredient to the target position in the display interface.
6. The visual interactive system for food ingredient management according to claim 1, characterized in that, The user interaction module is also used for: The system receives a third input from the user on the display interface. The third input is used to determine the optimal storage conditions for each ingredient, the physical size of each ingredient, and the frequency of the user's use of each ingredient. Accordingly, the response module is also used to determine the optimal storage compartment for each ingredient in response to the third input.
7. The visual interactive system for food ingredient management according to any one of claims 1-6, characterized in that, Also includes: The data acquisition module is used to determine the storage compartments of each ingredient in the storage equipment and the physical dimensions of each ingredient.
8. The visual interactive system for food ingredient management according to any one of claims 1-6, characterized in that, Also includes: The reminder module is used to send reminder messages to users when it is determined that the storage compartment where the food is located does not meet the storage conditions or the food is nearing its expiration date.
9. A visual interactive method for food ingredient management, characterized in that, The system applied to the visual interactive system for food ingredient management as described in any one of claims 1-8 includes: The system receives a first input from the user to the target 3D model in the display interface. The first input is used to instruct the user to operate on the target 3D model. The target 3D model is obtained by rendering the 3D model corresponding to each food ingredient into the 3D model corresponding to the storage device based on the storage compartment in the storage device where each food ingredient is located and the physical size of each food ingredient. In response to the first input, the operation is performed to display the three-dimensional models corresponding to each ingredient to the user.
10. A storage device, characterized in that, This includes the visual interactive system for food ingredient management as described in any one of claims 1-8.