Refrigerator AR Food Labels With Multi-Camera Item Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing refrigerator technologies face challenges in clearly viewing shielded food, updating shelf life information after food removal, providing intuitive expiration tracking, distinguishing identical food items, and requiring inconvenient repeated photo-taking for image recognition.
Innovation Solution
A method utilizing external and internal cameras to recognize food type and quantity, generate AR labels with position information, and display real-time images, updating labels when food is moved, and reminding users about expiration and improper food combinations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple internal cameras are used to capture food images from different positions, then the visibility of shielded food is improved, but the device complexity increases
Solution Approach 1:
The refrigerator interior is divided into multiple monitoring zones, with each internal camera responsible for capturing images from specific positions. This segmentation allows comprehensive coverage of shielded food areas without requiring a single complex camera system, as each camera focuses on a particular region.
Solution Approach 2:
The patent transitions from a single-plane 2D image capture to multi-angle 3D spatial positioning by deploying cameras at different heights and angles within the refrigerator. This dimensional approach enables visualization of previously shielded food items through perspective differentiation.
2Measurement precision
If AR labels are generated and updated in real-time for each food item, then the information accuracy is improved, but the processing time and energy consumption increase
Solution Approach 1:
AR labels are pre-generated with template structures containing all necessary information fields (food type, quantity, position, expiration date). When food is detected or moved, only the relevant label parameters need updating rather than regenerating entire labels, significantly reducing processing time.
Solution Approach 2:
The system automatically detects food items through image recognition and generates corresponding AR labels without manual intervention. The labels self-update when food positions change or expiration approaches, eliminating the need for user manual updates and reducing time loss.
3Measurement precision
If the system distinguishes and tracks identical food items placed at different times, then the food management precision is improved, but the image recognition complexity increases
Solution Approach 1:
When identical food items are detected, the system pre-assigns unique identification markers or metadata tags to distinguish them. This preliminary differentiation allows subsequent tracking without requiring complex continuous analysis, as each item already has its identity established.
Solution Approach 2:
The system implements continuous feedback loops that monitor food item positions and update AR labels accordingly. When food is moved or new identical items are added, the system compares current states with previous states and makes targeted adjustments, reducing recognition complexity through iterative refinement.
4Ease of operation
If real-time image display from internal cameras is provided, then the user convenience is improved, but the energy consumption increases
Solution Approach 1:
Instead of continuous real-time streaming, the system uses periodic image capture at intervals or triggered by specific events (door opening, food addition/removal detection). This periodic operation maintains user convenience by providing updated images when needed while significantly reducing energy consumption compared to continuous operation.
Solution Approach 2:
The patent introduces an image processing and compression intermediary layer that captures, processes, and transmits only essential visual information. This intermediary reduces the data transmission and processing energy requirements while maintaining adequate image quality for user convenience.
Data Source
AI summary
The application discloses a method for managing food in a refrigerator, including the steps of recognizing the type and quantity of the food placed in the refrigerator according to an image shot by an external camera of the refrigerator; determining a position of the food placed in the refrigerator according to images shot by internal cameras of the refrigerator; generating an AR label for recording information of the food with regard to the food placed in the refrigerator; displaying the AR label of the inquired food after receiving a food query request from a user; wherein the information of the food at least includes the type, quantity and position of the food; and displaying the images shot by the internal cameras in real time after receiving an image viewing request from the user. With the adoption of the application, the food in the refrigerator can be managed more efficiently.