Refrigerator Interior Imaging for Drawer and Shelf Food Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional refrigerators require opening the door to check the interior, leading to inefficiencies in food storage management, such as redundant purchases or missed items, due to limited camera range and poor power management, and issues with dew condensation and picture quality.

Innovation Solution

A refrigerator with a camera fixed to the ceiling that captures images of both the external and internal food storage regions, using a controller to separate and store images of these regions, and a display to show them intuitively, while minimizing camera shake and power consumption, and preventing dew condensation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are installed to photograph various storage regions, then the photographing coverage is improved, but the device complexity and cost increase

Engineering Contradiction:
Improvephotographing coverageVSAvoidnumber of cameras
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent applies the dynamics principle by making the camera rotatable to photograph different storage regions. The camera can rotate to capture images of multiple storage compartments including the refrigerating compartment, freezing compartment, and drawers, replacing the need for multiple fixed cameras with a single dynamic camera system.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements universality by designing a single camera system that serves multiple functions - photographing various storage regions at different angles and positions. The camera can capture images of different compartments by rotating, making one device perform the work of multiple cameras.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If the camera operates continuously to capture food storage information, then the information freshness is improved, but the power consumption increases

Engineering Contradiction:
Improveinformation freshnessVSAvoidcamera power consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent applies periodic action by controlling the camera to photograph only at specific intervals - when the door is opened or closed. The controller receives door opening/closing signals and triggers the camera to capture images at these periodic moments, rather than operating continuously, thus reducing power consumption while still providing timely food storage information.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses feedback from door sensors to trigger camera operation. When the door opening/closing signal is detected, the controller activates the camera to photograph, creating a feedback-based control mechanism that optimizes power usage based on actual user interaction with the refrigerator.

Inventive Principle:
Principle #23Feedback

3Area of stationary object

If the camera is installed inside the storage compartment to capture images, then the photographing range is improved, but dew condensation occurs on the camera

Engineering Contradiction:
Improvephotographing rangeVSAvoiddew condensation
Core Design Contradiction:
Area of stationary objectVSObject-affected harmful factors

Solution Approach 1:

The patent applies the extraction principle by removing the camera from the cold storage compartment environment and placing it outside (in the door body or on the cabinet). The camera photographs the storage regions when the door is open, avoiding direct exposure to the cold, humid conditions that cause dew condensation, while still capturing the required images.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The open door space acts as an intermediary medium, allowing the camera positioned outside the storage compartment to photograph the interior regions without being exposed to the harmful cold and humid environment. The camera captures images through the open door space, using this intermediate zone to avoid dew condensation.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Device complexity

If a single camera is used to photograph multiple storage regions, then the device complexity is reduced, but the difficulty of detecting and measuring different regions increases

Engineering Contradiction:
Improvenumber of camerasVSAvoidregion separation and identification
Core Design Contradiction:
Device complexityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent uses dynamics by implementing a rotatable camera mechanism that can be positioned at different angles to photograph specific storage regions. The rotation angle information is used by the controller to identify which region is being photographed, making region detection straightforward based on camera position rather than complex image analysis.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies segmentation by dividing the photographing process into distinct segments - each rotation angle corresponds to a specific storage region. The controller segments the overall photographing task by controlling the camera to rotate to predetermined angles for capturing images of different compartments, making region identification easier through spatial segmentation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2909548B1refrigerator
Publication Date: 2018.04.04 LG ELECTRONICS INC
  • EP2909548B1 patent drawingFigure 1~2
  • EP2909548B1 patent drawingFigure 3~4(b)
  • EP2909548B1 patent drawingFigure 5~6

AI summary

A refrigerator and a control method for the same are disclosed. The refrigerator includes a storage compartment formed in a cabinet of the refrigerator by a fixed insulation wall, the storage compartment being provided with an access opening, a door rotatably provided to the cabinet to open and close the access opening, a drawer (50) provided in the storage compartment, a camera (70) fixed to a ceiling of the storage compartment to photograph both a region (a first region) for storing of food arranged in an external space of the drawer (50) in the storage compartment and a region (a second region) for storing of food arranged in an internal space of the drawer (50) in the storage compartment, and a controller to separate, through a capturing time of a picture containing both the first region and the second region, a portion for the first region (a first region picture) and a portion for the second region (a second region picture) from the picture to individually divide and store the first region picture and the second region picture.