Refrigerator, operating method thereof and information providing system

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current refrigerator management systems require repetitive barcode scanning and complex procedures to identify and track expiration dates of items, which is inefficient and difficult to manage.

Innovation Solution

A refrigerator equipped with a camera to photograph items, a communicator to transmit images, and a processor to recognize text information on the items, comparing it with stored data, and an information providing system to assist in identifying items that cannot be recognized by the refrigerator.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If barcode scanning method is used to identify items, then item information can be obtained, but repetitive scanning and complex matching procedures are required for every item

Engineering Contradiction:
Improveitem identification accuracyVSAvoidtime for scanning and matching
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical barcode scanning system with an optical image recognition system. The camera captures images of items, and the processor uses image analysis and text recognition to identify items without requiring manual barcode scanning. This substitution eliminates the need for repetitive scanning operations while maintaining identification accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary actions by pre-storing text information from item exteriors and preparing image recognition models in advance. When an item is placed in the storage space, the system can immediately compare the captured image text with pre-stored information, eliminating the need for real-time barcode matching procedures.

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If multiple cameras are used to photograph items for expiration date recognition, then more items can be captured, but the system lacks detailed implementation methods for recognizing expiration dates

Engineering Contradiction:
Improvenumber of items capturedVSAvoidsystem implementation complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent introduces text information as an intermediary element between the captured images and the item identification process. The system extracts text information from item exteriors (including expiration dates) and uses this text as a mediator to match items with their corresponding stored information, simplifying the recognition process while handling multiple items.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system segments the item identification process into distinct steps: capturing images with multiple cameras, extracting text information from the images, comparing extracted text with stored text information, and identifying items based on matches. This segmentation makes the complex process of handling multiple items manageable and implementable.

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If text recognition is used to identify items, then identification becomes easier without complex operations, but items that cannot be identified by the refrigerator require external system assistance

Engineering Contradiction:
Improveitem identification easeVSAvoidsystem architecture complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent adds another dimension to the system architecture by introducing an external information providing system that works in conjunction with the refrigerator's internal text recognition system. The refrigerator handles simple text-based identification, while unidentified items are transmitted to the external system for advanced recognition, creating a multi-layered approach that maintains ease of operation while handling complex cases.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11436558B2Refrigerator, operating method thereof and information providing system
Publication Date: 2022.09.06 LG ELECTRONICS INC
  • US11436558B2 patent drawing
  • US11436558B2 patent drawing
  • US11436558B2 patent drawing

AI summary

Disclosed is a refrigerator configured to perform artificial intelligence (AI) algorithms and/or machine learning algorithms, communicate with other electronic devices and external servers in a 5G communication environment, and provide information based on an image. The refrigerator includes a camera, a display, and a processor. Accordingly, various services can be provided to improve user convenience by accurately identifying a photographing target.