Mobile Appliance Recognition via Image Analysis and Database Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Consumers face challenges in obtaining comprehensive information about household appliances in a showroom setting, as existing technologies like augmented reality and image-based search functions are not effectively accepted or applicable for this context, particularly due to the lack of energy labels and inefficient product recognition.

Innovation Solution

A system utilizing a mobile terminal device with a camera to capture and analyze images of household appliances, transmitting data to a computer database for additional information, allowing congruent image matching and providing augmented reality representations, including alphanumeric input for faster identification and wireless connectivity within a local area network.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If augmented reality technology with data glasses is used to provide additional information, then information availability is improved, but device complexity and user acceptance deteriorate

Engineering Contradiction:
Improveinformation availabilityVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent uses a camera to capture an image of the household appliance and creates a digital copy for analysis. This allows the system to process and identify the appliance without requiring complex augmented reality hardware like data glasses, thereby reducing device complexity while maintaining information availability through the mobile terminal display

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a server as an intermediary between the mobile terminal and the database. The server handles image analysis and coordinate transformation, allowing the mobile terminal to use simple hardware while still accessing comprehensive appliance information through the intermediary processing layer

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If image-based search function is used to obtain product information, then ease of operation is improved, but measurement precision deteriorates due to lack of energy labels

Engineering Contradiction:
Improveease of operationVSAvoidproduct identification accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the image analysis process into multiple stages: capturing the appliance image, analyzing specific features and contours, comparing with database entries, and progressively refining the identification. This segmented approach enables accurate identification without relying on energy labels by breaking down the complex recognition task into manageable feature comparisons

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements feedback mechanisms where the mobile terminal receives coordinate information from the server, transforms these coordinates to match the captured image orientation, and displays results for user confirmation. This feedback loop allows the system to refine identification accuracy based on user input and image matching results

Inventive Principle:
Principle #23Feedback

3Measurement precision

If detailed analysis of household appliance images is performed to improve recognition accuracy, then measurement precision is improved, but loss of time increases due to comprehensive data processing

Engineering Contradiction:
Improveappliance recognition accuracyVSAvoiddetection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-processing and storing appliance images and their feature data in a database before the actual recognition process. When a user captures an appliance image, the system quickly compares it against pre-analyzed database entries, significantly reducing detection time while maintaining high recognition accuracy through pre-computed feature matching

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2710535B1System for providing information on a domestic appliance in an enhanced manner, corresponding method, and computer program product
Publication Date: 2019.03.13 BOSCH SIEMENS HAUSGERATE GMBH

AI summary

The invention relates to a system for providing information on an actual viewable domestic appliance in an enhanced manner. A person to whom the information is addressed has a mobile terminal of at least one terminal that belongs to the system, said terminal having a camera. The camera is suitable for generating an analyzable image of an overall view of a domestic appliance, the respective analyzable image also being presentable on a display of the mobile terminal. An analyzer or decoder is also provided for obtained analyzable images, said analyzer or decoder outputting analyzed data. A wireless transmission to a computer, which is an external computer in particular, is provided, the database of said computer outputting additional data that can be read from the database in relation to the transmitted data. Said additional data can be wirelessly transmitted to the at least one mobile terminal. A receiving and processing unit is provided for the mobile terminal, said processing unit preparing the read data such that a presentation is allowed on the display of the mobile terminal in addition to the image of the overall view of the actual domestic appliance. An image of the domestic appliance, said image being accessible from the database, can be provided on the display of the mobile terminal to compare with the image of the actual domestic appliance and to supplement said image by means of presentations derived from the data of the database. The invention further relates to a corresponding method and to a computer program product.