Note Recognition Using Color Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies lack an efficient method for capturing and managing physical notes in a digital format, particularly in collaborative environments, where multiple notes need to be recognized, extracted, and organized effectively.

Innovation Solution

A system and method that utilize image capture devices and processing algorithms to recognize physical notes by detecting boundaries and extracting content, allowing for the creation of digital representations and management of notes, including categorization and grouping, using techniques such as color classification and marker-based detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical notes are used for collaboration, then ease of operation and accessibility are improved, but note management efficiency and information retrieval speed deteriorate

Engineering Contradiction:
Improveease of operationVSAvoidnote management efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent creates digital copies of physical notes by capturing images with a camera and processing them through OCR and color classification algorithms. The system generates software-based note objects that replicate the visual and organizational properties of physical notes while enabling efficient digital management, search, and retrieval operations.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces manual physical note management operations with automated computational processes. Image capture devices substitute for physical handling, while processing algorithms automatically perform boundary detection, color classification, content extraction, and organization, eliminating the need for manual sorting and filing of physical notes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If multiple physical notes are captured and managed digitally, then information retrieval and organization are improved, but device complexity and processing requirements increase

Engineering Contradiction:
Improveinformation retrievalVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the complex task of note management into distinct processing stages: image capture, boundary detection, color classification, content extraction, and digital storage. Each stage handles a specific aspect of the transformation from physical to digital notes, making the overall system more manageable and efficient despite the complexity involved.

Inventive Principle:
Principle #1Segmentation

3Productivity

If color classification is used to categorize notes, then note organization and retrieval efficiency are improved, but measurement precision and classification accuracy may deteriorate due to lighting variations

Engineering Contradiction:
Improvenote organization efficiencyVSAvoidcolor classification accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent transforms color data from raw RGB values captured by the camera into standardized color space representations (such as HSV or LAB color spaces) that are more robust to lighting variations. This parameter transformation allows for more reliable color-based classification by separating chromatic information from luminance information, improving classification accuracy despite varying illumination conditions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3020002B1Note recognition and management using color classification
Publication Date: 2022.05.04 3M INNOVATIVE PROPERTIES CO
  • EP3020002B1 patent drawingFigure 1
  • EP3020002B1 patent drawingFigure 2
  • EP3020002B1 patent drawingFigure 3

AI summary

This disclosure describes techniques for creating and manipulating software notes representative of physical notes. For example, techniques are described for recognizing physical notes present within a physical environment, capturing information therefrom and creating corresponding digital representations of the physical notes, referred to herein as digital notes or software-based notes. At least some aspects of the present disclosure feature system and methods for note recognition using color classification. The system receives a visual representation of a scene having one or more notes, where each note has a color. The system generates indicators indicative of color classes of pixels in the visual representation. The system further determines a general boundary of one of the notes based on the indicators.