Multi-Cropping Image Processing for Receipt Overlap Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multi-cropping systems for scanning multiple receipts fail to accurately detect overlaps and correctly extract character information when receipts are not properly aligned, leading to incomplete or incorrect preview displays and metadata extraction.

Innovation Solution

An image processing apparatus that analyzes scanned images, crops document images, extracts character strings, and displays metadata with a user interface for setting and re-scanning images, allowing for re-acquisition of specific image areas to improve accuracy and user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multi-cropping processing is performed to generate images in units of documents from scanned images, then productivity is improved by computerizing multiple receipts en bloc, but measurement precision deteriorates when receipts overlap or float up, making it impossible to correctly extract character information

Engineering Contradiction:
Improvebatch processing capabilityVSAvoidcharacter extraction accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary detection of receipt boundaries and overlap regions before character extraction. By identifying potential issues in advance and displaying preview images with boundary overlays, the system allows users to correct placement problems before final processing, ensuring accurate character extraction while maintaining batch processing efficiency

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides visual feedback by displaying preview images with detected receipt boundaries and overlap warnings. This feedback mechanism allows users to identify and correct placement issues, ensuring that character extraction is performed only on properly positioned receipts, thus maintaining measurement precision in batch processing

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the system provides detailed preview display and overlap detection, then measurement precision is improved for detecting receipt placement issues, but device complexity increases due to additional detection and display functions

Engineering Contradiction:
Improveoverlap detection accuracyVSAvoiddetection and display system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the complex detection task into distinct functional modules: boundary detection, overlap detection, and preview display. Each module handles a specific aspect of receipt validation, making the overall system more manageable and maintainable while providing comprehensive detection capabilities

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The preview display acts as an intermediary between the detection algorithms and the user. It translates complex detection results into visual representations that are easy to understand, allowing users to verify receipt placement without requiring complex detection logic to be exposed directly

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If the system processes all receipts in a batch without individual verification, then productivity is maintained, but reliability deteriorates when some receipts are misplaced, leading to erroneous processing

Engineering Contradiction:
Improvebatch processing speedVSAvoidprocessing accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary verification of each receipt in the batch by detecting boundaries and displaying previews before final character extraction. This preliminary action ensures that only properly positioned receipts are processed, maintaining reliability while preserving batch processing efficiency through parallel verification

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies verification selectively - performing full detection and preview display only for receipts that show signs of potential issues such as overlaps or unusual boundary patterns. This partial verification approach maintains productivity by avoiding redundant checks on clearly valid receipts while ensuring reliability for problematic cases

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11252290B2Image processing apparatus, image processing method and storage medium
Publication Date: 2022.02.15 CANON KK
  • US11252290B2 patent drawing
  • US11252290B2 patent drawing
  • US11252290B2 patent drawing

AI summary

To enable a user to, in a case where the user scans a plurality of documents en bloc and acquires an image in units of documents by using a multi-cropping function and metadata thereon, reacquire them efficiently. A configuration is designed so that scan processing can be performed again in a preview display of the image corresponding to each document obtained by multi-cropping and it is made possible for a user to perform the scan again in a case where the user checks the scanned contents by the preview display and determines that the scan has not been performed accurately. Then, for the scanned image obtained by the re-scan, necessary analysis processing is performed only for the document for which it becomes necessary to perform the scan again.