MFP Image Recognition for Automatic Cloud Document Revision Updates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for reflecting handwritten revisions on printed electronic documents back to their digital counterparts are cumbersome, as they require manual transcription or image scanning, which complicates the automatic conversion of image data into text format for cloud storage updates.

Innovation Solution

An information processing apparatus and method that generates a difference image from a printed document and an electronic document, identifies revision instructions and character strings, and performs processes to update the electronic document accordingly, utilizing a multi-function peripheral (MFP) system connected to cloud storage via a network.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If handwritten revisions on printed documents are captured using a scanner, then the revision content can be obtained as electronic data, but it is difficult to automatically convert the image data into text format for reflecting revisions to the electronic document

Engineering Contradiction:
Improveease of capturing revision contentVSAvoidautomatic conversion of image data to text
Core Design Contradiction:
Ease of manufactureVSExtent of automation

Solution Approach 1:

The patent replaces manual transcription (mechanical typing) with automatic image recognition technology. The MFP automatically captures handwritten revisions as images and uses recognition algorithms to convert them into text, eliminating the need for manual data entry while maintaining high accuracy in capturing revision content.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an image recognition process as an intermediary between scanning handwritten revisions and updating the electronic document. The MFP acts as a mediator that bridges the gap between image data capture and text format conversion, automatically processing the intermediate steps of recognition and conversion.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If manual transcription is used to reflect handwritten revisions to the electronic document, then the revision content can be accurately entered, but the process becomes complicated and time-consuming

Engineering Contradiction:
Improveaccuracy of revision contentVSAvoidtime required for transcription
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables self-service by allowing the MFP to automatically capture, recognize, and process handwritten revisions without requiring user intervention for transcription. The device serves itself by performing the entire workflow from scanning to document update, eliminating the need for manual typing while maintaining accuracy through advanced recognition algorithms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary actions by having the MFP capture and recognize handwritten revisions immediately when they are written on printed documents. The system proactively processes the revision content in real-time before the user needs to update the electronic document, eliminating the need for subsequent manual transcription steps.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If direct editing of the electronic document on cloud storage is performed, then the revision can be reflected to the cloud-stored document, but manual transcription using a keyboard is required which complicates the work

Engineering Contradiction:
Improvedirect update to cloud documentVSAvoidsimplicity of revision process
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent makes the MFP a multi-functional device that combines scanning, image recognition, text processing, and cloud document update capabilities in one system. The MFP universally handles the entire revision workflow from capturing handwritten notes to automatically updating the electronic document on cloud storage, eliminating the need for separate manual transcription steps.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The MFP serves as an intermediary between the handwritten revisions and the cloud-stored electronic document. It automatically processes the intermediate steps of image capture, recognition, and text conversion, then directly updates the cloud document, simplifying the operation for the user while maintaining reliable direct updates to the cloud storage.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11637937B2Information processing apparatus, information processing method, and non-transitory storage medium
Publication Date: 2023.04.25 CANON KK
  • US11637937B2 patent drawing
  • US11637937B2 patent drawing
  • US11637937B2 patent drawing

AI summary

A printed matter reviewed by a user is read, and a difference image is generated based on a first image obtained as a result of reading the printed matter and an electronic document that is a printing source from which the printed matter is generated. Based on the difference image, a process is performed to identify an instruction relating to a revision additionally written on the printed matter and a character string to be subjected to the revision in the electronic document. Thereafter, a particular process is executed on the electronic document based on the instruction related to the revision and the character string to which the revision is applied.