Mobile Document Capture via Video Frame Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern mobile devices face challenges in capturing and processing digital images due to limitations in hardware, such as insufficient quality caused by artifacts like blur, uneven illumination, and low resolution, which can result in inadequate image processing and lost opportunities for capturing important transient events.

Innovation Solution

A system and method that utilize a mobile device to capture video data, analyze frames for specific characteristics, and automatically capture high-quality images of documents by determining stability and satisfying predetermined quality control criteria, leveraging video stream resolution to overcome traditional still-photo limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If still-photo capture is used with mobile devices, then the capture process is simple and quick, but the image quality is insufficient due to artifacts like blur, uneven illumination, and low resolution

Engineering Contradiction:
Improveimage qualityVSAvoidcapture process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system dynamically switches between video mode and still-photo mode based on detected conditions. When a document is detected in video frames, the system transitions to capturing still photos at that moment, combining the simplicity of video capture with the quality of still images for documentation purposes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Video frames serve as an intermediary medium to detect document presence and capture conditions. The system uses video frames to identify when a document is present and when quality capture conditions are met, then triggers still-photo capture based on this intermediary detection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If video data is captured and analyzed frame-by-frame to detect documents and quality conditions, then image quality and capture reliability improve, but processing time and computational resources increase

Engineering Contradiction:
Improvecapture reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary video capture and frame analysis to detect document presence and assess capture conditions before triggering the actual still-photo capture. This preliminary action ensures that photos are only taken when documents are present and quality conditions are met, improving reliability without unnecessary delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system skips detailed analysis of frames that do not contain documents or do not meet quality criteria. By rapidly processing video frames and only triggering photo capture when necessary conditions are met, the system minimizes processing time while maintaining high capture reliability.

Inventive Principle:
Principle #21Skipping (Rushing through)

3Productivity

If automatic capture is implemented based on video frame analysis, then user input is reduced and capture efficiency improves, but the system complexity and processing requirements increase

Engineering Contradiction:
Improvecapture efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system automatically detects documents in video frames, assesses capture quality conditions, and triggers photo capture without requiring manual user intervention. The system serves itself by making autonomous decisions about when and what to capture, improving efficiency while managing complexity through automated workflows.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors video frames and provides feedback on document detection and quality condition assessment. This feedback loop enables automatic adjustment of capture timing and triggers, allowing the system to optimize capture efficiency while managing processing requirements through intelligent feedback-based control.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9819825B2Systems and methods for detecting and classifying objects in video captured using mobile devices
Publication Date: 2017.11.14 TUNGSTEN AUTOMATION CORPORATION
  • US9819825B2 patent drawing
  • US9819825B2 patent drawing
  • US9819825B2 patent drawing

AI summary

In one embodiment, a system includes a processor and logic executable by the processor. The logic is configured to cause the processor to: capture video data using a mobile device, the video data comprising a plurality of frames; determine whether one or more of the frames depict a document exhibiting one or more defining characteristics; determine whether one or more of the frame(s) determined to depict the document also satisfy one or more predetermined quality control criteria; and in response to determining one or more of the frames depict the document and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the document. Corresponding computer program products are also disclosed.