Normalized Focal Length Profiling for Camera Scanners

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera-based scanners face challenges in determining unknown scanned image focal lengths, leading to suboptimal metric rectification and OCR performance due to missing camera metadata and unknown imaging characteristics, especially with the increasing diversity of consumer devices.

Innovation Solution

A system and method that profiles camera devices by normalizing focal length over time, using device and user IDs to build models of focal length density distributions, predicting the most likely focal length, and encoding zoom usage patterns, thereby improving image enhancement and rectification processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If camera-based scanning is used to increase accessibility and ease of document capture, then ease of operation is improved, but measurement precision deteriorates due to unknown focal lengths and perspective distortion

Engineering Contradiction:
Improvedocument captureVSAvoidfocal length determination
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system performs preliminary actions by collecting focal length data from multiple images captured by the same camera device and building a probability density function (PDF) model before actual document scanning. This pre-computed statistical model enables accurate focal length estimation without requiring manual calibration or known reference objects during the actual scanning operation, thus maintaining ease of operation while improving measurement precision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by using the captured document images themselves to determine the camera's focal length. The focal length is estimated from the geometric relationships within the captured images (such as vanishing points and perspective distortion patterns), and this estimated focal length is then fed back to correct the perspective distortion in subsequent processing steps, creating a self-calibrating system that improves measurement precision without additional hardware.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If multiple camera devices with diverse imaging characteristics are supported to increase adaptability, then adaptability is improved, but device complexity increases due to the need to profile each device's imaging characteristics

Engineering Contradiction:
Improvedevice compatibilityVSAvoidimaging system profiling
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system applies parameter changes by transforming the focal length parameter from a fixed, device-specific value into a statistically distributed parameter represented by a probability density function. Instead of storing and managing separate calibration parameters for each camera device, the system represents each device's imaging characteristics through a mathematical model (PDF) that captures the distribution of focal lengths across multiple images. This transformation simplifies the representation of diverse imaging characteristics while maintaining adaptability to different camera devices.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system uses copying by creating a statistical model (probability density function) that replicates the essential imaging characteristics of a camera device without requiring direct access to the device's internal specifications or manual calibration data. The PDF model serves as a copy or representation of the device's optical properties, enabling the system to handle diverse camera devices through a unified statistical framework rather than device-specific configuration.

Inventive Principle:
Principle #26Copying

3Measurement precision

If focal length is estimated from captured images to improve measurement precision, then measurement precision is improved, but reliability deteriorates when images contain degenerate conditions such as single vanishing points

Engineering Contradiction:
Improvefocal length estimationVSAvoidrectification stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system applies beforehand cushioning by computing a probability density function from multiple images before processing any individual document scan. This pre-computed statistical model acts as a cushion or buffer that absorbs the variability and instability that would otherwise occur when processing individual images with degenerate conditions. When a new image is scanned, the system uses the pre-established PDF to provide a stable, reliable focal length estimate even if the individual image contains insufficient geometric information, thus preventing reliability deterioration while maintaining measurement precision.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The system uses feedback by continuously refining the probability density function based on newly captured images. When images with degenerate conditions are encountered, the feedback mechanism allows the system to identify these cases and either exclude them from the PDF computation or use the PDF from previous iterations to compensate. This feedback loop ensures that the focal length estimation remains reliable by learning from the statistical patterns across multiple successful captures while being resilient to individual failed or degenerate cases.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10210602B2System and method for normalized focal length profiling
Publication Date: 2019.02.19 SHARP KK
  • US10210602B2 patent drawing
  • US10210602B2 patent drawing
  • US10210602B2 patent drawing

AI summary

A system and method are provided for normalizing a camera focal length. A perspective geometry estimator accepts a scanned image from a camera having an undefined focal length, and generates a normalized focal length estimate for the image. The normalized focal length estimate is compared to a normalized focal length density distribution. If the normalized focal length estimate meets a minimum threshold of probability, the normalized focal length estimate is selected and the image is processed using the selected normalized focal length estimate. If the normalized focal length estimate fails to meet the minimum threshold of probability, the image is processed using the highest probability prior normalized focal length from the normalized focal length density distribution.