Handheld Scanner Image Stitching via Sensor Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Handheld scanners face challenges in producing high-quality composite images of large objects due to inaccurate navigation sensors and inefficient image processing techniques, which result in fuzzy or distorted images when the scanner motion is not constrained to a predefined path.

Innovation Solution

A system that synchronizes image data with position information from handheld devices, using concurrent coarse and fine positioning techniques to quickly assemble successive image frames into a composite image, allowing for accurate image stitching without mechanical constraints on scanner motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If handheld scanner is used without mechanical constraints on motion, then ease of operation is improved, but manufacturing precision deteriorates due to inaccurate navigation sensors causing fuzzy or distorted images

Engineering Contradiction:
Improveease of operationVSAvoidmanufacturing precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent replaces mechanical constraint systems with a computational image stitching system. Instead of using mechanical guides or rails to constrain scanner motion, the system uses navigation sensors to track position and software algorithms to assemble image frames, substituting physical constraints with informational constraints.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces navigation sensors as an intermediary between the scanner motion and the image assembly process. These sensors mediate the relationship by providing position information that enables accurate image stitching without requiring mechanical constraints on the scanner's movement.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If image stitching techniques are applied to handheld scanner, then manufacturing precision is improved, but productivity deteriorates due to slow processing speed and high computing power requirements

Engineering Contradiction:
Improvemanufacturing precisionVSAvoidproductivity
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent segments the image stitching process into multiple independent stages: navigation data acquisition, feature detection, frame alignment, and image assembly. This segmentation allows parallel processing and optimization of each stage, improving overall processing efficiency while maintaining image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-processing navigation sensor data and pre-detecting features in image frames before the actual stitching operation. This preparation work is done in advance to reduce the computational burden during the critical assembly phase, thereby improving productivity.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If conventional image stitching techniques are used, then manufacturing precision is improved, but loss of time increases due to slow processing speed

Engineering Contradiction:
Improvemanufacturing precisionVSAvoidloss of time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements continuous image acquisition and processing during the scanning operation. Instead of stopping to process images after scanning, the system continuously captures navigation data and image frames, performing real-time stitching operations that maintain continuous useful action throughout the scanning process.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent uses periodic action by processing image frames at regular intervals during scanning. The system captures images at periodic time intervals and processes them in sequence, maintaining a steady rhythm of data acquisition and processing that optimizes both speed and quality.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentEP2550798B1Synchronization of navigation and image information for handheld scanner
Publication Date: 2020.01.01 ML NETHERLANDS CV
  • EP2550798B1 patent drawingFigure 1~2
  • EP2550798B1 patent drawingFigure 3
  • EP2550798B1 patent drawingFigure 4

AI summary

A computer peripheral that operates either as a computer mouse or as a scanner. The peripheral includes navigation sensors that generate information on motion of the device and an image array that captures successive image frames of an object being scanned. In a mouse mode, the peripheral periodically transfers readings from the navigation sensors to a computing device so that the computing device can track a position of the device. In a scanner mode, in addition to obtaining navigation information from the navigation sensors, the peripheral also captures image frames as it is moved across the object. Operation of the navigation sensors and image array may be synchronized such that an association between the image data and the navigation information may be generated and maintained as image frames are transferred to the computing device, even if some of the frames are dropped in transmission between the scanner-mouse and a computer.