Mobile Image Annotation via Touch Screen Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional indicia reading devices face limitations in efficiently capturing and annotating images, especially when dealing with decodable information bearing indicia, as they require manual verbal descriptions for non-decodable areas, which can be cumbersome and inefficient.

Innovation Solution

A mobile device equipped with an image sensor, microcontroller, and touch screen capabilities allows for direct image annotation by the operator, enabling intuitive pointing and capturing of indicia, with the ability to store and transmit annotated images, reducing the need for verbal descriptions and enhancing data collection efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual verbal descriptions are used for non-decodable areas, then data collection can be completed, but the process becomes cumbersome and inefficient

Engineering Contradiction:
Improvedata collection efficiencyVSAvoidoperation convenience
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical/manual process of verbal description with an electronic annotation system. Operators use a touch screen to directly annotate images with graphical marks, text, or symbols, eliminating the need for verbal descriptions and significantly improving data collection efficiency while maintaining ease of operation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary annotation layer between the original image and the final data output. This annotation layer allows operators to mark non-decodable areas directly on the image, creating a visual bridge that preserves information without requiring separate verbal descriptions

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If operators annotate images directly, then data accuracy improves, but processing requirements increase

Engineering Contradiction:
Improvedata accuracyVSAvoidprocessing requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the annotation processing into distinct components: annotation input from the touch screen, annotation storage in memory, and annotation transmission to remote systems. This segmentation allows the mobile device to handle annotation collection efficiently while leveraging external systems for heavy processing tasks

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a new dimension to data processing by implementing wireless communication capabilities. Annotated images can be transmitted remotely via wireless networks, distributing processing requirements across multiple systems and reducing the burden on the mobile device itself

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If annotated images are stored and transmitted, then data communication efficiency improves, but device memory and power requirements increase

Engineering Contradiction:
Improvedata communication efficiencyVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by enabling operators to selectively transmit annotated images based on specific conditions or intervals. Rather than continuously transmitting all images, the system allows for targeted transmission of only those images requiring attention, reducing power consumption while maintaining communication efficiency

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent applies partial action by implementing selective transmission of annotated images. The system processes and stores all annotations locally, but only transmits a subset of images that meet specific criteria, reducing the overall data transmission volume and associated power requirements

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables efficient image annotation and data collection by allowing operators to directly mark and store relevant information within images, improving data accuracy and reducing processing requirements, while allowing for seamless communication of annotated data to remote systems.

Implementation Method 1

converting light reflected from a target into image data utilizing an image sensor

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP2320350B1Annotation of optical images on a mobile device
Publication Date: 2012.09.26 HAND HELD PRODS INC
  • EP2320350B1 patent drawingFigure 1
  • EP2320350B1 patent drawingFigure 2
  • EP2320350B1 patent drawingFigure 3

AI summary

A method of operating an image reader comprising the steps of: converting light reflected from a target into image data utilizing an image sensor; storing the image data in a display buffer; displaying the image on a display; annotating the displayed image by the operator while the image data is stored in the display buffer, thereby altering the image data in the display buffer; and, transmitting the altered image data from the display buffer; wherein the image sensor, display and display buffer are disposed in a common housing for hand held operation.