Smartphone Text Magnification via Row Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing smartphone-based methods for enlarging character strings from images are prone to blurriness due to hand shaking and struggle to accurately extract characters in units, leading to difficulties in correctly displaying enlarged character areas.

Innovation Solution

A terminal device with an extracting unit that extracts character strings in units of rows from image data and a display control unit that enlarges and displays designated character strings, allowing for precise enlargement and display by moving the enlarged area along the center line of the designated row.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a smartphone camera is used to photograph an object and a predetermined portion is enlarged for display, then magnification function is achieved, but the displayed image becomes blurred due to hand shaking

Engineering Contradiction:
Improvemagnification functionVSAvoidimage clarity
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the character area into multiple rows, and each row is further segmented into individual character strings. This segmentation allows the system to process and stabilize specific character regions independently, reducing the impact of hand shaking on overall image clarity while maintaining magnification functionality.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If the smartphone is moved toward the object to enlarge a predetermined portion, then magnification is achieved, but the displayed moving image becomes blurred

Engineering Contradiction:
Improveenlargement capabilityVSAvoidimage stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent performs preliminary actions by first capturing the image, then identifying and extracting the character area, and further extracting row information before final display. This preliminary processing stabilizes the character regions in advance, allowing the system to provide reliable enlargement without the blurring that occurs when the smartphone is moved toward the object.

Inventive Principle:
Principle #10Preliminary action

3Extent of automation

If character recognition is performed on a character area, then character extraction is achieved, but it is difficult to precisely extract characters in character units

Engineering Contradiction:
Improvecharacter extractionVSAvoidcharacter unit accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent applies segmentation by first dividing the character area into multiple rows based on spatial distribution, then further dividing each row into individual character strings. This two-level segmentation approach enables precise extraction of characters in character units by processing each row independently and identifying character boundaries within each row, thereby improving character unit accuracy.

Inventive Principle:
Principle #1Segmentation

4Ease of manufacture

If a character is inadvertently extracted from the character area, then extraction process is simplified, but the layout of the image is adversely affected

Engineering Contradiction:
Improveextraction process simplicityVSAvoidimage layout accuracy
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent employs feedback mechanisms by detecting the spatial distribution of characters within each row and using this information to accurately determine character boundaries. The system continuously monitors and adjusts the extraction process based on the detected character positions, ensuring that only valid characters are extracted while maintaining proper image layout, thus preventing inadvertent extraction errors.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3125087B1Terminal device, display control method, and program
Publication Date: 2019.09.04 FUJITSU LTD
  • EP3125087B1 patent drawingFigure 1
  • EP3125087B1 patent drawingFigure 2
  • EP3125087B1 patent drawingFigure 3

AI summary

A terminal device includes an extracting unit that extracts multiple character strings, in units of rows, from a character area included in an image data, and a display control unit that enlarges and displays one of the extracted plurality of character strings in a designated position of a designated row and the vicinity of the designated position.