Image Processing for High Magnification Score Location

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High imaging magnification of image capture devices makes it difficult to accurately compare and identify the location of captured images within musical scores or documents, as the number of feature points extracted decreases, hindering precise page number and musical score information identification.

Innovation Solution

An image processing method that extracts feature points from captured images, determines if the number exceeds a threshold value, and specifies the location relative to a previous image if it does not, using an image processing device with modules for extraction, determination, and analysis to display accurate page and score information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the imaging magnification of the image capture device is increased to capture detailed information, then the detail resolution is improved, but the number of feature points extracted from the captured image decreases, making it difficult to accurately compare and identify the location of the captured image within the musical score

Engineering Contradiction:
Improvedetail resolutionVSAvoidnumber of feature points
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system performs preliminary action by extracting feature points from a reference image (captured at a different magnification where sufficient feature points are available) before comparing the target captured image. This allows the system to establish a feature point map in advance that can be used for location identification even when the target image has insufficient feature points due to high magnification

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary approach by using a reference image captured at a lower magnification as a mediator. This reference image contains sufficient feature points and serves as an intermediate reference that enables comparison and location identification for target images captured at high magnification where direct feature point extraction is insufficient

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the image capture device is positioned close to the paper surface to achieve high imaging magnification, then the detail capture capability is improved, but the ability to accurately compare the captured image with candidate images is inhibited

Engineering Contradiction:
Improvedetail capture capabilityVSAvoidimage comparison accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system creates a copy of the feature point information from a reference image and uses this copied feature point map for comparison with the target captured image. This copying approach allows accurate location identification without requiring the target image itself to contain sufficient feature points, thus maintaining comparison accuracy even at high magnification

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The reference image and its feature points are prepared in advance before the actual comparison process. This preliminary preparation ensures that sufficient reference data is available to enable accurate comparison and location identification, even when the target image captured at high magnification lacks sufficient feature points

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11508174B2Image processing method and image processing device
Publication Date: 2022.11.22 YAMAHA CORP
  • US11508174B2 patent drawing
  • US11508174B2 patent drawing
  • US11508174B2 patent drawing

AI summary

An image processing method implemented by a computer includes extracting feature points from captured images that are sequentially generated by an image capture device and include at least a first captured image and a second captured image generated prior to the first captured image, determining whether the number of feature points extracted from the first captured image exceeds a threshold value, and specifying a location of the first captured image relative to the second captured image upon determining that the number of the feature points extracted from the first captured image is below the threshold value.