Chord Information Extraction from Score Images Using Notation Rules

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic musical instrument systems fail to accurately extract chord information from music score image data, as they cannot correctly interpret chord notation rules from general scores.

Innovation Solution

A chord information extraction device and method that includes a character group extractor, determiner, and corrector to identify and correct chord information from score image data based on predetermined notation rules, using font and position information to ensure accurate extraction and display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image analysis technique is used to read music score information, then music piece information can be extracted from score image data, but chord information cannot be extracted accurately

Engineering Contradiction:
Improvechord information extraction accuracyVSAvoidchord recognition reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the music score image data into distinct character groups, separating chord information from other musical notation. The character group extractor divides the score into individual character or character group units, allowing targeted extraction and analysis of chord-related characters independent of other musical elements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a determination unit as an intermediary between the character group extractor and the final chord information output. This determination unit validates whether extracted character groups actually represent chord information by checking against chord notation rules, acting as a mediator to filter false positives and improve extraction accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If general image analysis is applied to score data, then various music score information can be read, but chord notation rules cannot be verified

Engineering Contradiction:
Improvemusic score information extraction capabilityVSAvoidchord notation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary extraction of character groups from the score image data before final chord information determination. The character group extractor预先 identifies and extracts potential chord-related character groups, which are then validated by the determination unit against chord notation rules, ensuring both versatility and precision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The determination unit provides feedback to the extraction process by validating extracted character groups against chord notation rules. When character groups do not conform to expected chord notation patterns, the system can identify and correct extraction errors, creating a feedback loop that improves overall extraction accuracy.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If QR code is used for setting information, then setting information can be acquired easily, but chord information notated on score cannot be extracted

Engineering Contradiction:
Improvesetting information acquisition easeVSAvoidchord information extraction capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

Instead of relying on QR codes or manual input, the patent directly copies and extracts chord information from the visual notation on the music score itself. The character group extractor captures chord characters directly from the score image, and the determination unit verifies them against chord notation rules, enabling automatic extraction without additional markup or codes.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11315532B2Chord information extraction device, chord information extraction method and non-transitory computer readable medium storing chord information extraction program
Publication Date: 2022.04.26 YAMAHA CORP
  • US11315532B2 patent drawing
  • US11315532B2 patent drawing
  • US11315532B2 patent drawing

AI summary

A chord information extraction device includes a character group extractor, a determiner and a corrector. The character group extractor extracts a character group corresponding to chord information from score image data representing a music score. The determiner determines whether the character group extracted by the character group extractor follows a predetermined chord notation rule. In a case where the character group extracted by the character group extractor does not follow the chord notation rule, the corrector corrects the extracted character group to follow the chord notation rule.