Musical Score Image and Logical Data Correspondence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing techniques for analyzing musical scores face challenges in accurately recognizing musical symbols from image data and maintaining reproduction reliability, as the correspondence between musical score image data and logical musical score data is unclear, making it difficult to use both types of data in combination effectively.

Innovation Solution

A computer-implemented method that analyzes musical score image data and logical musical score data to identify the correspondence relationship between individual notes in both formats by comparing the image note sequence and the logical note sequence, allowing for the combination of both data types to enable diversified use of musical scores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Shape

If musical score image data is used to display the musical score layout, then the display form matches the creator's intention, but the computer cannot accurately recognize the musical content

Engineering Contradiction:
Improvelayout formVSAvoidcontent recognition accuracy
Core Design Contradiction:
ShapeVSMeasurement precision

Solution Approach 1:

The patent segments the musical score data into two distinct components: image data for layout display and logical data for content representation. By separating the visual presentation (staff lines, note positions, formatting) from the musical content (pitch, duration, rhythm), the system can process each type of data with its appropriate method, thereby resolving the contradiction between maintaining layout fidelity and achieving accurate content recognition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a correspondence relationship data structure that acts as an intermediary between image data and logical data. This intermediary establishes the mapping between visual elements in the image (note positions, staff lines) and their corresponding logical musical content, enabling the computer to accurately recognize and interpret musical symbols while preserving the original layout intent.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If logical musical score data is used to represent musical content, then the content can be accurately grasped, but the display layout varies depending on rendering algorithms

Engineering Contradiction:
Improvecontent accuracyVSAvoidlayout consistency
Core Design Contradiction:
Measurement precisionVSShape

Solution Approach 1:

The patent separates the musical score into logical data (containing precise pitch, duration, and rhythmic information) and image data (containing the authoritative layout and formatting). This segmentation allows the system to use logical data for accurate content representation while referring to image data when layout consistency is required, thus resolving the contradiction between content accuracy and layout consistency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The correspondence relationship data structure serves as an intermediary that links logical data elements to their visual representations in the image data. This intermediary enables the system to maintain layout consistency by referencing the original image data's spatial arrangements while using logical data for accurate musical content interpretation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If both musical score image data and logical musical score data are used in combination, then diversified use is possible, but the correspondence relationship between notes is unclear

Engineering Contradiction:
Improveusage flexibilityVSAvoidcorrespondence information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent introduces a correspondence relationship data structure that acts as an intermediary to establish and maintain the mapping between image data and logical data. This intermediary preserves the correspondence information by recording which logical musical elements (notes, rests, measures) correspond to which visual elements in the image, thereby enabling diversified usage of both data types without losing the critical correspondence information.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a structured copy of the correspondence relationship between image and logical data. By generating this intermediate representation that captures the mapping information, the system enables multiple uses of the musical score (display, analysis, performance) while preserving the original correspondence through this copied relational structure.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS9275616B2Associating musical score image data and logical musical score data
Publication Date: 2016.03.01 YAMAHA CORP
  • US9275616B2 patent drawing
  • US9275616B2 patent drawing
  • US9275616B2 patent drawing

AI summary

The method analyzes, on the basis of the musical score image data, an image note sequence that is a time series of a plurality of notes included in the image of a musical score of a given music piece, acquires, on the basis of a logical musical score data, a logical note sequence that is a time series of a plurality of notes included in the musical score of the given music piece, and then identifies correspondence relationship between the individual notes in the image note sequence and the individual notes in the logical note sequence by comparing the image note sequence and the logical note sequence. Further, the method displays the musical score image of the given music piece on the basis of the musical score image data, and controls a display state of the displayed image of the musical score by use of the identified correspondence relationship.