Image Analysis for Musical Score Retrieval Without Notation Knowledge

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies require musical knowledge to retrieve a desired musical piece, limiting situations in which retrieval is possible, and a similar issue occurs when retrieving a document with a desired character string.

Innovation Solution

An image analysis method and device that generate partial-image analysis data by analyzing a partial image of a musical score or document and select a candidate image by comparing its characteristics with candidate image analysis data, allowing for easy identification of desired information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the user specifies notes of a desired musical piece, then the desired musical piece can be retrieved, but the user needs to have musical knowledge which limits retrieval situations

Engineering Contradiction:
Improveretrieval accuracyVSAvoidoperational simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent uses image copying technology to capture visual representations of musical scores and documents. Instead of requiring users to input musical notation or text, the system captures images of the actual score or document pages, converts them to analysis data, and performs retrieval based on visual pattern matching. This allows users without specialized knowledge to retrieve desired content simply by taking a photo.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical system of manual note specification with an optical/image-based system. The imaging device captures the visual appearance of musical scores, and image analysis algorithms automatically extract features and compare them with stored candidate images. This substitution eliminates the need for users to understand musical notation while maintaining accurate retrieval capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the user specifies character strings in a document, then the desired document can be retrieved, but the user needs to know the exact character string which limits retrieval situations

Engineering Contradiction:
Improveretrieval accuracyVSAvoidretrieval flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies image copying to document retrieval by capturing photographs of document pages. The system analyzes the visual appearance of the captured document, extracts text and layout features, and compares them with stored document images. This allows users to retrieve documents by photographing any visible portion without needing to know specific text content or search keywords.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent creates a universal retrieval system that handles both musical scores and general documents using the same image analysis framework. The system can process any visual document content regardless of language, script, or format, making it adaptable to various retrieval scenarios without requiring user input in specific formats or languages.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11398100B2Image analysis method and image analysis device for identifying musical information
Publication Date: 2022.07.26 YAMAHA CORP
  • US11398100B2 patent drawing
  • US11398100B2 patent drawing
  • US11398100B2 patent drawing

AI summary

Disclosed is an image analysis method implemented by a computer, the method including analyzing a partial image which is a part of an image of a planar subject, generating partial-image analysis data representing a characteristic of the partial image, comparing, for each of a plurality of images, candidate-image analysis data with the partial-image analysis data, the candidate-image analysis data representing a characteristic of each of the plurality of images, and selecting a candidate image among the plurality of images, the candidate image including a part corresponding to the partial image.