Music score editing device

Abstract

An image recognition unit (11) recognizes the image of the music score before the shift as first image data. A pitch reception unit (14) receives designation of a pitch amount indicating a difference between a tone before a shift and a tone after the shift. A note recognition unit (12) recognizes notes in the first image data. A note deletion unit (13) outputs second image data in which notes have been deleted from the first image data. A note shifting unit (15) outputs third image data indicating an image of the shifted note on the basis of the specified pitch amount. A synthesis unit (16) synthesizes the second image data and the third image data, and outputs fourth image data indicating an image of the shifted music score.

Description

Technical Field

[0001] The invention relates to a music score editing device for editing music scores. Background Art

[0002] There is a known technique for recognizing musical scores in the form of images. For example, in a musical score recognition device described in Patent Document 1, a part template corresponding to a musical score read by a scanner is selected from pre-stored part templates. The musical score read by the scanner is automatically corrected using the selected part template.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2009-98161 Summary of the invention

[0006] Problems to be solved by the invention

[0007] According to the music score recognition device described in Patent Document 1, when the music score read by the scanner is a music score reflecting the transposed instrument, the key signature can be corrected. However, in the technology described in Patent Document 1, it is difficult to generate a transposed music score.

[0008] An object of the present invention is to provide a music score editing device capable of generating transposed music scores.

[0009] Means for solving problems

[0010] A music score editing device according to one embodiment of the present invention comprises: an image recognition unit that recognizes an image of a music score before transposition as first image data; a pitch receiving unit that receives a designation of a pitch amount representing a difference between a key before transposition and a key after transposition; a note recognition unit that recognizes a note in the first image data; a note deletion unit that outputs second image data in which the note is deleted from the first image data; a note transposition unit that outputs third image data representing an image of the transposed note based on the pitch amount designated to the pitch receiving unit; and a synthesis unit that outputs fourth image data representing an image of the transposed music score by synthesizing the second image data and the third image data.

[0011] Effects of the Invention

[0012] According to the present invention, a transposed musical score can be generated. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is a block diagram showing the structure of a processing system including a music score editing device according to one embodiment of the present invention.

[0014] Figure 2 : is a block diagram showing the structure of the music score editing device.

[0015] Figure 3 FIG. 1 is a diagram showing an example of an image of a musical score based on the first image data recognized by the image recognition unit.

[0016] Figure 4 : is a diagram showing an example of an image of a musical score element based on image data generated from first text data.

[0017] Figure 5 : is a diagram showing an example of an image of a musical score based on the second image data.

[0018] Figure 6 : is a diagram showing an example of an image of a musical score element after the key shift based on the third image data.

[0019] Figure 7 : is a diagram showing an example of an image of a transposed musical score based on the fourth image data.

[0020] Figure 8 1 is a partially enlarged view showing an example of an image of a transposed musical score in the first modification.

[0021] Fig. 9 1 is a partially enlarged view showing an example of an image of a transposed musical score in the second modification.

[0022] Fig.10 1 is a partially enlarged view showing an example of an image of a transposed musical score in the third modification.

[0023] Fig.11 It is a diagram for explaining the fourth modification example.

[0024] Fig.12 2 is a diagram showing an example of an image of a transposed musical score in the fourth modification.

[0025] Fig.13 It is a partially enlarged view showing an example of an image of a musical score before and after transposition in the fourth modification.

[0026] Fig.14 1 is a partially enlarged view showing an example of an image of a transposed musical score in the fifth modification.

[0027] Fig.15 1 is a partially enlarged view showing an example of an image of a transposed musical score in the sixth modification.

[0028] Fig.16 It is shown based on Figure 2 A flowchart of an example of a music score editing process of a music score editing device. DETAILED DESCRIPTION

[0029] (1) Structure of the processing system

[0030] Hereinafter, a music score editing device according to an embodiment of the present invention will be described in detail with reference to the drawings. Figure 1 1 is a block diagram showing the structure of a processing system including a music score editing device according to an embodiment of the present invention. Figure 1 As shown, the processing system 100 includes a RAM (Random Access Memory) 110 , a ROM (Read Only Memory) 120 , a CPU (Central Processing Unit) 130 , a storage unit 140 , an operation unit 150 , and a display unit 160 .

[0031] The processing system 100 is implemented by a computer such as a personal computer, a tablet terminal, a smart phone, or smart glasses. Alternatively, the processing system 100 may be implemented by the joint operation of a plurality of computers connected by a communication path such as Ethernet, or by an electronic musical instrument with a performance function such as an electronic piano.

[0032] The RAM 110, the ROM 120, the CPU 130, the storage unit 140, the operation unit 150, and the display unit 160 are connected to a bus 170. The RAM 110, the ROM 120, and the CPU 130 constitute the musical score editing device 10.

[0033] The RAM 110 is composed of, for example, a volatile memory and is used as a work area of ​​the CPU 130. The ROM 120 is composed of, for example, a nonvolatile memory and stores a score editing program. The CPU 130 performs score editing processing by executing the score editing program stored in the ROM 120 on the RAM 110. Details of the score editing processing will be described later.

[0034] The music score editing program may be stored in the storage unit 140 instead of the ROM 120. Alternatively, the music score editing program may be provided in a form stored in a computer-readable storage medium and installed in the ROM 120 or the storage unit 140. Alternatively, when the processing system 100 is connected to a network such as the Internet, the music score editing program distributed from a server (including a cloud server) on the network may be installed in the ROM 120 or the storage unit 140.

[0035] The storage unit 140 includes a storage medium such as a hard disk, an optical disk, a magnetic disk, or a memory card. The storage unit 140 stores in advance templates (including musical notation fonts for depicting musical scores) for determining various musical symbols included in image data representing an image of a musical score (so-called static musical score) or weight parameters of a learning model used in deep learning, etc.

[0036] The operation unit 150 includes a pointing device such as a mouse or a keyboard, and is operated by the user to specify a given command to the music score editing device 10. The display unit 160 includes, for example, a liquid crystal display, and displays the result of the music score editing process by the music score editing device 10. The operation unit 150 and the display unit 160 may also be configured by a touch panel display.

[0037] (2) Structure of the Music Score Editing Device

[0038] Figure 2 1 is a block diagram showing the structure of the music score editing device 10. Figure 2 As shown, the musical score editing device 10 includes an image recognition unit 11, a note recognition unit 12, a note deletion unit 13, a pitch acceptance unit 14, a note transposition unit 15, a synthesis unit 16, and a correction acceptance unit 17 as functional units. Figure 1 The CPU 130 executes the music score editing program, thereby realizing the functional parts of the music score editing device 10. At least part of the functional parts of the music score editing device 10 may also be realized by hardware such as an electronic circuit.

[0039] The image recognition unit 11 identifies various musical symbols in the provided image of the musical score based on a template stored in the storage unit 140 or a weight learning model based on deep learning or the like, thereby recognizing first image data representing the image of the musical score. Figure 3 1 is a diagram showing an example of an image of a musical score based on the first image data recognized by the image recognition unit 11 .

[0040] In addition, in this example, only the musical symbols related to transposition need to be recognized. For example, musical symbols such as bar lines and repeat symbols that have no relation to transposition may not be recognized. On the other hand, even if musical symbols that have no relation to transposition are recognized and processed, Figure 3 The musical score with clear lines can be generated even when a part of the line overlapping with other symbols is deleted by the note deletion unit 13 described later. If the line is deformed, it is difficult to recognize and redraw it. Therefore, the performance of the recognition function or the quality of the musical score to be processed can be considered to determine the symbols to be recognized and deleted.

[0041] The user can provide the image recognition unit 11 with an image of the desired score before transposition. The image of the score before transposition may also be an image in AR (augmented reality) that can be visually recognized through a smart device or smart glasses. The same is true for the image of the score after transposition. Figure 3 In the example of FIG. 1 , the music score of the 10th "Tendre fleur" of Burgmuller's 25 etudes is provided to the image recognition unit 11. The numbers added above or below the notes in the music score are finger numbers indicating the fingers used when playing the notes on the piano.

[0042] The note recognition unit 12 recognizes notes, accidentals, staves, part symbols, key signatures, or beat signatures (hereinafter referred to as musical score elements) in the first image data recognized by the image recognition unit 11. In addition, the note recognition unit 12 generates first text data indicating the recognized musical score elements and the coordinates of the musical score elements. Figure 4 1 is a diagram showing an example of an image of a musical score element based on image data generated by depicting musical notation fonts or lines, etc. according to first text data. Figure 4 As shown, image data in a PNG (Portable Network Graphics) format or the like representing an image of a musical score element can be generated based on the first text data.

[0043] The musical note deleting unit 13 outputs second image data obtained by deleting musical score elements from the first image data recognized by the image recognizing unit 11 , based on the first text data generated by the musical note recognizing unit 12 . Figure 5 is a diagram showing an example of an image of a musical score based on the second image data. Figure 5 As shown, in the second image data, musical symbols other than the notes, accidentals, staves, part symbols, key signatures, and time signatures included in the first image data remain as peripheral information. Examples of peripheral information include performance symbols, annotations, and explanations. Figure 5 In the example, it is equivalent to the song title and performance symbols (tempo, dynamics, expression terms, articulation (slur or staccato) and articulation (finger number or pedal), etc.).

[0044] Figure 5 The image of the sheet music can be used as Figure 3 The image of the sheet music with Figure 4 It is generated by the residual of the image of the musical score element. That is, Figure 4 The image is used as the Figure 3 The mask image for removing the music score elements from the image, Figure 3 Each pixel of the image is Figure 4 The overlapping parts of the pixels of the image are deleted. Figure 3 The image can be reliably deleted without any unnecessary parts, and the note deletion unit 13 can also be slightly expanded. Figure 4 The image data of the musical notes, accidentals, staves, part symbols, key signatures and time signatures are generated in the form of Figure 4 image data.

[0045] As a method of dilating an image, a morphology operation (dilation processing) or a method of using the bounding box (rectangle surrounding the symbol) of each symbol obtained during music score recognition as a mask image can be cited as an example. In addition, since the symbol is inclined diagonally (for example, a treble clef, a note head, or a repeat sign (Segno)), in order to generate a more accurate mask image ( Figure 4 ), and rotation processing can also be combined.

[0046] The pitch receiving unit 14 receives the specification of the pitch amount from the user. The user can provide the pitch amount indicating the difference between the key before transposition and the key after transposition to the pitch receiving unit 14 by operating the operation unit 150. The pitch amount can be provided as the number of semitones or as the number of sharps or flats in the key signature.

[0047] Alternatively, the pitch receiving unit 14 may also receive the designation of a key from the user. Figure 2 As shown by the dotted arrow, the key before transposition is detected based on the notes recognized by the note recognition unit 12 in the music score before transposition. In addition, the pitch receiving unit 14 receives the designation of the pitch amount by comparing the detected key before transposition with the designated key after transposition.

[0048] The note transposing unit 15 generates second text data representing the transposed musical score element and the coordinates of the musical score element based on the pitch amount specified by the pitch receiving unit 14. In this example, the coordinates of each note in the first text data are rewritten so that each note is arranged at a position shifted in the vertical direction with respect to the five-line by an amount corresponding to the specified pitch amount, thereby generating the second text data. In addition, the note transposing unit 15 outputs third image data representing an image of the transposed musical score element based on the generated second text data. Figure 6 : is a diagram showing an example of an image of a musical score element after the key shift based on the third image data.

[0049] The synthesizing unit 16 synthesizes the second image data (see Figure 5 ), and the third image data output by the note transposing unit 15 (refer to Figure 6 ), outputs fourth image data representing the transposed musical score. Figure 7 is a diagram showing an example of an image of a musical score after the transposition based on the fourth image data. Figure 7 The fourth image data causes the display unit 160 to display the image of the transposed musical score.

[0050] The correction accepting unit 17 accepts from the user the designation of an arbitrary note and the designation of the pitch amount of the note in the fourth image data output by the synthesizing unit 16. The user can designate a desired note and the pitch amount of the note in the image of the transposed musical score displayed on the display unit 160 by operating the operating unit 150.

[0051] When a note and a pitch amount are specified in the correction receiving unit 17, the synthesizing unit 16 corrects the coordinates of the specified note in the second text data based on the specified pitch amount. As a result, the fourth image data is updated, and the specified note is arranged at a position shifted in the vertical direction by an amount corresponding to the specified pitch amount in the transposed musical score.

[0052] (3) Modification

[0053] In the image of the transposed musical score, the readability of the musical score may be reduced due to the overlap of the peripheral information and the musical score elements. Therefore, various processes for improving the readability of the musical score may be performed.

[0054] Figure 8 is a partially enlarged view showing an example of an image of a musical score after transposition in the first modification. In the first modification, the synthesis unit 16 synthesizes the second image data representing the image of the surrounding information and the second image data representing the image of the musical score element by logical exclusive OR, and outputs the fourth image data. According to this processing, even if the fourth image data is binary data, Figure 8 As shown, in the image of the transposed score, the overlapping part of the peripheral information and the score element is indicated by a hollow. Thus, the readability of the score is improved. In the case where the fourth image data is not binary data, in the image of the transposed score, the peripheral information and the score element can also be displayed in different colors.

[0055] Fig. 9 1 is a partially enlarged view showing an example of an image of a transposed musical score in the second modification. In the second modification, the note transposing unit 15 sets the transposed key signature, chord symbol, and beat signature to different densities and outputs the third image data. According to this processing, as shown in FIG. Fig. 9 As shown, in the image of the transposed score, the key signature is displayed lighter than the note symbol and the time signature. Thus, even when the key signature overlaps with the note symbol or the time signature, the readability of the score is improved. In the image of the transposed score, the key signature may also be displayed in a different color from the note symbol or the time signature.

[0056] Fig.10FIG. 1 is a partial enlarged view showing an example of an image of a transposed musical score in the third modification. In the third modification, the note transposing unit 15 arranges the transposed key signature in the gap between the note symbol and the beat signature and outputs the third image data. Fig.10 As shown in FIG. 1 , in the image of the transposed musical score, the key signature is arranged so as not to overlap with the note symbol and the time signature, thereby improving the readability of the musical score.

[0057] In the image of the transposed musical score, peripheral information corresponding to each note may be arranged near the note. Fig.11 is a diagram for explaining the fourth modification. Fig.11 As shown by the dotted line in FIG. 1 , the note deleting unit 13 determines the moving region R in the second image data. The moving region R is a region from a position above the region where the staves are to be arranged by a predetermined distance to a position below the region where the staves are to be arranged by a predetermined distance. The left end and the right end of the moving region R are respectively equal to the left end and the right end of the region where the staves are to be arranged.

[0058] The note deleter 13 outputs the second image data by placing the peripheral information included in the specified moving region R in the peripheral information in the second image data at a position following the transposed note. The synthesizer 16 outputs fourth image data representing the transposed musical score using the second image data. Fig.12 FIG. 4 is a diagram showing an example of an image of a transposed musical score in the fourth modification. Fig.12 As shown, according to the above-mentioned processing, the musical note can be arranged near the musical note in the image of the transposed musical score.

[0059] Fig.13 : is a partially enlarged diagram showing an example of an image of a musical score before and after transposition in the fourth modification. Fig.13 The upper part shows an image of the score before transposition. Fig.13 The lower part of shows the image of the transposed music score. Fig.13 As shown, in the fourth variant, peripheral information such as performance symbols (legato lines or fingering numbers, etc.) or annotations can be moved while maintaining a positional relationship with the notes. In addition, even if the second image data includes decorative notes as peripheral information due to recognition errors, the decorative notes can be arranged at appropriate positions in the image of the transposed score. In this way, even if the score recognition is partially incorrect, the score can be visually correctly transposed. This is an example of the effectiveness of the present invention.

[0060] Fig.14 FIG. 4 is a partially enlarged diagram showing an example of an image of a transposed musical score in the fifth modification. Fig.14As shown, the surrounding information included in the above-mentioned moving area R can also be displayed in a different color from other symbols such as musical score elements. In this case, even if the surrounding information near the note overlaps with the musical score elements, the readability of the musical score can be improved. The surrounding information included in the moving area R can also be displayed lighter than other symbols such as musical score elements.

[0061] Fig.15 FIG. 4 is a partially enlarged diagram showing an example of an image of a transposed musical score in the sixth modification. Fig.15 As shown, the synthesizing unit 16 may also add one or more guide lines G above or below the five-line at intervals equal to the intervals of the five-line and output the fourth image data. According to this processing, even if the ornamental note is arranged at a position away from the five-line without an ornamental line in the transposed musical score due to a music score recognition error or the like, the user can easily identify the pitch of the ornamental note with the guide line G as a reference. Thus, even if an ornamental note cannot be added with an ornamental line due to a recognition error of the ornamental note or the like, the pitch of the note can be correctly identified. In addition, although an example of an ornamental note is shown here, the guide line G may also be used for ordinary notes.

[0062] exist Fig.15 In the example of FIG. 1 , the number of guide straight lines G is three, but the embodiment is not limited thereto. The number of guide straight lines G can be arbitrarily specified by the user. Fig.15 In the example, the guide straight line G is displayed as a dotted line, but the guide straight line G may not be displayed as a dotted line as long as it can be distinguished from the five lines. For example, the guide straight line G may be displayed with a different thickness from the five lines, or may be displayed with a different color from the five lines.

[0063] (4) Music score editing

[0064] Fig.16 It is shown based on Figure 2 A flowchart of an example of a music score editing process of the music score editing device 10. Fig.16 The score editing process is done by Figure 1 The CPU 130 executes the music score editing program.

[0065] First, the image recognition unit 11 determines whether an image of a musical score is provided (step S1). The user can provide the image of a musical score to the image recognition unit 11. If the image of a musical score is not provided, the image recognition unit 11 waits until the image of the musical score is provided. If the image of a musical score is provided, the image recognition unit 11 recognizes the first image data representing the image of the musical score provided in step S1 (step S2).

[0066] Next, the note recognition unit 12 recognizes the musical score elements in the first image data recognized in step S2 (step S3). Furthermore, the note recognition unit 12 generates first text data indicating the musical score elements recognized in step S3 and the coordinates of the musical score elements (step S4). Next, the note deletion unit 13 outputs second image data in which the musical score elements are deleted from the first image data recognized in step S2 based on the first text data generated in step S4 (step S5).

[0067] Afterwards, the pitch receiving unit 14 determines whether the specification of the pitch amount indicating the difference between the key before the transposition and the key after the transposition is received (step S6). The user can specify the pitch amount to the pitch receiving unit 14. Alternatively, the user can specify the key to the pitch receiving unit 14 instead of the pitch amount. If the specification of the pitch amount is not received, the pitch receiving unit 14 waits until the specification of the pitch amount is received.

[0068] When receiving the specification of the pitch amount, the note transposing unit 15 generates second text data representing the transposed musical score element and the coordinates of the musical score element based on the pitch amount (step S7). In addition, the note transposing unit 15 outputs third image data representing an image of the transposed musical score element based on the second text data generated in step S7 (step S8).

[0069] Next, the synthesizing unit 16 synthesizes the second image data outputted in step S5 and the third image data outputted in step S8, thereby outputting fourth image data representing the transposed musical score (step S9). Next, the correction accepting unit 17 determines whether an instruction to correct the musical score is received (step S10). The user can instruct the correction accepting unit 17 to correct the musical score by specifying any note in the fourth image data outputted in step S9 and the pitch amount of the note.

[0070] When the correction of the musical score is instructed, the synthesizing unit 16 corrects the second text data based on the note and pitch amount specified in step S10 (step S11). Specifically, in the second text data, the coordinates of the designated note are corrected based on the designated pitch amount. Thereafter, the synthesizing unit 16 returns to step S8. As a result, the third image data and the fourth image data are updated, and in the transposed musical score, the designated note is arranged at a position shifted in the vertical direction by an amount corresponding to the designated pitch amount.

[0071] If the instruction to modify the score is not received in step S10, the synthesizing unit 16 determines whether an instruction to end is received (step S12). The user can instruct the synthesizing unit 16 to end the score editing process by performing a given operation using the operation unit 150. If the instruction to end is not received, the synthesizing unit 16 returns to step S10. If the instruction to end is received, the synthesizing unit 16 ends the score editing process.

[0072] (5) Effects of Implementation

[0073] As described above, the musical score editing device 10 according to the present embodiment includes: an image recognition unit 11 that recognizes an image of a musical score before transposition as first image data; a pitch receiving unit 14 that receives a designation of a pitch amount indicating a difference between a key before transposition and a key after transposition; a note recognition unit 12 that recognizes musical notes in the first image data; a note deletion unit 13 that outputs second image data in which musical notes are deleted from the first image data; a note transposition unit 15 that outputs third image data indicating an image of the musical note after transposition based on the pitch amount designated to the pitch receiving unit 14; and a synthesis unit 16 that synthesizes the second image data and the third image data to output fourth image data indicating an image of the musical score after transposition.

[0074] According to this configuration, a transposed musical score can be generated from an image of a musical score. Therefore, the user can generate a transposed musical score using an image of a desired musical score, and can easily perform an ensemble with a transposed musical instrument, for example.

[0075] The pitch receiving unit 14 may also receive the designation of the transposed key, detect the pre-transposed key from the pre-transposed musical score, and receive the designation of the pitch amount based on the detected pre-transposed key and the designated post-transposed key. In this case, the designation of the pitch amount can be received based on the post-transposed key.

[0076] The note recognition unit 12 may further recognize the five lines in the first image data, and the note deletion unit 13 may output the second image data after the five lines are deleted from the first image data. According to this configuration, even if the image of the musical score before transposition is a five-line staff, the transposed musical score can be generated.

[0077] The note transposing unit 15 may shift the recognized note relative to the stave based on the pitch amount specified to the pitch receiving unit 14, thereby outputting third image data representing an image of the stave and the transposed note. In this case, a transposed musical score can be easily generated.

[0078] The note recognition unit 12 may further recognize the part symbols, key signatures, and time signatures in the first image data, and the note deletion unit 13 may output the second image data from which the part symbols, key signatures, and time signatures are further deleted. According to this configuration, even when the image of the musical score includes the part symbols, key signatures, and time signatures, a transposed musical score can be generated.

[0079] The musical note deleting unit 13 outputs the second image data after deleting the musical notes and the like from the first image data. Figure 4 In the image data), you can also Figure 4 The portion of the musical notes or the like is expanded so as to become slightly larger than the musical notes or the like included in the first image data. In this case, the musical notes or the like can be reliably deleted from the image of the musical score represented by the second image data.

[0080] The note transposing unit 15 may also output the third image data by setting the transposed key signature, part symbol, and time signature to different concentrations or different colors. In this case, the key signature is displayed differently from the part symbol and the time signature in the transposed musical score. Thus, even when the key signature overlaps with the part symbol or the time signature, the user can easily recognize the key signature.

[0081] The note transposing unit 15 may also arrange the key signature after transposition in the gap between the note symbol and the beat signature and output the third image data. In this case, in the transposed musical score, the key signature is arranged so as not to overlap with the note symbol and the beat signature. In the case where the number of symbols (sharp or flat) of the key signature is larger than the number of symbols of the key before transposition (in Fig.10 In the example of transposing from D major (2 sharps) to G major (4 sharps), since there is insufficient space between the note symbol and the beat signature, in order to ensure space for the key signature, the third image data may be generated by moving the note symbol and the surrounding five lines to the left and extending them. This allows the user to easily recognize the key signature.

[0082] The synthesizing unit 16 may add the guide straight line G above or below the stave at intervals equal to the intervals between the staves and output the fourth image data. According to this configuration, even if the grace note is arranged at a position away from the staves in the transposed musical score, the user can easily recognize the pitch of the grace note based on the guide straight line G.

[0083] The note deletion unit 13 may output second image data including performance symbols, comments, explanations, etc. as peripheral information. In this case, the peripheral information written in the image of the musical score before transposition can be maintained in the musical score after transposition.

[0084] The note deleting unit 13 may also output the second image data by arranging the peripheral information at the position following the transposed note. In this case, the correspondence between the note and the peripheral information can be easily recognized in the transposed musical score.

[0085] The musical score editing device 10 may further include a correction receiving unit 17 that receives a designation of an arbitrary note in the fourth image data and a designation of a pitch amount of the note, and the synthesizing unit 16 may update the fourth image data by correcting the designated note based on the pitch amount designated to the correction receiving unit 17. In this case, in the transposed musical score, the notes can be edited in units of one note.

[0086] (6) Other Implementation Methods

[0087] (a) In the above-mentioned embodiment, the third image data includes the five-line, note symbols, key signature and time signature as music score elements, but the embodiment is not limited to this. It is also possible that part or all of the five-line, note symbols, key signature and time signature are not included in the third image data. In addition, part or all of the note symbols, key signature and time signature may not be included in the third image data but may be included in the second image data. In this case, part or all of the five-line, note symbols, key signature and time signature are displayed in the image of the music score based on the second image data.

[0088] (b) In the above embodiment, the third image data is outputted by the musical note moving relative to the stave, but the embodiment is not limited thereto. The third image data may be outputted by the musical note and the stave moving relative to each other. Therefore, the third image data may be outputted by the stave moving relative to the musical note.

[0089] (c) In the above embodiment, the music score editing device 10 includes the correction accepting unit 17, but the embodiment is not limited thereto. In the case where it is not necessary to edit the notes in units of one note in the transposed music score, the music score editing device 10 may not include the correction accepting unit 17.

[0090] (d) In the above embodiment, the musical note recognition unit 12 and the musical note transposition unit 15 generate text data and generate image data based on the generated text data, but the embodiment is not limited to this. The musical note recognition unit 12 or the musical note transposition unit 15 may generate transposed image data by processing a raster image or a vector image of the musical note recognized by the image recognition unit 11, etc., without generating text data.

[0091] Description of Reference Numerals

[0092] 10: Music score editing device, 11: Image recognition unit, 12: Note recognition unit, 13: Note deletion unit, 14: Pitch receiving unit, 15: Note transposition unit, 16: Synthesis unit, 17: Correction receiving unit, 100: Processing system, 110: RAM, 120: ROM, 130: CPU, 140: Storage unit, 150: Operation unit, 160: Display unit, 170: Bus, G: Guide line, R: Moving area.

Claims

1. A music score editing device, comprising: an image recognition unit that recognizes an image of the musical score before transposition as first image data; a pitch receiving unit that receives a specification of a pitch amount indicating a difference between a key before transposition and a key after transposition; a musical note recognition unit, configured to recognize musical notes in the first image data; a musical note deleting unit configured to output second image data obtained by deleting the musical note from the first image data; a note transposing section that outputs third image data representing an image of the note after transposition based on the pitch amount specified to the pitch receiving section; as well as The synthesis unit synthesizes the second image data and the third image data to output fourth image data representing an image of the transposed musical score.

2. The music score editing device according to claim 1, wherein: The pitch receiving unit receives designation of a key after transposition, detects the key before transposition from the musical score before transposition, and receives designation of a pitch amount based on the detected key before transposition and the designated key after transposition.

3. The music score editing device according to claim 1 or 2, wherein: The musical note recognition unit further recognizes the five lines in the first image data. The note deleting unit outputs the second image data obtained by deleting the five-line from the first image data.

4. The music score editing device according to claim 3, wherein: The note transposing unit relatively shifts the recognized note and the stave based on the pitch amount specified to the pitch receiving unit, thereby outputting the third image data representing an image of the stave and the transposed note.

5. The music score editing device according to claim 3 or 4, wherein: The musical note recognition unit further recognizes the musical part symbol, key signature and time signature in the first image data. The note deleting unit outputs the second image data from which the part symbol, the key signature, and the beat signature are deleted from the first image data.

6. The music score editing device according to claim 5, wherein: The note transposing unit outputs the third image data by setting the transposed key signature, the part code, and the beat signature to different concentrations or different colors.

7. The music score editing device according to claim 5, wherein: The note transposing unit arranges the transposed key signature in a gap between the part symbol and the beat signature and outputs the third image data.

8. The music score editing device according to any one of claims 3 to 7, wherein: The synthesis unit adds guide straight lines above or below the five lines at intervals equal to the intervals between the five lines, and outputs the fourth image data.

9. The music score editing device according to any one of claims 1 to 8, wherein: The note deleting unit outputs the second image data including musical symbols other than notes, accidentals, staves, part symbols, key signatures, and time signatures as peripheral information.

10. The music score editing device according to claim 9, wherein: The note deleting unit arranges the peripheral information at a position following the transposed note and outputs the second image data.

11. The music score editing device according to any one of claims 1 to 10, wherein: The musical score editing device further comprises: a correction accepting unit that accepts a designation of an arbitrary note in the fourth image data and a designation of a pitch amount of the note; The synthesizing unit corrects the designated musical note based on the pitch amount designated to the correction accepting unit and updates the fourth image data.

12. The music score editing device according to any one of claims 1 to 11, wherein: When the musical note deleting unit outputs the second image data in which the musical notes and the like are deleted from the first image data, the musical note deleting unit deletes the musical notes and the like included in the first image data by dilating or rotating a mask image for deletion.

Images