Text display method, text display device, and text display program

Abstract

This text display method includes: acquiring melody data PD representing a plurality of sounds which have been put in order; acquiring text information that includes a word and a first symbol; and displaying a corresponding text item that corresponds to a first phoneme determined on the basis of the position of the first symbol in the word and phonemes constituting the word, the corresponding text item being displayed in association with a first sound included in the melody data PD and one or a plurality of sounds which succeed the first sound.

Description

Text display method, text display device, and text display program

[0001] The present invention relates to a technique for displaying text in association with a plurality of sounds.

[0002] A piano roll user interface is used to visualize music on a computer. For example, a piano roll consists of an image of a piano keyboard and block images that represent the melody and are placed at positions corresponding to the keys. The block images placed corresponding to each key (each pitch) on the keyboard represent the onset time, duration, and pitch of each note, allowing the piano roll to represent music.

[0003] When a piece of music is displayed in a piano roll, lyrics are assigned to block images representing musical notes. This allows a user to understand the melody and the lyrics assigned to each note by referring to the piano roll. Patent Document 1 listed below proposes a method for inputting lyrics to be assigned to multiple notes all at once in a piano roll-style user interface.

[0004] JP 2013-190595 A

[0005] In the above-mentioned Patent Document 1, lyrics are divided into syllables and assigned to each note on the piano roll. In actual songs, advanced singing techniques and complex singing styles may be used, and the task of assigning lyrics for such songs to the piano roll may be tedious. If a technology were developed that allows lyrics to be assigned to notes appropriately for songs involving various singing techniques, it would be convenient for users.

[0006] An object of the present invention is to display text in association with a plurality of sounds according to information contained in the text information.

[0007] A text display method according to one aspect of the present invention acquires data indicating an ordered plurality of sounds, acquires text information including a word and a first symbol, and displays corresponding text corresponding to a first phoneme determined based on the position of the first symbol in the word and the phonemes that constitute the word, in association with the first sound included in the data and one or more sounds subsequent to the first sound.

[0008] The present invention is also directed to a text display device and a text display program.

[0009] According to the present invention, text can be displayed in association with a plurality of sounds in accordance with information contained in the text information.

[0010] FIG. 1 is a configuration diagram of a text display device according to an embodiment. FIG. 2 is a diagram showing the configuration of music data. FIG. 3 is a diagram showing the relationship between text information and corresponding text. FIG. 4 is a diagram showing an example of text allocation to notes. FIG. 5 is a diagram showing an example of text allocation to notes. FIG. 6 is a diagram showing an example of text allocation to notes. FIG. 7 is a functional block diagram of a text display device according to an embodiment. FIG. 8 is a diagram showing a piano roll-style user interface. FIG. 9 is a diagram showing a piano roll-style user interface in a state where a lyrics input interface is displayed. FIG. 10 is a diagram showing a piano roll-style user interface to which text has been allocated. FIG. 11 is a flowchart showing a text display method according to an embodiment.

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A text display method, a text display device, and a program according to embodiments of the present invention will now be described with reference to the accompanying drawings.

[0012] {1. Configuration of Text Display Device} Fig. 1 is a block diagram showing the configuration of a text display device 1 according to this embodiment. The text display device 1 is configured, for example, by a personal computer. As shown in Fig. 1, the text display device 1 includes a CPU (Central Processing Unit) 20, a ROM (Read Only Memory) 21, a RAM (Random Access Memory) 22, a storage device 23, an input device 24, a display 25, a sound source 26, a sound system 27, a communication interface (I / F) 28, and a device interface (I / F) 29. These devices are connected via a system bus 30.

[0013] The CPU 20 controls the overall operation of the text display device 1. The ROM 21 stores control programs executed by the CPU 20 and various data. The RAM 22 is used as a work area for the CPU 20. The storage device 23 stores the program PR, music data SD, and rule data RD. The storage device 23 can be configured using various storage media such as a hard disk or semiconductor memory. The program PR executes processes such as displaying a piano roll-style user interface on the display 25, determining the first phoneme from text information indicating lyrics, assigning text to each note that makes up the music, and displaying text associated with each note on the piano roll on the display 25. In this way, the program PR functions as a so-called score editor.

[0014] The input device 24 is an interface that accepts input operations by the user. The display 25 is used to display a piano roll-style user interface, etc. The sound source unit 26 and sound system 27 play music, etc. The communication interface 28 is an interface that performs wired or wireless communication with other computers. The device interface 29 is an interface that accesses a storage medium 31 such as a CD, DVD, or semiconductor memory.

[0015] The program PR will be described as being stored in the storage device 23. In another embodiment, the program PR may be provided by being stored in a storage medium 31. The CPU 20 may access the storage medium 31 via the device interface 29 and store the program PR stored in the storage medium 31 in the storage device 23 or the ROM 21. Alternatively, the CPU 20 may access the storage medium 31 via the device interface 29 and execute the program PR stored in the storage medium 31. Alternatively, the CPU 20 may download the program PR from a server on the network via the communication interface 28 and store the downloaded program PR in the storage device 23 or the ROM 21. Alternatively, the CPU 20 may directly execute the program PR stored in a server on the network via the communication interface 28.

[0016] {2. Structure of Music Data} Figure 2 shows the structure of music data SD. Music data SD is composed of melody data PD and lyric data LD. The melody data PD is data that records the onset time, duration, and pitch of each note that makes up a piece of music. The melody data PD may also include the volume and velocity of each note. A piano roll-style user interface can be generated based on the melody data PD.

[0017] The lyrics data LD is data that records lyrics to be assigned to a melody generated based on the melody data PD. In the lyrics data LD, text information indicating lyrics is composed of multiple corresponding texts. In the lyrics data LD, each corresponding text is associated with each note recorded in the melody data PD. Based on the lyrics data LD, lyrics can be displayed on a piano roll-style user interface.

[0018] {3. Text Information and Corresponding Text} Fig. 3 is a diagram showing the relationship between text information and corresponding text. Text information is data indicating lyrics. The text information is input, for example, by a user. The lyrics indicated by the text information are divided into corresponding texts, and each corresponding text is assigned to each note of the music piece. In the example shown in Fig. 3, the text information "A faintly sweet flavor" is divided into 10 corresponding texts: "ka", "su", "ka", "na", "a", "ma", "mi", "no", "flaa", and "vor".

[0019] As described above, in phonetic characters such as Japanese, one character corresponds to one syllable, and therefore, in this embodiment, one hiragana or katakana character is assigned to one musical note as one corresponding text. In contrast, an English word may be composed of multiple syllables. If an English word is composed of one syllable, the English word is assigned to one musical note as one corresponding text. If an English word is composed of multiple syllables, the English word is divided into multiple corresponding texts and assigned to multiple musical notes. In the example of FIG. 3, the English word "flavor" contains two syllables, "fla" and "vor," and therefore is divided into two corresponding texts, each of which is assigned to one musical note.

[0020] {4. First Symbol and First Phoneme} Figures 4 to 7 are diagrams showing examples of allocating text information to notes. Figure 4 shows an example in which the text information includes the English word "kiss." Since the English word "kiss" has one syllable, in this embodiment, as shown in Figure 4, "kiss" is allocated to one note as one corresponding text.

[0021] FIG. 5 shows another example in which text information includes an English word and a first symbol. When inputting text information such as that shown in FIG. 3, the user can include a first symbol in the English word. The first symbol is used to specify a first phoneme that is assigned across multiple notes. For example, the first phoneme is a phoneme that is pronounced across multiple notes in lyrics sung with a so-called melisma. Melisma refers to a singing technique in which multiple notes are associated with one syllable in lyrics. In this embodiment, an example in which the first symbol is a hyphen (-) will be described.

[0022] As shown in FIG. 5, in the text information input by the user, a first symbol (hyphen) is inserted between "ki" and "ss", as in "ki-ss". In this case, in this embodiment, the phoneme corresponding to the vowel "i" contained in the syllable immediately preceding the first symbol is determined as the first phoneme. The one-syllable English word "kiss" is usually assigned to one musical note, but the corresponding text "ki" corresponding to the first phoneme is additionally assigned to one musical note. As a result, the text information "ki-ss" is divided into two corresponding texts, "ki" and "ss", and each is assigned to a musical note.

[0023] In the example shown in FIG. 5, a single first symbol is inserted, but consecutive first symbols may also be inserted. For example, two consecutive first symbols may be inserted, and text information "ki--ss" may be input. In this case, the text information "ki--ss" is divided into three corresponding texts, "ki," "i," and "ss," each of which is associated with a note. Any number of consecutive first symbols may be designated.

[0024] 6 shows an example in which the text information includes the English word "flavor." Since the English word "flavor" has two syllables, in this embodiment, as shown in FIG. 6, the syllable "fla" is assigned to one note as one corresponding text, and the syllable "vor" is assigned to one note as one corresponding text.

[0025] FIG. 7 shows another example in which text information includes an English word and a first symbol. In FIG. 7, the text information entered by the user includes a first symbol inserted between "fla" and "vo" and between "vo" and "r," such as "fla-vo-r." In this case, in this embodiment, the phoneme corresponding to the vowel "a" included in the syllable immediately preceding the first first symbol is determined as the first phoneme. Furthermore, the phoneme corresponding to the vowel "o" included in the syllable immediately preceding the second first symbol is determined as the first phoneme. The two-syllable word "flavor" is normally assigned to two notes, but the corresponding text "a" and "vo" corresponding to the first phoneme are each assigned to one additional note. Therefore, the text information "fla-vo-r" is divided into four corresponding texts: "fla," "a," "vo," and "r," and each is assigned to a note. It is possible to split the syllable "fla" into two corresponding texts, "fl" and "a," by specifying the first phoneme "a." However, in this embodiment, the consonant "fl" is not separated, and the syllable is split into two corresponding texts, "fla" and "a." Furthermore, it is possible to split the syllable "vor" into two corresponding texts, "vo" and "r," by specifying the first phoneme "o." However, the consonant "r" is not separated, and the syllable is split into two corresponding texts, "vo" and "or."

[0026] In the example shown in Figure 7, the first symbol is inserted singly at two locations, but the first symbol may be inserted consecutively. For example, the first symbol may be inserted three times consecutively, and the text information "fla---vor" may be input. In this case, the text information "fla---vor" is divided into five corresponding texts, "fla," "a," "a," "a," and "vor," and each is associated with a musical note.

[0027] The rule for determining the first phoneme and the rule for dividing syllables are recorded in the rule data RD. In this embodiment, the rule data RD records, as the rule for determining the first phoneme, a rule that "a phoneme corresponding to a vowel included in the syllable immediately preceding the first symbol is determined as the first phoneme." Alternatively, the rule data RD may record a rule that "a phoneme immediately preceding the first symbol is determined as the first phoneme." Alternatively, the rule data RD may record a rule that "a phoneme included in the syllable immediately preceding the first symbol is determined as the first phoneme." Alternatively, the rule data RD may record a rule that "a phoneme corresponding to a voiced consonant included in the syllable immediately preceding the first symbol is determined as the first phoneme." Alternatively, the rule data RD may record a rule that "a phoneme corresponding to a voiced consonant included in the syllable immediately preceding the first symbol is determined as the first phoneme." Alternatively, these multiple rules may be recorded so as to be applied in a composite manner. Alternatively, multiple rules may be recorded so as to be applied in a composite manner together with their priorities.

[0028] {5. Functional Configuration of Text Display Device} Figure 8 is a block diagram showing the functional configuration of the text display device 1. In Figure 8, the control unit 10 is a functional unit realized by the CPU 20 executing the program PR while using the RAM 22 as a work area. The control unit 10 includes a melody data acquisition unit 11, a piano roll display unit 12, a text information acquisition unit 13, a first phoneme determination unit 14, a text correspondence unit 15, a text display unit 16, and a playback unit 17. The melody data acquisition unit 11, the piano roll display unit 12, the text information acquisition unit 13, the first phoneme determination unit 14, the text correspondence unit 15, the text display unit 16, and the playback unit 17 are functional units realized by the execution of the program PR. In other words, each of the functional units 11 to 17 is a functional unit included in the CPU 20.

[0029] The melody data acquisition unit 11 reads out melody data PD stored in the storage device 23. The piano roll display unit 12 displays a user interface in piano roll format on the display 25 based on the melody data PD read out by the melody data acquisition unit 11. The piano roll display unit 12 arranges the notes that make up the melody on the piano roll based on the melody data PD. The melody data acquisition unit 11 is an example of a sound data acquisition unit according to the present invention.

[0030] The text information acquisition unit 13 acquires text information indicating lyrics input by the user. The user inputs the text information by operating an input device 24 such as a keyboard. The first phoneme determination unit 14 determines a first phoneme based on the text information acquired by the text information acquisition unit 13. The first phoneme determination unit 14 refers to the rule data RD and determines the first phoneme based on the first phoneme determination rule recorded in the rule data RD.

[0031] The text associating unit 15 associates corresponding text with each note specified in the melody data PD based on the text information acquired by the text information acquisition unit 13 and the first phoneme determined by the first phoneme determination unit 14. As illustrated in FIG. 3 , the text associating unit 15 associates one corresponding text with each note. However, as described above, the text associating unit 15 associates the corresponding text corresponding to the first phoneme with multiple notes. The text associating unit 15 stores information about the corresponding text in the storage device 23 as lyric data LD.

[0032] The text display unit 16 displays lyrics on a piano roll-style user interface displayed by the piano roll display unit 12. When the music data SD has lyrics data LD, the text display unit 16 displays lyrics on the piano roll based on the lyrics data LD stored in the storage device 23. Alternatively, the text display unit 16 displays lyrics on the piano roll based on text information acquired by the text information acquisition unit 13.

[0033] The playback unit 17 plays music based on the music data SD. The playback unit 17 provides the melody data PD to the sound source unit 26. The sound source unit 26 generates waveform data based on the melody data PD and provides the waveform data to the sound system 27. As a result, a melody is output by the sound system 27. The playback unit 17 also plays lyrics based on lyric data LD. The playback unit 17 provides the lyric data LD to the sound source unit 26. The sound source unit 26 has phoneme segment data corresponding to each phoneme. The sound source unit 26 converts the pitch of the phoneme segment data in accordance with the pitch specified in the melody data PD and provides the waveform data to the sound system 27. As a result, singing is output by the sound system 27. The playback unit 17 synchronously plays back the melody and lyrics based on the melody data PD and the lyric data LD. As a result, a music piece with singing is output from the sound system 27. When the user specifies the tone color of the melody and the vocal quality of the singing, the sound source unit 26 can output waveform data corresponding to the tone color and vocal quality.

[0034] 6. Piano Roll-Style User Interface Next, a piano roll-style user interface displayed by the piano roll display unit 12 and the text display unit 16 will be described with reference to FIGS. 9 to 11. FIG. 9 is a diagram showing a piano roll-style user interface displayed on the display 25. The piano roll includes a keyboard unit 101 displaying an image resembling a keyboard, and a melody display unit 102 disposed to the right of the keyboard unit 101. A plurality of block images 103 representing a string of musical notes are disposed in the melody display unit 102. The pitch is specified by the vertical position of the block image 103, and the onset time of the note is specified by the horizontal position of the block image 103. The note duration is specified by the horizontal length of the block image 103.

[0035] The piano roll display unit 12 displays the piano roll shown in Fig. 9 on the display 25 based on the melody data PD acquired by the melody data acquisition unit 11. The piano roll shown in Fig. 9 shows a state in which lyrics are not displayed.

[0036] FIG. 10 is a diagram showing a piano roll displaying an input interface 105 for text information (lyrics). The piano roll display unit 12 displays the input interface 105 overlaid on the piano roll displayed on the display 25 or to the side of the piano roll. By specifying one of the block images 103, the user can specify the starting note ST to which lyrics to be input via the input interface 105 will be assigned. In the example shown in FIG. 10, the leftmost block image 103 is specified as the starting note ST. Therefore, the text information input via the input interface 105 is assigned to the sequence of notes following the starting note ST along the time axis. Note that the starting note ST is an example of a designated note in the present invention. In the example of FIG. 10, the text information "faint sweetness of fla-vo-r" has been input into the input interface 105. The user can input text information into the input interface 105 by operating an input device 24, such as a keyboard. Alternatively, if the display 25 is a touch panel display, text information can be input by touching the display 25, which functions as the input device 24, with a finger or a pen.

[0037] FIG. 11 illustrates a state in which input text information is reflected in a piano roll. The text information "faintly sweet flavor" input by the user is assigned to the string of subsequent notes starting from the start note ST. As shown in FIG. 11, the corresponding text assigned to each note is displayed superimposed on each block image 103. As illustrated in FIG. 3, the Japanese character portion of the text information, "faintly sweet flavor," is divided into eight corresponding texts ("ka," "su," "ka," "na," "a," "ma," "mi," and "no") and assigned to the subsequent eight notes starting from the start note ST. The English word "fla-vo-r" is divided into four corresponding texts ("fla," "a," "vo," and "or") and assigned to the subsequent four notes. In FIG. 11, the note to which the corresponding text "fla" or "vo" is assigned (the note indicated by the symbol AT in the figure) is an example of a first note in the present invention. Furthermore, the notes to which the corresponding text "a" or "or" is assigned (notes indicated by the symbol BT in the drawing) are examples of notes subsequent to the first note in the present invention.

[0038] 11, the playback unit 17 can play back music containing lyrics with the lyrics assigned to the piano roll. This allows the user to check the validity of the lyrics assigned to each note based on the input text information. The user can also check whether the vocal parts, such as melismata specified by the first symbol, have been properly assigned to the notes.

[0039] {7. Text Display Method} Next, the text display method according to this embodiment will be described with reference to Fig. 12. The flowchart shown in Fig. 12 shows the overall processing flow of the text display method. The processing shown in Fig. 12 is realized by executing the program PR on the CPU 20. First, in step S1, the melody data acquisition unit 11 acquires melody data PD from the storage device 23. The melody data PD is an example of "data indicating a plurality of ordered notes" in the present invention.

[0040] In step S2, the piano roll display unit 12 displays a user interface in piano roll format on the display 25 based on the melody data PD acquired by the melody data acquisition unit 11. The piano roll display unit 12 displays, for example, a piano roll such as that shown in FIG.

[0041] In step S3, the text information acquisition unit 13 acquires text information indicating lyrics. The text information includes words such as Japanese characters and English words. The text information also includes a first symbol. The piano roll display unit 12 displays an input interface 105 such as that shown in FIG. 10 on the display 25 in response to a user operation using the input device 24. At this time, the user operation specifies a start note ST to which the text information is to be assigned. In the example shown in FIG. 10, the leftmost block image 103 is specified as the start note ST. The user can specify any note (any block image 103) displayed on the piano roll as the start note ST. The user inputs text information into the input interface 105 using the input device 24.

[0042] In step S4, the first phoneme determination unit 14 determines a first phoneme based on the text information acquired by the text information acquisition unit 13. The first phoneme determination unit 14 determines the first phoneme from the position of the first symbol in the word and the phonemes that make up the word. When determining the first phoneme, the first phoneme determination unit 14 refers to a first phoneme determination rule recorded in the rule data RD.

[0043] In step S5, the text associating unit 15 assigns text information to each note based on the melody data PD, the text information, and the first phoneme. For words such as English words, the text associating unit 15 generally associates one syllable of corresponding text with one note. However, the text associating unit 15 also associates the first phoneme with a first note included in the melody data PD and one or more notes following the first note. In other words, the first phoneme is assigned to multiple notes. This allows the user to input text information corresponding to advanced singing techniques, such as melisma, all at once.

[0044] In step S6, the text display unit 16 displays the corresponding text associated with each note superimposed on the piano roll displayed on the display 25. For example, as shown in FIG. 11, the text display unit 16 displays the corresponding text in a block image 103 representing each note. In FIG. 11, the "a" corresponding to the first phoneme is divided into two corresponding texts, "fla" and "a," which are assigned to two notes. Also, the "o" corresponding to the first phoneme is divided into two corresponding texts, "vo" and "o," which are assigned to two notes.

[0045] Thus, with the text display device 1 of this embodiment, the user can input lyrics to be sung across multiple notes in one go by inputting text information including the first symbol. By using the text display device 1 of this embodiment, the user can enjoy the customer experience of inputting lyrics corresponding to advanced singing techniques such as melisma in one go.

[0046] 8. Other Embodiments In the above embodiments, an example has been described in which a phoneme corresponding to a vowel included in a syllable immediately preceding a first symbol is determined as the first phoneme. The rules for determining the first phoneme are not limited and may be freely set for each user. In any case, it is sufficient that the rules for determining the first phoneme based on the position of the first symbol and the phonemes that constitute a word are recorded in the rule data RD.

[0047] In addition to a basic rule such as "the phoneme corresponding to the vowel contained in the syllable immediately preceding the first symbol is determined as the first phoneme," the rule data RD may also record exception rules according to the structure of a word or for each individual word. The text corresponding unit 15 determines the first symbol based on the basic rule recorded in the rule data RD, but if an exception rule is recorded, the text corresponding unit 15 may apply the exception rule.

[0048] Furthermore, if the first symbol is inserted in a position where an appropriate rule recorded in the rule data RD cannot be applied, processing may be performed that assumes that the first symbol exists in a surrounding position where the rule can be applied.

[0049] Based on the rule data RD, a trained model may be generated that trains the relationship between a word (input) and a first phoneme (output) and the relationship between a word (input) and a syllable division (output). By using this trained model, it is possible to estimate the first phoneme and syllable division even for words that do not exist in the rule data RD. Based on the estimated content, it is possible to associate text with musical notes and output sound.

[0050] In the above embodiment, the first symbol is included in an English word. In another embodiment, the first symbol may be included in a word of a language other than English that has a deep orthography, such as French. This allows the user to input lyrics that use singing techniques such as melisma all at once, just like in the above embodiment.

[0051] In the above embodiment, the text information is described as lyrics. As another example, the present invention can be applied to a case where the text information is a sentence. For example, by inputting a sentence in the same manner as in the above embodiment, the present invention can be applied to software that reads out a sentence.

[0052] In the above embodiment, the corresponding text corresponding to the first phoneme determined based on the position of the first symbol in the word and the phonemes constituting the word is associated with the first sound and the sounds subsequent to the first sound and displayed on the display 25. In another embodiment, the association between the corresponding text and the first sound may not be displayed on the display, and instead, the audio corresponding to the first phoneme may be played back in association with the first sound and one or more subsequent sounds.

[0053] 9. Features and Effects of the Embodiments A text display method according to one aspect of the present invention acquires data indicating a plurality of ordered sounds, acquires text information including a word and a first symbol, and displays corresponding text corresponding to a first phoneme determined based on the position of the first symbol in the word and the phonemes that make up the word, in association with the first sound included in the data and one or more sounds following the first sound.

[0054] A plurality of sounds can be associated with the first phoneme determined from the first symbol, making it easy to input lyrics that are compatible with various singing techniques.

[0055] Displaying in association may involve displaying information indicating a sequence of multiple sounds on an image display device, and displaying corresponding text on the image display device in association with information indicating a first sound and one or more subsequent sounds.

[0056] The user can visually grasp the correspondence between the phoneme to be extended and the sound.

[0057] Furthermore, a sound corresponding to the first phoneme may be played in association with the first sound and one or more subsequent sounds.

[0058] The user can check the validity of the association with multiple sounds.

[0059] The phoneme immediately preceding the first symbol may be determined as the first phoneme.

[0060] The user can specify the phoneme to be extended by including the first symbol immediately after the phoneme that the user wants to associate with multiple sounds.

[0061] A phoneme included in the syllable immediately preceding the first symbol may be determined as the first phoneme.

[0062] The user can specify the phoneme to be extended by including the first symbol immediately after the syllable containing the phoneme that the user wants to map to multiple sounds.

[0063] A phoneme corresponding to a vowel included in the syllable immediately preceding the first symbol may be determined as the first phoneme.

[0064] The user can specify the phoneme to be lengthened by including the first symbol immediately after the syllable containing the vowel that the user wants to map to multiple sounds.

[0065] The input interface for the text information may be associated with a designated sound included in a sequence of multiple sounds, and the text designated by the text information may be associated with subsequent sounds starting from the designated sound.

[0066] The user can assign text from any position to a sequence of multiple sounds.

[0067] The number of sounds associated with the first phoneme may be specified by consecutively notating the first symbol.

[0068] The user can freely set the number of sounds to which the first phoneme is assigned.

[0069] The words may include words of languages ​​with deep orthographies.

[0070] The words may include English words.

[0071] A text display device according to another aspect of the present invention includes a sound data acquisition unit that acquires data indicating a plurality of ordered sounds, a text information acquisition unit that acquires text information including a word and a first symbol, and a text display unit that displays corresponding text corresponding to a first phoneme determined based on the position of the first symbol in the word and the phonemes that make up the word, in association with the first sound included in the data and one or more sounds following the first sound.

[0072] A text display program according to another aspect of the present invention is a program that causes a computer to execute a text display method, which acquires data indicating a plurality of ordered sounds, acquires text information including a word and a first symbol, and displays corresponding text corresponding to a first phoneme determined based on the position of the first symbol in the word and the phonemes that make up the word, in association with the first sound included in the data and one or more sounds following the first sound.

[0073] 10...control unit, 11...melody data acquisition unit, 12...piano roll display unit, 13...text information acquisition unit, 14...first phoneme determination unit, 15...text correspondence unit, 23...storage device, 24...input device, 25...display, SD...music data, PD...melody data, LD...lyrics data, RD...rule data

Claims

1. A text display method comprising: acquiring data indicating a plurality of ordered sounds; acquiring text information including a word and a first symbol; and displaying corresponding text corresponding to a first phoneme determined based on the position of the first symbol in the word and the phonemes that constitute the word, in association with the first sound included in the data and one or more sounds following the first sound.

2. The text display method of claim 1, wherein said corresponding and displaying comprises displaying information indicating the sequence of the plurality of sounds on an image display device, and displaying the corresponding text on the image display device in association with information indicating the first sound and the one or more subsequent sounds.

3. The method of claim 1 or 2, further comprising: playing a sound corresponding to said first phoneme in association with said first sound and said subsequent one or more sounds.

4. The method of claim 1 or 2, wherein the phoneme immediately preceding the first symbol is determined as the first phoneme.

5. The text display method according to claim 1 or 2, wherein a phoneme contained in a syllable immediately preceding said first symbol is determined as said first phoneme.

6. The text display method according to claim 1 or 2, wherein a phoneme corresponding to a vowel contained in a syllable immediately preceding said first symbol is determined as said first phoneme.

7. The text display method according to claim 2, wherein the input interface for the text information is associated with a designated sound included in the sequence of the plurality of sounds, and the text specified in the text information is associated with subsequent sounds beginning with the designated sound.

8. The method of displaying text according to claim 1 or 2, wherein the number of sounds associated with the first phoneme is designated by consecutively writing the first symbol.

9. A method for displaying text as claimed in claim 1 or claim 2, wherein the words include words of a deep orthographic language.

10. The method of claim 1 or 2, wherein the words include English words.

11. A text display device comprising: a sound data acquisition unit that acquires data indicating a plurality of ordered sounds; a text information acquisition unit that acquires text information including a word and a first symbol; and a text display unit that displays corresponding text corresponding to a first phoneme determined based on the position of the first symbol in the word and the phonemes that constitute the word, in association with a first sound included in the data and one or more sounds following the first sound.

12. A program for causing a computer to execute a text display method, the text display method comprising the steps of: acquiring data indicating a plurality of ordered sounds; acquiring text information including a word and a first symbol; and displaying corresponding text corresponding to a first phoneme determined based on the position of the first symbol in the word and the phonemes constituting the word, in association with the first sound included in the data and one or more sounds following the first sound.

Images