Reproduction control method, information processing system and program

Abstract

To effectively facilitate user's understanding of a musical score through sound.SOLUTION: An information processing system 100 acquires musical score data X representing a musical score, and reproduces sound corresponding to the musical score data X. In controlling the reproduction, for a chord consisting of multiple notes including a first note and a second note among the musical notes represented by the musical score data X, the reproduction of a first guide sound corresponding to the first note and the reproduction of a second guide sound corresponding to the second note are started at different points in time.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a technique for assisting a user in understanding the contents of a musical score. [Background technology]

[0002] Various technologies have been proposed to help users understand the contents of musical scores. For example, Patent Document 1 discloses an automatic musical score braille transcription system that processes musical score data to transcribing the musical score into braille and generates a braille score that represents the result of the transcription. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Unexamined Patent Publication No. 60-119594 Summary of the Invention [Problem to be solved by the invention]

[0004] However, even if a conventional technique for assisting in understanding musical scores is used, it is actually difficult for a user to understand the contents of the musical score, and there is room for further improvement. In consideration of the above circumstances, one aspect of the present disclosure aims to effectively facilitate a user to understand musical scores by sound. [Means for solving the problem]

[0005] In order to solve the above problems, a playback control method according to one embodiment of the present disclosure is a playback control method realized by a computer system that acquires musical score data representing a musical score and plays sounds corresponding to the musical score data, and in controlling the playback, for a chord composed of a plurality of notes including a first note and a second note in the musical score represented by the musical score data, playback of a first guidance sound corresponding to the first note and playback of a second guidance sound corresponding to the second note are started at different times.

[0006] A playback control method according to one aspect of the present disclosure is a playback control method implemented by a computer system that acquires musical score data representing a musical score and plays sounds corresponding to the musical score data, and in controlling the playback, for derived notes in which an alteration symbol has been added to a fundamental note in the musical score represented by the musical score data, a note name guidance sound representing the note name of the fundamental note and an alteration guidance sound representing the name of the alteration symbol are sequentially played.

[0007] A playback control method according to one embodiment of the present disclosure is a playback control method realized by a computer system that acquires musical score data representing a musical score of a piece of music composed of multiple voice parts including a first voice part and a second voice part, and plays back a sound corresponding to the musical score data, wherein in controlling the playback, the first guidance sound and the second guidance sound are played back so that a first sound image of a first guidance sound corresponding to the first voice part and a second sound image of a second guidance sound corresponding to the second voice part are positioned at different positions. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram illustrating a configuration of an information processing system according to a first embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a functional configuration of an information processing system. [Diagram 3] 11A and 11B are explanatory diagrams of a reproducing operation and a guiding operation. [Figure 4] 13 is a flowchart of a guidance operation. [Diagram 5] 13 is an explanatory diagram of a reproducing operation and a guiding operation in the second embodiment. FIG. [Figure 6] 10 is a flowchart of a guidance operation in the second embodiment. [Figure 7] 13 is a flowchart of a process executed in a conversion process according to a third embodiment. [Figure 8] 13 is an explanatory diagram of a guiding operation in the third embodiment. FIG. [Figure 9] FIG. 13 is a block diagram illustrating an example of a functional configuration of an information processing system according to a fourth embodiment. [Figure 10]FIG. 13 is an explanatory diagram of a reading voice regarding a derived sound. [Figure 11] 13 is a flowchart of a guidance operation in the fourth embodiment. [Figure 12] FIG. 13 is a block diagram illustrating an example of a functional configuration of an information processing system according to a fifth embodiment. [Figure 13] FIG. 13 is an explanatory diagram of a preparatory operation in the fifth embodiment. [Figure 14] 13 is a flowchart of a process executed by a control device according to a fifth embodiment. [Figure 15] FIG. 13 is an explanatory diagram of a preparatory operation in the fifth embodiment. [Figure 16] 13 is an explanatory diagram of a guiding operation in a modified example. FIG. [Figure 17] FIG. 2 is an explanatory diagram of a plurality of notes sounded in sequence. [Figure 18] 13A and 13B are explanatory diagrams of a note name guidance sound and a change guidance sound in a modified example. [Figure 19] 13A and 13B are explanatory diagrams of a note name guidance sound and a change guidance sound in a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] A: First embodiment 1 is a block diagram illustrating an example of the configuration of an information processing system 100 according to the first embodiment. The information processing system 100 is a computer system that assists a user U in understanding the contents of a musical score relating to a specific piece of music.

[0010] The information processing system 100 includes a control device 11, a storage device 12, a display device 13, an operation device 14, and a playback device 15. The information processing system 100 is realized by an information device such as a smartphone, a tablet terminal, or a personal computer. The information processing system 100 may be realized as a single device, or may be realized as a plurality of devices configured separately from each other.

[0011] The control device 11 is composed of one or more processors that control each element of the information processing system 100. For example, the control device 11 is composed of one or more types of processors such as a central processing unit (CPU), a sound processing unit (SPU), a digital signal processor (DSP), a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC).

[0012] The storage device 12 is one or more memories that store the programs executed by the control device 11 and various data used by the control device 11. The storage device 12 is configured with a known recording medium such as a magnetic recording medium or a semiconductor recording medium. The storage device 12 may be configured with a combination of multiple types of recording media. In addition, a portable recording medium that is detachable from the information processing system 100, or a recording medium (e.g., cloud storage) to which the control device 11 can write or read via a communication network may be used as the storage device 12.

[0013] The storage device 12 stores score data X representing the musical score of a piece of music. The score data X specifies the time sequence of notes that make up the piece of music. Specifically, the score data X specifies the pitch and sound duration for each of the multiple notes that make up the piece of music. Chords may be specified in the score data X. A chord is a combination of multiple notes that are sounded in parallel with each other. For example, a file in a format that complies with the MIDI standard (SMF: Standard MIDI File) is used as the score data X. Note that the score data X may be generated from image data representing the musical score.

[0014] The display device 13 displays an image under the control of the control device 11. The display device 13 is configured with a display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel. The display device 13 displays, for example, an image of a musical score represented by musical score data X. The operation device 14 is an input device that accepts instructions from the user U. The operation device 14 is, for example, an operator operated by the user U, or a touch panel that detects contact by the user U. Note that the display device 13 or the operation device 14, which are separate from the information processing system 100, may be connected to the information processing system 100 by wire or wirelessly.

[0015] The playback device 15 plays sounds under the control of the control device 11. An audio signal V is supplied to the playback device 15. The audio signal V is a signal representing waveforms of various sounds such as the performance sounds of a piece of music. The playback device 15 plays back the sounds represented by the audio signal V. The playback device 15 includes a sound emitting device such as a speaker or a headphone. The playback device 15 may also include a D / A converter that converts the audio signal V from digital to analog, and an amplifier that amplifies the audio signal V. The playback device 15, which is separate from the information processing system 100, may be connected to the information processing system 100 by wire or wirelessly.

[0016] 2 is a block diagram illustrating an example of a functional configuration of the information processing system 100. The control device 11 executes a program stored in the storage device 12 to realize a plurality of functions for processing the musical score data X (a musical score data acquisition unit 21, a playback control unit 22a).

[0017] The score data acquisition unit 21 acquires the score data X. Specifically, the score data acquisition unit 21 reads out the score data X from the storage device 12. The score data acquisition unit 21 may generate the score data X in response to an operation by the user U on the operation device 14. The score data acquisition unit 21 may also receive the score data X distributed from a distribution server by a communication device (not shown). As can be understood from the above explanation, "acquiring" the score data X includes various processes such as reading, generating, and receiving the score data X.

[0018] The playback control unit 22a plays back sounds corresponding to the musical score data X by the playback device 15. Specifically, the playback control unit 22a generates an audio signal V according to the musical score data X and supplies the audio signal V to the playback device 15.

[0019] The playback control unit 22a of the first embodiment executes a playback operation and a guidance operation. The playback operation and the guidance operation are selectively executed in response to an instruction from the user U via the operation device 14, for example.

[0020] The playback operation is an operation for playing back the performance sounds of the music piece represented by the musical score data X. Specifically, the playback control unit 22a generates an audio signal V of the performance sounds by sequentially processing the musical score data X. The performance sounds of each note are musical sounds of a pitch specified for that note by the musical score data X, and are continued for the sounding period specified for that note by the musical score data X. For example, musical instrument sounds or singing sounds are played back as the performance sounds.

[0021] The guiding action is an action for supporting the user U in understanding the musical score. The guiding action of the first embodiment is an action for playing back the performance sounds of the music represented by the musical score data X, similar to the playing action, but differs from the playing action in the processing related to the chords of the music.

[0022] 3 is an explanatory diagram regarding the processing of chords in the playback operation and the guidance operation. In the following explanation, a chord C consisting of three notes (hereinafter referred to as "constituent notes") N1 to N3 is assumed. The pitch of constituent note N1 (e.g. C) is lower than the pitch of constituent note N2 (e.g. E), and the pitch of constituent note N2 is lower than the pitch of constituent note N3 (e.g. G).

[0023] In the playback operation, the playback control unit 22a plays back performance sounds corresponding to three constituent tones N1 to N3 in parallel with each other in a sounding period Pc of a chord C specified by the musical score data X. The sounding period P1 of the constituent tone N1, the sounding period P2 of the constituent tone N2, and the sounding period P3 of the constituent tone N3 are common to the sounding period Pc on the time axis. The sounding period Pk (k=1 to 3) is a period during which a performance sound corresponding to the constituent tone Nk is played back.

[0024] As described above, in the playback operation, the playback of the performance sounds corresponding to the three constituent tones N1 to N3 that make up the chord C is started simultaneously. Therefore, it is difficult for the user U to grasp each constituent tone Nk of the chord C by listening to the performance sounds. The guidance operation of the first embodiment is an operation for making it easier to grasp each constituent tone Nk of the chord C.

[0025] In the guidance operation, the playback control unit 22a starts the playback of the performance sounds corresponding to the constituent tones Nk of the chord C at different times in the sound generation period Pc of the chord C. That is, the start point ts1 of the sound generation period P1 of the performance sound corresponding to the constituent tone N1, the start point ts2 of the sound generation period P2 of the performance sound corresponding to the constituent tone N2, and the start point ts3 of the sound generation period P3 of the performance sound corresponding to the constituent tone N3 are different on the time axis. For example, the start point ts2 of the sound generation period P2 is located after the start point ts1 of the sound generation period P1, and the start point ts3 of the sound generation period P3 is located after the start point ts2 of the sound generation period P2.

[0026] In the first embodiment, the end point te1 of the sound generation period P1 coincides with the start point ts2 of the sound generation period P2, and the end point te2 of the sound generation period P2 coincides with the start point ts3 of the sound generation period P3. In other words, the sound generation period P1, the sound generation period P2, and the sound generation period P3 do not overlap with each other on the time axis. Note that any one of the three constituent tones N1 to N3 of the chord C, Nk, is an example of the "first note", and any one of the remaining constituent tones Nk is an example of the "second note".

[0027] As described above, in the guiding operation of the first embodiment, the playback of the performance sounds of the constituent tones Nk of the chord C starts at different times. Therefore, compared to a playback operation in which the playback of the performance sounds of the constituent tones Nk of the chord C starts simultaneously, the user U can easily grasp the notes that constitute the chord C by the sounds. In other words, a unique customer experience can be provided to the user U in which the notes that constitute the chord C of the music piece can be easily grasped by the sounds.

[0028] In the first embodiment, a guiding action is executed to sequentially start the playback of the performance sounds of each of the constituent tones Nk of the chord C at different times, and a playback action is executed to simultaneously start the playback of the performance sounds corresponding to each of the constituent tones Nk of the chord C. Therefore, the user U can auditorily grasp whether the three constituent tones N1 to N3 notified to the user U by the performance sounds are multiple notes that constitute one chord C, or multiple notes that are generated sequentially at different times.

[0029] The playback control unit 22a calculates the time length Lk of each sound generation period Pk by the following formula (1). Note that the symbol K in formula (1) means the number of constituent tones Nk of the chord C (K=3 in the first embodiment). The number of constituent tones Nk is arbitrary.

number

[0030] The duration D applied to the calculation of each duration Lk is set, for example, by any one of the following methods according to aspects 1 to 3.

[0031] [Aspect 1] In the first aspect, the playback control unit 22a sets the duration D in the formula (1) to a duration that has a predetermined relationship with the note value of the chord C. That is, the duration D is set to a duration that corresponds to a specific note value of the music piece. For example, the duration D is set to a duration that corresponds to a sixteenth note of the music piece. Therefore, the duration D depends on the performance tempo of the music piece. Specifically, the faster the performance tempo is, the shorter the duration D is set to.

[0032] As described above, the playback control unit 22a of aspect 1 plays the performance sounds of each note of constituent notes N1 and N2 for a duration D that has a predetermined relationship to the note value of chord C, and plays the performance sound of constituent note N3 for the remaining duration (Lc-2D) of the sound generation period Pc.

[0033] According to the first aspect, the playback of each performance sound can be started at a time that matches the beat (rhythm) of the music. Specifically, the playback of each performance sound is started at a time that is synchronized with a beat point of the music. The time that is synchronized with a beat point is, for example, a time that coincides with a beat point or a time that divides the interval between two adjacent beat points on the time axis equally.

[0034] [Aspect 2] In the second aspect, the playback control unit 22a sets the time length D in the formula (1) to a predetermined time length that is unrelated to the performance tempo of the music piece. The time length D is set to, for example, 250 milliseconds.

[0035] As described above, the playback control unit 22a of aspect 2 plays the performance sounds of each note, constituent notes N1 and N2, for a predetermined time length D, and plays the performance sound of constituent note N3 for the remaining time length (Lc-2D) of the sound generation period Pc.

[0036] According to the second aspect, the constituent tones N1 and N2 of the chord C are played back for a predetermined duration D that is independent of the performance tempo of the music piece. Therefore, even if the performance tempo is fast, the playback time of each performance tone can be appropriately secured.

[0037] [Aspect 3] In the third aspect, the playback control unit 22a sets the duration D in the formula (1) to a duration that has a predetermined relationship with the note value of the chord C and is closest to the predetermined duration. For example, the 250 milliseconds exemplified in the second aspect is assumed to be a reference value. When the performance tempo of the music piece is 60 BPM (Beats Per Minute), the duration D is set to a duration equivalent to a sixteenth note of the music piece (i.e., 250 milliseconds). When the performance tempo of the music piece is 120 BPM, the duration D is set to a duration equivalent to an eighth note of the music piece (i.e., 250 milliseconds).

[0038] When the performance tempo of a piece of music is 68 BPM, the time length corresponding to an eighth note in the piece of music is 441 milliseconds, and the time length corresponding to a sixteenth note in the piece of music is 221 milliseconds. Therefore, the time length D is set to the time length corresponding to a sixteenth note that is close to the reference value (250 milliseconds).

[0039] As described above, the playback control unit 22a of the third aspect plays back the performance sounds of the notes N1 and N2 for the duration D that has a predetermined relationship with the note value of the chord C and is closest to the predetermined value, and plays back the performance sound of the note N3 for the remaining duration (Lc-2D) of the sound generation period Pc. Therefore, the playback of each performance sound can be started at a point in time that matches the beat (rhythm) of the music piece while appropriately securing the playback time of each performance sound. In other words, the third aspect can enjoy the advantages of both the first and second aspects.

[0040] 4 is a flowchart of the guiding operation described above. For example, the guiding operation is started in response to an instruction from the user U via the operation device 14. When the guiding operation is started, the control device 11 (musical score data acquisition unit 21) acquires the musical score data X stored in the storage device 12 (Sa1).

[0041] The control device 11 (playback control section 22a) executes a conversion process on the musical score data X to generate converted data Y (Sa2). The conversion process is a process for changing the sounding period Pk of each constituent note Nk of a chord C specified by the musical score data X. That is, the control device 11 changes the time length Lk and the position on the time axis of each sounding period Pk so that the start points tsk (ts1 to ts3) of the sounding periods Pk of each constituent note Nk are different points on the time axis. The conditions for each sounding period Pk are as described above. Note that the sounding periods of each note other than the chord C are not changed.

[0042] The control device 11 (playback control unit 22a) generates an audio signal V by sequentially processing the converted data Y generated by the conversion process (Sa3). The control device 11 (playback control unit 22a) supplies the audio signal V to the playback device 15 to play back the musical piece (Sa4). The specific procedure of the guidance operation is as described above.

[0043] B: Second embodiment A second embodiment will be described. Note that, for elements having the same functions as those in the first embodiment in each of the following exemplary aspects, the same reference numerals as those in the first embodiment will be used, and detailed descriptions of each will be omitted as appropriate.

[0044] In the guidance operation of the first embodiment, the performance sounds of each note specified by the musical score data X are played. In the guidance operation of the second embodiment, instead of the performance sounds of each note, a voice representing the note name of each note (hereinafter referred to as a "reading voice") is played. The reading voice is a voice uttered by a virtual speaker by reading the note name of the note. For example, a one-syllable voice reading out the note name such as "do", "re", "mi" ... is exemplified as the reading voice. Note that the operations other than the guidance operation are the same as those of the first embodiment.

[0045] Fig. 5 is an explanatory diagram regarding the processing of chord C in the guidance operation of the second embodiment. In Fig. 5, similarly to the first embodiment, a chord C (DoMiSo) including a constituent note N1 of the note name "Do", a constituent note N2 of the note name "Mi", and a constituent note N3 of the note name "So" is illustrated.

[0046] In the guidance operation, the playback control unit 22a starts the playback of the reading voices corresponding to each of the constituent tones Nk of the chord C at different times in the pronunciation period Pc of the chord C. That is, the start point ts1 of the pronunciation period P1 of the reading voice corresponding to the constituent tone N1, the start point ts2 of the pronunciation period P2 of the reading voice corresponding to the constituent tone N2, and the start point ts3 of the pronunciation period P3 of the reading voice corresponding to the constituent tone N3 are different on the time axis. Specifically, the playback of the reading voice representing the note name "Do" of the constituent tone N1, the playback of the reading voice representing the note name "Mi" of the constituent tone N2, and the playback of the reading voice representing the note name "So" of the constituent tone N3 are started sequentially at different times. That is, the playback device 15 plays back the reading voices that pronounce "Do", "Mi", and "So" in order for one chord C.

[0047] The relationship between the sound generation periods Pk corresponding to each constituent tone Nk is the same as in the first embodiment. That is, the time length Lk of each sound generation period Pk is set using the formula (1) exemplified in the first embodiment and any one of the aspects 1 to 3. As in the first embodiment, any one of the three constituent tones N1 to N3 of the chord C is an example of the "first note", and any one of the remaining constituent tones Nk is an example of the "second note".

[0048] 6 is a flowchart of the guiding operation in the second embodiment. When the guiding operation is started, the control device 11 (musical score data acquisition unit 21) acquires the musical score data X stored in the storage device 12 (Sb1), similarly to the first embodiment.

[0049] The control device 11 (the reproduction control section 22a) generates converted data Y (Sb2) by executing a conversion process on the musical score data X. The conversion process of the second embodiment includes a character setting process Sb21 and a period adjustment process Sb22.

[0050] The character setting process Sb21 is a process for setting a character representing the note name of each note specified by the musical score data X. For example, the character "C" is set for the note with the note name "C". For the chord C, a character of the note name is set for each constituent note Nk.

[0051] The period adjustment process Sb22 is a process for changing the sound generation period Pk of each constituent tone Nk of the chord C. That is, similar to the first embodiment, the control device 11 changes the time length Lk and the position on the time axis of each sound generation period Pk so that the start points tsk (ts1 to ts3) of the sound generation period Pk of each constituent tone Nk are different points on the time axis. The sound generation periods of each note other than the chord C are not changed. The order of the character setting process Sb21 and the period adjustment process Sb22 may be reversed.

[0052] The control device 11 (playback control unit 22a) generates an audio signal V by executing a voice synthesis process on the converted data Y generated by the conversion process (Sb3). The voice synthesis process is a process for generating an audio signal V that represents a waveform of a voice corresponding to the converted data Y. Specifically, the voice represented by the audio signal V is a read-out voice in which the characters (note names) set for each note in the converted data Y are pronounced at the pitch of the note over the pronunciation period of the note. Examples of the voice synthesis process include a segment connection type voice synthesis process that connects multiple voice segments, or a statistical model type voice synthesis process that uses a statistical model such as a deep neural network or an HMM (Hidden Markov Model).

[0053] As in the first embodiment, the control device 11 (playback control unit 22a) supplies the audio signal V to the playback device 15 to play back the reading voice of each note of the music piece (Sb4). The specific procedure of the guidance operation is as described above.

[0054] The second embodiment also achieves the same effect as the first embodiment. In particular, in the second embodiment, the playback of the voice readings representing the pitch names of the constituent tones Nk of the chord C starts at different times. Therefore, compared to a playback operation in which the playback of the performance sounds of the constituent tones Nk of the chord C starts simultaneously, the user U can easily grasp the pitch names of the constituent tones Nk that make up the chord C by the sounds.

[0055] The performance sounds of each constituent tone Nk in the first embodiment and the reading voices of each constituent tone Nk in the second embodiment are collectively expressed as "guidance sounds" that guide the user U to the constituent tones Nk of the chord C.

[0056] C: Third embodiment In the first embodiment, the duration Lk of the sound generation period Pk of each constituent tone Nk is set by the above-mentioned formula (1). In the second embodiment, the method of setting the duration Lk of each sound generation period Pk is different from that in the first embodiment.

[0057] Fig. 7 is a flowchart of the process executed in the conversion process (Sa2) of the third embodiment. The process of Fig. 7 is executed for each chord C specified by the musical score data X. When the process starts, the control device 11 (playback control section 22a) judges whether or not the duration Lc of the tone generation period Pc of the chord C is below a predetermined value Lref (Sc1). The predetermined value Lref is set to a predetermined positive number.

[0058] When the duration Lc exceeds the predetermined value Lref (Sc1: NO), the control device 11 (playback control section 22a) sets the duration Lk of each sound generation period Pc in the same manner as in the first embodiment (Sc2). That is, each duration Lk is set by formula (1) and any one of aspects 1 to 3.

[0059] When the duration Lc is less than the predetermined value Lref (Sc1: YES), the control device 11 (playback control section 22a) sets K sound generation periods P1 to PK by equally dividing the sound generation period Pc of the chord C for each constituent tone Nk (Sc3), as illustrated in Fig. 8. That is, the duration Lk of each sound generation period Pk is set to a common numerical value (Lk = Lc / K) obtained by dividing the duration Lc of the sound generation period Pc by the number K of the constituent tones Nk.

[0060] In the conversion process, the sound generation period Pk specified by the musical score data X for the constituent notes Nk of the chord C is set to the duration Lk determined by the above process. The generation of the audio signal V using the conversion data Y is the same as in the first embodiment. As described above, when the duration Lc of the sound generation period Pc of the chord C falls below a predetermined value Lref, the control device 11 (playback control unit 22a) of the third embodiment reproduces the performance sound of the constituent note Nk corresponding to the sound generation period Pk in each of the multiple sound generation periods Pk obtained by equally dividing the sound generation period Pc for each of the constituent notes Nk of the chord C.

[0061] The third embodiment also achieves the same effect as the first embodiment. In the third embodiment, when the sounding period Pc of the chord C is short, the sounding period Pc is divided equally for each of the constituent notes Nk, and the performance sound of the constituent note Nk is reproduced in each sounding period Pk. Therefore, the reproduction time of each performance sound can be appropriately secured within the sounding period Pc of the chord C.

[0062] In the above explanation, the third embodiment has been described based on the configuration of the first embodiment, but the configuration of the third embodiment in which the sound generation period Pc is divided equally for each constituent tone Nk is also applicable to the second embodiment. In addition, in the third embodiment, the sound generation period Pc is divided into K equal parts when the time length Lc of the sound generation period Pc falls below a predetermined value Lref, but K sound generation periods P1 to PK may be set by equally dividing the sound generation period Pc for each constituent tone Nk regardless of the time length Lc of the sound generation period Pc. In other words, the setting of the time length Lk according to the formula (1) may be omitted.

[0063] D: Fourth embodiment 9 is a block diagram illustrating a functional configuration of an information processing system 100 in the fourth embodiment. The control device 11 in the fourth embodiment functions as a musical score data acquisition unit 21 and a playback control unit 22b by executing a program stored in the storage device 12. The configuration of the information processing system 100 in the fourth embodiment is the same as that in the first embodiment.

[0064] The musical score data acquisition unit 21 acquires the musical score data X in the same manner as in the first embodiment. The multiple notes specified by the musical score data X include fundamental notes and derived notes. The fundamental notes are musical notes that are the basis of the musical scale, and specifically refer to musical notes (Do, Re, Mi, Fa, So, La, and Si) to which no alteration symbols such as sharp (♯), flat (♭), or natural (?) are added. The derived notes are musical notes other than the fundamental notes in the musical scale, and specifically refer to musical notes to which alteration symbols are added (Do#, Re#, Mi#, Fa#, So#, La#, and Si#). The alteration symbols include a key signature that is applied collectively to a specific section of a piece of music, and accidentals that are applied to each note.

[0065] The playback control unit 22b executes a playback operation and a guidance operation in the same manner as the playback control unit 22a in the first embodiment. The playback operation is an operation of playing the performance sound of the music piece represented by the musical score data X in the same manner as the first embodiment. On the other hand, the guidance operation is an operation of playing a reading voice representing the note name of each note in the same manner as the second embodiment. The playback operation and the guidance operation are selectively executed in response to an instruction from the user U to the operation device 14, for example, in the same manner as the first embodiment.

[0066] Fig. 10 is an explanatory diagram of the read-aloud regarding derived notes among the multiple notes represented by the musical score data X. Fig. 10 illustrates the note N of "G#".

[0067] The derived sound reading voice R includes a note name guidance voice Ra and a change guidance voice Rb. The note name guidance voice Ra is a one-syllable voice representing the note name of the root sound that constitutes the derived sound. In other words, the note name guidance voice Ra is a voice pronounced by a virtual speaker by reading the note name of the root sound. The change guidance voice Rb is a voice representing the name of the change symbol. In other words, the change guidance voice Rb is a voice pronounced by a virtual speaker by reading the name of the change symbol.

[0068] The change guide sound Rb in the fourth embodiment is a voice that reads out the full name of the change symbol, abbreviated or simplified to one syllable. Specifically, the change guide sound Rb for sharp (♯) is "sha", the change guide sound Rb for flat (♭) is "fu", and the change guide sound Rb for natural (?) is "na". In addition, the change guide sound Rb for double sharp is "ja", and the change guide sound Rb for double flat is "bu". As described above, each of the note name guide sound Ra and the change guide sound Rb is composed of a voice of one syllable, so the reading voice R of one derived sound is composed of two syllables.

[0069] As shown in Fig. 10, the playback control unit 22b generates an audio signal V so that the note name guidance sound Ra and the change guidance sound Rb are played in sequence. In the third embodiment, the note name guidance sound Ra is played following the change guidance sound Rb. For example, for the derived sound (So#) shown in Fig. 10, a reading voice R of "Sha-So" is played, in which the change guidance sound Rb of the change symbol "#" is followed by the note name guidance sound Ra of the fundamental sound "So".

[0070] Specifically, the playback control unit 22b starts playing the change guidance sound Rb at time tb on the time axis, and starts playing the note name guidance sound Ra at time ta after time tb. Therefore, the change guidance sound Rb is played during the period from time tb to time ta. The interval between time tb and time ta is set to a time length (e.g., 250 milliseconds) that allows the user U to hear the change guidance sound Rb. On the other hand, the note name guidance sound Ra is played during the period from time ta to the end point te of the pronunciation period P of the note N. The playback period of the note name guidance sound Ra is longer than the playback period of the change guidance sound Rb.

[0071] 10, the time tb at which the playback of the change guidance sound Rb for one note N starts precedes the start point ts of the sounding period P of the note N. The time ta at which the playback of the note name guidance sound Ra starts coincides with the start point ts of the sounding period P of the note N. In other words, the note name guidance sound Ra is played from the start point ts to the end point te of the sounding period P of the note N.

[0072] 11 is a flowchart of the guiding operation in the fourth embodiment. When the guiding operation is started, the control device 11 (musical score data acquisition unit 21) acquires the musical score data X stored in the storage device 12, similarly to the first embodiment (Sd1).

[0073] The control device 11 (playback control unit 22b) executes a conversion process on the musical score data X to generate converted data Y (Sd2). The conversion process in the second embodiment is a process (character setting process) for setting characters representing the note names of each note specified by the musical score data X. Specifically, the control device 11 sets characters for the names of accidentals and characters for the note names of fundamental notes for derived notes.

[0074] The control device 11 (playback control unit 22b) generates an audio signal V by executing a voice synthesis process on the conversion data Y generated by the conversion process (Sd3). For derived sounds, the audio signal V is generated so that the note name guidance sound Ra and the change guidance sound Rb are played back in sequence. Note that a specific example of the voice synthesis process is the same as in the second embodiment. The control device 11 (playback control unit 22a) supplies the audio signal V to the playback device 15 to play back the reading voice of each note (Sd4). The specific steps of the guidance operation are as described above.

[0075] As described above, in the fourth embodiment, for derived notes, the note name guide sound Ra, which indicates the note name of the fundamental note, and the alteration guide sound Rb, which indicates the name of the alteration symbol, are played in sequence. Therefore, even a user U who has difficulty reading musical scores can easily understand the derived notes contained in the musical score by the sound. In other words, a unique customer experience in which the derived notes contained in the musical score can be easily understood by the sound can be provided to the user U. Note that a user U who has difficulty reading musical scores is, for example, a beginner who lacks the knowledge to understand the contents of the musical score, a visually impaired person who has difficulty viewing the musical score, or a user who is in a situation where he or she cannot view the musical score (for example, while performing another task).

[0076] In the fourth embodiment, the note name guide sound Ra is played after the change guide sound Rb. Therefore, it is easier to ensure a sufficient playback period for the note name guide sound Ra than for the change guide sound Rb. In other words, compared to a form in which the change guide sound Rb is played after the note name guide sound Ra, there is an advantage in that the user U can easily hear the note name guide sound Ra.

[0077] 10, in the fourth embodiment, the playback of the change guidance sound Rb is started at time tb preceding the start point ts of the note, and the playback of the note name guidance sound Ra is started at time ta coinciding with the start point ts of the note. Therefore, compared to a form in which the playback of the change guidance sound Rb is started at the start point ts of the note (i.e., a form in which the playback of the note name guidance sound Ra is started at a time delayed from the start point ts of the note), the note name guidance sound can be played at a time that is auditorily natural with respect to the progression of the music piece.

[0078] E: Fifth embodiment 12 is a block diagram illustrating a functional configuration of an information processing system 100 in the fifth embodiment. The control device 11 in the fifth embodiment functions as a musical score data acquisition unit 21 and a playback control unit 22c by executing a program stored in the storage device 12. The configuration of the information processing system 100 in the fifth embodiment is the same as that in the first embodiment.

[0079] The musical score data acquisition unit 21 acquires musical score data X in the same manner as in the first embodiment. The musical piece represented by the musical score data X in the fifth embodiment is composed of a plurality of voice parts. Each voice part is a set of a series of notes having musical meaning. A voice part can also be said to be a performance part of a musical piece.

[0080] In the following explanation, we will assume that a piece of music is played on a keyboard instrument, and that the piece of music contains a part that the performer should play with the right hand (hereafter referred to as the "right-hand part") and a part that the performer should play with the left hand (hereafter referred to as the "left-hand part"). The right-hand part is an example of the "first part," and the left-hand part is an example of the "second part."

[0081] The musical score data X of the fifth embodiment specifies dynamic symbols for each of a plurality of voices. The dynamic symbols for each voice are performance symbols that specify the dynamics (volume) of the performance of the voice. For example, dynamic symbols such as forte (loud) or piano (soft) are specified for each voice.

[0082] The score data X also specifies the names of the multiple voice parts. Specifically, in the score data X, a character string named "right hand voice part" is specified for the right hand voice part, and a character string named "left hand voice part" is specified for the left hand voice part.

[0083] 12, the reproduction device 15 of the fifth embodiment includes a plurality of sound emitting devices 151. The plurality of sound emitting devices 151 are installed at different positions with respect to the user U. For example, the reproduction device 15 is exemplified by a surround system configured with a plurality of sound emitting devices 151 installed around the user U, or a stereophonic system configured with two sound emitting devices 151 worn on both ears of the user U.

[0084] The playback control unit 22c plays back musical sounds corresponding to the musical score data X by the playback device 15. Specifically, the playback control unit 22c plays back musical sounds for the user U by supplying an audio signal V to each sound emitting device 151 of the playback device 15. The playback control unit 22c of the fifth embodiment controls the position of a sound image by a sound image localization process that adjusts the acoustic characteristics (e.g., volume and phase) of each audio signal V. The sound image is a virtual sound source that the user U can perceive by listening to sounds reproduced by the multiple sound emitting devices 151.

[0085] The playback control unit 22c executes a playback operation and a preparation operation. The playback operation is an operation for playing back the performance sound of the music piece represented by the musical score data X, as in the first embodiment. The playback control unit 22c of the fifth embodiment generates an acoustic signal V to be supplied to each sound emitting device 151 so that sound images corresponding to each of the multiple voice parts of the music piece are localized at different positions during the playback operation. Specifically, the playback control unit 22c localizes a sound image corresponding to the performance sound of the right hand voice part of the music piece to the right front of the user U, and localizes a sound image corresponding to the performance sound of the left hand voice part to the left front of the user U during the playback operation.

[0086] The preparatory operation is executed before the start of the playback operation. The preparatory operation is an operation for informing the user U of the position of the sound image of each voice part of the music during the playback operation. FIG. 13 is an explanatory diagram of the preparatory operation. During the preparatory operation, the playback control unit 22c plays a guidance sound GR corresponding to the right-hand voice part of the music and a guidance sound GL corresponding to the left-hand voice part by the playback device 15. Note that the guidance sound GR is an example of a "first guidance sound" and the guidance sound GL is an example of a "second guidance sound".

[0087] The guidance sound GR is a voice that represents the name of the right-hand voice part. Specifically, a voice that reads out the name "right-hand voice part" specified by the musical score data X is played as the guidance sound GR. Similarly, the guidance sound GL is a voice that represents the name of the left-hand voice part. Specifically, a voice that reads out the name "left-hand voice part" specified by the musical score data X is played as the guidance sound GL.

[0088] The playback control unit 22c executes sound image localization processing so that the guidance sound GR and the guidance sound GL are localized at different positions. Specifically, as illustrated in Fig. 13, the playback control unit 22c executes sound image localization processing so that the sound image QR of the guidance sound GR corresponding to the right hand voice part is localized to the right front of the user U, and the sound image QL of the guidance sound GL corresponding to the left hand voice part is localized to the left front of the user U. Note that the sound image QR is an example of a "first sound image" and the sound image QL is an example of a "second sound image."

[0089] As explained above, the sound image QR corresponding to the guidance sound GR of the right-hand voice part during the preparatory operation is localized at the same position as the sound image of the performance sound of the right-hand voice part during the playback operation. Therefore, by listening to the guidance sound GR during the preparatory operation, the user U can confirm the position where the sound image of the performance sound of the right-hand voice part is localized during the playback operation. Similarly, the sound image QL corresponding to the guidance sound GL of the left-hand voice part during the preparatory operation is localized at the same position as the sound image of the performance sound of the left-hand voice part during the playback operation. Therefore, by listening to the guidance sound GL during the preparatory operation, the user U can confirm the position where the sound image of the performance sound of the left-hand voice part is localized during the playback operation.

[0090] The playback control unit 22c sequentially plays back the guidance sound GR and the guidance sound GL by the playback device 15. Specifically, the playback control unit 22c plays back the guidance sound GL after playing back the guidance sound GR. That is, after the guidance sound GR called "right hand voice part" is played back by the sound image QR to the right front of the user U, the guidance sound GL called "left hand voice part" is played back by the sound image QL to the left front of the user U. Note that the order of playing back the guidance sound GR and the guidance sound GL may be reversed.

[0091] Fig. 14 is a flowchart of the process executed by the control device 11 of the fifth embodiment. For example, the process of Fig. 14 is started in response to an instruction from the user U to the operation device 14. The control device 11 first executes preparatory operations (Se1 to Se5). When the preparatory operations are started, the control device 11 (musical score data acquisition unit 21) acquires musical score data X stored in the storage device 12 (Se1).

[0092] The control device 11 (the playback control unit 22c) generates an audio signal V representing the guidance sound GR and the guidance sound GL (Se2). Specifically, the playback control unit 22c generates the audio signal V by executing a voice synthesis process on the character strings of the names of the "right hand voice part" and the "left hand voice part" specified by the musical score data X.

[0093] In the voice synthesis process, the playback control unit 22c specifies the pitch of a note included in the right hand voice part of the music as the pitch of the guidance sound GR. For example, the pitch of the first note among the multiple notes that make up the right hand voice part is specified. Similarly, the playback control unit 22c specifies the pitch of a note included in the left hand voice part of the music as the pitch of the guidance sound GL. For example, the pitch of the first note among the multiple notes that make up the left hand voice part is specified.

[0094] The audio signal V representing the guidance sound GR and the guidance sound GL may be stored in the storage device 12. In a configuration in which the audio signal V is stored in the storage device 12, the voice synthesis process is omitted. The control device 11 (playback control unit 22c) reads out the audio signal V from the storage device 12 and adjusts the pitch of the audio signal V.

[0095] The control device 11 (playback control unit 22c) executes a volume adjustment process for the audio signal V (Se3). The volume adjustment process is a process for adjusting the volume of the audio signal V. Specifically, the control device 11 adjusts the volume of the guidance sound GR in the audio signal V to a volume corresponding to the dynamic markings specified for the right-hand part by the musical score data X. Similarly, the control device 11 adjusts the volume of the guidance sound GL in the audio signal V to a volume corresponding to the dynamic markings specified for the left-hand part by the musical score data X.

[0096] The control device 11 (the reproduction control unit 22c) executes a sound image localization process on the sound signal V so that the sound images of the guidance sound GR and the guidance sound GL are localized at different positions (Se4). Note that the order of the volume adjustment process and the sound image localization process may be reversed.

[0097] The control device 11 (playback control unit 22c) supplies the audio signal V generated by the above process to the playback device 15 to play back the guidance sound GR and the guidance sound GL (Se5). As can be understood from the above explanation, the guidance sound GR is played back at a volume corresponding to the dynamics markings of the right-hand part, depending on the pitch of the notes contained in the right-hand part. On the other hand, the guidance sound GL is played back at a volume corresponding to the dynamics markings of the left-hand part, depending on the pitch of the notes contained in the left-hand part.

[0098] The specific procedure of the preparatory operation is as described above. When the reproduction of the guidance sound GR and the guidance sound GL by the preparatory operation is completed, the control device 11 (the reproduction control section 22c) executes the reproduction operation (Se6 to Se7).

[0099] When the playback operation is started, the control device 11 (playback control unit 22c) generates an audio signal V by sequentially processing the musical score data X (Se6). In generating the audio signal V, the control device 11 executes a sound image localization process. Specifically, the control device 11 executes the sound image localization process so that the sound image of the performance sound of the right-hand voice part is localized to the right front of the user U, and the sound image of the performance sound of the left-hand voice part is localized to the left front of the user U. The control device 11 (playback control unit 22c) supplies the audio signal V to the playback device 15 to play back the performance sound of the music piece (Se7).

[0100] As described above, in the fifth embodiment, the sound image QR of the guidance sound GR corresponding to the right-hand voice part and the sound image QL of the guidance sound GL corresponding to the left-hand voice part are localized at different positions. Therefore, the user U can audibly confirm the position of the sound image corresponding to the performance sound of the right-hand voice part and the position of the sound image corresponding to the performance sound of the left-hand voice part before the start of the reproduction operation. In other words, a unique customer experience can be provided to the user U in which the position of the sound image corresponding to the performance sound of each voice part of the music piece can be audibly confirmed. In particular, in the fifth embodiment, the guidance sound GR representing the name of the right-hand voice part and the guidance sound GL representing the name of the left-hand voice part are reproduced. Therefore, the user U can easily distinguish between the name of the right-hand voice part and the name of the left-hand voice part.

[0101] In the fifth embodiment, the guidance sound GR is reproduced by the pitch of the notes included in the right hand voice part, and the guidance sound GL is reproduced by the pitch of the notes included in the left hand voice part. Therefore, by listening to the guidance sound GR and the guidance sound GL, the user U can easily grasp the range of the right hand voice part and the range of the left hand voice part by hearing them.

[0102] In the fifth embodiment, the guidance sound GR is played at a volume corresponding to the dynamics of the right hand part, and the guidance sound GL is played at a volume corresponding to the dynamics of the left hand part. Therefore, by listening to the guidance sounds GR and GL, the user U can easily grasp the dynamics of the right hand part and the left hand part.

[0103] In the above description, two voice parts, a right hand voice part and a left hand voice part, are exemplified, but a piece of music may include three or more voice parts. For example, a piece of music may include a right hand high range voice part (hereinafter referred to as a "right hand high voice part"), a right hand low range voice part (hereinafter referred to as a "right hand low voice part"), and a left hand voice part. In a performance motion, the sound image of the performance sound of the right hand high voice part is localized to the right front of the user U, the sound image of the performance sound of the right hand low voice part is localized in front of the user U, and the sound image of the performance sound of the left hand voice part is localized to the left front of the user U.

[0104] In the preparatory operation, as illustrated in Fig. 15, guidance sound GR1 corresponding to the high right hand voice part, guidance sound GR2 corresponding to the low right hand voice part, and guidance sound GL corresponding to the left hand voice part are played back in sequence. Guidance sound GR1 is, for example, a voice saying "high range of right hand," and guidance sound GR2 is, for example, a voice saying "low range of right hand." The sound image QR1 of guidance sound GR1 is localized to the right front of the user U, the sound image QR2 of guidance sound GR2 is localized in front of the user U, and the sound image QL of guidance sound GL is localized to the left front of the user U. As illustrated above, the position where the sound image of each voice part is localized corresponds to the high and low range of each voice part.

[0105] Also, assume that there are multiple performance parts that make up an orchestra or other musical group. The playback control unit 22c localizes the sound images of the voice parts corresponding to each performance part at positions corresponding to the arrangement of each performance part in the orchestra. For example, the sound images of each performance part are localized in the order of the first violin, second violin, viola, etc. from left to right with respect to the user U.

[0106] F: Variation Specific modified embodiments added to each of the above-mentioned embodiments are exemplified below. Two or more embodiments selected from the following examples may be appropriately combined as long as they are not mutually contradictory.

[0107] (1) In the first to fourth embodiments, the reproducing operation and the guiding operation are selectively executed, but the time relationship between the reproducing operation and the guiding operation is not limited to the above examples. For example, the reproducing operation and the guiding operation may be executed in parallel. Specifically, the control device 11 (the reproducing control unit 22a, the reproducing control unit 22b) may generate the sound signal V by mixing a first signal of a performance sound generated by the reproducing operation and a second signal of a guidance sound (a performance sound or a reading voice) generated by the guiding operation. In addition, the control device 11 may alternately switch between reproducing the first signal and reproducing the second signal in response to an instruction from the user U to the operation device 14, for example. The control device 11 may localize the sound image of the first signal and the sound image of the second signal at different positions.

[0108] As illustrated above, according to the form in which the playback operation and the guidance operation are executed, as described in the first embodiment, the user U can audibly grasp whether the three constituent notes N1 to N3 are multiple notes that make up one chord C, or multiple notes that are sounded sequentially at different times.

[0109] (2) In the first and second embodiments, the sounding periods Pk of the guide sounds (play sounds or read-out voices) corresponding to the constituent tones Nk of the chord C do not overlap each other, but the sounding periods Pk of the constituent tones Nk may overlap each other on the time axis. For example, as shown in FIG. 16, the sounding period Pk of each constituent tone Nk may continue until the end of the sounding period Pc of the chord C.

[0110] For multiple notes that are sounded in sequence, the sounding periods Pk of the performance tones of each note do not overlap with each other on the time axis, as illustrated in Fig. 17. Therefore, the user U can audibly distinguish whether the multiple musical tones that are sounded in sequence are multiple constituent tones Nk of a chord C or multiple notes that are sounded in sequence, depending on whether the sounding periods P overlap.

[0111] (3) Prior to playing the guidance sounds corresponding to each constituent note Nk of chord C, a sound (hereinafter referred to as an "alert sound") may be played to inform user U that the guidance sound is chord C. The alert sound is, for example, a voice that reads out a character string such as "chord" or "chord." Immediately after playing the alert sound exemplified above, a guidance sound such as "Do Mi So" is played. Even with the above configuration, user U can audibly distinguish whether the musical tones played by playback device 15 are multiple notes that make up one chord C or multiple notes that are sounded sequentially at different times.

[0112] (4) In the third embodiment, the pitch guide sound Ra corresponding to the root sound of the derived sound follows the alteration guide sound Rb of the alteration sign, but the order of the pitch guide sound Ra and the alteration guide sound Rb may be reversed. That is, as shown in FIG. 18, the alteration guide sound Rb may follow the pitch guide sound Ra. That is, the reading voice R of "Sosha" may be played.

[0113] (5) In the third embodiment, the embodiment in which the playback of the note name guide sound Ra is started at the start point ts of the pronunciation period P of the derived sound is exemplified, but the time when the playback of the reading voice R is started is not limited to the above example. For example, as shown as Example 1 in Fig. 19, in the embodiment in which the note name guide sound Ra follows the change guide sound Rb (second embodiment), the playback of the change guide sound Rb may be started at the start point ts of the pronunciation period P. Also, in the embodiment in which the change guide sound Rb follows the note name guide sound Ra, the playback of the note name guide sound Ra may be started at the start point ts of the pronunciation period P as in Example 2 in Fig. 19, or the playback of the change guide sound Rb may be started at the start point ts of the pronunciation period P as in Example 3 in Fig. 19.

[0114] (6) In the above-mentioned embodiments, the guidance sounds corresponding to the constituent tones Nk of the chord C are reproduced in the order from the low pitch to the high pitch of the constituent tones Nk, but the order of reproduction of the guidance sounds is not limited to the above examples. For example, the guidance sounds may be reproduced in the order from the high pitch to the low pitch of the constituent tones Nk.

[0115] (7) As described above, the functions of the information processing system 100 exemplified above are realized by the cooperation of one or more processors constituting the control device 11 and the program stored in the storage device 12. The program according to the present disclosure can be provided in a form stored in a computer-readable recording medium and installed in a computer. The recording medium is, for example, a non-transitory recording medium, and a good example is an optical recording medium (optical disk) such as a CD-ROM, but also includes any known type of recording medium such as a semiconductor recording medium or a magnetic recording medium. Note that the non-transitory recording medium includes any recording medium except for a transient propagating signal, and does not exclude volatile recording media. In addition, in a configuration in which a distribution device distributes a program via a communication network, the storage medium that stores the program in the distribution device corresponds to the non-transitory recording medium described above.

[0116] E: Notes From the above-described exemplary embodiments, the following configurations can be understood, for example.

[0117] E-1: Appendix A As a technology for making it easier for users to understand musical scores, for example, a configuration in which the name of each element in a musical score is read out by a computer is assumed. However, for chords consisting of multiple notes, the names of each note are read out in parallel, making it difficult for users to understand each note by hearing. In consideration of the above circumstances, one aspect of the present disclosure (Appendix A) aims to enable users to easily understand the notes that make up a chord by sound.

[0118] A playback control method according to one aspect (Appendix A1) of the present disclosure is a playback control method realized by a computer system that acquires musical score data representing a musical score and plays sounds corresponding to the musical score data, and in controlling the playback, for a chord composed of a plurality of notes including a first note and a second note in the musical score represented by the musical score data, starts playback of a first guidance sound corresponding to the first note and playback of a second guidance sound corresponding to the second note at different times.

[0119] In the above embodiment, for a chord including a first note and a second note, the first guide sound corresponding to the first note and the second guide sound corresponding to the second note are played at different times. Therefore, compared to an embodiment in which the playback of the first guide sound and the playback of the second guide sound start simultaneously, the user can easily grasp the notes that make up the chord by sound.

[0120] The first note and the second note are two notes among a plurality of notes that make up a chord. As long as the reproduction of the first guide sound corresponding to the first note and the reproduction of the second guide sound corresponding to the second note are started at different times, the reproduction of the guide sounds corresponding to the other notes can be started at any time. In other words, the reproduction of the guide sounds for all notes that make up the chord may be started at different times, or the reproduction of the guide sounds for the notes other than the first note and the second note among the plurality of notes may be started simultaneously with the reproduction of the guide sounds for the other notes.

[0121] In a specific example (Appendix A2) of Appendix A1, the first guide sound is the performance sound of the first note, and the second guide sound is the performance sound of the second note. In the above embodiment, the playback of the performance sounds of the notes that make up the chord starts at different times, so that the user can easily understand the notes that make up the chord by the sounds. The performance sounds are, for example, musical sounds such as musical instrument sounds or singing sounds.

[0122] In a specific example (Appendix A3) of Appendix A1, the first guidance sound is a voice reading that represents the pitch name of the first note, and the second guidance sound is a voice reading that represents the pitch name of the second note. In the above embodiment, the playback of the voice reading that represents the pitch name of each note that constitutes a chord is started at different times, so that the user can easily grasp the pitch names of the notes that constitute the chord by the sounds.

[0123] In any of the specific examples (Appendix A4) of Appendix A1 to Appendix A3, in the control of the playback, the guide sound for each note other than the last note among the plurality of notes is played for a time length that has a predetermined relationship to the note value of the chord within the pronunciation period of the chord, and the guide sound for the last note is played for the remaining time length of the pronunciation period of the chord. In the above aspects, the guide sound is played for a time length that has a predetermined relationship to the note value of the chord for each note other than the last note among the plurality of notes that make up the chord. Therefore, the playback of each guide sound can be started at a time that matches the meter (rhythm) of the music piece.

[0124] In any of the specific examples (Appendix A5) of Appendix A1 to Appendix A3, in the control of the playback, the guide sound of each note other than the last note among the plurality of notes is played for a predetermined time length, and the performance sound of the last note is played for the remaining time length of the sounding period of the chord. In the above aspect, the guide sound is played for each note other than the last note among the plurality of notes constituting the chord for a predetermined time length that is independent of the performance tempo. Therefore, the playback time of each guide sound can be appropriately secured.

[0125] In any of the specific examples (Appendix A6) of Appendix A1 to Appendix A3, in the control of the playback, the performance sound of each note other than the last note among the multiple notes is played for a time length that has a predetermined relationship to the note value of the chord within the sounding period of the chord and is closest to a predetermined value, and the playback sound of the last note is played for the remaining time length of the sounding period of the chord. In the above aspects, for each note other than the last note among the multiple notes constituting the chord, a guidance sound is played for a time length that has a predetermined relationship to the note value of the chord and is closest to a predetermined value. Therefore, the playback of each guidance sound can be started at a time that matches the meter (rhythm) of the music while appropriately ensuring the playback time of each guidance sound.

[0126] In any of the specific examples (Appendix A7) of Appendix A1 to Appendix A6, in the control of the reproduction, when the time length of the sounding period of the chord falls below a predetermined value, in each of a plurality of reproduction periods obtained by equally dividing the sounding period for each note of the chord, a guide sound for the note corresponding to the reproduction period is reproduced. In the above aspect, when the sounding period of the chord is short, the guide sound for the note is reproduced in each of the reproduction periods obtained by equally dividing the sounding period for each note. Therefore, the reproduction time of each guide sound can be appropriately secured within the range of the sounding period of the chord.

[0127] In any of the specific examples (Appendix A8) of Appendix A1 to Appendix A7, the control of the reproduction includes a guidance action of sequentially starting the reproduction of guidance sounds corresponding to each of the multiple notes constituting the chord at different times, and a reproduction action of simultaneously starting the reproduction of performance sounds corresponding to each of the multiple notes constituting the chord. In the above aspect, a guidance action of sequentially starting the reproduction of guidance sounds for each note constituting the chord at different times, and a reproduction action of simultaneously starting the reproduction of guidance sounds corresponding to each note constituting the chord are executed. Therefore, the user can auditorily grasp whether the multiple notes notified to the user by the guidance sounds are multiple notes constituting one chord or multiple notes that are pronounced sequentially at different times.

[0128] The time relationship between the guidance operation and the playback operation may be arbitrary. For example, the guidance operation and the playback operation may be executed alternatively or in parallel with each other.

[0129] An information processing system according to one aspect (Appendix A9) of the present disclosure includes a score data acquisition unit that acquires score data representing a score, and a playback control unit that plays sounds corresponding to the score data, and the playback control unit starts playback of a first guidance sound corresponding to a first note and a second note corresponding to the second note at different times for a chord composed of a plurality of notes including a first note and a second note in the score represented by the score data.

[0130] A program according to one embodiment (embodiment A10) of the present disclosure causes a computer system to function as a score data acquisition unit that acquires score data representing a musical score, and a playback control unit that plays sounds corresponding to the score data, wherein the playback control unit starts playback of a first guidance sound corresponding to a first note and a second note corresponding to the second note at different times for a chord composed of a plurality of notes including a first note and a second note in the musical score represented by the score data.

[0131] E-2: Appendix B As a technology for making it easier for users to understand musical scores, for example, a configuration in which the name of each element in the musical score is read out by a computer is assumed. However, for example, when it comes to derived notes in which an accidental sign such as sharp (#) or flat (♭) is added to a fundamental note, it is difficult to reproduce a voice guide so that the user can easily understand the derived notes. In consideration of the above circumstances, one aspect of the present disclosure (Appendix B) aims to enable even users who have difficulty reading musical scores to easily understand the derived notes included in the musical score by sound.

[0132] A playback control method according to one aspect of the present disclosure (Appendix B1) is a playback control method implemented by a computer system that acquires musical score data representing a musical score and plays sounds corresponding to the musical score data, and in controlling the playback, for derived notes in which a change symbol has been added to a fundamental note in the musical score represented by the musical score data, a note name guidance sound representing the note name of the fundamental note and a change guidance sound representing the name of the change symbol are sequentially played.

[0133] In the above-mentioned embodiment, for a derived note in which a conjugated note is added to a fundamental note, a note name guide sound that indicates the note name of the fundamental note and a conjugated note that indicates the name of the conjugated note are sequentially played. Therefore, even a user who has difficulty reading music can easily understand the derived note included in the music score by the sound.

[0134] In a specific example (Appendix B2) of Appendix B1, in controlling the playback, playback of the variation guidance sound is started at a first time point, and playback of the note name guidance sound is started at a second time point after the first time point. For derived sounds, understanding the root sound is often prioritized over understanding the altered symbol. In the above embodiment, the note name guidance sound is played after the variation guidance sound is played. Therefore, compared to a form in which the variation guidance sound is played after the note name guidance sound, there is an advantage in that the note name guidance sound is easier to hear.

[0135] In a specific example (Supplementary Note B3) of Appendix B2, the first time point is a time point preceding the start of the note specified by the musical score data for the derived note, and the second time point is a time point coinciding with the start of the note. In the above embodiment, playback of the change guidance sound is started at the first time point preceding the start of the note, and playback of the note name guidance sound is started at the second time point coinciding with the start of the note. Therefore, the note name guidance sound can be played at a time point that is auditorily natural with respect to the progression of the music piece.

[0136] An information processing system according to one aspect of the present disclosure (Appendix B4) includes a score data acquisition unit that acquires score data representing a score, and a playback control unit that plays sounds corresponding to the score data, and the playback control unit sequentially plays, for derived notes in which an alteration symbol is added to a fundamental note in the score represented by the score data, a note name guidance sound that represents the note name of the fundamental note and an alteration guidance sound that represents the name of the alteration symbol.

[0137] A program according to one aspect of the present disclosure (Appendix B5) is a program that causes a computer system to function as a score data acquisition unit that acquires score data representing a musical score, and a playback control unit that plays sounds corresponding to the score data, and the playback control unit sequentially plays a note name guide sound that represents the note name of a fundamental note and a change guide sound that represents the name of the change symbol for a derived note in which an alteration symbol is added to a fundamental note in the musical score represented by the score data. program.

[0138] E-3: Appendix C As a technology for making it easier for users to understand musical scores, for example, a configuration in which the name of each element in the musical score is read out by a computer is assumed. However, for a piece of music that includes multiple voice parts played in parallel with each other, it is actually difficult for a user to audibly distinguish between the voice parts because the guide sounds corresponding to each voice part are played in parallel. In consideration of the above circumstances, one aspect of the present disclosure (Appendix C) aims to enable a user to easily audibly distinguish between the guide sounds corresponding to each of the multiple voice parts.

[0139] A playback control method according to one embodiment (Appendix C1) of the present disclosure is a playback control method realized by a computer system, which obtains musical score data representing the musical score of a piece of music composed of multiple voice parts including a first voice part and a second voice part, and plays back sounds corresponding to the musical score data, and in controlling the playback, the first guidance sound and the second guidance sound are played back so that a first sound image of a first guidance sound corresponding to the first voice part and a second sound image of a second guidance sound corresponding to the second voice part are positioned at different positions.

[0140] In the above embodiment, the first sound image of the first guidance sound corresponding to the first voice part and the second sound image of the second guidance sound corresponding to the second voice part are localized at different positions, so that the user can easily audibly confirm the position of the sound image of the first guidance sound corresponding to the first voice part and the position of the sound image of the second guidance sound corresponding to the second voice part.

[0141] In a specific example (additional note C2) of supplementary note C1, the first guidance sound is a voice representing the name of the first voice part, and the second guidance sound is a voice representing the name of the second voice part. According to the above aspect, the user can easily distinguish between the name of the first voice part and the name of the second voice part.

[0142] In a specific example (additional note C3) of appendix C1 or appendix C2, the first guidance sound is played back at the pitch of a note included in the first voice, and the second guidance sound is played back at the pitch of a note included in the second voice. According to the above aspect, by listening to the first guidance sound and the second guidance sound, the user can easily auditorily grasp the range of the first voice and the range of the second voice. Note that the "note included in the first voice" is, for example, the first note of the multiple notes that make up the first voice.

[0143] In any specific example (Appendix C4) of Appendix C1 to Appendix C3, the first guidance sound is played at a volume corresponding to the dynamic markings specified by the score data for the first voice, and the second guidance sound is played at a volume corresponding to the dynamic markings specified by the score data for the second voice. According to the above aspect, by listening to the first guidance sound and the second guidance sound, the user can easily audibly grasp the dynamics of the first voice and the second voice.

[0144] An information processing system according to one embodiment (Appendix C5) of the present disclosure includes a score data acquisition unit that acquires score data representing a musical score of a piece of music composed of multiple voice parts including a first voice part and a second voice part, and a playback control unit that plays sounds corresponding to the score data, and the playback control unit reproduces the first guidance sound and the second guidance sound such that a first sound image of a first guidance sound corresponding to the first voice part and a second sound image of a second guidance sound corresponding to the second voice part are localized at different positions.

[0145] A program according to one embodiment (embodiment C6) of the present disclosure is a program that causes a computer system to function as a score data acquisition unit that acquires score data representing a musical score of a piece of music composed of multiple voices including a first voice part and a second voice part, and a playback control unit that plays a sound corresponding to the score data, wherein the playback control unit reproduces the first guidance sound and the second guidance sound so that a first sound image of a first guidance sound corresponding to the first voice part and a second sound image of a second guidance sound corresponding to the second voice part are positioned at different positions. [Explanation of symbols]

[0146] 100...information processing system, 11...control device, 12...storage device, 13...display device, 14...operation device, 15...playback device, 151...sound emission device, 21...musical score data acquisition unit, 22a, 22b, 22c...playback control unit.

Claims

1. Obtaining musical score data representing a musical score; Reproducing a sound corresponding to the musical score data; A playback control method implemented by a computer system, comprising: In the control of the regeneration, For a chord composed of a plurality of notes including a first note and a second note in the musical score represented by the musical score data, playback of a first guide sound corresponding to the first note and playback of a second guide sound corresponding to the second note are started at different times. Playback control method.

2. the first guide sound is a performance sound of the first note, The second guide sound is a performance sound of the second note. The playback control method according to claim 1.

3. the first guide sound is a reading voice representing a note name of the first note, The second guide sound is a voice reading that represents the note name of the second note. The playback control method according to claim 1.

4. In the control of the regeneration, playing a guide sound for each note of the plurality of notes except for the last note for a time length that has a predetermined relationship to the note value of the chord during the tone generation period of the chord; The guide sound of the last note is played for the remaining time of the sounding period of the chord. The playback control method according to claim 1.

5. In the control of the regeneration, playing a guide sound for each note of the plurality of notes except for the last note for a predetermined period of time; The performance sound of the last note is reproduced for the remaining time of the tone generation period of the chord. The playback control method according to claim 1.

6. In the control of the regeneration, reproducing the performance sound of each note of the plurality of notes except for the last note for a duration that has a predetermined relationship to the note value of the chord during the tone generation period of the chord and is closest to a predetermined value; The playback sound of the last note is played for the remaining time of the tone generation period of the chord. The playback control method according to claim 1.

7. In the control of the regeneration, When the duration of the sounding period of the chord falls below a predetermined value, in each of a plurality of playback periods obtained by equally dividing the sounding period for each note of the chord, a guide sound of the note corresponding to the playback period is played. The playback control method according to claim 1.

8. In the control of the regeneration, a guidance action of sequentially starting reproduction of guidance sounds corresponding to each of the plurality of notes constituting the chord at different times; and executing a reproducing operation for simultaneously starting reproduction of performance sounds corresponding to each of the plurality of notes constituting the chord. The playback control method according to claim 1.

9. a score data acquisition unit for acquiring score data representing a score; a playback control unit that plays back a sound corresponding to the musical score data, The playback control unit For a chord composed of a plurality of notes including a first note and a second note in the musical score represented by the musical score data, playback of a first guide sound corresponding to the first note and playback of a second guide sound corresponding to the second note are started at different times. Information processing system.

10. A score data acquisition unit that acquires score data representing a score; and a playback control unit that plays back sounds corresponding to the musical score data; A program for causing a computer system to function as The playback control unit For a chord composed of a plurality of notes including a first note and a second note in the musical score represented by the musical score data, playback of a first guide sound corresponding to the first note and playback of a second guide sound corresponding to the second note are started at different times. program.

11. Obtaining musical score data representing a musical score; Reproducing a sound corresponding to the musical score data; A playback control method implemented by a computer system, comprising: In the control of the regeneration, For a derived note in which a change symbol is added to a fundamental note in the musical score represented by the musical score data, a note name guide sound indicating the note name of the fundamental note and a change guide sound indicating the name of the change symbol are sequentially reproduced. Playback control method.

12. In the control of the regeneration, starting playback of the change guidance sound at a first time point; Start playing the note name guide sound at a second time point that is after the first time point. The playback control method according to claim 11.

13. the first time point is a time point preceding a start point of a note designated by the musical score data for the derived sound, The second point in time is a point in time that coincides with the starting point. The playback control method of claim 12.

14. a score data acquisition unit for acquiring score data representing a score; a playback control unit that plays back a sound corresponding to the musical score data, The playback control unit For a derived note in which a change symbol is added to a fundamental note in the musical score represented by the musical score data, a note name guide sound indicating the note name of the fundamental note and a change guide sound indicating the name of the change symbol are sequentially reproduced. Information processing system.

15. A score data acquisition unit that acquires score data representing a score; and a playback control unit that plays back sounds corresponding to the musical score data; A program for causing a computer system to function as The playback control unit For a derived note in which a change symbol is added to a fundamental note in the musical score represented by the musical score data, a note name guide sound indicating the note name of the fundamental note and a change guide sound indicating the name of the change symbol are sequentially reproduced. program.

16. Acquire sheet music data representing a sheet music of a piece of music composed of a plurality of voice parts including a first voice part and a second voice part; Reproducing a sound corresponding to the musical score data; A playback control method implemented by a computer system, comprising: In the control of the regeneration, The first guidance sound and the second guidance sound are reproduced such that a first sound image of a first guidance sound corresponding to the first voice part and a second sound image of a second guidance sound corresponding to the second voice part are localized at different positions. Playback control method.

17. the first guidance sound is a sound representing a name of the first voice part, The second guidance sound is a sound representing the name of the second voice part. The playback control method of claim 16.

18. the first guidance sound is reproduced at the pitch of a note included in the first voice part, The second guidance sound is reproduced according to the pitch of the note included in the second voice part. The playback control method of claim 16.

19. the first guide sound is reproduced at a volume corresponding to a dynamic marking designated by the musical score data for the first voice part; The second guide sound is reproduced at a volume corresponding to the dynamic marking designated by the musical score data for the second voice part. The playback control method of claim 16.

20. a score data acquisition unit that acquires score data representing a score of a piece of music composed of a plurality of voice parts including a first voice part and a second voice part; a playback control unit that plays back sounds corresponding to the musical score data; The playback control unit The first guidance sound and the second guidance sound are reproduced such that a first sound image of a first guidance sound corresponding to the first voice part and a second sound image of a second guidance sound corresponding to the second voice part are localized at different positions. Information processing system.

21. a score data acquisition unit that acquires score data representing a score of a piece of music composed of a plurality of voice parts including a first voice part and a second voice part; a playback control unit that plays back sounds corresponding to the musical score data; A program for causing a computer system to function as The playback control unit The first guidance sound and the second guidance sound are reproduced such that a first sound image of a first guidance sound corresponding to the first voice part and a second sound image of a second guidance sound corresponding to the second voice part are localized at different positions. program.

Images