Musical sound input device, performance state display device, musical score, performance teaching device, musical sound input method, performance state display method, performance teaching method, program and recording medium

Abstract

To provide a musical sound input device which does not require special operation for scale movement.SOLUTION: A musical sound input device includes an operator group and a body, the operator group being arranged on an upper surface of the body and including a plurality of operators. Musical sound is individually allocated to each of the plurality of operators. The body includes an infinite scale setting part, a musical sound detection part, and an input part. The infinite scale setting part sets the presence or absence of application of an infinite scale; the musical sound detection part detects an input target sound corresponding to the operated operator; the input target sound is a musical sound reflecting the presence or absence of the application of the infinite scale with respect to the musical sound allocated to the operator; and the input part inputs the input target sound.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a musical sound input device, a performance state display device, a musical score, a performance instruction device, a musical sound input method, a performance state display method, a performance instruction method, a program, and a recording medium.

Background Art

[0002] Regarding operators such as keys on a keyboard or a piano keyboard, a technique has been reported in which the number of the operators arranged on the main body (such as a keyboard or a piano) is reduced to reduce the size of the main body (see Patent Document 1, etc.).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the techniques such as Patent Document 1, etc., the user needs to memorize the correspondence between the combination of each operator and the sound. Therefore, there is a problem that the user has a cognitive load and the operation is difficult. This problem is not limited to musical instruments such as pianos, but is the same in devices such as keyboards.

[0005] Therefore, a musical sound input device, etc. excellent in ease of operation has been disclosed (Patent Document 2). However, in order to easily acquire performance, a technique for further reducing the cognitive load of the user is required. Specifically, the following problems can be mentioned.

[0006] The first problem of the present invention is that it is a heavy burden for beginners to perform a scale movement operation while operating the keyboard. Therefore, an object of the present invention is to provide a musical sound input device that eliminates the need for a special operation for scale movement.

[0007] The second problem of the present invention is that there is a need for a low-cost and easy-to-operate method for improving the degree of freedom of expression. Therefore, an object of the present invention is to provide a musical sound input device that enables free expression at low cost and easily.

[0008] The third problem of the present invention is that it is difficult for beginners who challenge melody composition to recall by themselves the constituent sounds of chords and available scales. Therefore, an object of the present invention is to provide a performance state display device that assists the user in recalling sounds.

[0009] The fourth problem of the present invention is that there are some operations that are difficult to grasp in a musical score that only specifies note names and the keyboard. Therefore, an object of the present invention is to provide a musical score that facilitates the grasping of operations.

[0010] The fifth problem of the present invention is that it is a heavy burden for beginners to perform different movements with both hands at the same time. Therefore, an object of the present invention is to provide a musical sound input device and a performance instruction device that facilitate the acquisition of performance with both hands.

Means for Solving the Problems

[0011] To solve the above first problem, the musical sound input device according to the first - 1 invention of the present invention includes an operator group and a main body, the operator group is arranged on the upper surface of the main body and includes a plurality of operators, the plurality of operators are individually assigned musical sounds, the main body includes an infinite scale setting unit, a musical sound detection unit, and an input unit, the infinite scale setting unit sets the presence or absence of the application of an infinite scale, the musical sound detection unit detects an input target sound corresponding to the operated operator, The input target sound is a musical sound that reflects the presence or absence of application of the infinite scale to the musical sound assigned to the operator. The input unit inputs the input target sound.

[0012] The musical sound input method according to the first-first invention of the present invention includes an infinite scale setting step, a musical sound detection step, and an input step. Each of the above steps is implemented using a musical sound input device including an operator group and a main body. The operator group is arranged on the upper surface of the main body and includes a plurality of operators. Musical sounds are individually assigned to the plurality of operators, and the infinite scale setting step sets the presence or absence of application of the infinite scale. The musical sound detection step detects an input target sound corresponding to the operated operator in a musical sound input device in which musical sounds are assigned to a plurality of operators. The input target sound is a musical sound that reflects the presence or absence of application of the infinite scale to the musical sound assigned to the operator. The input step inputs the input target sound.

[0013] The program according to the first-first invention of the present invention includes an infinite scale setting procedure, a musical sound detection procedure, and an input procedure. Each of the above procedures is implemented using a musical sound input device including an operator group and a main body. The operator group is arranged on the upper surface of the main body and includes a plurality of operators. Musical sounds are individually assigned to the plurality of operators. The infinite scale setting procedure sets the presence or absence of application of the infinite scale. The musical sound detection procedure detects an input target sound corresponding to the operated operator in a musical sound input device in which musical sounds are assigned to a plurality of operators. The input target sound is a musical sound that reflects the presence or absence of application of the infinite scale to the musical sound assigned to the operator. The input procedure inputs the input target sound. It is a program for causing a computer to execute each of the above procedures.

[0014] The recording medium according to the first invention of the present invention includes an infinite scale setting procedure, a musical sound detection procedure, and an input procedure, each of the above procedures is implemented using a musical sound input device including an operator group and a main body, the operator group is arranged on the upper surface of the main body and includes a plurality of operators, the plurality of operators are individually assigned musical sounds, the infinite scale setting procedure sets the presence or absence of application of an infinite scale, the musical sound detection procedure detects an input target sound corresponding to the operated operator in a musical sound input device in which musical sounds are assigned to a plurality of operators, the input target sound is a musical sound that reflects the presence or absence of application of the infinite scale with respect to the musical sound assigned to the operator, the input procedure inputs the input target sound, and is a computer-readable recording medium recording a program for causing a computer to execute each of the above procedures.

[0015] In order to solve the first problem, the musical sound input device according to the second invention of the present invention includes an operator group and a main body, the operator group is arranged on the upper surface of the main body and includes a plurality of operators, the plurality of operators are individually assigned musical sounds, the main body includes an automatic scale movement setting unit, a musical sound detection unit, and an input unit, the automatic scale movement setting unit sets the presence or absence of application of automatic scale movement, the musical sound detection unit detects an input target sound corresponding to the operated operator, the input target sound is a musical sound that reflects the presence or absence of application of the automatic scale movement with respect to the musical sound assigned to the operator, and the input unit inputs the input target sound.

[0016] The musical sound input method according to the second invention of the present invention including an automatic scale movement setting step, a musical sound detection step, and an input step, each of the above steps is implemented using a musical sound input device including an operator group and a main body, the operator group is arranged on the upper surface of the main body and includes a plurality of operators, the plurality of operators are individually assigned musical sounds, the automatic scale movement setting step sets the presence or absence of the application of automatic scale movement, the musical sound detection step detects an input target sound corresponding to the operated operator in the musical sound input device in which musical sounds are assigned to a plurality of operators, the input target sound is a musical sound reflecting the presence or absence of the application of the automatic scale movement with respect to the musical sound assigned to the operator, the input step inputs the input target sound.

[0017] The program according to the first to second inventions of the present invention, includes an automatic scale movement setting procedure, a musical sound detection procedure, and an input procedure, each of the above procedures is implemented using a musical sound input device including an operator group and a main body, the operator group is arranged on the upper surface of the main body and includes a plurality of operators, the plurality of operators are individually assigned musical sounds, the automatic scale movement setting procedure sets the presence or absence of the application of automatic scale movement, the musical sound detection procedure detects an input target sound corresponding to the operated operator in the musical sound input device in which musical sounds are assigned to a plurality of operators, the input target sound is a musical sound reflecting the presence or absence of the application of the automatic scale movement with respect to the musical sound assigned to the operator, the input procedure inputs the input target sound, and is a program for causing a computer to execute each of the above procedures.

[0018] The recording medium according to the first to second inventions of the present invention, includes an automatic scale movement setting procedure, a musical sound detection procedure, and an input procedure, Each of the above procedures is implemented using a musical sound input device including an operator group and a main body, The operator group is arranged on the upper surface of the main body and includes a plurality of operators, The plurality of operators are individually assigned musical sounds, The automatic scale shift setting procedure sets the presence or absence of application of automatic scale shift, The musical sound detection procedure detects an input target sound corresponding to the operated operator in a musical sound input device in which musical sounds are assigned to a plurality of operators, The input target sound is a musical sound that reflects the presence or absence of application of the automatic scale shift with respect to the musical sound assigned to the operator, The input procedure inputs the input target sound, It is a computer-readable recording medium recording a program for causing a computer to execute each of the above procedures.

[0019] In order to solve the second problem, the musical sound input device according to the second invention of the present invention, includes an operator group, a main body, and a pressure sensor, The operator group is arranged on the upper surface of the main body and includes a plurality of operators, The plurality of operators are individually assigned musical sounds, The main body includes a musical sound detection unit and an input unit, The musical sound detection unit detects an input target sound corresponding to the operated operator, The input target sound is the musical sound assigned to the operator, The pressure sensor is arranged at the position of the user's wrist during operation and detects the pressure by the user's wrist, The pressure by the wrist is associated with a specific acoustic effect according to the mode of the pressure, The input unit inputs the input target sound added with the acoustic effect.

[0020] The musical sound input method according to the second invention of the present invention, includes a musical sound detection step, a pressure detection step, and an input step, Each of the above steps is implemented using a musical sound input device including an operator group, a main body, and a pressure sensor. The operator group is arranged on the upper surface of the main body and includes a plurality of operators. Musical sounds are individually assigned to the plurality of operators. In the musical sound detection step, an input target sound corresponding to the operated operator in the musical sound input device in which musical sounds are assigned to the plurality of operators is detected. The input target sound is the musical sound assigned to the operator. In the pressure detection step, the pressure exerted by the user's wrist is detected using the pressure sensor arranged at the position of the user's wrist during operation. The pressure exerted by the wrist is associated with a specific acoustic effect according to the mode of the pressure. In the input step, the input target sound added with the acoustic effect is input.

[0021] The program according to the second invention of the present invention includes a musical sound detection procedure, a pressure detection procedure, and an input procedure. Each of the above procedures is implemented using a musical sound input device including an operator group, a main body, and a pressure sensor. The operator group is arranged on the upper surface of the main body and includes a plurality of operators. Musical sounds are individually assigned to the plurality of operators. In the musical sound detection procedure, an input target sound corresponding to the operated operator in the musical sound input device in which musical sounds are assigned to the plurality of operators is detected. The input target sound is the musical sound assigned to the operator. In the pressure detection procedure, the pressure exerted by the user's wrist is detected using the pressure sensor arranged at the position of the user's wrist during operation. The pressure exerted by the wrist is associated with a specific acoustic effect according to the mode of the pressure. In the input procedure, the input target sound added with the acoustic effect is input. It is a program for causing a computer to execute each of the above procedures.

[0022] The recording medium according to the second invention of the present invention is including a sound detection procedure, a pressure detection procedure, and an input procedure, wherein each of the above procedures is carried out using a sound input device including an operator group, a main body, and a pressure sensor, the operator group is arranged on the upper surface of the main body and includes a plurality of operators, the plurality of operators are individually assigned sounds, the sound detection procedure detects an input target sound corresponding to the operated operator in a sound input device in which sounds are assigned to a plurality of operators, the input target sound is the sound assigned to the operator, the pressure detection procedure uses the pressure sensor arranged at the position of the user's wrist during operation to detect the pressure exerted by the user's wrist, the pressure exerted by the wrist is associated with a specific acoustic effect according to the mode of the pressure, the input procedure inputs the input target sound with the acoustic effect added, and is a computer-readable recording medium recording a program for causing a computer to execute each of the above procedures.

[0023] In order to solve the third problem, a performance state display device according to the third invention of the present invention is including an operation information acquisition unit, an operator object generation unit, a chord composition display generation unit, a movement display processing unit, and an information output unit, the operation information acquisition unit acquires operation information regarding the operation of an operator in a sound input device in which sounds are assigned to each operator, the operator object generation unit generates operator object information for displaying the operated operator on a display screen based on the operation information, the chord composition display generation unit generates chord composition display information for displaying the single sounds constituting the chord on the display screen when an operator assigned with a chord is operated, the movement display processing unit generates screen movement information for moving the display position of the display screen according to the state of the operation in the sound input device, The information output unit outputs operation state information of the musical sound input device, The operation state information includes information regarding the display screen that reflects the operator object information, chord composition display information, and screen movement information.

[0024] The performance state display method according to the third invention of the present invention includes an operation information acquisition step, an operator object generation step, a chord composition display generation step, a movement display processing step, and an information output step The operation information acquisition step acquires operation information regarding operations of the respective operators in a musical sound input device in which musical sounds are assigned to the respective operators, The operator object generation step generates operator object information for displaying the operator operated based on the operation information on the display screen, The chord composition display generation step generates chord composition display information for displaying the single sounds constituting the chord on the display screen when an operator to which a chord is assigned is operated, The movement display processing step generates screen movement information for moving the display position of the display screen according to the state of operations in the musical sound input device, The information output step outputs operation state information of the musical sound input device, The operation state information includes information regarding the display screen that reflects the display settings, the operator object information, the chord composition display information, and the screen movement information.

[0025] The program according to the third invention of the present invention includes an operation information acquisition procedure, an operator object generation procedure, a chord composition display generation procedure, a movement display processing procedure, and an information output procedure The operation information acquisition procedure acquires operation information regarding operations of the respective operators in a musical sound input device in which musical sounds are assigned to the respective operators, The operator object generation procedure generates operator object information for displaying the operator operated based on the operation information on the display screen, When an operator to which a harmony is assigned is operated, the harmony composition display generation procedure generates harmony composition display information for displaying the single tones that constitute the harmony on the display screen. The movement display processing procedure generates screen movement information for moving the display position of the display screen according to the state of operations in the musical sound input device. The information output procedure outputs the operation state information of the musical sound input device. The operation state information includes information regarding the display screen that reflects the display settings, the operator object information, the harmony composition display information, and the screen movement information. Each of the above procedures is a program for causing a computer to execute them.

[0026] The recording medium according to the third invention of the present invention includes an operation information acquisition procedure, an operator object generation procedure, a harmony composition display generation procedure, a movement display processing procedure, and an information output procedure The operation information acquisition procedure acquires operation information regarding the operation of each operator in a musical sound input device to which musical sounds are assigned to each operator. The operator object generation procedure generates operator object information for displaying the operator operated based on the operation information on the display screen. When an operator to which a harmony is assigned is operated, the harmony composition display generation procedure generates harmony composition display information for displaying the single tones that constitute the harmony on the display screen. The movement display processing procedure generates screen movement information for moving the display position of the display screen according to the state of operations in the musical sound input device. The information output procedure outputs the operation state information of the musical sound input device. The operation state information includes information regarding the display screen that reflects the display settings, the operator object information, the harmony composition display information, and the screen movement information. It is a computer-readable recording medium that records a program for causing a computer to execute each of the above procedures.

[0027] To solve the fourth problem, the musical score according to the fourth invention of the present invention is a musical score corresponding to a musical sound input device having an operator group, the operator group includes five operator sequences, the operation sequence is composed of one or more operators, and stage information corresponding to the position is assigned, the operator has a sound assigned to each position where the stage information of the operator sequence is assigned, including a display area, a display of musical sounds, a display of operator sequences, and a display of stage information, the display area includes at least one of a main melody area for displaying the main melody and a harmony area for displaying harmony, the display of the musical sound is arranged at positions with a certain interval corresponding to the beat of the music in the corresponding display area, the display of the operator sequence is displayed adjacent to the display of the musical sound, the display of the stage information is a visual identification display for identifying the stage information applied to the arrangement part of the display of the musical sound in the display area.

[0028] To solve the fifth problem, the musical sound input device according to the fifth invention of the present invention is composed of an operator group and a main body, the operator group includes a harmony operator group and a single note operator group the harmony operator group and the single note operator group are arranged on the upper surface of the main body and include a plurality of operators, the plurality of operators in the harmony operator group have harmony musical sounds individually assigned, the plurality of operators in the single note operator group have single note musical sounds individually assigned, the main body includes a performance assistance setting unit, a performance assistance information acquisition unit, an auxiliary musical sound assignment unit, a musical sound detection unit, and an input unit, the performance assistance setting unit sets whether to apply performance assistance settings, the performance assistance setting includes a setting for assisting in performing harmony performance according to the harmony progression in accordance with the beat of the music, When the performance assistance setting is applied, the performance assistance information acquisition unit acquires performance assistance information including information on the chord progression. When the performance assistance information acquisition unit acquires the performance assistance information, the auxiliary musical tone assignment unit assigns musical tones based on the performance assistance information to all the operators constituting the chord operator group, instead of the chords individually assigned to the plurality of operators in the chord operator group. The musical tone detection unit detects an input target sound corresponding to the operated operator. The input target sound is the musical tone assigned to the operator. The input unit inputs the input target sound.

[0029] The performance teaching device according to the fifth invention of the present invention includes a musical score information acquisition unit, a performance assistance information output unit, an operator object generation unit, a moving display processing unit, and an information output unit. The musical score information acquisition unit acquires musical score information regarding a musical score including performance assistance information. The performance assistance information includes information on the chord progression. The performance assistance information output unit outputs the performance assistance information to a musical tone input device to which musical tones are assigned to a plurality of operators. The operator object generation unit generates teaching object information for teaching the operation of the operator corresponding to the musical tone included in the musical score information and the chord progression. The moving display processing unit generates teaching screen position information for moving the display position on the display screen according to the position of the teaching part in the musical score. The information output unit outputs performance teaching information of the musical tone input device. The performance teaching information includes the teaching object information and information on the display screen reflecting the screen movement information.

[0030] The musical tone input method according to the fifth invention of the present invention includes a performance assistance setting step, a performance assistance information acquisition step, an auxiliary musical tone assignment step, a musical tone detection step, and an input step. Each of the above steps is carried out using a musical sound input device including an operator group and a main body. The operator group includes a chord operator group and a single - note operator group. The chord operator group and the single - note operator group are arranged on the upper surface of the main body and include a plurality of operators. The plurality of operators in the chord operator group have musical sounds of chords individually assigned thereto. The plurality of operators in the single - note operator group have musical sounds of single notes individually assigned thereto. The performance assistance setting step sets whether to apply performance assistance settings. The performance assistance setting includes settings for assisting in performing chord performances according to a chord progression in accordance with the tempo of a piece of music. The performance assistance information acquisition step acquires performance assistance information including information regarding the chord progression when the performance assistance setting is applied. In the auxiliary musical sound assignment step, when the performance assistance information is acquired in the performance assistance information acquisition step, musical sounds based on the performance assistance information are assigned to all the operators constituting the chord operator group instead of the chords individually assigned to the plurality of operators in the chord operator group. The musical sound detection step detects an input target sound corresponding to the operated operator. The input target sound is the musical sound assigned to the operator. The input step inputs the input target sound.

[0031] The performance instruction method according to the fifth invention of the present invention includes a musical score information acquisition step, a performance assistance information output step, an operator object generation step, a moving display processing step, and an information output step. The musical score information acquisition step acquires musical score information regarding a musical score including performance assistance information. The performance assistance information includes information regarding the chord progression. The performance assistance information output step outputs the performance assistance information to a musical sound input device to which musical sounds are assigned to a plurality of operators. The operator object generation step generates instruction object information for instructing operations of the operators corresponding to musical sounds included in the score information and the chord progression. The moving display processing step generates instruction screen position information for moving the display position of the display screen according to the position of the instruction part in the score. The information output step outputs performance instruction information of the musical sound input device. The performance instruction information includes the instruction object information and information regarding the display screen reflecting the screen movement information.

[0032] The program of the musical sound input method according to the fifth invention of the present invention includes a performance assistance setting procedure, a performance assistance information acquisition procedure, an auxiliary musical sound assignment procedure, a musical sound detection procedure, and an input procedure. Each of the above procedures is implemented using a musical sound input device including an operator group and a main body. The operator group includes a chord operator group and a single note operator group. The chord operator group and the single note operator group are arranged on the upper surface of the main body and include a plurality of operators. The plurality of operators in the chord operator group are individually assigned musical sounds of chords. The plurality of operators in the single note operator group are individually assigned musical sounds of single notes. The performance assistance setting procedure sets the presence or absence of application of performance assistance settings. The performance assistance setting includes settings for assisting in performing chord performances according to a chord progression in accordance with the tempo of a piece of music. The performance assistance information acquisition procedure acquires performance assistance information including information regarding the chord progression when the performance assistance setting is applied. When the performance assistance information is acquired in the auxiliary musical sound assignment procedure in the performance assistance information acquisition step, musical sounds based on the performance assistance information are assigned to all the operators constituting the chord operator group instead of the chords individually assigned to the plurality of operators in the chord operator group. The musical sound detection procedure detects an input target sound corresponding to the operated operator. The input target sound is a musical sound assigned to the operator, The input procedure is to input the input target sound, and each of the procedures is a program for causing a computer to execute them.

[0033] The program of the performance instruction method according to the fifth invention of the present invention, includes a musical score information acquisition procedure, a performance assistance information output procedure, an operator object generation procedure, a moving display processing procedure, and an information output procedure, The musical score information acquisition procedure acquires musical score information regarding a musical score including performance assistance information, The performance assistance information includes information regarding the chord progression, The performance assistance information output procedure outputs the performance assistance information to a musical sound input device in which musical sounds are assigned to a plurality of operators, The operator object generation procedure generates instruction object information for instructing the operation of the operator corresponding to the musical sound included in the musical score information and the chord progression, The moving display processing procedure generates instruction screen position information for moving the display position on the display screen according to the position of the instruction portion in the musical score, The information output procedure outputs performance instruction information of the musical sound input device, The performance instruction information includes the instruction object information and information regarding the display screen reflecting the screen movement information, and each of the procedures is a program for causing a computer to execute them.

[0034] The recording medium of the musical sound input method according to the fifth invention of the present invention, includes a performance assistance setting procedure, a performance assistance information acquisition procedure, an auxiliary musical sound assignment procedure, a musical sound detection procedure, and an input procedure, Each of the procedures is implemented using a musical sound input device including an operator group and a main body, The operator group includes a chord operator group and a single note operator group The chord operator group and the single note operator group are arranged on the upper surface of the main body and include a plurality of operators, The plurality of operators in the chord operator group are individually assigned musical tones of chords. The plurality of operators in the single - tone operator group are individually assigned musical tones of single - tones. The performance assistance setting procedure sets the presence or absence of the application of performance assistance settings. The performance assistance setting includes settings for assisting in performing chord performances according to a chord progression in accordance with the tempo of a piece of music. The performance assistance information acquisition procedure acquires performance assistance information including information on the chord progression when the performance assistance setting is applied. When the performance assistance information is acquired in the performance assistance information acquisition step, the assistance tone assignment procedure assigns tones based on the performance assistance information to all the operators constituting the chord operator group instead of the chords individually assigned to the plurality of operators in the chord operator group. The tone detection procedure detects an input target tone corresponding to the operated operator. The input target tone is the musical tone assigned to the operator. The input procedure inputs the input target tone. It is a computer - readable recording medium recording a program for causing a computer to execute each of the above procedures.

[0035] The recording medium of the performance teaching method according to the fifth invention of the present invention includes a musical score information acquisition procedure, a performance assistance information output procedure, an operator object generation procedure, a moving display processing procedure, and an information output procedure. The musical score information acquisition procedure acquires musical score information regarding a musical score including performance assistance information. The performance assistance information includes information on the chord progression. The performance assistance information output procedure outputs the performance assistance information to a musical tone input device in which musical tones are assigned to a plurality of operators. The operator object generation procedure generates teaching object information for teaching the operation of the operator corresponding to the musical tone included in the musical score information and the chord progression. The movement display processing procedure generates teaching screen position information for moving the display position on the display screen according to the position of the teaching part in the musical score. The information output procedure outputs performance teaching information of the musical sound input device. The performance teaching information includes the teaching object information and information regarding the display screen reflecting the screen movement information. It is a computer-readable recording medium recording a program for causing a computer to execute each of the above procedures.

Advantages of the Invention

[0036] According to the present invention relating to the first problem, a special operation for scale movement becomes unnecessary.

[0037] According to the present invention relating to the second problem, the degree of freedom of expression can be improved by a low-cost and easy method.

[0038] According to the present invention relating to the third problem, the user's recollection of sounds is assisted.

[0039] According to the present invention relating to the fourth problem, it becomes easy to grasp the operations according to the musical score.

[0040] According to the present invention relating to the fifth problem, it becomes easy to acquire performance with both hands.

[0041] As described above, according to the present disclosure, it is possible to facilitate the acquisition of performance by the user.

Brief Description of the Drawings

[0042]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

DETAILED DESCRIPTION OF THE INVENTION

[0043] Embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the following embodiments. In the following drawings, the same parts are denoted by the same reference numerals. In addition, the descriptions of the respective embodiments can be mutually referred to unless otherwise specified, and the configurations of the respective embodiments can be combined unless otherwise specified.

[0044] [Embodiment 1] In order to solve the first problem of the present invention, the first - 1 invention of the present invention enables the application of an infinite scale.

[0045] First, the configuration of the musical sound input device of the present embodiment will be described with reference to FIG. 1. FIG. 1(A) is a perspective view showing an example of the configuration of the musical sound input device 1 according to the present disclosure, and FIG. 1(B) is a top view of the musical sound input device 1 (hereinafter also referred to as "this device 1") shown in FIG. 1(A). As shown in FIG. 1, the device 1 includes an operator group 11 and a main body 12. The operator group 11 is arranged on the upper surface of the main body 12 and includes a plurality of operators 111a to 111e. Each of the above - mentioned operators is individually assigned a musical sound. When the operator is operated, the musical sound assigned to the operator is detected. For example, the detected musical sound is input to an output device and can be heard as a performance of a music piece through the output device. Note that the configuration of FIG. 1 is an example of the configuration of the musical sound input device according to the present disclosure and is not limited thereto.

[0046] The operation subgroup 11 is composed of operators 111a to 111e arranged in five columns on the upper surface of the main body 12 as shown in FIG. 1, for example. The operators 111a to 111e in FIG. 1 are each an independent operator, and each can perform three-stage operations. FIG. 2 shows an example of the configuration of an operator capable of three-stage operations. As shown in FIG. 2(A), three sensors 112 may be arranged on the lower surface side of the operator configuration 111. In this case, as shown in FIG. 2(B), the sensors for detecting the pressing differ depending on the position where the operator is pressed. Therefore, three-stage operations are possible. For an operator capable of three-stage operations, a musical sound can be individually assigned to each stage. For example, "#Do" can be assigned to the upper part, "Do" to the middle part, and "Si" to the lower part. Also, the operation subgroup 11 may have another configuration. FIG. 3 is a top view showing another example of the operation subgroup. As shown in FIG. 3, for example, an operator column may be composed of three operators 114a to 114c, and the operation subgroup may be composed of five operator columns 113a to 113e. In this case, each operator can be individually assigned a musical sound. For example, "#Do" can be assigned to the operator 114a in the operator column 113a, "Do" to 114b, and "Si" to 114c. In the above two examples, the number of operators constituting the operator column is different, but similar musical sound assignments are possible. Thus, the operation subgroup 11 may be, for example, a set of operators arranged in five columns as shown in FIGS. 1 to 3. Also, the operation subgroup 11 may be composed of, for example, each operator arranged in five columns as shown in FIG. 1 and capable of at least three-stage operations. Furthermore, the operation subgroup 11 may be, for example, each operator arranged in five columns as shown in FIG. 3 and including at least three operators arranged vertically. The operation subgroup 11 is not limited to the above examples. For example, the number of operator columns is not limited, and any configuration may be used as long as it is composed of a plurality of operators.

[0047] In addition, if the operator sequence constituting the operator group 11 has five columns, one finger of one hand corresponding to each column can be assigned. Therefore, with the operator sequence arranged in five columns, performance is possible with the position of the palm fixed. Thus, it is desirable that the operator sequence be five columns. Further, the operator group 11 arranged on the upper surface of the main body 12 may be, for example, one unit when the operator sequence of five columns is taken as one unit, or two or more units. The arrangement of the operator group 11 on the main body 12 is not particularly limited. For example, as shown in FIG. 1, two operator groups 11 may be arranged vertically, or may be arranged horizontally adjacent to each other. The present apparatus 1 can input sounds of different octaves, for example, by having two or more units of the operator group 11. Further, the present apparatus 1 can input a main melody and a harmony simultaneously, for example, by having two or more units of the operator group 11.

[0048] Each of the plurality of operators is assigned a musical tone. The assignment of the musical tones may be pre-assigned or may be assigned by the assignment process of the present apparatus 1. Further, the assignment of the musical tones is not particularly limited as long as it is individually assigned to a plurality of operators. For example, as shown in FIG. 3, when three vertically arranged operators are regarded as one operator column and five operator columns are arranged to form an operator group 11, a reference tone is assigned to the middle operator of each operator column, and musical tones based on the reference tone are assigned to the operators arranged in the upper and lower stages of each operator column. In FIG. 3, the reference tones "Do, Re, Mi, So, La" are assigned from the left. And, musical tones with a pitch one semitone (minor second) higher than the reference tone of each operator column are assigned to the operators arranged in the upper stage of each operator column. Also, musical tones with a pitch one semitone (minor second) lower than the reference tone of each operator column are assigned to the operators arranged in the lower stage of each operator column. Thus, the assignment of the musical tones may be, for example, a method of determining a reference tone, assigning the reference tone to an arbitrary operator of each operator column, and assigning musical tones having a certain relationship with the reference tone of each operator column to other operators. Further, the assignment of the musical tones may be, for example, a method of determining a specific assignment pattern for each operator, selecting an arbitrary pattern from the patterns, and making the assignment based on the selected pattern. Also, the musical tones to be assigned may be, for example, single tones or chords. Further, in one unit of the operator group, an assignment including both single tones and chords may be made, for example, by assigning chords only to the operators of the leftmost operator column and assigning single tones to the other operators. The assignment of the musical tones is not limited to the above examples, and may be by any method as long as musical tones are individually assigned to each operator.

[0049] The present device 1 can set whether to apply an infinite scale. The infinite scale is based on a principle utilizing auditory illusion. For example, for a group of sounds that simultaneously play a plurality of sounds separated by one octave, the sounds in the low frequency band and the high frequency band are played at a small volume, while the sounds in the intermediate frequency band are played at a large volume. Such a group of sounds is prepared for each pitch of a scale such as do, re, mi, fa, so, la, ti. As the scale ascends, while the volume of the high frequency gradually fades, the volume of the low frequency gradually increases. As a result, the boundary where the octave switches becomes ambiguous and the brain cannot recognize it, causing an auditory illusion where it feels like the scale is continuously ascending. When the scale descends, based on the same principle, an illusion that it is continuously descending occurs. By utilizing this principle, even when the sound is not actually a musical note that is one octave higher in pitch, it can be heard as if the pitch has risen by one octave. For example, after pressing operators corresponding to "do, re, mi, fa, so" in sequence to play sounds, then pressing the operator corresponding to "ti, do" which is one octave lower and playing sounds in sequence. In this case, the part of "ti, do" is a musical note assigned a pitch that is one octave lower. However, it can be heard as if the pitch is continuously rising in sequence with "do, re, mi, fa, so, la, ti". By using the infinite scale, as an effect of the aforementioned auditory illusion, for example, it can be heard almost the same as when switching octaves even without actually switching octaves. Therefore, if a setting to apply the infinite scale is made, the same effect as when performing a shift operation to switch or move by one octave can be obtained without performing an octave switching (shift operation). With this configuration, the present device 1 can reduce the cognitive burden during operation.

[0050] Each operator may include, for example, an operator-side display unit. The operator-side display unit displays distinguishable operator information. The operator including the operator-side display unit is, for example, a liquid crystal keyboard or the like in which a liquid crystal panel is built into the operator. Thereby, the display of the operator information can be easily changed and switched. Also, each operator may include, for example, a light-emitting unit. The light-emitting unit emits light of a color corresponding to each of the above stages. The light-emitting unit can emit light by a light-emitting device such as an LED (light emitting diode), for example. The light-emitting device is not particularly limited, and may be, for example, a device capable of emitting single-color light or a device capable of emitting multi-color light. Also, the number of the light-emitting devices is not particularly limited, and may be one or two or more. The color is not particularly limited.

[0051] FIG. 4 is a block diagram showing a configuration of an example of the main body 12 of the present embodiment. The main body 12 includes an infinite scale setting unit 121, a musical sound detection unit 122, and an input unit 123. The main body 12 may further include, for example, as an arbitrary configuration, a musical sound assignment unit 124, a mode selection unit 125, and the like.

[0052] Next, an example of the hardware configuration of the main body 12 will be described with reference to FIG. 5. The main body 12 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, an output device 106, a communication device 107, and the like. Each part of the present device 10 is connected to each other via the bus 103 by respective interfaces (I / F).

[0053] The central processing unit (CPU) 101 is responsible for overall control of the main body 12. The CPU 101 operates in cooperation with other components by means of a controller (such as a system controller, I / O controller, etc.) and is responsible for overall control of the apparatus 10. In the apparatus 10, programs of the present invention and other programs are executed by the CPU 101, and various information is read and written. Specifically, for example, the CPU 101 functions as an infinite scale setting unit 121, a musical sound detection unit 122, and an input unit 123. When the apparatus 10 includes the output unit, the CPU 101 may function as the output unit. The apparatus 10 may be provided with other arithmetic units such as a CPU, a GPU (Graphics Processing Unit), and an APU (Accelerated Processing Unit) as an arithmetic unit, or may be provided with a combination of a CPU and these.

[0054] The bus 103 can be connected to an external device, for example. Examples of the external device include an external storage device (such as an external database), a printer, and a performance state display device 2 described later. The apparatus 10 can be connected to an external network (the communication line network) by means of a communication device 107 connected to the bus 103, and can also be connected to other devices via the external network. Examples of other devices include a manager's terminal (such as a PC, a server, a smartphone, a tablet, etc.). Examples of the external network include an Internet line, the World Wide Web (WWW), a telephone line, a local area network (LAN), and a delay tolerant network (DTN). Communication by the communication device 107 may be wired or wireless. Examples of wireless communication include WiFi (Wireless Fidelity) and Bluetooth (registered trademark). The wireless communication may be in a form in which each device communicates directly (Ad Hoc communication) or indirect communication via an access point.

[0055] The memory 102 includes, for example, a main memory (primary storage device). When the central processing unit 101 performs processing, for example, the memory 102 reads various operation programs such as the program of the present invention stored in the storage device 104 described later, and the central processing unit 101 receives data from the memory 102 and executes the program. The main memory is, for example, a RAM (Random Access Memory). Also, the memory 102 may be, for example, a ROM (Read Only Memory).

[0056] The storage device 104 is also referred to as a so-called auxiliary storage device with respect to the main memory (primary storage device). As described above, the storage device 104 stores an operation program including the program of the present invention. The storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing to the recording medium. The recording medium is not particularly limited, and may be, for example, an internal type or an external type, and examples include an HD (Hard Disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, memory card, etc. The storage device 104 may be, for example, a hard disk drive (HDD) in which a recording medium and a drive are integrated, and a solid state drive (SSD).

[0057] In the present device 1, the memory 102 and the storage device 104 can also store the input target sound, access information from the administrator, and log information described later, as well as information acquired from an external database (not shown).

[0058] In the main body 12, the memory 102 and the storage device 104 can store various information such as log information, information acquired from an external database (not shown) or an external device, information generated by the present device 1, and information used when the present device 1 executes processing. In this case, the memory 102 and the storage device 104 may store, for example, musical score information. Note that at least some of the information may be stored in an external server other than the memory 102 and the storage device 104, or may be distributed and stored in a plurality of terminals using blockchain technology or the like.

[0059] The main body 12 further includes, for example, an input device 105 and an output device 106. The input device 105 includes, for example, pointing devices such as a touch panel, a track pad, and a mouse; a keyboard; imaging means such as a camera and a scanner; card readers such as an IC card reader and a magnetic card reader; voice input means such as a microphone; and the like. The output device 106 includes, for example, display devices such as an LED display and a liquid crystal display; voice output devices such as a speaker; a printer; and the like. The output device 106 functions as a display screen, for example. In the present embodiment, the input device 105 and the output device 106 are separately configured, but the input device 105 and the output device 106 may be integrally configured like a touch panel display.

[0060] Next, an example of the musical sound input method of the present embodiment will be described based on the flowchart of FIG. 6. The musical sound input method of the present embodiment is implemented as follows, for example, using the musical sound input device 1 of FIG. 1. Note that the musical sound input method of the present embodiment is the same when using the musical sound input device 1 of FIG. 3. Further, the musical sound input method of the present embodiment is not limited to the use of the musical sound input device 1 of FIGS. 1 and 3.

[0061] First, the infinite scale setting unit 121 sets whether to apply the infinite scale (S1, infinite scale setting step). The setting is performed, for example, by a switching button (not shown) of the present device 1. For example, when the application of the infinite scale is set to "ON", the musical sound detection unit 122 described later detects, as an input target sound, a musical sound obtained by applying the infinite scale to the musical sound corresponding to the operated operator. For example, when the application of the infinite scale is set to "OFF", the musical sound detection unit 122 described later detects, as an input target sound, the musical sound corresponding to the operated operator. Note that the method of the setting is not limited to that by the switching button, and for example, it may be performed by clicking a switching display displayed on a display device which is an external device, and any method may be used as long as it is a method capable of setting whether to apply the infinite scale.

[0062] Next, the musical sound detection unit 122 detects an input target sound corresponding to the operated operator (S2, musical sound detection step). The input target sound is a musical sound that reflects the presence or absence of the application of the infinite scale to the musical sound assigned to the operator. The assignment of musical sounds to each operator is as described above. In the case of the operator group 11 in FIG. 3, for example, when the operator located in the middle of the leftmost operator row is pressed, the musical sound detection unit 122 detects the musical sound "Do" assigned to the operator 114b in the pressed operator row 113a as the input target sound. In this way, the musical sound assigned to the operated operator is extracted. Further, when the application of the infinite scale is set, the musical sound detection unit 122 detects a musical sound having the effect of the infinite scale.

[0063] Here, the case where the infinite scale is applied will be described. For example, a case where operators corresponding to "Do, Re, Mi, Fa, So, La" are continuously pressed and then operators corresponding to "Si, Do" are continuously pressed will be taken as an example. In FIG. 3, the operators corresponding to "Do, Re, Mi, Fa, So, La" are sequentially arranged from the left side to the right side of the operator group 11, and musical sounds are assigned so that the pitch increases in the order of the above-mentioned operators. Among the operators corresponding to "Si, Do", the operator corresponding to "Si" is arranged below the left side of the operator group 11, and a musical sound with a pitch lower than the musical sound assigned to the operator corresponding to the original "Do" is assigned. And among the operators corresponding to "Si, Do", the operator corresponding to "Do" is the same operator as the original "Do". Therefore, when the infinite scale is not applied, the part of "Si, Do" sounds like the pitch has dropped by one octave. However, when the infinite scale is applied, as described above, due to the effect of auditory illusion, it sounds like the pitch is continuously rising. As a result, even without performing any special operations such as octave switching, "Do, Re, Mi, Fa, So, La, Si, Do" sounds like the pitch is continuously rising.

[0064] Then, the input unit 123 inputs the input target sound (S3, input step). Note that, when there is an application of the infinite scale, the input target sound input by the input unit 123 is a musical sound having the effect of musical hallucination by the infinite scale as described above. When there is no application of the infinite scale, the input target sound is the musical sound itself assigned to each operator without the effect of musical hallucination described above. Further, the input is not particularly limited, and for example, it may be input via a communication network to a sound generation device such as an electronic musical instrument or a speaker, an external display device (LED display, liquid crystal display, etc.), and an external terminal device (personal computer, smartphone, etc.). If the present device 1 further includes, for example, a speaker, the input sound may be generated. The input unit 125 may continuously input the sound while, for example, operating (pressing, etc.) the operator configuration 111, or may define in advance the length of time during which the sound is generated from a speaker or the like (for example, 1 second, etc.).

[0065] The main body 12 may further include, for example, an operator display unit. The operator display unit is disposed on the upper surface of the main body and displays the operator configuration 111 as an image. That is, the operator display unit is in the form of a touch panel or the like.

[0066] The present device 1 may display a musical score on, for example, the output device 106 and the operator display unit. The musical score is not particularly limited, but is preferably the musical score according to the present disclosure described later. Further, the present device 1 may further include, for example, a musical score display unit for displaying a musical score.

[0067] As described above, the musical sound input device according to the present disclosure can obtain substantially the same effect as when a shift operation is performed even without performing a shift operation for converting an octave. Therefore, for example, even a beginner can obtain a sense of satisfaction in playing. Further, since the cognitive load for acquisition is reduced, it can be easily acquired.

[0068] (Modification 1) As described above, the present device 1 may assign musical sounds to the plurality of operators. In this case, the main body 12 of the present device 1 further includes a musical sound assignment unit 124. Note that the configuration of the present device 1 in this case is the same as that of the present device 1 except that the main body 12 includes the musical sound assignment unit 124. Also, the configuration and hardware configuration of the main body of the present device 1 and the method of inputting musical sounds to the present device 1 are the same. Therefore, regarding the parts excluding the musical sound assignment unit 124, including FIGS. 4 to 6, the description of the present device 1 above can be cited. Therefore, the musical sound assignment unit 124 will be described below.

[0069] The musical sound assignment unit 124 assigns musical sounds to the plurality of operators. The method of the assignment is not particularly limited as described above. For example, the assignment method may be to assign a reference sound to each operator sequence constituting the operator group 11, and assign a musical sound having a certain relationship with the reference sound to the operators to which the reference sound is not assigned within each operator sequence. Also, the assignment method may be, for example, a method of selecting from a previously prepared pattern and assigning based on the selected pattern. Also, the assignment may be, for example, to switch a plurality of patterns and reset the musical sound assignment of each operator. Also, the musical sound to be assigned may be a single note or a chord. The assignment may be to switch between a single note and a chord. Thus, the assignment method may be any method as long as musical sounds can be individually assigned to the plurality of operators.

[0070] According to Modification Example 1, the musical sound assigned to each operator can be set according to the situation.

[0071] (Modification Example 2) As shown in FIG. 3, the device 1 may have an operation element group that takes five columns of operation element rows arranged on the upper surface of the main body as one unit. In this case, the operation element rows may include at least three vertically arranged operation elements. Further, as shown in FIG. 7, an operation element group 11b for left - hand operation and an operation element group 11c for right - hand operation may be arranged on the upper surface of the main body 12. Note that FIG. 7 is a top view showing an example of a tone input device that can be operated with both hands. The operation element group 11 in FIG. 7 is composed of three operation elements 114a to 114c arranged vertically in each operation element row, and five columns of operation element rows are arranged horizontally. And an operation element group 11b for left - hand operation is arranged on the left side of the upper surface of the main body 12, and an operation element group 11c for right - hand operation is arranged on the right side of the upper surface of the main body 12. For example, a chord is assigned to the operation element group 11b for left - hand operation, and a main melody (single tone) is assigned to the operation element group 11c for right - hand operation. Note that the assignment of chords and single tones is not limited to the above example. For example, a chord may be assigned to the operation element group 11c for right - hand operation, single tones may be assigned to both operation element groups 11, chords may be assigned to both operation element groups 11, and any assignment may be made.

[0072] The device 1 may further include, for example, a main body having a mode setting unit 125. The mode setting unit 125 performs, for example, mode settings related to the operator group for left - hand operation and the operator group for right - hand operation before the assignment of musical tones by the musical tone assignment unit 124. The mode setting is a setting for selecting at least one of a single - tone mode or a chord mode for each operator group. The single - tone mode is a single - tone mode in which only single tones are assigned by the musical tone setting unit 124, and the chord mode is a chord mode in which only chords are assigned by the musical tone setting unit 124. When the mode setting is performed, the musical tone assignment unit 124 assigns musical tones based on the mode setting to the plurality of operators according to the mode setting. Specifically, for example, as shown in FIG. 7, the device 1 can set an arbitrary mode by a switching button 126 arranged on the main body 12. The arrangement of the switching button 126 is not particularly limited and is arranged, for example, on the upper surface, side surface, and lower surface of the main body 12. Also, the method of mode setting is not limited to using a switching button and can be performed by an appropriate method such as touching a switching operation display displayed on a touch panel or the like. In this case, since the detection step (S2) by the musical tone detection unit 122 performs detection according to the selected mode setting, the input step (S3) inputs musical tones corresponding to the mode setting.

[0073] FIG. 7 shows an example in which the chord mode is selected for the operator group 11b for left - hand operation and the single - tone mode is selected for the operator group 11c for right - hand operation. In this case, the musical tone detection unit 122 further detects the selected mode, and the input unit 123 inputs the musical tones in the detected mode. Therefore, in FIG. 7, the middle operator of the right - most operator row 115e of the operator group 11b for left - hand operation is in the chord mode, and the chord of "C" is assigned. The middle operator of the left - most operator row 116a of the operator group 11c for right - hand operation is in the single - tone mode, and the tone of "do" is assigned. Therefore, as described above, when each operator is pressed with both hands, the chord of "C" and the tone of "do" are input simultaneously.

[0074] Modification Example 2 is the same as the description of the configuration of the main body 12, the configuration of the mode setting unit, and the method of mode setting, except for the foregoing description. Therefore, the description of the present apparatus 1 can be cited, excluding the additional description of Modification Example 2 including FIGS. 4 to 6.

[0075] For example, in the form of Modification Example 2, it is possible to play with both hands and play chords and the main melody simultaneously.

[0076] [Embodiment 2] In order to solve the first problem of the present invention, the first to second inventions of the present invention enable the application of automatic scale movement.

[0077] This embodiment includes a configuration of automatic scale movement that automatically applies a predetermined scale movement to the musical sounds assigned to each operator sound, instead of the configuration of the infinite scale in Embodiment 1. The configuration of the musical sound input device 1B (hereinafter also referred to as "the present device 1B") of this embodiment, the configuration of the main body, the configuration of the hardware, and the musical sound input method are the same as those in Embodiment 1, except for the configuration of the automatic scale movement. Therefore, the present device 1B can cite the description of Embodiment 1 by replacing "infinite scale" with "automatic scale movement" and replacing the description of the infinite scale with the description of the automatic scale movement. That is, the main body 12 includes an automatic scale movement setting unit 121B. Also, the infinite scale setting step (S1) can be read as an automatic scale movement setting step (S1B). That is, the automatic scale movement setting unit sets whether or not to apply the automatic scale movement. Further, the input target sound input by the input unit 123 is a musical sound that reflects whether or not the automatic scale movement is applied to the musical sound assigned to the operated operator. Therefore, the automatic scale movement will be described below.

[0078] The setting of the automatic scale shift is a setting that automatically switches the shift according to the piece when playing a note that requires a shift operation. The shift is, for example, the movement of an octave. Limiting the number of operators results in a limit to the range of tones that can be handled in the normal state. Therefore, for example, depending on the piece, an operation such as raising or lowering by one octave is required. However, performing a shift operation while playing is particularly burdensome for beginners. Thus, the use of the infinite scale in Embodiment 1 becomes one solution. However, since the infinite scale is a method that utilizes auditory illusion, there may be cases where it is appropriate to actually perform a shift operation.

[0079] The automatic scale shift setting is performed, for example, using a switching button provided on the main body 12, similar to the case of Modification Example 2 of Embodiment 1. Note that the setting method is not limited to this, and it can be by an appropriate method such as panel operation on the screen. The automatic switching is performed based on information on the scheduled scale movement (shift). For example, when playing while referring to the score information recorded in the present apparatus 1B, when the score information is acquired and a musical tone that requires a shift operation is played, the shift switching is automatically executed. Also, the method of shift switching is not limited to this. For example, it may be one that performs shift switching at a predetermined timing, or may be set to determine shift switching from the pattern of the piece, and can be set as appropriate.

[0080] The automatic scale shift setting, similar to the case of using the infinite scale, is such that, for example, even without performing a shift operation, an effect similar to having performed a shift operation can be obtained. Also, it is a method different from the infinite scale, and the range of corresponding methods is widened. Therefore, the present apparatus 1 has a great effect as support for operation acquisition.

[0081] (Modification Example 1) This device 1B may be configured to be able to switch not only between the automatic scale movement settings but also, for example, between the infinite scale setting of Embodiment 1 and the automatic scale movement setting. Moreover, without being limited to this, the device 1B may be appropriately set, for example, to be able to switch between normal settings, the infinite scale setting, and the automatic scale movement setting. Here, each process including the infinite scale and the automatic scale movement is referred to as a scale movement process. In other words, the main body 12 of the device 1B includes a scale movement process setting unit 121C. Therefore, the automatic scale movement setting step (S1B) of the device 1B can be read as a scale movement process setting step (S1C). That is, the scale movement process setting unit of the device 1B sets whether to apply the scale movement process. The scale movement process includes the infinite scale and the automatic scale movement. The input target sound input by the input unit 123 is a musical sound that reflects whether to apply the scale movement process to the musical sound assigned to the operator. As described above, in Modification 1 of this embodiment, the "infinite scale" of Embodiment 1 or the "automatic scale movement" of this embodiment is respectively read as the "scale movement process", and the description regarding the above-mentioned scale movement process is added, and the description of the device 1 of Embodiment 1 or the device 1B of this embodiment can be applied. Note that the scale movement process, for example, as the automatic scale movement setting, in the case of a single note, it is an octave movement, but it is not limited to this, and in the case of a chord, it may include a chord change such that the root note constituting the chord matches with at least one operator or more before and after the movement.

[0082] (Modification 2) The configurations of Modification 1 and Modification 2 of Embodiment 1 may also be applied to this embodiment.

[0083] [Embodiment 3] In order to solve the second problem of the present invention, the second invention of the present invention applies an acoustic effect using a pressure sensor disposed at the position of the user's wrist.

[0084] Hereinafter, an example of the configuration of the pleasant sound input device 1C (hereinafter also referred to as "this device 1C") in the present disclosure will be described with reference to FIG. 8. FIG. 8 is a block diagram showing an example of the configuration of this device 1C. As shown in FIG. 8, this device 1C includes, for example, an operator group 11, a main body 12 (a pleasant sound detection unit 122 and an input unit 123), and a pressure sensor 13. In this device 1C, the configurations of the operator group 11 and the main body 12 are the same as those described in other embodiments, and the description thereof can be incorporated herein. However, the configurations of the infinite scale setting unit 121 in Embodiment 1, the automatic scale movement setting unit 121B and the scale movement processing setting unit 121C in Embodiment 2 are arbitrary, and this device 1C may not include these.

[0085] Note that the hardware configuration of the main body 12 is the same as that in Embodiment 1 described with reference to FIG. 5. However, the pressure sensor 13 may be included in the main body 12 as an input device 105. Further, the pressure sensor 13 may be connected to the main body as an external device.

[0086] Next, an example of the pleasant sound input method in the present disclosure will be described with reference to the flowchart of FIG. 9. The pleasant sound input method in the present disclosure is implemented as follows, for example, using this device 1C shown in FIG. 8. Note that the pleasant sound input method in the present disclosure is not limited to the use of this device 1C in FIG. 8.

[0087] First, the pleasant sound detection step (S2) is the same as that in Embodiment 1. Note that the infinite scale setting step (S1) in Embodiment 1, the automatic scale movement setting step (S1B) and the scale movement processing step (S1C) in Embodiment 2 are arbitrary configurations in this embodiment, and this embodiment may or may not include these steps. Therefore, the pressure detection step and the input step will be described below.

[0088] The pressure sensor 13 is arranged at the position of the user's wrist during operation and detects the pressure exerted by the user's wrist (S2B, pressure detection step). The pressure exerted by the wrist is associated with a specific acoustic effect according to the mode of the pressure. Similar to Embodiment 1, in this device 1C, for example, the operator group 11 is composed of five columns of operator rows. Therefore, one unit of the operator group 11 can assign the operation of each operator row to one finger. For example, in the case of the operator group 11c for right - hand operation in FIG. 7, each operator row 116a to 116e arranged from left to right is assigned to the first finger to the fifth finger of the right hand respectively. Therefore, during performance, finger - threading or lateral movement of the palm is not necessary. The same applies to the operator group 11b for left - hand operation. Therefore, for example, in the device 1C shown in FIG. 10, where the operator group 11b for left - hand operation and the operator group 11c for right - hand operation are arranged, the positions of both palms are fixed during performance. Therefore, as shown in FIG. 10, when a pressure sensor is arranged at the position of the wrist, the user of this device 1C can apply the pressure of the wrist to the pressure sensor or sway the wrist while performing.

[0089] The pressure sensor 13 is, for example, as shown in FIG. 10, installed at a position close to the user on the upper surface of the main body 12, with two sensors each, such as 131a and 131b as pressure sensors for left - hand operation, and 132a and 132b as pressure sensors for right - hand operation, capable of detecting the overall pressing pressure, the ratio of left - and - right pressing pressures, etc. for each hand. Note that the pressure sensor is not limited to this, and it may be independent of the main body 12. The shape is not limited, such as a rectangular parallelepiped shape. As long as it can be arranged at the position of the user's wrist and detect the pressure of the wrist, it can be any type. Also, the method of detecting pressure is not limited to the above - mentioned examples. In addition, according to the detected pressure state, set the added acoustic effect. For example, the loudness of the sound may be adjusted according to the degree of the overall pressure of the pressure sensor. Also, for example, when left - and - right swaying is detected, the effect of pitch bend (pitch variation) of the sound may be added. For example, when strong pressure is detected in a certain direction, an effect such as cutting off the played sound short may be added. In this way, the added acoustic effect may be appropriately set according to the pressure situation.

[0090] The input unit 123 of the main body 12 inputs an input target sound with a specific acoustic effect associated with the mode of the pressure based on the pressure of the user's wrist detected by the pressure sensor 13 (S3B). Note that the input of sound by the input unit 123 is the same as that in the case of Embodiment 1 except for adding a predetermined acoustic effect.

[0091] According to the correspondence of this embodiment, the musical sound input device according to the present disclosure can add appropriate acoustic effects to the performance and can increase the degree of freedom of expression related to the performance.

[0092] (Modification example) The configurations of Modification Example 1 and Modification Example 2 of Embodiment 1 may be applied to this embodiment.

[0093] [Embodiment 4] To solve the third problem of the present invention, the third invention of the present invention relates to a performance state display device that displays single tones constituting a chord.

[0094] FIG. 13 is a block diagram showing a configuration of an example of a performance state display device 2 (hereinafter also referred to as "the present device 2") of the present embodiment. As shown in FIG. 11, the present device 2 includes an operation information acquisition unit 21, an operator object generation unit 22, a chord configuration display generation unit 23, a movement display processing unit 24, and an information output unit 25.

[0095] The present device 2 may be, for example, one device including each of the above units, or each of the above units may be a device connectable via the communication line network. Further, the present device 2 can be connected to an external device described later via the communication line network. The communication line network is, for example, the same as described above. Also, the present device 2 may be, for example, a personal computer (PC, for example, a desktop type or a notebook type) installed with the program of the present invention, a smartphone, a tablet terminal, or the like.

[0096] FIG. 12 illustrates a block diagram of the hardware configuration of the present device 2. The hardware configuration of the present device 2 is, for example, as shown in FIG. 12, the central processing unit 201 functions as the operation information acquisition unit 21, the operator object generation unit 22, the chord configuration display unit 23, the movement display processing unit 24, and the information output unit 25, and is the same as the hardware configuration of the musical sound input device 1 shown in FIG. 5 except that the storage unit can use the memory 202 and the storage device 204.

[0097] Next, an example of the performance state display method of the present embodiment will be described based on the flowchart of FIG. 13. The performance state display method of the present embodiment is implemented as follows, for example, using the performance state display device 2 of FIG. 11. Note that the performance state display method of the present embodiment is not limited to the use of the performance state display device 2 of FIG. 11.

[0098] First, the operation information acquisition unit 21 acquires operation information regarding the operation of an operator in a musical sound input device in which musical sounds are assigned to respective operators (S21, operation information acquisition step). The musical sound input device is not particularly limited, but for example, it is preferably at least one of the musical sound input device 1 of Embodiment 1, the musical sound input device 1B of Embodiment 2, the musical sound input device 1C of Embodiment 3, and the musical sound input device 1D of Embodiment 6 described later. Hereinafter, the musical sound input device 1 described in Embodiment 1 will be described as an example. The operation information is, for example, an operator sequence of the operated operator, the position of the operator in the operator sequence, and information regarding the assigned musical sound. The acquisition format is not particularly limited, and for example, it may be acquired via the communication network.

[0099] Next, the operator object generation unit 22 generates operator object information for displaying the operator operated based on the operation information on the display screen (S22, operator object generation step). FIG. 14 is a reference diagram showing an example of a display screen for displaying the performance state. As shown in FIG. 14, in the display screen, for example, a display area 251 is provided for each operator row of the musical sound input device. The operator object 252 is displayed, for example, within the display area 251. The operator object 252 visually confirms the information of the operated operator and the information of the assigned musical sound on the display screen. Therefore, the length of the operator object 252 is adjusted, for example, in accordance with the length of the musical sound corresponding to the operated operator. Further, the shape of the operator object 252 is, for example, a rectangle as shown in FIG. 14, but is not limited thereto. The shape may be, for example, a circle or a triangle, and may be any shape as long as the operation state can be confirmed. Further, the operator object 252 is, for example, an operation by an operator group for right hand operation. When "Do" is operated, it is displayed in the display area corresponding to the leftmost operator row of the operator group for right hand operation to which "Do" is assigned. The operator object 252 may display the musical sound. For example, the operator object 252 for displaying "Do" may display "Do" and the musical sound. Further, the operator object 252 may display the position of the operator in the operator row. The position of the operator may be displayed, for example, inside the operator object 252, or may be displayed outside the operator object 252 after operation and adjacent to the musical sound display. Further, for example, the operator object 252 may be displayed in a unified color for each of the upper, middle, and lower positions in the operator row, and the color of the operator object 252 may be displayed in the color assigned to the corresponding position. The above example is an example of the operator object 252. The operator object 252 is not particularly limited, for example, in terms of shape, length, color, elements to be displayed, etc., and may be any as long as the operation state of the musical sound input device can be grasped.

[0100] Next, when an operator assigned with a chord is operated, the chord composition display generation unit 23 generates chord composition display information for displaying the single tones that make up the chord on the display screen (S23, chord composition display generation step). As shown in FIG. 14, when an operator is operated, an operator object 27 related to the operator corresponding to the operation is generated. For example, in the operator group for left hand operation, when the chord of "C" is operated, on the display screen, the operator object 252 is displayed in the display area related to the rightmost operator column for left hand operation. In this way, when the musical tone corresponding to the operated operator is a chord, the chord composition display generation unit 23 generates information related to the display of the single tones that make up the chord. For example, when the operator of "C" is operated, the displays of the operators of "do, mi, so" that make up the chord of "C" are generated. The display of each operator is displayed in a manner distinguishable from the operator object 252, such as changing the color and displaying it in the display area 251 of the operator object 252, or only displaying the frame. Also, for example, as shown in FIG. 14, a method of showing the layout diagram of the operator group at the lower part of the display screen and brightening the corresponding operator display part in the layout diagram may be used. The display of each operator is not limited to the above examples, and any display that allows the single tones that make up the operated chord to be confirmed may be used.

[0101] Next, the movement display processing unit 24 generates screen movement information for moving the display position of the display screen according to the operation state in the music input device (S24, movement display processing step). The display screen displays, for example, the position during the performance of the music being performed. For this reason, the display screen needs to move according to, for example, the performance position and show the corresponding part during the performance. In FIG. 14, a timing line 253 is provided, and the timing line 253 indicates the position at the performance time. In FIG. 14, the operator object 252 is displayed at the part of the timing line 253 when the operator is operated, and moves upward on the display screen, for example, in accordance with the tempo of the music. Thereby, on the display screen, for example, the current operation state can be grasped and the flow of the music can be confirmed. The movement of the display screen is not limited to upward movement, and may move in any direction, such as downward, rightward, or leftward. Also, the display screen may be displayed three-dimensionally using, for example, augmented reality (AR) technology. In this case, for example, the movement direction of the operator object 252 or the like may move closer to the viewer or move away into the distance. Thus, the movement of the display screen may be anything as long as, for example, the operation state, the flow of the sound, etc. can be confirmed. The movement display processing unit 24 generates information for controlling the movement of the display screen as described above.

[0102] Next, the information output unit 25 outputs the operation state information of the music input device (S25, information output step). The operation state information includes information regarding the display screen that reflects the operator object information, chord composition display information, and screen movement information. The information output unit 25, for example, displays operator objects on a display screen having a display area corresponding to the configuration of the operator group, and when there is chord composition information, displays the chord composition information, and displays a display screen whose display position moves in accordance with the tempo of the music or the like. Note that the display method on the display screen is not limited to this, and for example, it is as described in the above description regarding each element to be reflected. The output by the information output unit 25 is not limited to the display on the display screen, and for example, input target information input based on the operation of an operator in the music input device may be output as operation state information to a speaker or the like. The present device 2 may include, for example, a playback mechanism such as a speaker. Then, the playback mechanism plays back the sound input from the music input device. Further, the present device 2 may be connected to an external playback device (such as a speaker, earphone, headphone, etc.) and play back the sound input from the music input device 1 from the external playback device.

[0103] As described above, the performance state display device according to the present disclosure can confirm the content played using the music input device. Further, when a chord is operated, the single tones constituting the chord can be confirmed. Confirming the single tones constituting the chord helps to grasp the single tones suitable for the chord and aids in considering the melody. Therefore, the range of utilization of the music input device can be expanded.

[0104] (Modification Example 1) The device 2 may obtain allocation information regarding the allocation of musical sounds to the respective operators from a musical sound input device in which musical sounds are allocated to the respective operators, and perform setting of the display screen configuration based on the allocation information. In Modification 1, the device 2 further includes an allocation information acquisition unit 26 and a display screen setting unit 27. Other configurations are the same as those of the aforementioned device 2. Therefore, regarding the configuration, hardware configuration, and display screen setting method of the device 2 according to Modification 1 of the present embodiment, the description of the aforementioned device 2 can be cited except for the configurations of the allocation information acquisition unit 26 and the display screen setting unit 27. Therefore, the allocation information acquisition unit 26 and the display screen setting unit 27 will be described below.

[0105] The allocation information acquisition unit 26 acquires allocation information regarding the allocation of musical sounds to the respective operators from a musical sound input device in which musical sounds are allocated to the respective operators. The allocation information is, for example, the arrangement of the operator sequence, the arrangement of the operators within the operator sequence, the musical sounds allocated to the operators, and the like. The allocation information is not limited to this, and may include any information as long as it is information necessary for grasping the allocation status of musical sounds to the operators.

[0106] Next, the display screen setting unit 27 performs setting of the display screen configuration based on the allocation information. The display screen configuration is, for example, the display order of the operator sequence, the display position of the operator object 252, the items to be displayed on the display screen, and the like. The display screen configuration is not limited to this, and may include any configuration as long as it is a configuration necessary for grasping the operation state of the operator, such as, for example, the setting of augmented reality (AR). In this case, the operation state information output by the information output unit 25 includes a display screen that reflects the setting of the display screen configuration.

[0107] For example, when the assignment of musical sounds to the operators of the musical sound input device is fixed and the present device 2 is dedicated to the musical sound input device, the setting of the display screen may be set in advance, and the display screen setting unit 27 or the like is not necessary. However, when the musical sound input device can change the setting status of musical sounds, for example, can switch between single notes and chords, can select the assignment of musical sounds from patterns, can arbitrarily set musical sounds, etc., the present device 2 also needs to be able to cope with the change. Therefore, the configuration of Modification Example 1 of the present embodiment is useful, for example, when the display content of the display screen changes with the change of the musical sound assignment of the musical sound input device.

[0108] (Modification Example 2) The present device 2 may include a configuration that acquires information related to a musical score and teaches an operation according to the musical score. In Modification Example 2, the present device 2 further includes a musical score information acquisition unit 28. Modification Example 2 is the same as the above-described present device 2 except for the configuration that teaches an operation according to the musical score. Therefore, the configuration and hardware configuration of the present device 2 in Modification Example 2 of the present embodiment can refer to the description of the above-described present device 2 except for adding the musical score information acquisition unit 28. Also, the performance state display method of the present device 2 in Modification Example 2 of the present embodiment can refer to the description of the above-described present device 2 except for the part that teaches an operation according to the musical score. Therefore, hereinafter, the musical score information acquisition unit 28 and the teaching of an operation according to the musical score will be described.

[0109] First, the score information acquisition unit 28 acquires score information regarding the score. The score information may include chord progression information regarding the chord progression. The score information is, for example, stored in the storage unit of the musical sound input device. The acquisition of the score information is not limited to acquisition from the musical sound input device, and may be, for example, stored in this device 2, or may be acquired from an external database via a communication line, or may be any kind of information. Note that it is desirable that the score related to the score information is, for example, adapted to the musical sound input device. However, the score is not limited to this. The score may be, for example, information of a normal score such as pitch, rhythm, tempo, dynamics, etc., as long as it can be converted into information on the operation of the operator of the musical sound input device in this device 2. Thus, the score related to the score information may be any kind of score as long as it can specify the operation of the operator, for example.

[0110] Next, the operator object generation unit 22 generates teaching object information for teaching the operation of the operator corresponding to the musical sound included in the score information. The operator object of this device 2 is, for example, the operation status of the operator in the musical sound input device, that is, the specification of the operator sequence, the specification of the position of the operator within the operator sequence, the length and pitch of the musical sound, etc. The teaching object information replaces the operation status of the operator in the musical sound input device with the information of the score. That is, the teaching object information is, for example, the specification of the operator sequence, the specification of the position of the operator within the operator sequence, the length and pitch of the musical sound, etc., which are necessary for playing the music related to the score. The operator object generation unit generates the teaching object based on the score information.

[0111] Next, when the chord progression information regarding the chord progression is included in the score information, the chord constitution display generation unit 23 generates chord constitution display information for displaying the single notes that constitute the chord on the display screen. The chord constitution display information in this case is, for example, the information of the single notes that constitute the chord generated as the teaching object information. By generating the chord constitution display information, the user can simultaneously confirm the display of the chord indicated by the teaching object information and the display of the constituent notes of the chord.

[0112] Next, the movement display processing unit 24 generates teaching screen position information for moving the display position of the display screen according to the position of the teaching part in the score. The above-mentioned screen movement information of the apparatus 2 is, for example, to move the operator object with the timing line 253 as the viewpoint based on the operation time in the musical sound input device. The teaching screen position information is to display the teaching object in advance from a certain time before, and move the teaching object so that it reaches the timing line 28 at the time when the operation should be performed with the timing line 253 as the end point. The teaching screen position information may be, for example, to stop the operator on the timing line 253 when the user is not operating the corresponding operator at the time when the operator should be operated. When using the function of score teaching, the movement display processing unit 24 may generate information for performing any control regarding the movement of the display screen as long as it is necessary for score teaching.

[0113] Next, similar to the description of the present apparatus 2 in the foregoing of this embodiment, the information output unit 25 outputs the operation state information of the musical sound input device. Then, the operation state information includes information regarding the display screen that reflects the teaching object information, the chord constitution display information, and the teaching screen position information. Note that also in Modification 2, the operation state information may be output to a speaker or the like to reproduce musical sounds. In this case, the chords related to the chord constitution display information may be reproduced by a speaker or the like. That is, the present apparatus 2 when used as a function of musical score teaching, for example, acquiring musical score information, the displayed object being based on the musical score information, when the musical score information includes chord progression information, a chord constitution corresponding to the chord progression information being displayed, the movement of the operation screen being by a method suitable for musical score teaching, etc. are different from when used as a performance state display device. Other aspects are the same as when used as a performance state display device, so the description of the present apparatus 2 in the foregoing embodiment can be incorporated.

[0114] According to the form of Modification 2, it is possible to teach the user operations based on musical score information. Also, it is possible to confirm the progression of chords included in the musical score information and, at the same time, confirm the single tones that constitute the chords. Therefore, the present apparatus 2 of Modification 2 can assist the user in efficiently acquiring operations.

[0115] [Embodiment 5] In order to solve the fourth problem of the present invention, the fourth invention of the present invention relates to a musical score that facilitates grasping of the operation of a musical sound input device.

[0116] The musical score 3 of this embodiment corresponds to a musical sound input device provided with an operator group. The operator group includes five operator columns. Further, the operation column is composed of one or more operators, and stage information corresponding to the position is assigned. The musical sound is assigned to each position where the stage information of the operator column is assigned to the operator. Therefore, the musical score 3 of this embodiment is a musical score for a musical sound input device including five columns of operator columns and an operator group having stages within the operator columns. Also, the performance method of the assigned musical sound can be confirmed, for example, by specifying the operator column and the stage (position within the operator column) of the operator. The musical score 3 includes a display area, a display of musical sounds, a display of operator columns, and a display of stage information. The display area 31 includes at least one of a main melody area 311 for displaying the main melody and a harmony area 312 for displaying harmony. The display of musical sounds is arranged at positions with a certain interval corresponding to the beat of the music in the corresponding display area 31. Therefore, if the musical sound corresponding to the operator to be operated is a single note, the display of the musical sound is arranged in the main melody area. The display of the operator column is displayed adjacent to the display of the musical sound. And the display of the stage information is a visual identification display for identifying the stage information, which is applied to the arrangement portion of the display of the musical sound in the display area. The portion related to the display position of the musical sound in the display area 31 has a visual identification display for identifying the stage in the operator column. The visual identification display is, for example, color-coded corresponding to the color of the stage of the operator of the musical sound input device. Note that the present invention is not limited to this, and the visual identification display may, for example, divide the display portion of the musical sound in the display area 31 with a pattern such as a diagonal line.

[0117] The musical score 3 may include a display of a scale movement instruction. The display of the scale movement instruction may be displayed adjacent to the display of the musical sound corresponding to the musical sound accompanied by a scale movement during operation. The display method of the scale movement instruction display is, for example, displayed at the upper part or the lower part of the sound display area 31. For example, the upper display indicates a shift operation to raise one octave, and the lower display indicates a shift operation to lower one octave. The display method is not limited to the above examples, and any display can be used as long as the display can indicate the shift operation.

[0118] In the method for creating the musical score 3 of this embodiment, in the musical score 3 including at least one of the main melody area 311 for displaying the main melody and the harmony area 312 for displaying the harmony, the display of the musical sound is arranged at positions with a certain interval corresponding to the tempo of the music in the display area 31 corresponding to the type. The display of the operator sequence is displayed adjacent to the display of the musical sound, and a visual identification display for identifying the stage of the operator sequence is added to the part related to the display position 31 of the musical sound. Further, a display for instructing a shift operation may be added to the musical score 3.

[0119] An example of the musical score 3 will be described with reference to FIG. 15. In FIG. 15, the display area 31 is composed of two areas, the upper part is the main melody area 311, and the lower part is the harmony area 312. FIG. 15 shows the display for two measures, and there are four quarter notes in one measure. The display of "Do, Re, Mi, Fa" in the left measure of the upper part is the display of single-note musical sounds. The display of "C, G" in the left measure of the lower part is the display of harmony musical sounds. The single note on the upper left is a quarter note, and the harmony on the lower left is a half note. Therefore, the display position 31 of the sound is at an interval corresponding to the interval of the sound. In the upper part, numbers are displayed in the column outside adjacent to the upper part of the display of the musical sound. In the lower part, numbers are displayed in the column outside adjacent to the lower part of the display of the sound. Each of the numbers indicates the position from the left in the operator group of the operator sequence. Further, the part of "Fa" on the upper left is marked with a right-rising diagonal line. Furthermore, the part of "Si" on the upper right is marked with a left-rising diagonal line. Each of the diagonal lines indicates the stage of the operator configuration. The right-rising diagonal line of "Fa" is the display of the top state (specification of the upper operator), and the left-rising diagonal line of "Si" is the display of the bottom state (specification of the lower operator). Thus, in the score 3 of this embodiment, the display of the sound, the display of the operator sequence, and the stage in the operator sequence are displayed. Note that a bar display is provided above "Si, Do" on the upper right. The upper bar display indicates an instruction for a shift operation to raise one octave.

[0120] [Embodiment 6] To solve the fifth problem of the present invention, the fifth invention of the present invention relates to a musical sound input device capable of automatically designating chords and playing chords only by matching the timing, and a performance instruction device that outputs information on the designated chord progression to the musical sound input device and displays the chord progression and the like on a display screen.

[0121] [Embodiment 6-1] First, the musical sound input device in this embodiment will be described. That the musical sound input device in this embodiment includes an operator group and a main body is the same as that of the musical sound input device in other embodiments. Also, that musical sounds are individually assigned to each operator is the same as in other embodiments. Thus, since the configuration of the operators is the same as in other embodiments, the description thereof can be incorporated by reference. Further, it may include the configurations of Modifications 1 and 2 of Embodiment 1.

[0122] The operator group in this embodiment includes a chord operator group and a single-note operator group. The chord operator group and the single-note operator group are arranged on the upper surface of the main body and include a plurality of operators, similar to the operator group in other embodiments. The plurality of operators in the chord operator group are individually assigned chord musical sounds. Also, the plurality of operators in the single-note operator group are individually assigned single-note musical sounds. Then, by operating the operators constituting the single-note operator group, the main melody is played, and at the same time, by operating the operators constituting the chord operator group, chords are played. In the case of beginners, for example, playing the main melody and playing chords at the same time is a considerable burden. Further, playing while checking the positions of the operators to which chords are assigned is particularly burdensome. Therefore, in this embodiment, for example, chords matching the chord progression of a music piece are assigned to all the operators constituting the chord operator group. As a result, for any operator in the chord operator group, for example, chords matching the music piece can be played by operating any operator. That is, playing chords becomes possible only by matching the timing of, for example, the music piece. In this way, the musical sound input device of this embodiment serves as a bridge for, for example, acquiring two-handed performance by facilitating the playing of chords.

[0123] Hereinafter, an example of the configuration of the pleasant sound input device 1D (hereinafter also referred to as "this device 1D") in the present disclosure will be described with reference to FIG. 16. FIG. 16 is a block diagram showing an example of the configuration of this device 1D. As shown in FIG. 16, this device 1D includes, for example, an operator group 11 and a main body 12 (a pleasant sound detection unit 122, an input unit 123, a performance assistance setting unit 127, a performance assistance information acquisition unit 128, and an auxiliary pleasant sound assignment unit 129). In this device 1D, the configurations of the operator group 11 and the main body 12 are the same as those described in other embodiments, and the description thereof can be incorporated herein. However, the configurations of the infinite scale setting unit 121 in Embodiment 1, the automatic scale movement setting unit 121B, the scale movement processing setting unit 121C, and the pressure sensor 13 in Embodiment 2 are arbitrary, and this device 1D may not include these.

[0124] Note that the hardware configuration of the main body 12 is the same as that in the case of Embodiment 1 described with reference to FIG. 5, except that, for example, the central processing unit 101 functions as the performance assistance setting unit 127, the performance assistance information acquisition unit 128, and the auxiliary pleasant sound assignment unit 129, and the storage unit can use the memory 102 and the storage device 104. Therefore, the description thereof can be incorporated herein.

[0125] Next, an example of the pleasant sound input method of this embodiment will be described based on the flowchart of FIG. 17. The pleasant sound input method of this embodiment is implemented as follows, for example, using this device 1D in FIG. 16. Note that the pleasant sound input method of this embodiment is not limited to the use of this device 1D in FIG. 16.

[0126] First, the performance assistance setting unit 127 sets whether to apply the performance assistance setting (S1B, performance assistance setting step). The performance assistance setting includes settings for assisting in performing chord performances according to the chord progression in accordance with the tempo of the music. The performance assistance setting is, for example, a setting for assigning the chords to be used in accordance with the progression of the music to the operators in accordance with the tempo of the music.

[0127] Next, when the performance assistance setting is applied, the performance assistance information acquisition unit 128 acquires performance assistance information including information on the chord progression (S1C, performance assistance information acquisition step). The performance assistance information is information for executing the performance assistance setting. Therefore, the performance assistance information is, for example, information for assigning chords used in a piece of music to operators according to the tempo of the piece of music. The performance assistance information is acquired, for example, from a performance instruction device described later. Note that the acquisition of the performance assistance information is not limited to this, and may be acquired from an external database, for example, or may be acquired from data stored in the storage unit of the present apparatus 1D, and any method may be used.

[0128] When the performance assistance information acquisition unit 128 acquires the performance assistance information, the auxiliary musical tone assignment unit 129 assigns musical tones based on the performance assistance information to all the operators constituting the chord operator group instead of the chords individually assigned to the plurality of operators of the chord operator group (S1D, auxiliary musical tone assignment step). As described above, the operator group of the present apparatus 1D includes a chord operator group to which chords are assigned and a single-tone operator group to which single tones are assigned. When the performance assistance setting is applied, the performance assistance information acquisition unit 128 acquires the performance assistance information. In this case, the auxiliary musical tone assignment unit 129 assigns the same chord related to the performance assistance information to each operator of the chord operator group, for example, instead of the individual chords assigned to each operator of the chord operator group. As a result, the user can play the chord related to the performance assistance information regardless of which operator of the chord operator group is operated.

[0129] When the performance assistance setting is applied, the user can play chords, for example, simply by operating any one of the chord operators in accordance with the rhythm of the music. Therefore, the rhythm of the music may be taught to the user, for example, by a method of displaying it on a performance instruction device described later. Further, when the operator of the chord operator group includes an operator-side display unit, for example, in accordance with the timing of performance, the operator may display chords on the operator-side display unit to teach the user the rhythm of the music. When the operator-side display unit emits light, for example, the operator may teach the timing to the user with light. Further, for example, when the present device 1D is configured to emit sound, the present device 1D may teach the user the timing of the operation with sound. The method of teaching the user the rhythm of the music is not limited to the above examples and may be any method. Thus, the present device 1D may include, for example, means for teaching the user the rhythm of the music, or may be connected to an external device that teaches the user the rhythm of the music. As a result, the user can play chords without worrying about the position of the operator corresponding to the chords used in the music.

[0130] The musical sound detection unit 122 detects an input target sound corresponding to the operated operator (S2, musical sound detection step). The input target sound is a musical sound assigned to the operator. When the performance assistance setting is applied, the chord related to the performance assistance information assigned to each operator of the chord operator group becomes the input target sound.

[0131] The input unit 123 inputs the input target sound (S3, input step). Since the input of the input target sound is the same as that in other embodiments, the description thereof can be incorporated by reference.

[0132] Thus, according to the musical sound input device of the present embodiment, the user can perform a chord performance without being concerned about the position of the operator to which the chord is assigned. For example, in the case of a beginner, it is a heavy burden to play the main melody with one hand and the chords with the other hand. In particular, for example, it is difficult to perform the main melody performance while checking the position of the operator for playing the chords. Therefore, for example, being able to play the chords only by timing without checking the position of the operator to which the chords are assigned serves as a bridge for the user to acquire two-handed performance. The musical sound input device of the present embodiment has the effect of facilitating the acquisition of two-handed performance by the user.

[0133] [Embodiment 6-2] Next, the performance teaching device in the present embodiment will be described. The performance teaching device in the present embodiment outputs the performance assistance information to the musical sound input device and displays information regarding the chord progression on the display screen to teach the user chord performance.

[0134] Hereinafter, an example of the configuration of the performance teaching device 4 (hereinafter, also referred to as "the present device 4") in the present disclosure will be described with reference to FIG. 18. FIG. 18 is a block diagram showing an example of the configuration of the present device 4 of the present embodiment. As shown in FIG. 18, the present device 4 includes a musical score information acquisition unit 41, a performance assistance method output unit 42, an operator object generation unit 43, a movement display processing unit 44, and an information output unit 45.

[0135] The present device 4 may be, for example, one device including each of the above units, or each of the above units may be a device connectable via the communication network. Further, the present device 4 can be connected to an external device described later via the communication network. The communication network is, for example, the same as described above. Also, the present device 4 may be, for example, a personal computer (PC, for example, a desktop type, a notebook type) installed with the program of the present invention, a smartphone, a tablet terminal, or the like.

[0136] FIG. 19 illustrates a block diagram of the hardware configuration of the present apparatus 4. The hardware configuration of the present apparatus 4 is the same as that of the musical sound input device 1 shown in FIG. 5, except that, for example, as shown in FIG. 19, the central processing unit 401 functions as the musical score information acquisition unit 41, the performance assistance method output unit 42, the operator object generation unit 43, the movement display processing unit 44, and the information output unit 45, and the storage unit can use the memory 402 and the storage device 404.

[0137] Next, an example of the performance teaching method of the present embodiment will be described based on the flowchart of FIG. 20. The performance teaching method of the present embodiment is implemented as follows, for example, using the present apparatus 3 shown in FIGS. 18 and 19. Note that the performance teaching method of the present embodiment is not limited to the use of the present apparatus 3 shown in FIGS. 18 and 19.

[0138] First, the musical score information acquisition unit 41 acquires musical score information regarding a musical score including performance assistance information (S41, musical score information acquisition step). The performance assistance information includes information regarding the chord progression. The acquisition of the musical score information is the same as the acquisition of the musical score information in the performance state display device shown in Modification Example 2 of Embodiment 4. Note that in the present embodiment, the musical score information includes performance assistance information.

[0139] Next, the performance assistance information output unit 42 outputs the performance assistance information to a musical sound input device in which musical sounds are assigned to a plurality of operators (S42, performance assistance information output step). The musical sound input device is, for example, the present apparatus 1D of Embodiment 6-1. Note that the musical sound input device is not limited to the present apparatus 1D, and any musical sound input device to which performance assistance settings can be applied may be used.

[0140] Next, the operator object generation unit 43 generates instruction object information for instructing the operation of the operator corresponding to the musical sound included in the musical score information and the chord progression (S43, operator object generation step). The generation of the instruction object information is the same as the generation of the instruction object in the performance state display device shown in Modification Example 2 of Embodiment 4. However, the configuration related to the display of the constituent sounds of the chord may be arbitrary, and it may not include this configuration. Also, in the present embodiment, for example, the instruction object information related to the chord is based on the performance assistance information. In Modification Example 2 of Embodiment 4, the chord instruction object is displayed in the display area of the operator sequence to which the chord is assigned. In contrast, in the present embodiment, for example, based on the performance assistance information, the same chord is assigned to all the operators in the chord operator group, so the chord instruction object has a shape that spans the display areas of all the operators in the chord operator group. Note that the shape of the chord instruction object is not limited to this, and for example, it may be displayed only in an arbitrary display area, and may be any shape.

[0141] Next, the movement display processing unit 44 generates instruction screen position information for moving the display position of the display screen according to the position of the instruction part in the musical score (S44, movement display processing step). The instruction position information is the same as the instruction position information in Modification Example 2 of Embodiment 4.

[0142] Next, the information output unit 45 outputs the performance instruction information of the musical sound input device (S45, information output step). The performance instruction information includes the instruction object information and information regarding the display screen that reflects the screen movement information. Therefore, by outputting the instruction information, for example, the display screen displays information regarding the chord progression based on the performance assistance information to teach the user the content of the chord progression in accordance with the rhythm of the music. Further, the information output unit 45 may output information for teaching the timing of chord performance, for example, by emitting light from the display screen. Furthermore, the information output unit 45 may output information for causing an external device such as a speaker to emit a sound for teaching the timing of chord performance. In this way, the information output unit 45 outputs information for teaching, for example, the content of the chord to be performed and the timing of performance.

[0143] According to the performance instruction device of the present embodiment, it is possible to teach the user chord performance based on the performance assistance information. Therefore, by using it together with a musical sound input device to which performance assistance settings are applied, the acquisition of performance by both hands by the user becomes more efficient.

[0144] Hereinafter, an example of a specific flow of a performance instruction method using the musical sound input device (this device 1D) and the performance instruction device (this device 4) in the present embodiment will be described. Note that the chord performance instruction method of the present embodiment is implemented using, for example, this device 1D and this device 4, but is not limited thereto. The performance instruction method may be by, for example, either one of this device 1D and this device 4, or may not use these devices. Further, the performance instruction method is not limited to the following description.

[0145] First, the performance assistance setting unit 127 of the present device 1D performs settings for applying performance assistance settings. Then, the score information acquisition unit 41 of the present device 4 acquires score information. The score information includes performance assistance information. The performance assistance information output unit 42 of the present device 4 outputs the performance assistance information to the present device 1D. The performance assistance information acquisition unit 128 of the present device 1D acquires the performance assistance information. Note that the output and acquisition of the performance assistance information may be performed collectively, for example, before the start of performance, or may be performed each time according to the timing of performance. Then, the auxiliary musical tone assignment unit 129 of the present device 1D assigns the same harmony based on the performance assistance information to all the operators of the harmony operator group of the present device 1D. The operator object information generation unit 43 of the present device 4 generates an instruction object. Also, the movement display processing unit 44 of the present device 4 generates instruction screen position information. Then, the information output unit 45 of the present device 4 outputs information for displaying an instruction object and a display screen on which the screen moves in accordance with the rhythm of the music, and the display screen is displayed.

[0146] FIG. 21 is a reference diagram showing an example of the display screen of the performance instruction device (this device 4). In the operator group of this device 1D, chords are assigned to the operator group for left hand operation, and single notes are assigned to the operator group for right hand operation. Therefore, in FIG. 21, chord displays are shown on the left side, and single note displays are shown on the right side. In addition, a display area for instruction objects is provided at the upper part of the display screen of FIG. 21, and the instruction objects move downward in accordance with the flow of the music. Further, the arrangement of the operators of this device 1D is shown at the lower part of the display screen. Since musical tones are arranged based on the performance assistance information in the arrangement of the operators on the left side, it is a display that groups the operator groups together. In the arrangement of the operators on the right side, the musical tones arranged on each operator are shown. In FIG. 21, instruction objects spanning each operator column are shown in the left display area. In the right display area, instruction objects related to the main melody of the music are shown, and the displays of the operators that require operations are shown. The user can check the display screen to grasp the operations of the operators for right hand operation to play the main melody and also grasp the timing of playing chords. The display screen of FIG. 21 shows the operation of the operator located in the middle of the leftmost operator column that is first operated with the first finger for the operator for right hand operation, indicating that the assigned musical tone is "do". The display screen shows the timing of the operation for the operator for left hand operation, indicating that the first assigned chord is "C". The user performs the operations of both hands according to the display screen. At this time, for the left hand that operates the chords, any operator in the operator group for left hand operation may be operated. Therefore, the user does not need to care about the position of the operator operated by the left hand.

[0147] According to this embodiment, the user can play chords without worrying about the position of the operator for operating the chords. In this case, since the user can play the chords only by matching the timing for chord playing, for example, it is possible to easily perform playing with both hands and to get used to playing with both hands. Therefore, using the musical sound input device and the performance instruction device of this embodiment has an effect of serving as a bridge for performing the original two-handed performance in which musical sounds are individually assigned to the operators of each of the two operator groups. As a result, this embodiment can facilitate the user's performance acquisition.

[0148] [Embodiment 7] The program according to the first-first invention is a program for causing a computer to execute each step of the above-described musical sound input method. Specifically, the program in the present disclosure is a program for causing a computer to execute, for example, an infinite scale setting procedure, a musical sound detection procedure, and an input procedure.

[0149] Each of the above procedures is implemented using a musical sound input device including an operator group and a main body. The operator group is arranged on the upper surface of the main body and includes a plurality of operators. Musical sounds are individually assigned to the plurality of operators. The infinite scale setting procedure sets the presence or absence of application of an infinite scale. The musical sound detection procedure detects an input target sound corresponding to the operated operator in a musical sound input device in which musical sounds are assigned to a plurality of operators. The input target sound is a musical sound that reflects the presence or absence of application of the infinite scale with respect to the musical sound assigned to the operator. The input procedure inputs the input target sound.

[0150] Also, the program according to the first-first invention can also be said to be a program that causes a computer to function as, for example, an infinite scale setting procedure, a musical sound detection procedure, and an input procedure.

[0151] The program according to the first and second inventions is a program for causing a computer to execute each step of the above-described musical sound input method. Specifically, the program in the present disclosure is a program for causing a computer to execute, for example, an automatic scale movement setting procedure, a musical sound detection procedure, and an input procedure.

[0152] Each of the above procedures is implemented using a musical sound input device including an operator group and a main body. The operator group is disposed on the upper surface of the main body and includes a plurality of operators. The plurality of operators have musical sounds individually assigned thereto. The automatic scale movement setting procedure sets whether or not to apply automatic scale movement. The musical sound detection procedure detects an input target sound corresponding to the operated operator in a musical sound input device in which musical sounds are assigned to a plurality of operators. The input target sound is a musical sound that reflects whether or not to apply the automatic scale movement to the musical sound assigned to the operator. The input procedure inputs the input target sound.

[0153] Also, the program according to the first and second inventions can also be said to be a program for causing a computer to function as, for example, an automatic scale movement setting procedure, a musical sound detection procedure, and an input procedure.

[0154] The program according to the second invention is a program for causing a computer to execute each step of the above-described musical sound input method. Specifically, the program in the present disclosure is a program for causing a computer to execute, for example, a musical sound detection procedure, a pressure detection procedure, and an input procedure.

[0155] Each of the above procedures is implemented using a musical sound input device including an operator group, a main body, and a pressure sensor. The operator group is disposed on the upper surface of the main body and includes a plurality of operators. The plurality of operators have musical sounds individually assigned thereto. The musical sound detection procedure detects an input target sound corresponding to the operated operator in a musical sound input device in which musical sounds are assigned to a plurality of operators, The input target sound is the musical sound assigned to the operator, The pressure detection procedure uses the pressure sensor arranged at the position of the user's wrist during operation to detect the pressure by the user's wrist, The pressure by the wrist is associated with a specific acoustic effect according to the mode of the pressure, The input procedure inputs the input target sound with the acoustic effect added.

[0156] Also, the program according to the second invention can also be said to be a program that causes a computer to function as, for example, a musical sound detection procedure, a pressure detection procedure, and an input procedure.

[0157] The program according to the third invention is a program for causing a computer to execute each step of the above-described performance state display method. Specifically, the program in the present disclosure is a program for causing a computer to execute, for example, an operation information acquisition procedure, an operator object generation procedure, a chord composition display generation procedure, a movement display processing procedure, and an information output procedure.

[0158] The operation information acquisition procedure acquires operation information regarding the operation of each operator in a musical sound input device in which musical sounds are assigned to each operator, The operator object generation procedure generates operator object information for displaying the operator operated based on the operation information on the display screen, The chord composition display generation procedure generates chord composition display information for displaying the single sounds constituting the chord on the display screen when an operator assigned with a chord is operated, The movement display processing procedure generates screen movement information for moving the display position of the display screen according to the operation state in the musical sound input device, The information output procedure outputs the operation state information of the musical sound input device, The operation state information includes information regarding the display screen that reflects the display settings, the operator object information, the chord composition display information, and the screen movement information.

[0159] Also, the program according to the third invention can be said to be a program that causes a computer to function as, for example, an operation information acquisition procedure, an operator object generation procedure, a chord composition display generation procedure, a movement display processing procedure, and an information output procedure.

[0160] The program of the musical sound input method according to the fifth invention is a program for causing a computer to execute each step of the musical sound input method described above. Specifically, the program in the present disclosure is a program for causing a computer to execute, for example, a performance assistance setting procedure, a performance assistance information acquisition procedure, an auxiliary musical sound assignment procedure, a musical sound detection procedure, and an input procedure.

[0161] Each of the above procedures is implemented using a musical sound input device including an operator group and a main body. The operator group includes a chord operator group and a single note operator group. The chord operator group and the single note operator group are arranged on the upper surface of the main body and include a plurality of operators. The plurality of operators in the chord operator group are individually assigned musical sounds of chords. The plurality of operators in the single note operator group are individually assigned musical sounds of single notes. The performance assistance setting procedure sets whether or not to apply the performance assistance setting. The performance assistance setting includes a setting for assisting in performing chord performances according to a chord progression in accordance with the tempo of a piece of music. The performance assistance information acquisition procedure acquires performance assistance information including information regarding the chord progression when the performance assistance setting is applied. When the performance assistance information is acquired in the performance assistance information acquisition step, the auxiliary musical sound assignment procedure assigns musical sounds based on the performance assistance information to all the operators constituting the chord operator group instead of the chords individually assigned to the plurality of operators in the chord operator group. The musical sound detection procedure detects an input target sound corresponding to the operated operator, The input target sound is a musical sound assigned to the operator, The input procedure inputs the input target sound.

[0162] Also, the program of the musical sound input method according to the fifth invention can also be said to be a program that causes a computer to function as, for example, a performance assistance setting procedure, a performance assistance information acquisition procedure, an auxiliary musical sound assignment procedure, a musical sound detection procedure, and an input procedure.

[0163] The program of the performance instruction method according to the fifth invention is a program for causing a computer to execute each step of the performance instruction method described above. Specifically, the program in the present disclosure is a program for causing a computer to execute, for example, a musical score information acquisition procedure, a performance assistance information output procedure, an operator object generation procedure, a movement display processing procedure, and an information output procedure.

[0164] The musical score information acquisition procedure acquires musical score information regarding a musical score including performance assistance information, The performance assistance information includes information regarding the chord progression, The performance assistance information output procedure outputs the performance assistance information to a musical sound input device in which musical sounds are assigned to a plurality of operators, The operator object generation procedure generates teaching object information that teaches the operation of the operator corresponding to the musical sound included in the musical score information and the chord progression, The movement display processing procedure generates teaching screen position information for moving the display position of the display screen according to the position of the teaching part in the musical score, The information output procedure outputs performance instruction information of the musical sound input device, The performance instruction information includes the teaching object information and information regarding the display screen reflecting the screen movement information.

[0165] Also, the program of the performance instruction method according to the fifth invention can also be said to be a program that causes a computer to function as, for example, a musical score information acquisition procedure, a performance assistance information output procedure, an operator object generation procedure, a moving display processing procedure, and an information output procedure.

[0166] Each program in the present disclosure can incorporate the descriptions in the sound input device and sound input method of the present invention, as well as the performance state display device and performance state display method. Each of the above procedures can, for example, have the "procedure" read as "processing". Also, the program of the present embodiment may be recorded, for example, on a computer-readable recording medium. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited and examples include random access memory (RAM), read-only memory (ROM), hard disk (HD), flash memory (e.g., solid state drive (SSD), USB flash memory, SD / SDHC card, etc.), optical disk (e.g., CD-R / CD-RW, DVD-R / DVD-RW, BD-R / BD-RE, etc.), magneto-optical disk (MO), floppy (registered trademark) disk (FD), etc. Also, the program of the present embodiment (also referred to as a programming product or program product, for example) may be in a form distributed from an external computer. The "distribution" may be, for example, distribution via a communication network or distribution via a device connected by wire. The program of the present embodiment may be installed and executed on the distributed device or may be executed without installation.

[0167] The present invention has been described with reference to the embodiments above, but the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

Industrial Applicability

[0168] According to the present disclosure, the cognitive load for operating acquisition of a musical sound input device is reduced. For this reason, the present disclosure is extremely useful, for example, for a user who is not accustomed to musical instrument performance.

Explanation of Signs

[0169] 1, 1B, 1C, 1D Musical sound input device 11 Operator group 12 Main body 13 Pressure sensor 121 Infinite scale setting unit 122 Musical sound detection unit 123 Input unit 124 Musical sound allocation unit 125 Mode selection unit 127 Performance assistance setting unit 128 Performance assistance information acquisition unit 129 Auxiliary musical sound allocation unit 2 Performance state display device 21 Operation information acquisition unit 22 Operator object generation unit 23 Harmony composition display generation unit 24 Movement display processing unit 25 Information output unit 26 Allocation information acquisition unit 27 Display screen setting unit 28 Musical score information acquisition unit 3 Musical score 31 Display area 4 Performance instruction device 41 Musical score information acquisition unit 42 Performance assistance information output unit 43 Operator object generation unit 44 Movement display processing unit 45 Information output unit 101, 201, 401 Central processing unit 102, 202, 402 Memory 103, 203, 403 Bus 104, 204, 404 Storage device 105, 205, 405 Input device 106, 206, 406 Output device 107, 207, 407 Communication device

Claims

1. The device includes an operator group and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The main body includes an infinite scale setting unit, a musical tone detection unit, and an input unit, The infinite scale setting unit sets whether or not an infinite scale is applied, the musical sound detection unit detects an input target sound corresponding to the operated operator, the input target sound is a musical sound that reflects whether or not the infinite scale is applied to the musical sound assigned to the operator, The input unit inputs the input target sound. Musical tone input device.

2. The device includes an operator group and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The main body includes an automatic scale shift setting unit, a musical tone detection unit, and an input unit, The automatic scale shift setting unit sets whether or not automatic scale shift is applied, the musical sound detection unit detects an input target sound corresponding to the operated operator, the input target sound is a musical sound that reflects whether or not the automatic scale shift is applied to the musical sound assigned to the operator, The input unit inputs the input target sound. Musical tone input device.

3. The main body includes a scale shift processing setting unit instead of the infinite scale setting unit, The scale shift processing setting unit sets whether or not to apply the scale shift processing, The scale shifting process includes the infinite scale and automatic scale shifting, the input target sound is a musical sound that reflects whether or not the scale shift processing is applied to the musical sound assigned to the operator; 2. The musical tone input device according to claim 1.

4. The device includes an operator group, a main body, and a pressure sensor, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The main body includes a musical tone detection unit and an input unit, the musical sound detection unit detects an input target sound corresponding to the operated operator, the input target sound is a musical sound assigned to the operator, The pressure sensor is disposed at a position of a wrist of a user during operation and detects pressure applied by the wrist of the user; The pressure applied by the wrist is associated with a specific sound effect depending on the manner of the pressure, The input unit inputs the input target sound to which the sound effect has been added. Musical tone input device.

5. The device includes an operator group and a main body, The operator group includes a chord operator group and a single note operator group. the chord operator group and the single note operator group are disposed on an upper surface of the main body and include a plurality of operators; The plurality of operators in the chord operator group are individually assigned musical tones of chords, The plurality of operators in the group of single-tone operators are individually assigned single musical tones, The main body includes a performance assistance setting unit, a performance assistance information acquisition unit, an assistance musical tone allocation unit, a musical tone detection unit, and an input unit, the performance assistance setting unit sets whether or not a performance assistance setting is applied; the performance assistance setting includes a setting for assisting in performing chord performance according to a chord progression in accordance with the beat of the music piece, the musical performance assistance information acquisition unit acquires musical performance assistance information including information regarding the chord progression when the musical performance assistance setting is applied, when the performance support information acquisition unit acquires the performance support information, the support musical tone allocation unit assigns musical tones based on the performance support information to all operators constituting the chord operator group, instead of the chords individually assigned to the plurality of operators of the chord operator group; the musical sound detection unit detects an input target sound corresponding to the operated operator, the input target sound is a musical sound assigned to the operator, The input unit inputs the input target sound. Musical tone input device.

6. The main body further includes a musical tone allocation unit, the musical tone allocation unit allocates musical tones to the plurality of operators; 6. A musical tone input device according to claim 1.

7. The operator group is defined as a unit consisting of five operator rows arranged on the top surface of the main body, The row of operators includes at least three operators arranged vertically.

6. A musical tone input device according to claim 1.

8. the main body has the operator group for left-hand operation and the operator group for right-hand operation disposed on an upper surface thereof, The main body further includes a mode setting unit, the mode setting unit performs mode setting for the operator group for left-hand operation and mode setting for the operator group for right-hand operation, the mode setting is a setting for selecting at least one of a single note mode and a chord mode for each of the operator groups; the input sound allocation unit allocates musical sounds based on the mode setting to the plurality of operators.

8. The musical tone input device according to claim 7.

9. The apparatus includes an operation information acquisition unit, an operation object generation unit, a chord structure display generation unit, a movement display processing unit, and an information output unit, the operation information acquisition unit acquires operation information relating to operations of operators in a musical sound input device in which musical sounds are assigned to the respective operators; the operator object generation unit generates operator object information for displaying the operator operated on a display screen based on the operation information; the chord structure display generating unit generates chord structure display information for displaying single notes constituting the chord on the display screen when a manipulator to which a chord is assigned is operated; the movement display processing unit generates screen movement information for moving a display position of the display screen in accordance with a state of an operation on the musical sound input device; the information output unit outputs operation state information of the musical sound input device; the operation state information includes information about the display screen reflecting the control object information, chord structure display information, and screen movement information; Playing status display device.

10. Further, the system includes an allocation information acquisition unit and a display screen setting unit, the allocation information acquisition unit acquires, from the musical sound input device, allocation information regarding an allocation of the musical sounds to the respective operators; The display screen setting unit sets a display screen configuration based on the allocation information, the operation state information includes information regarding the display screen reflecting the setting of the display screen configuration, 10. The performance status display device according to claim 9.

11. Further, a musical score information acquisition unit is included, the musical score information acquisition unit acquires musical score information relating to a musical score, and the operator object generation unit generates instruction object information for instructing an operator on an operation of the operator corresponding to a musical note included in the musical score information; the chord structure display generating unit generates chord structure display information for displaying single notes constituting the chord on the display screen when the musical score information includes chord progression information relating to a chord progression; the moving display processing unit generates teaching screen position information for moving a display position of the display screen in accordance with a position of a teaching portion in the musical score; The operation state information includes information about the display screen reflecting the teaching object information, the chord configuration display information, and the teaching screen position information. The performance status display device according to claim 9 or 10.

12. 10. The performance status display device according to claim 9, wherein the musical sound input device is the musical sound input device according to any one of claims 1 to 5.

13. A musical score corresponding to a musical sound input device having a group of operators, The operator group includes five operator rows, The operation sequence is composed of one or more operators, and stage information according to positions is assigned to the operation sequence, a sound is assigned to each of the positions of the operator array to which the stage information is assigned, A display area includes a display of musical tones, a display of an operator row, and a display of stage information; the display area includes at least one of a theme area for displaying a theme and a chord area for displaying chords; the display of the musical tones is arranged at positions spaced apart at regular intervals in accordance with the beat of the music piece in the corresponding display area; the display of the operator row is displayed adjacent to the display of the musical tone; the display of the stage information is a visual identification display for identifying the stage information, which is provided in a portion of the display area where the display of the musical tones is arranged; Musical score.

14. In addition, it includes a scale shift indication, The display of the scale shift instruction is displayed adjacent to the display of the musical note corresponding to the musical note with the scale shift.

14. The musical score according to claim 13.

15. The musical score information acquisition unit, the performance support information output unit, the operator object generation unit, the movement display processing unit, and the information output unit are included. The score information acquisition unit acquires score information on a score including performance support information, the musical performance assistance information includes information regarding the chord progression, the performance assistance information output unit outputs the performance assistance information to a musical sound input device in which musical sounds are assigned to a plurality of operators; the operator object generation unit generates instruction object information instructing an operation of the operator corresponding to the musical note included in the musical score information and the chord progression; the moving display processing unit generates teaching screen position information for moving a display position of a display screen in accordance with a position of a teaching portion in the musical score; the information output unit outputs performance instruction information of the musical sound input device; The performance instruction information includes the instruction object information and information about the display screen reflecting the screen movement information. Performance teaching device.

16. The musical sound input device is a musical sound input device according to claim 5.

16. The playing instruction device according to claim 15.

17. The method includes an infinite scale setting step, a musical tone detection step, and an input step, Each of the steps is carried out using a musical tone input device including a group of operators and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, and the infinite scale setting step sets whether or not an infinite scale is applied, the musical sound detection step detects an input target sound corresponding to a plurality of operators operated in a musical sound input device to which musical sounds are assigned, the input target sound is a musical sound that reflects whether or not the infinite scale is applied to the musical sound assigned to the operator, The input step includes inputting the input target sound. How to input musical notes.

18. The method includes an automatic scale shift setting step, a musical tone detection step, and an input step, Each of the steps is carried out using a musical tone input device including a group of operators and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The automatic scale shift setting step sets whether or not to apply the automatic scale shift, the musical sound detection step detects an input target sound corresponding to a plurality of operators operated in a musical sound input device to which musical sounds are assigned, the input target sound is a musical sound that reflects whether or not the automatic scale shift is applied to the musical sound assigned to the operator, The input step includes inputting the input target sound. How to input musical notes.

19. Instead of the infinite scale setting step, a scale shift processing setting step is included, The scale shifting process setting step sets whether or not to apply the scale shifting process, The scale shifting process includes the infinite scale and automatic scale shifting, the input target sound is a musical sound that reflects whether or not the scale shift processing is applied to the musical sound assigned to the operator; 18. The method for inputting musical tones according to claim 17.

20. The method includes a musical tone detection step, a pressure detection step, and an input step, The steps are performed using a musical sound input device including a group of operators, a main body, and a pressure sensor, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, the musical sound detection step detects an input target sound corresponding to a plurality of operators operated in a musical sound input device to which musical sounds are assigned, the input target sound is a musical sound assigned to the operator, The pressure detection step detects pressure applied by the user's wrist using the pressure sensor disposed at a position of the user's wrist during operation; The pressure applied by the wrist is associated with a specific sound effect depending on the manner of the pressure, The input step includes inputting the input target sound to which the sound effect has been added. How to input musical notes.

21. The method includes a performance assistance setting step, a performance assistance information acquisition step, an assistance tone allocation step, a tone detection step, and an input step, Each of the steps is carried out using a musical tone input device including a group of operators and a main body, The operator group includes a chord operator group and a single note operator group. the chord operator group and the single note operator group are disposed on an upper surface of the main body and include a plurality of operators; The plurality of operators in the chord operator group are individually assigned musical tones of chords, The plurality of operators in the group of single-tone operators are individually assigned single musical tones, The performance assistance setting step sets whether or not a performance assistance setting is applied, the performance assistance setting includes a setting for assisting in performing chord performance according to a chord progression in accordance with the beat of the music piece, the acquiring step acquires, when the assistive playing setting is applied, assistive playing information including information on the chord progression; the auxiliary musical tone allocating step, when the auxiliary musical performance information is acquired in the auxiliary musical performance information acquiring step, allocates musical tones based on the auxiliary musical performance information to all operators constituting the chord operator group, instead of the chords individually assigned to the plurality of operators of the chord operator group; the musical sound detection step detects an input target sound corresponding to the operated operator, the input target sound is a musical sound assigned to the operator, The input step includes inputting the input target sound. How to input musical notes.

22. Further, the method includes a musical tone allocation step, the musical tone allocation step allocates a musical tone to each of the operators; A method for inputting musical tones according to any one of claims 17 to 21.

23. The operator group is defined as a unit consisting of five operator rows arranged on the top surface of the main body, The row of operators includes at least three operators arranged vertically. A method for inputting musical tones according to any one of claims 17 to 21.

24. the main body has the operator group for left-hand operation and the operator group for right-hand operation disposed on an upper surface thereof, Further, a mode setting step is included, the mode setting step includes performing a mode setting for the operator group for left-hand operation and a mode setting for the operator group for right-hand operation, the mode setting is a setting for selecting at least one of a single note mode and a chord mode for each of the operator groups; the input sound allocation step allocates musical sounds based on the mode setting to the plurality of operators; 24. The method for inputting musical tones according to claim 23.

25. The method includes an operation information acquisition step, an operation object generation step, a chord composition display generation step, a movement display processing step, and an information output step, The operation information acquisition step acquires operation information relating to an operation of each operator in a musical sound input device in which musical sounds are assigned to each operator, the operator object generating step generates operator object information for displaying the operator operated based on the operation information on the display screen; the chord structure display generating step generates chord structure display information for displaying single notes constituting the chord on the display screen when a manipulator to which a chord is assigned is operated, the moving display processing step generates screen moving information for moving a display position of the display screen in accordance with an operation state of the musical sound input device; The information output step outputs operation status information of the musical sound input device, the operation state information includes information about the display screen reflecting the display settings, the control object information, the chord configuration display information, and screen movement information; How to display the playing status.

26. Further, the method includes an allocation information acquisition step and a display screen setting step, the allocation information acquisition step acquires, from the musical sound input device, allocation information regarding an allocation of the musical sounds to the respective operators; The display screen setting step sets a display screen configuration based on the allocation information, the operation state information includes information regarding the display screen reflecting the setting of the display screen configuration, 26. The performance status display method according to claim 25.

27. Further, the method includes a step of acquiring musical score information, The musical score information acquiring step acquires musical score information relating to a musical score, the operator object generating step generates instruction object information for instructing an operation of the operator corresponding to the musical note included in the musical score information, the chord structure display generating step generates chord structure display information for displaying single notes constituting the chord on the display screen when the musical score information includes chord progression information relating to a chord progression; the moving display processing step generates instruction screen position information for moving a display position of the display screen in accordance with a position of an instruction portion in the musical score; The operation state information includes information about the display screen reflecting the teaching object information, the chord configuration display information, and the teaching screen position information.

27. The performance status display method according to claim 25 or 26.

28. The method includes a musical score information acquisition step, a performance assistance information output step, a control object generation step, a movement display processing step, and an information output step, The musical score information acquiring step acquires musical score information related to a musical score including performance support information, the musical performance assistance information includes information regarding the chord progression, The performance assistance information output step outputs the performance assistance information to a musical tone input device in which musical tones are assigned to a plurality of operators; the operator object generating step generates instruction object information for instructing the operation of the operator corresponding to the musical note included in the musical score information and the chord progression; the moving display processing step generates instruction screen position information for moving a display position of a display screen in accordance with a position of an instruction portion in the musical score; The information output step outputs performance instruction information of the musical tone input device, The performance instruction information includes the instruction object information and information about the display screen reflecting the screen movement information. How to teach performance.

29. The method includes an infinite scale setting procedure, a musical tone detection procedure, and an input procedure, The above steps are performed using a musical tone input device including a group of operators and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The infinite scale setting step sets whether or not an infinite scale is applied, the musical sound detection step includes detecting an input target sound corresponding to a plurality of operators operated in a musical sound input device in which musical sounds are assigned to the plurality of operators; the input target sound is a musical sound that reflects whether or not the infinite scale is applied to the musical sound assigned to the operator, The input step includes inputting the input target sound, A program for causing a computer to execute each of the above procedures.

30. The method includes an automatic scale shift setting procedure, a musical note detection procedure, and an input procedure, The above steps are performed using a musical tone input device including a group of operators and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The automatic scale shift setting step sets whether or not to apply the automatic scale shift, the musical sound detection step includes detecting an input target sound corresponding to a plurality of operators operated in a musical sound input device in which musical sounds are assigned to the plurality of operators; the input target sound is a musical sound that reflects whether or not the automatic scale shift is applied to the musical sound assigned to the operator, The input step includes inputting the input target sound, A program for causing a computer to execute each of the above procedures.

31. Instead of the infinite scale setting procedure, a scale shift processing setting procedure is included, The scale shifting process setting step sets whether or not to apply the scale shifting process, The scale shifting process includes the infinite scale and automatic scale shifting, the input target sound is a musical sound that reflects whether or not the scale shifting process is applied to the musical sound assigned to the operator, 30. A program according to claim 29, for causing a computer to execute each of the steps.

32. A musical tone detection step, a pressure detection step, and an input step are included; The above steps are performed using a musical sound input device including a group of operators, a main body, and a pressure sensor, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, the musical sound detection step includes detecting an input target sound corresponding to a plurality of operators operated in a musical sound input device in which musical sounds are assigned to the plurality of operators; the input target sound is a musical sound assigned to the operator, the pressure detection step includes detecting a pressure applied by a wrist of the user using the pressure sensor disposed at a position of the wrist of the user during an operation; The pressure applied by the wrist is associated with a specific sound effect depending on the manner of the pressure, the input step includes inputting the input target sound to which the sound effect has been added; A program for causing a computer to execute each of the above procedures.

33. The method includes a performance assistance setting procedure, a performance assistance information acquisition procedure, an assistance tone allocation procedure, a tone detection procedure, and an input procedure. The above steps are performed using a musical tone input device including a group of operators and a main body, The operator group includes a chord operator group and a single note operator group. the chord operator group and the single note operator group are disposed on an upper surface of the main body and include a plurality of operators; The plurality of operators in the chord operator group are individually assigned musical tones of chords, The plurality of operators in the group of single-tone operators are individually assigned single musical tones, The performance assistance setting step includes setting whether or not to apply the performance assistance setting, the performance assistance setting includes a setting for assisting in performing chord performance according to a chord progression in accordance with the beat of the music piece, the musical performance assistance information acquisition step, when the musical performance assistance setting is applied, acquires musical performance assistance information including information on the chord progression; the auxiliary musical tone allocation step, when the musical performance assistance information is acquired in the musical performance assistance information acquisition step, allocates musical tones based on the musical performance assistance information to all operators constituting the chord operator group, instead of the chords individually assigned to the plurality of operators of the chord operator group; the musical sound detection step includes detecting an input target sound corresponding to the operated operator; the input target sound is a musical sound assigned to the operator, The input step includes inputting the input target sound, A program for causing a computer to execute each of the above procedures.

34. Further, a musical tone allocation procedure is included, the musical tone allocation step allocates a musical tone to each of the operators; 34. The program according to claim 29, for causing a computer to execute each of the steps.

35. The operator group is defined as a unit consisting of five operator rows arranged on the top surface of the main body, The row of operators includes at least three operators arranged vertically, 34. The program according to claim 29, for causing a computer to execute each of the steps.

36. the main body has the operator group for left-hand operation and the operator group for right-hand operation disposed on an upper surface thereof, The main body further includes a mode setting unit, the mode setting step includes performing a mode setting for the operator group for left-hand operation and a mode setting for the operator group for right-hand operation; the mode setting is a setting for selecting at least one of a single note mode and a chord mode for each of the operator groups; the input sound allocation step includes: allocating musical sounds based on the mode setting to the plurality of operators; 36. A program according to claim 35, for causing a computer to execute each of the steps.

37. The method includes an operation information acquisition procedure, an operation object generation procedure, a chord composition display generation procedure, a movement display processing procedure, and an information output procedure. the operation information acquisition step acquires operation information relating to an operation of each operator in a musical sound input device in which musical sounds are assigned to each operator; the operator object generating step includes generating operator object information for displaying the operator operated based on the operation information on the display screen; the chord structure display generating step generates chord structure display information for displaying single notes constituting the chord on the display screen when a manipulator to which a chord is assigned is operated; the moving display processing step generates screen moving information for moving a display position of the display screen in accordance with an operation state of the musical sound input device; the information output step includes outputting operation status information of the musical sound input device; the operation state information includes information about the display screen reflecting the display settings, the control object information, the chord configuration display information, and screen movement information; A program for causing a computer to execute each of the above procedures.

38. Further, the method includes an allocation information acquisition procedure and a display screen setting procedure, the assignment information acquisition step includes acquiring, from the musical sound input device, assignment information regarding assignment of the musical sounds to the respective operators; the display screen setting step sets a display screen configuration based on the allocation information; the operation state information includes information regarding the display screen reflecting a setting of the display screen configuration, 38. A program according to claim 37, for causing a computer to execute each of the steps.

39. Further, the method includes a step of acquiring musical score information, The musical score information acquisition step acquires musical score information relating to a musical score, the operator object generating step generates instruction object information for instructing an operation of the operator corresponding to the musical note included in the musical score information; the chord structure display generating step generates chord structure display information for displaying single notes constituting the chord on the display screen when the musical score information includes chord progression information relating to a chord progression; the moving display processing step generates instruction screen position information for moving a display position of the display screen in accordance with a position of an instruction portion in the musical score; the operation state information includes information about the display screen reflecting the teaching object information, the chord configuration display information, and the teaching screen position information, 39. A program according to claim 37 or 38, for causing a computer to execute each of the procedures.

40. The method includes a musical score information acquisition procedure, a performance support information output procedure, a control object generation procedure, a movement display processing procedure, and an information output procedure. The score information acquisition step acquires score information about a score including performance support information; the musical performance assistance information includes information regarding the chord progression, the musical performance assistance information output step includes outputting the musical performance assistance information to a musical tone input device in which musical tones are assigned to a plurality of operators; the operator object generating step generates instruction object information for instructing the operation of the operator corresponding to the musical note included in the musical score information and the chord progression; the moving display processing step generates instruction screen position information for moving a display position of a display screen in accordance with a position of an instruction portion in the musical score; the information output step includes outputting performance instruction information of the musical tone input device; the performance instruction information includes the instruction object information and information about the display screen reflecting screen movement information; A program for causing a computer to execute each of the above procedures.

41. The method includes an infinite scale setting procedure, a musical tone detection procedure, and an input procedure, The above steps are performed using a musical tone input device including a group of operators and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The infinite scale setting step sets whether or not an infinite scale is applied, the musical sound detection step includes detecting an input target sound corresponding to a plurality of operators operated in a musical sound input device in which musical sounds are assigned to the plurality of operators; the input target sound is a musical sound that reflects whether or not the infinite scale is applied to the musical sound assigned to the operator, The input step includes inputting the input target sound, A computer-readable recording medium having recorded thereon a program for causing a computer to execute each of the above procedures.

42. The method includes an automatic scale shift setting procedure, a musical note detection procedure, and an input procedure, The above steps are performed using a musical tone input device including a group of operators and a main body, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, The automatic scale shift setting step sets whether or not to apply the automatic scale shift, the musical sound detection step includes detecting an input target sound corresponding to a plurality of operators operated in a musical sound input device in which musical sounds are assigned to the plurality of operators; the input target sound is a musical sound that reflects whether or not the automatic scale shift is applied to the musical sound assigned to the operator, The input step includes inputting the input target sound, A computer-readable recording medium having recorded thereon a program for causing a computer to execute each of the above procedures.

43. Instead of the infinite scale setting procedure, a scale shift processing setting procedure is included, The scale shifting process setting step sets whether or not to apply the scale shifting process, The scale shifting process includes the infinite scale and automatic scale shifting, the input target sound is a musical sound that reflects whether or not the scale shifting process is applied to the musical sound assigned to the operator, 42. A computer-readable recording medium according to claim 41, which records a program for causing a computer to execute each of the procedures.

44. A musical tone detection step, a pressure detection step, and an input step are included; The above steps are performed using a musical sound input device including a group of operators, a main body, and a pressure sensor, the operator group is disposed on an upper surface of the main body and includes a plurality of operators; The plurality of operators are individually assigned musical tones, the musical sound detection step includes detecting an input target sound corresponding to a plurality of operators operated in a musical sound input device in which musical sounds are assigned to the plurality of operators; the input target sound is a musical sound assigned to the operator, the pressure detection step includes detecting a pressure applied by a wrist of the user using the pressure sensor disposed at a position of the wrist of the user during an operation; The pressure applied by the wrist is associated with a specific sound effect depending on the manner of the pressure, the input step includes inputting the input target sound to which the sound effect has been added; A computer-readable recording medium having recorded thereon a program for causing a computer to execute each of the above procedures.

45. The method includes a performance assistance setting procedure, a performance assistance information acquisition procedure, an assistance tone allocation procedure, a tone detection procedure, and an input procedure. The above steps are performed using a musical tone input device including a group of operators and a main body, The operator group includes a chord operator group and a single note operator group. the chord operator group and the single note operator group are disposed on an upper surface of the main body and include a plurality of operators; The plurality of operators in the chord operator group are individually assigned musical tones of chords, The plurality of operators in the group of single-tone operators are individually assigned single musical tones, The performance assistance setting step includes setting whether or not to apply the performance assistance setting, the performance assistance setting includes a setting for assisting in performing chord performance according to a chord progression in accordance with the beat of the music piece, the musical performance assistance information acquisition step, when the musical performance assistance setting is applied, acquires musical performance assistance information including information on the chord progression; the auxiliary musical tone allocation step, when the musical performance assistance information is acquired in the musical performance assistance information acquisition step, allocates musical tones based on the musical performance assistance information to all operators constituting the chord operator group, instead of the chords individually assigned to the plurality of operators of the chord operator group; the musical sound detection step includes detecting an input target sound corresponding to the operated operator; the input target sound is a musical sound assigned to the operator, The input step includes inputting the input target sound, A computer-readable recording medium having recorded thereon a program for causing a computer to execute each of the above procedures.

46. Further, a musical tone allocation procedure is included, the musical tone allocation step allocates a musical tone to each of the operators; 46. ​​A computer-readable recording medium according to any one of claims 41 to 45, having a program recorded thereon for causing a computer to execute each of the procedures.

47. The operator group is defined as a unit consisting of five operator rows arranged on the top surface of the main body, The row of operators includes at least three operators arranged vertically, 46. ​​A computer-readable recording medium according to any one of claims 41 to 45, having a program recorded thereon for causing a computer to execute each of the procedures.

48. the main body has the operator group for left-hand operation and the operator group for right-hand operation disposed on an upper surface thereof, The main body further includes a mode setting unit, the mode setting unit performs mode setting for the operator group for left-hand operation and mode setting for the operator group for right-hand operation, the mode setting is a setting for selecting at least one of a single note mode and a chord mode for each of the operator groups; the input sound allocation unit allocates musical sounds based on the mode settings to the plurality of operators; 48. A computer-readable recording medium according to claim 47, which records a program for causing a computer to execute each of said procedures.

49. The method includes an operation information acquisition procedure, an operation object generation procedure, a chord composition display generation procedure, a movement display processing procedure, and an information output procedure. the operation information acquisition step acquires operation information relating to an operation of each operator in a musical sound input device in which musical sounds are assigned to each operator; the operator object generating step includes generating operator object information for displaying the operator operated based on the operation information on the display screen; the chord structure display generating step generates chord structure display information for displaying single notes constituting the chord on the display screen when a manipulator to which a chord is assigned is operated; the moving display processing step generates screen moving information for moving a display position of the display screen in accordance with an operation state of the musical sound input device; the information output step includes outputting operation status information of the musical sound input device; the operation state information includes information about the display screen reflecting the display settings, the control object information, the chord configuration display information, and screen movement information; A computer-readable recording medium having recorded thereon a program for causing a computer to execute each of the above procedures.

50. Further, the method includes an allocation information acquisition procedure and a display screen setting procedure, the assignment information acquisition step includes acquiring, from the musical sound input device, assignment information regarding assignment of the musical sounds to the respective operators; the display screen setting step sets a display screen configuration based on the allocation information; the operation state information includes information regarding the display screen reflecting a setting of the display screen configuration, 50. A computer-readable recording medium according to claim 49, having recorded thereon a program for causing a computer to execute each of said steps.

51. Further, the method includes a step of acquiring musical score information, The musical score information acquisition step acquires musical score information relating to a musical score, the operator object generating step generates instruction object information for instructing an operation of the operator corresponding to the musical note included in the musical score information; the chord structure display generating step generates chord structure display information for displaying single notes constituting the chord on the display screen when the musical score information includes chord progression information relating to a chord progression; the moving display processing step generates instruction screen position information for moving a display position of the display screen in accordance with a position of an instruction portion in the musical score; the operation state information includes information about the display screen reflecting the teaching object information, the chord configuration display information, and the teaching screen position information, 51. A computer-readable recording medium according to claim 49 or 50, which records a program for causing a computer to execute each of the procedures.

52. The method includes a musical score information acquisition procedure, a performance support information output procedure, a control object generation procedure, a movement display processing procedure, and an information output procedure. The score information acquisition step acquires score information about a score including performance support information; the musical performance assistance information includes information regarding the chord progression, the musical performance assistance information output step includes outputting the musical performance assistance information to a musical tone input device in which musical tones are assigned to a plurality of operators; the operator object generating step generates instruction object information for instructing the operation of the operator corresponding to the musical note included in the musical score information and the chord progression; the moving display processing step generates instruction screen position information for moving a display position of a display screen in accordance with a position of an instruction portion in the musical score; the information output step includes outputting performance instruction information of the musical tone input device; the performance instruction information includes the instruction object information and information about the display screen reflecting screen movement information; A computer-readable recording medium having recorded thereon a program for causing a computer to execute each of the above procedures.

Images