Information processing method and program

Abstract

To easily grasp the general trends regarding musical instrument performance. [Solution] The information processing system includes a performance data acquisition unit (31) that acquires multiple pieces of performance data (P) representing the performance of a keyboard instrument (10), a performance analysis unit (32) that calculates performance proficiency (X) for each performance period by analyzing the multiple pieces of performance data (P), and a display control unit (33) that displays a time series of performance proficiency (X) for each performance period on a display device (25).

Description

[Technical Field]

[0001] The present disclosure relates to techniques for managing musical instrument performances. [Background technology]

[0002] Various technologies to support musical instrument performance have been proposed. For example, Patent Document 1 discloses a technology that estimates the cause of a mistake in a musical piece, determines instruction content based on the estimation result, and displays the instruction content on a display device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-139528 Summary of the Invention [Problem to be solved by the invention]

[0004] In order to effectively master playing an instrument, it is important for a performer or instructor to grasp not only the location and cause of mistakes in, for example, a single performance of a piece of music, but also the overall trends in instrument performance over a relatively long period of time. In consideration of the above, one aspect of the present disclosure aims to make it possible to easily grasp the overall trends in instrument performance. [Means for solving the problem]

[0005] An information processing method according to a first aspect of the present disclosure acquires a plurality of performance data representing the performance of a musical instrument, calculates performance proficiency for each performance period by analyzing the plurality of performance data, and displays a time series of performance proficiency for each performance period on a display device.

[0006] An information processing method according to a second aspect of the present disclosure acquires a plurality of performance data representing the performance of an instrument, calculates performance proficiency for each analysis section of a piece of music by analyzing the plurality of performance data, and displays the distribution of performance proficiency for the piece of music on a display device.

[0007] An information processing method according to a third aspect of the present disclosure acquires a plurality of performance data representing the performance of a musical instrument, calculates the amount of performance per unit period by analyzing the plurality of performance data, and displays a time series of the amount of performance per unit period on a display device.

[0008] An information processing method according to a fourth aspect of the present disclosure acquires a plurality of performance data representing the performance of an instrument, calculates the performance amount for each analysis section of a musical piece by analyzing the plurality of performance data, and displays the distribution of the performance amount in the musical piece on a display device.

[0009] A program according to a first aspect of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple pieces of performance data representing the performance of an instrument, a performance analysis unit that calculates performance proficiency for each performance period by analyzing the multiple pieces of performance data, and a display control unit that displays a time series of performance proficiency for each performance period on a display device.

[0010] A program according to a second aspect of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple pieces of performance data representing the performance of an instrument, a performance analysis unit that calculates performance proficiency for each analysis section of a piece of music by analyzing the multiple pieces of performance data, and a display control unit that displays the distribution of performance proficiency in the piece of music on a display device.

[0011] A program according to a third aspect of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple pieces of performance data representing the performance of an instrument, a performance analysis unit that calculates the amount of performance per unit period by analyzing the multiple pieces of performance data, and a display control unit that displays a time series of the amount of performance per unit period on a display device.

[0012] A program according to a fourth aspect of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple performance data representing the performance of an instrument, a performance analysis unit that calculates the performance amount for each analysis section of a musical piece by analyzing the multiple performance data, and a display control unit that displays the distribution of the performance amount in the musical piece on a display device. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a block diagram illustrating the configuration of a performance system according to a first embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of a functional configuration of an information processing system. [Figure 3] FIG. 10 is a schematic diagram of the analysis screen Gx1. [Figure 4] FIG. 10 is a schematic diagram of the analysis screen Gx2. [Figure 5] FIG. 10 is a schematic diagram of an analysis screen Gy1. [Figure 6] FIG. 10 is a schematic diagram of the analysis screen Gy2. [Figure 7] 10 is a flowchart of a display control process. [Figure 8] FIG. 11 is an explanatory diagram of the performance amount Yc in the second embodiment. [Figure 9] FIG. 11 is a schematic diagram of an analysis screen Gy1 in the second embodiment. [Figure 10] FIG. 10 is a schematic diagram of an analysis screen Gx1 in a modified example. [Figure 11] FIG. 10 is a schematic diagram of an analysis screen Gx1 in a modified example. [Figure 12] FIG. 10 is a schematic diagram of an analysis screen Gy1 in a modified example. [Figure 13] FIG. 10 is a schematic diagram of an analysis screen Gy1 in a modified example. [Figure 14] FIG. 10 is a schematic diagram of an analysis screen Gy1 in a modified example. [Figure 15] FIG. 10 is a schematic diagram of an analysis screen Gy1 in a modified example. [Figure 16] FIG. 10 is a schematic diagram of an analysis screen G in a modified example. [Figure 17]FIG. 10 is a schematic diagram of an analysis screen G in a modified example. [Figure 18] FIG. 10 is a schematic diagram of an analysis screen G in a modified example. [Figure 19] 10 is an example of a musical score displayed on an analysis screen according to a modified example. [Figure 20] FIG. 10 is a schematic diagram of an analysis screen in a modified example. [Figure 21] FIG. 10 is a schematic diagram of an analysis screen Gx2 in a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0014] A: First embodiment 1 is a block diagram illustrating the configuration of a performance system 100 according to the first embodiment. The performance system 100 is a computer system for managing a performance by a performer Ua. The performance system 100 includes a keyboard instrument 10 and an information processing system 20.

[0015] A performer Ua plays the keyboard instrument 10. The performer Ua is a person who practices playing the keyboard instrument 10, for example, in a music school. An instructor Ub instructs the performer Ua in the music school. The instructor Ub manages the performer Ua's performance of the keyboard instrument 10 by understanding the performer Ua's performance tendencies using an information processing system 20. As described above, the information processing system 20 is a computer system that assists the instructor Ub in managing the performer Ua's performance of the keyboard instrument 10. Note that, in reality, the instructor Ub manages the performances of multiple performers Ua, but the following explanation will focus on the performance of one performer Ua for convenience.

[0016] The keyboard instrument 10 is an electronic musical instrument that accepts a performance by a performer Ua. The keyboard instrument 10 is, for example, an electronic musical instrument that conforms to the MIDI (Musical Instrument Digital Interface) standard and has a plurality of keys corresponding to different pitches. The performer Ua plays a desired piece of music by operating each key in sequence. The keyboard instrument 10 not only emits musical tones corresponding to the performance by the performer Ua, but also generates performance data P that represents the performance by the performer Ua. The performance data P is, for example, time-series data that conforms to the MIDI standard. Specifically, the performance data P specifies the pitch and duration for each note played by the performer Ua.

[0017] The performer Ua repeatedly plays the keyboard instrument 10 over multiple practice days. Furthermore, the performer Ua repeatedly plays the keyboard instrument 10 on each practice day. Performance data P is generated for each performance of the keyboard instrument 10 by the performer Ua. The period of one performance by the performer Ua is the period during which a series of performances of the keyboard instrument 10 continues. As described above, the performance data P is generated for each performance on each of the multiple practice days. Each piece of performance data P generated by the keyboard instrument 10 is supplied to the information processing system 20.

[0018] The information processing system 20 is an information device such as a smartphone, a tablet terminal, or a personal computer. The information processing system 20 includes a control device 21, a storage device 22, a communication device 23, an operation device 24, and a display device 25. The information processing system 20 may be realized as a single device, or may be realized as multiple devices configured separately from each other. Some or all of the functions of the information processing system 20 may be incorporated into the keyboard instrument 10.

[0019] The control device 21 is composed of one or more processors that control each element of the information processing system 20. For example, the control device 21 is composed of one or more types of processors such as a central processing unit (CPU), a graphics processing unit (GPU), a sound processing unit (SPU), a digital signal processor (DSP), a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC).

[0020] The communication device 23 communicates with an external device such as the keyboard instrument 10. For example, the communication device 23 receives each piece of performance data P sequentially transmitted from the keyboard instrument 10. Note that communication between the communication device 23 and the keyboard instrument 10 may be either wired communication or wireless communication.

[0021] The storage device 22 is one or more memories that store programs executed by the control device 21 and various data used by the control device 21. The storage device 22 is configured with a known storage medium such as a magnetic storage medium or a semiconductor storage medium. The storage device 22 may be configured with a combination of multiple types of storage media. Furthermore, the storage device 22 may be a portable storage medium that is detachable from the information processing system 20, or a storage medium (e.g., cloud storage) that the control device 21 can write to or read from via a communication network.

[0022] The storage device 22 stores multiple pieces of performance data P received by the communication device 23 from the keyboard instrument 10. In the first embodiment, multiple pieces of performance data P representing a performance of a specific piece of music by the performer Ua are stored in the storage device 22. Performance data P is stored in the storage device 22 for each performance on each of multiple practice days. In other words, multiple pieces of performance data P corresponding to different dates and times are stored in the storage device 22. A performance date and time Q is associated with each of the multiple pieces of performance data P. The performance date and time Q of each piece of performance data P is the date and time when one performance represented by the performance data P was performed. For example, the performance date and time Q includes the start time and end time of one performance.

[0023] The storage device 22 also stores musical score data M and reference data R for the music piece to be performed by the performer Ua. The musical score data M is image data representing the musical score of the music piece. The reference data R is data representing an exemplary or standard performance of the music piece. Like the performance data P, the reference data R is time-series data that conforms to, for example, the MIDI standard. The reference data R is used to evaluate the performance by the performer Ua.

[0024] The operation device 24 is an input device that accepts operations by the user U (performer Ua or instructor Ub). For example, an operator operated by the user U or a touch panel that detects contact with the display surface of the display device 25 is used as the operation device 24. The display device 25 displays images under the control of the control device 21. The display device 25 is configured with a display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel. Note that the operation device 24 or the display device 25, which are separate from the information processing system 20, may be connected to the information processing system 20 by wire or wirelessly.

[0025] 2 is a block diagram illustrating an example of the functional configuration of the information processing system 20. The control device 21 executes a program stored in the storage device 22 to realize a plurality of functions (a performance data acquisition unit 31, a performance analysis unit 32, and a display control unit 33) for managing the performance of the keyboard instrument 10 by the performer Ua.

[0026] The performance data acquisition unit 31 acquires multiple pieces of performance data P representing a performance by the performer Ua from the keyboard instrument 10. Specifically, the performance data acquisition unit 31 receives the performance data P transmitted from the keyboard instrument 10 via the communication device 23. The performance data acquisition unit 31 stores the multiple pieces of performance data P acquired from the keyboard instrument 10 in the storage device 22.

[0027] The performance analysis unit 32 analyzes the performance of the keyboard instrument 10 by the performer Ua using a plurality of pieces of performance data P. The performance analysis unit 32 processes the plurality of pieces of performance data P to analyze the performance proficiency X (Xa, Xb, Xc, Xd) and performance amount Y (Ya, Yb, Yc, Yd) of the performer Ua.

[0028] The performance proficiency level X is an index that represents the performer Ua's level of proficiency in playing the keyboard instrument 10. Specifically, the more skilled the performer Ua is at playing, the larger the value of the performance proficiency level X is set to. The performance proficiency level X can also be expressed as an evaluation value that evaluates the skill (degree of completion) of the performer Ua's performance. The relationship between the performer Ua's level of proficiency in playing and the magnitude of the performance proficiency level X may be changed as desired. For example, the performance proficiency level X may be set to a smaller value as the performer Ua becomes more skilled at playing. For example, in a configuration in which the performance proficiency level X is calculated based on the number of mistakes made by the performer Ua, the performance proficiency level X may be set to a smaller value as the performer Ua becomes more skilled at playing (i.e., the fewer mistakes). It is also conceivable that the performance proficiency level X approaches a predetermined reference value as the performer Ua becomes more skilled at playing.

[0029] The performance amount Y is an index relating to the total amount of performance of the keyboard instrument 10 by the performer Ua. Specifically, the performance amount Y is exemplified by the performance time (length of time) or the number of times the performance has been performed. The performance amount Y can also be expressed as the amount of practice (practice time or number of times the performance has been performed). As exemplified in FIG. 2, the performance analysis unit 32 includes a first analysis unit 321 that calculates the performance proficiency X and a second analysis unit 322 that calculates the performance amount Y.

[0030] [Performance Proficiency X] The first analysis unit 321 calculates the performance proficiency X by analyzing the multiple pieces of performance data P stored in the storage device 22. Specifically, the first analysis unit 321 calculates the performance proficiency X by comparing each piece of the multiple pieces of performance data P with the reference data R stored in the storage device 22. For example, the first analysis unit 321 calculates the performance proficiency X based on the number or frequency of differences between the performance represented by the performance data P and the performance represented by the reference data R (hereinafter referred to as "performance errors"). Performance errors by the performer Ua are evaluated from various perspectives, such as the accuracy of the pitch or duration of each note, the stability of the performance tempo, the continuity of each successive note, and the accuracy or continuity of the performance intensity (velocity) or volume.

[0031] The performance proficiency X calculated by the first analysis unit 321 includes multiple types of performance proficiency X (Xa, Xb, Xc, Xd) with different evaluation targets. Each performance proficiency X will be described in detail below.

[0032] The performance proficiency Xa is an index calculated for each of a plurality of sections (hereinafter referred to as "analysis sections") B into which the musical piece performed by the performer Ua is divided. The analysis section B is a section of the musical piece that corresponds to, for example, a predetermined number of measures (e.g., one measure). That is, the first analysis unit 321 calculates the performance proficiency Xa for each analysis section B by analyzing each of the plurality of performance data P. As described above, the performance proficiency Xa is an evaluation value related to the performance of the analysis section B of the musical piece by the performer Ua in one performance. The performance proficiency Xa calculated by the first analysis unit 321 for each analysis section B is stored in the storage device 22.

[0033] The performance proficiency Xb is an index calculated for each piece of performance data P. In other words, the performance proficiency Xb is an index related to a series of performances (i.e., one performance) by the performer Ua. The first analysis unit 321 calculates the performance proficiency Xb by analyzing multiple pieces of performance data P. The specific method for calculating the performance proficiency Xb is arbitrary.

[0034] The first analysis unit 321 calculates, for example, a representative value of the performance proficiency Xa calculated for each analysis section B for one piece of performance data P as the performance proficiency Xb. The representative value of the performance proficiency X is the average value (e.g., simple average or weighted average), maximum value, minimum value, mode, or median of the performance proficiency Xa. In other words, the performance proficiency Xb is a comprehensive evaluation value for the entirety of one performance by the performer Ua. As described above, the performance analysis unit 32 (first analysis unit 321) calculates the performance proficiency Xb for each piece of performance data P by analyzing multiple pieces of performance data P. The performance proficiency Xb calculated by the first analysis unit 321 for each performance is stored in the storage device 22. Note that, as mentioned above, the method for calculating the performance proficiency Xb may be changed as desired. For example, the first analysis unit 321 may calculate the performance proficiency Xb without using the performance proficiency Xa.

[0035] The performance proficiency Xc is an index calculated for each performance period T on the time axis. The performance period T is a period corresponding to, for example, a predetermined number of performances by the performer Ua. Therefore, each performance period T is a variable-length period. The first analysis unit 321 calculates the representative value of the performance proficiency Xb (or the representative value of the performance proficiency Xa) calculated for the predetermined number of performances in each performance period T as the performance proficiency Xc for that performance period T. In other words, the performance proficiency Xc is a comprehensive evaluation value for the predetermined number of performances in the performance period T. As explained above, the performance analysis unit 32 (first analysis unit 321) calculates the performance proficiency Xc for each performance period T by analyzing multiple pieces of performance data P. The performance proficiency Xc calculated by the first analysis unit 321 for each performance period T is stored in the storage device 22.

[0036] The performance proficiency Xd is an index calculated for each analysis section B of the piece of music performed by the performer Ua. While the aforementioned performance proficiency Xa is calculated for each analysis section B in a single performance, the performance proficiency Xd is a comprehensive index across multiple performances within a unit period D. The unit period D is a predetermined period longer than the performance period T. For example, the unit period D is a period equivalent to one day. The first analysis unit 321 calculates the representative value of the performance proficiency Xa for each analysis section B across multiple performances within the unit period D as the performance proficiency Xd for that analysis section B. In other words, the performance proficiency Xd is an evaluation value related to the performance of the analysis section B across multiple performances within the unit period D. As explained above, the performance analysis unit 32 (first analysis unit 321) calculates the performance proficiency Xd for each analysis section B of the piece of music by analyzing multiple pieces of performance data P. The performance proficiency Xd calculated by the first analysis section 321 for each analysis section B for each unit period D is stored in the storage device 22.

[0037] [Performance amount Y] The second analysis unit 322 calculates the performance amount Y by analyzing the plurality of performance data P stored in the storage device 22. Specifically, the second analysis unit 322 calculates the performance amount Y according to each of the plurality of performance data P and the performance date and time Q corresponding to the performance data P.

[0038] The performance amount Y calculated by the second analysis unit 322 includes a plurality of types of performance amounts Y (Ya, Yb, Yc, Yd) that have different measurement targets. Each performance amount Y will be described in detail below.

[0039] The performance amount Ya is an index calculated for each of a plurality of analysis sections B into which the musical piece played by the performer Ua is divided. The performance amount Ya is the total amount of performance of the analysis sections B in one performance by the performer Ua. As explained above, the second analysis unit 322 calculates the performance amount Ya for each analysis section B by analyzing a plurality of pieces of performance data P. The performance amount Ya calculated by the second analysis unit 322 for each analysis section B is stored in the storage device 22.

[0040] The performance amount Yb is an index calculated for each piece of performance data P. In other words, the performance amount Yb is the total amount related to a series of performances (i.e., one performance) by the performer Ua. The second analysis unit 322 calculates the performance amount Yb by analyzing multiple pieces of performance data P. The specific method for calculating the performance amount Yb is arbitrary.

[0041] For example, the second analysis unit 322 calculates the performance amount Yb as the cumulative value of the performance amount Ya calculated for each analysis section B for one piece of performance data P. In other words, the performance amount Yb is the total amount for one entire performance by the performer Ua. The second analysis unit 322 may calculate the performance amount Yb for the performance data P from the performance date and time Q corresponding to the performance data P. For example, the second analysis unit 322 may calculate the performance amount Yb as the interval between the start time and end time indicated by the performance date and time Q. As described above, the performance analysis unit 32 (second analysis unit 322) calculates the performance amount Yb for each piece of performance data P by analyzing multiple pieces of performance data P. The performance amount Yb calculated by the second analysis unit 322 for each performance is stored in the storage device 22. As described above, the method for calculating the performance amount Yb may be changed as desired. For example, the second analysis section 322 may calculate the performance amount Yb without using the performance amount Ya.

[0042] The performance amount Yc is an index calculated for each unit period D on the time axis. As described above, the unit period D is a period equivalent to, for example, one day. The second analysis unit 322 calculates the cumulative value of the performance amount Yb calculated for a predetermined number of performances in each unit period D as the performance amount Yc for that unit period D. In other words, the performance amount Yc is the total amount of performance by the performer Ua within the unit period D. As explained above, the performance analysis unit 32 (second analysis unit 322) calculates the performance amount Yc for each unit period D by analyzing multiple pieces of performance data P. The performance amount Yc calculated by the second analysis unit 322 for each unit period D is stored in the storage device 22.

[0043] The performance amount Yd is an index calculated for each analysis section B of the musical piece performed by the performer Ua. While the performance amount Ya described above is calculated for each analysis section B in one performance, the performance amount Yd is a comprehensive index across multiple performances within the unit period D. The second analysis unit 322 calculates the cumulative value of the performance amount Ya for each analysis section B across multiple performances within the unit period D as the performance amount Yd for that analysis section B. In other words, the performance amount Yd is the total amount of time that the performer Ua has played the analysis section B of the musical piece in multiple performances within the unit period D. As explained above, the performance analysis unit 32 (second analysis unit 322) calculates the performance amount Yd for each analysis section B of the musical piece by analyzing multiple pieces of performance data P. The performance amount Yd calculated by the second analysis unit 322 for each analysis section B for each unit period D is stored in the storage device 22.

[0044] The display control unit 33 in FIG. 2 displays an image (hereinafter referred to as "analysis screen G") showing the results of the analysis by the performance analysis unit 32 on the display device 25. Specifically, the display control unit 33 displays one of the multiple types of analysis screens G (Gx1, Gx2, Gy1, Gy2) shown below on the display device 25. The analysis screens Gx1 and Gx2 are screens that show the performance proficiency level X. The analysis screens Gy1 and Gy2 are screens that show the performance volume Y.

[0045] [Analysis screen Gx1] FIG. 3 is a schematic diagram of the analysis screen Gx1. The analysis screen Gx1 is an image showing a time series of the performance proficiency Xc for each performance period T. Specifically, the analysis screen Gx1 displays a time series of the performance proficiency Xc over multiple performance periods T along a time axis At extending horizontally. In the first embodiment, the time series of the performance proficiency Xc is displayed using a line graph. The numerical range of the performance proficiency Xc is divided into multiple ranges Z (Z1 to Z3). Each range Z is displayed in a different display mode. Note that the "display mode" refers to an image characteristic that can be visually distinguished by the user U. In the analysis screen Gx1, for example, the display color (hue, brightness, or saturation), pattern (design), or transparency differs for each range Z. However, the performance proficiency Xc does not have to be divided into multiple ranges Z. Therefore, the distinction in display mode for each range Z may be omitted.

[0046] Each performance period T is displayed on the time axis At with an equal display length. Also displayed on the time axis At are multiple unit periods D and the date and time E11 of each unit period D. Because the number of performances by the performer Ua may differ for each unit period D, the number of performance periods T differs for each unit period D. Therefore, each unit period D is displayed on the time axis At with a different display length.

[0047] As described above, the display control unit 33 of the first embodiment displays a time series of the performance proficiency Xc for each performance period T on the display device 25. Therefore, the user U can visually and intuitively grasp the general trend of how the performance proficiency Xc changes over time within the song. In particular, in the first embodiment, a representative value of the performance proficiency Xb for each piece of performance data P in the performance period T is calculated and displayed as the performance proficiency Xc for that performance period T. Therefore, the user U can accurately grasp the trend of how the performance proficiency Xc changes over time for each performance period T.

[0048] [Analysis screen Gx2] FIG. 4 is a schematic diagram of the analysis screen Gx2. The analysis screen Gx2 is an image showing the distribution of performance proficiency Xd in one of a plurality of unit periods D (hereinafter referred to as the "selected period D") displayed on the time axis At of the analysis screen Gx1. For example, the user U can select one of the plurality of unit periods D on the analysis screen Gx1 as the selected period D by operating the operation device 24. The display control unit 33 accepts the selection of the selected period D from the user U and displays the analysis screen Gx2 for the selected period D on the display device 25. The analysis screen Gx2 is an image showing the performance proficiency Xd calculated by the performance analysis unit 32 for each analysis section B for the selected period D. The image displayed on the display device 25 switches from one of the analysis screen Gx1 and the analysis screen Gx2 to the other in response to an instruction from the user U via the operation device 24.

[0049] The analysis screen Gx2 displays the date and time E21 of the selection period D. Furthermore, the analysis screen Gx2 displays the score E22 of the music piece performed by the performer Ua. Specifically, the display control unit 33 displays the score E22 on the display device 25 using the score data M stored in the storage device 22. The score E22 is, for example, a staff notation in which the right-hand part and the left-hand part of the music piece are arranged. On the analysis screen Gx2, a proficiency image E23 is displayed for each analysis section B (for example, for each bar) in the score E22.

[0050] The proficiency image E23 for each analysis section B is an image that represents the performance proficiency Xd calculated for that analysis section B. Specifically, the display control unit 33 displays the proficiency image E23 in a display mode that corresponds to the performance proficiency Xd. For example, the display color (hue, brightness, or saturation), pattern (design), transparency, size, or shape of the proficiency image E23 are controlled according to the performance proficiency Xd. For example, the proficiency image E23 is an ellipse with a size that corresponds to the performance proficiency Xd. In other words, the larger the performance proficiency Xd, the larger the size of the proficiency image E23 that is displayed.

[0051] Furthermore, the numerical range of the performance proficiency Xd is divided into a plurality of ranges Z (Z1 to Z3) corresponding to different display colors. The proficiency image E23 is displayed in a display color corresponding to the range Z to which the performance proficiency Xd belongs, among the plurality of ranges Z. That is, the display color of the proficiency image E23 differs for each range Z to which the performance proficiency Xd belongs. The display color of each range Z on the analysis screen Gx2 is the same as the display color of each range Z on the analysis screen Gx1. Note that the performance proficiency Xd does not have to be divided into a plurality of ranges Z. Therefore, the plurality of proficiency images E23 may be displayed in a common display mode.

[0052] As described above, the display control unit 33 displays the distribution of performance proficiency Xd for the piece of music performed by the performer Ua on the display device 25. Therefore, the user U can visually and intuitively grasp the general trend regarding the distribution of performance proficiency Xd. For example, the user U can visually and intuitively grasp the level of performance proficiency Xd in each analysis section B of the piece of music, and the distribution of performance proficiency Xd within the piece of music. Therefore, the user U can easily confirm which parts of the piece of music are lacking in proficiency.

[0053] In particular, in the first embodiment, a representative value of the performance proficiency Xa for each analysis section B is calculated and displayed as the performance proficiency Xd for that analysis section B. Therefore, the user U can accurately grasp the distribution trend of the performance proficiency Xd in the piece of music.

[0054] [Analysis screen Gy1] 5 is a schematic diagram of the analysis screen Gy1. The analysis screen Gy1 is an image showing a time series of the performance amount Yc for each unit period D. Specifically, the analysis screen Gy1 displays a time series of the performance amount Yc over a plurality of unit periods D along a time axis At extending horizontally. In the first embodiment, the time series of the performance amount Yc is displayed using a bar graph. Specifically, a numeric bar E31 whose vertical display length is set according to the performance amount Yc is displayed for each unit period D. Furthermore, a numeric value E32 of the performance amount Yc is displayed above each numeric bar E31.

[0055] As described above, the display control unit 33 displays the time series of the performance amount Yc for each unit period D on the display device 25. Therefore, the user U can visually and intuitively grasp the tendency of the performance amount Yc changing over time for each unit period D. Furthermore, the cumulative value of the performance amount Yb for each piece of performance data P in the unit period D is calculated and displayed as the performance amount Yc for that unit period D. Therefore, the user U can accurately grasp the tendency of the performance amount Yc of the song changing over time for each unit period D.

[0056] As explained above, the analysis screens Gx1 and Gy1 are images that represent the long-term trends in the performance of the performer Ua (for example, trends over multiple performance dates). Therefore, by referring to the analysis screen Gx1 or Gy1, the user U can visually and intuitively grasp the long-term trends in the performance of the performer Ua.

[0057] [Analysis screen Gy2] FIG. 6 is a schematic diagram of the analysis screen Gy2. The analysis screen Gy2 is an image showing the distribution of the performance amount Yd in one of the multiple unit periods D (selection period D) displayed on the time axis At of the analysis screen Gy1. For example, the user U can select one of the multiple unit periods D on the analysis screen Gy1 as the selection period D by operating the operation device 24. The display control unit 33 accepts the selection of the selection period D from the user U and displays the analysis screen Gy2 for the selection period D on the display device 25. The analysis screen Gy2 is an image showing the performance amount Yd calculated for each analysis section B for the selection period D by the performance analysis unit 32. The image displayed on the display device 25 switches from one of the analysis screen Gy1 and the analysis screen Gy2 to the other in response to an instruction from the user U via the operation device 24.

[0058] The analysis screen Gy2 displays the date and time E41 of the selected period D. Furthermore, the analysis screen Gy2 displays a musical score E42 of the music piece performed by the performer Ua. Specifically, the display control unit 33 displays the musical score E42 on the display device 25 using the musical score data M stored in the storage device 22. On the analysis screen Gy2, a performance amount image E43 is displayed for each analysis section B (for example, for each bar) in the musical score E42.

[0059] The performance amount image E43 for each analysis section B is an image that represents the performance amount Yd calculated for that analysis section B. Specifically, the performance amount image E43 is a rectangular image that is superimposed on each analysis section B of the musical score E42. Specifically, the display control unit 33 displays the performance amount image E43 in a display mode that corresponds to the performance amount Yd. Specifically, the performance amount image E43 is displayed with a density that corresponds to the performance amount Yd. In other words, the larger the performance amount Yd, the higher the density (for example, high saturation) of the performance amount image E43 that is displayed.

[0060] As described above, the display control unit 33 displays the distribution of the performance amounts Yd in the musical piece performed by the performer Ua on the display device 25. Therefore, the user U can visually and intuitively grasp the general trend regarding the distribution of the performance amounts Yd in the musical piece. For example, the user U can visually and intuitively grasp the amount of performance amount Yd in each analysis section B of the musical piece and the distribution of the performance amounts Yd in the musical piece. Therefore, the user U can easily confirm which parts of the musical piece need to be practiced insufficiently.

[0061] In the first embodiment, in particular, the cumulative value of the performance amount Ya for each analysis section B is calculated and displayed as the performance amount Yd for the analysis section B. Therefore, the user U can accurately grasp the distribution trend of the performance amount Yd in the music piece.

[0062] As explained above, the analysis screens Gx2 and Gy2 are images that represent the performance tendencies of the performer Ua within the piece of music. Therefore, by referring to the analysis screen Gx2 or Gy2, the user U can visually and intuitively grasp the performance tendencies of the performer Ua within the piece of music.

[0063] 7 is a flowchart illustrating the specific steps of the process (hereinafter referred to as the "display control process") in which the control device 21 displays each analysis screen G on the display device 25. The display control process is executed in a state in which multiple pieces of performance data P have been accumulated in the storage device 22 as a result of performances by the performer Ua over multiple practice days. For example, the display control process is started in response to an operation from the user U on the operation device 24.

[0064] When the display control process is started, the control device 21 (performance analysis unit 32) analyzes the performance of the keyboard instrument 10 by the performer Ua using a plurality of pieces of performance data P stored in the storage device 22 (S1-S2). Specifically, the control device 21 (first analysis unit 321) calculates a performance proficiency X (Xa, Xb, Xc, Xd) by analyzing the plurality of pieces of performance data P (S1). Furthermore, the control device 21 (second control unit) calculates a performance amount Y (Ya, Yb, Yc, Yd) by analyzing the plurality of pieces of performance data P (S2). Note that the performance proficiency X may be calculated after the calculation of the performance amount Y, or the calculation of the performance proficiency X (S1) and the calculation of the performance amount Y (S2) may be executed in parallel.

[0065] The control device 21 (display control unit 33) receives a selection of an analysis screen G from the user U (S3). The control device 21 (display control unit 33) displays the analysis screen G selected by the user U on the display device 25 (S4). Specifically, when the analysis screen Gx1 is selected, the control device 21 (display control unit 33) displays on the display device 25 an analysis screen Gx1 that shows a time series of the performance proficiency Xc for each performance period T. When the analysis screen Gx2 is selected, the control device 21 (display control unit 33) displays on the display device 25 an analysis screen Gx2 that shows a distribution of the performance proficiency Xd in the musical piece. When the analysis screen Gy1 is selected, the control device 21 (display control unit 33) displays on the display device 25 an analysis screen Gy1 that shows a time series of the performance amount Yc for each unit period D. When the analysis screen Gy2 is selected, the control device 21 (display control unit 33) displays on the display device 25 an analysis screen Gy2 that shows the distribution of the performance amount Yd in the musical piece.

[0066] The control device 21 determines whether a predetermined termination condition is met (S5). The termination condition may be any condition, for example, when the user U issues an instruction to terminate the display control process by operating the operation device 24. If the termination condition is not met (S5: NO), the control device 21 shifts the process to step S3. That is, the process of displaying the analysis screen G on the display device 25 in accordance with the instruction from the user U is repeated. If the termination condition is met (S5: YES), the control device 21 terminates the display control process.

[0067] Note that, in the above description, an example has been given in which the calculation of the performance proficiency X (S1) and the calculation of the performance amount Y (S2) are executed after the display control process has started, but the calculation of the performance proficiency X and the performance amount Y may be executed in advance before the display control process starts. For example, the control device 21 (performance analysis unit 32) calculates the performance proficiency X and the performance amount Y when the performance by the performer Ua has finished, and stores the calculation results in the storage device 22. When the display control process starts, the control device 21 (display control unit 33) acquires the previously calculated performance proficiency X and performance amount Y from the storage device 22 and displays the analysis screen G (S3, S4). As shown in the above example, the calculation of the performance proficiency X (S1) and the calculation of the performance amount Y (S2) may be omitted from the display control process.

[0068] B: Second embodiment A second embodiment will be described. In the following embodiments, elements that have the same functions as those in the first embodiment will be denoted by the same reference numerals as those in the first embodiment, and detailed descriptions thereof will be omitted as appropriate.

[0069] FIG. 8 is an explanatory diagram of the performance amount Yc in the second embodiment. As mentioned above, the performance amount Yc is the total amount of performance in each unit period D. The performance analysis unit 32 in the second embodiment calculates the performance amount Yc_k (Yc_1 to Yc_6) for each of a plurality of performance conditions by analyzing a plurality of pieces of performance data P stored in the storage device 22. The performance conditions are conditions related to the performance by the performer Ua. As described above, in the second embodiment, the performance amount Yc is subdivided into a plurality of performance amounts Yc_k corresponding to different performance conditions.

[0070] In the second embodiment, Condition 1: Whether the performance is a complete performance of the piece (Run) or a partial performance of the piece (Section). Condition 2: Whether the performance of the keyboard instrument 10 is performed using both hands (Together), using only the right hand (Right), or using only the left hand (Left) are shown as examples of performance conditions. Specifically, the performance amount Yc_k, which takes each combination of condition 1 and condition 2 as a performance condition, is calculated by the performance analysis unit 32 (second analysis unit 322).

[0071] Specifically, the performance amount Yc_1 is the performance amount (Run / Together) when the performer Ua plays the entire piece of music with both hands. The performance amount Yc_2 is the performance amount (Run / Right) when the performer Ua plays the entire piece of music with only the right hand. The performance amount Yc_3 is the performance amount (Run / Left) when the performer Ua plays the entire piece of music with only the left hand. The performance amount Yc_4 is the performance amount (Section / Together) when the performer Ua plays a part of the piece of music with both hands. The performance amount Yc_5 is the performance amount (Section / Right) when the performer Ua plays a part of the piece of music with only the right hand. The performance amount Yc_6 is the performance amount (Section / Left) when the performer Ua plays a part of the piece of music with only the left hand. As can be understood from the above explanation, the sum of the performance amounts Yc_1 to Yc_6 corresponds to the performance amount Yc.

[0072] FIG. 9 is a schematic diagram of the analysis screen Gy1 in the second embodiment. As in the first embodiment, the analysis screen Gy1 is an image that displays a time series of the performance amount Yc for each unit period D. The analysis screen Gy1 in the second embodiment not only displays the performance amount Yc for each unit period D, but also displays each performance amount Yc_k (Yc_1 to Yc_6) obtained by dividing the performance amount Yc for each performance condition. Specifically, on the analysis screen Gy1, a numerical value bar E31 corresponding to one unit period D is divided vertically into a plurality of sections corresponding to different performance conditions. Each section of the numerical value bar E31 is displayed in a different display mode (for example, a display color). The vertical display length of the section of the numerical value bar E31 corresponding to each performance condition is set according to the performance amount Yc_k corresponding to that performance condition. In other words, the numerical value bar E31 is divided vertically based on the ratio of the performance amounts Yc_k corresponding to the different performance conditions.

[0073] The display control process of the second embodiment is the same as that of the first embodiment, except that the performance amount Yc_k for each performance condition is calculated in the calculation of the performance amount Yc (S2) and each performance amount Yc_k is displayed on the analysis screen Gy1. Therefore, the second embodiment also achieves the same effects as the first embodiment.

[0074] In the second embodiment, the performance amounts Yc_k corresponding to one or more performance conditions are displayed on the display device 25 in the display (analysis screen Gy1) of the performance amounts Yc. Therefore, the user U can visually and intuitively grasp the tendency of the performance amounts Yc_k related to specific performance conditions. For example, the user U can easily confirm a tendency that practice of a part of the piece of music (partial performance) is insufficient, or that practice of only one hand is insufficient.

[0075] In the above description, the analysis screen Gy1 showing the time series of the performance amount Yc displays the performance amount Yc for each performance condition. However, the analysis screen Gy2 showing the distribution of the performance amount Yd may also display the performance amount Yd_k for each performance condition. For example, the performance amount image E43 showing the performance amount Yd for each analysis section B on the analysis screen Gy2 may be divided into a plurality of portions corresponding to different performance conditions. The size of the portion of the performance amount image E43 corresponding to each performance condition is set according to the performance amount Yd_k corresponding to that performance condition. The above configuration also achieves the same effects as the second embodiment.

[0076] C: Modified Example Specific modified embodiments that can be added to each of the embodiments exemplified above are exemplified below. Two or more embodiments arbitrarily selected from the following examples may be combined as appropriate within the scope of not being mutually contradictory.

[0077] (1) The format of the analysis screen Gx1 showing the time series of performance proficiency Xc is not limited to the examples of the above-mentioned forms and may be changed as desired. For example, in the above-mentioned forms, the time series of performance proficiency Xc is displayed as a line graph, but the time series of performance proficiency Xc may also be displayed as a bar graph, for example. Furthermore, in the above-mentioned forms, the analysis screen Gx1 is shown with the horizontal axis representing time At and the vertical axis representing performance proficiency Xc, but the vertical axis representing time At and the horizontal axis representing performance proficiency Xc may also be shown.

[0078] A plurality of time series of performance proficiency Xc, which evaluate the performance of the performer Ua from different viewpoints (evaluation methods), may be displayed on the analysis screen Gx1. For example, on the analysis screen Gx1 illustrated in FIG. 10, a time series of performance proficiency Xc_1 and a time series of performance proficiency Xc_2 are displayed in parallel. The performance proficiency Xc_1 and the performance proficiency Xc_2 are evaluation values ​​calculated using different evaluation methods. On the analysis screen Gx1 of FIG. 10, a time series of performance proficiency Xc, which is the sum of the performance proficiency Xc_1 and the performance proficiency Xc_2, is also displayed on the analysis screen Gx1.

[0079] In addition, in each of the above-described embodiments, the performance proficiency Xc is calculated for each performance period T corresponding to a predetermined number of performances, but the performance period T may be a period corresponding to one performance by the performer Ua. In other words, the time series of the performance proficiency Xb calculated for each performance data P may be displayed on the analysis screen Gx1.

[0080] The performance period T in each of the above-described forms corresponds to a predetermined number of performances by the performer Ua. Therefore, as can be seen from the example in Fig. 3, the number of performance proficiencies Xc within a unit period D may differ for each unit period D. As shown in the example in Fig. 11, the first analysis unit 321 may calculate the performance proficiency Xc so that the number of performance proficiencies Xc for each unit period D (e.g., each day) is a constant number.

[0081] (2) The format of the analysis screen Gy1 showing the time series of the performance amount Yc is not limited to the examples of the above-mentioned embodiments and may be changed as desired. For example, in the above-mentioned embodiments, the time series of the performance amount Yc is displayed as a bar graph, but the time series of the performance amount Yc may also be displayed as a line graph, for example. Furthermore, in the above-mentioned embodiments, the analysis screen Gy1 is shown with the horizontal axis representing the time axis At and the vertical axis representing the performance amount Yc, but the vertical axis representing the time axis At and the horizontal axis representing the performance amount Yc may also be shown.

[0082] 12, the ratio of the performance amount Yc_k (Yc_1 to Yc_6) corresponding to each of the plurality of performance conditions may be displayed for each unit period D. Specifically, the performance amount Yc, which is the sum of the plurality of performance amounts Yc_k corresponding to different performance conditions, is set to a predetermined value (100%), and the ratio of the performance amount Yc_k for each performance condition is displayed on the analysis screen Gy1. As shown in FIG. 13, a time series of the performance amount Yc may be displayed together with the ratio of the performance amount Yc_k for each performance condition. FIG. 13 illustrates an example of an analysis screen Gy1 in which the performance amount Yc_k for each performance condition is displayed as a bar graph and the time series of the performance amount Yc is displayed as a line graph. The time series of the performance amount Yc may be displayed superimposed on the ratio of the performance amount Yc_k for each performance condition as shown in FIG. 13, or may be displayed in an area separate from the ratio of the performance amount Yc_k for each performance condition as shown in FIG. 14. Furthermore, as illustrated in FIG. 15, the performance amounts Yc_k (Yc_1 to Yc_6) corresponding to each of a plurality of performance conditions may be displayed as a bar graph for each unit period D on the analysis screen Gy1.

[0083] (3) The format of the analysis screen Gx2 showing the distribution of performance proficiency Xd is not limited to the examples described above and may be changed as desired. For example, in the examples described above, an ellipse of a size corresponding to the performance proficiency Xd is used as the proficiency image E23, but the format of the proficiency image E23 is arbitrary. The proficiency image E23 may be any shape, such as a triangle, or any display object, such as a living creature or character. Furthermore, similar to the performance amount image E43 on the analysis screen Gy2, a rectangular proficiency image E23 superimposed on each analysis section B of the score may be displayed on the analysis screen Gx2. A line graph or bar graph showing the performance proficiency Xd may be displayed as the proficiency image E23.

[0084] In the above-described embodiments, a configuration has been exemplified in which a proficiency image E23 corresponding to the performance proficiency Xd is displayed together with the score E22, but the performance proficiency Xd may also be displayed by controlling the display mode of the score E22. For example, the display control unit 33 may control the display mode of the elements that make up the score E22 (hereinafter referred to as "score elements") according to the performance proficiency Xd. Specifically, the display control unit 33 changes the display mode (e.g., display color, size, shape, etc.) of the score elements in each analysis section B according to the performance proficiency Xd for that analysis section B.

[0085] Examples of musical score elements used to display the performance proficiency Xd include notes, rests, staffs, bar lines, lyrics, and various symbols (such as dynamics, time signatures, and clefs). Controlling the display mode of musical score elements includes any process that changes the display of musical score elements, such as undulating musical score elements according to the performance proficiency Xd or changing the angle of musical score elements according to the performance proficiency Xd. Furthermore, both displaying the proficiency image E23 according to the performance proficiency Xd and controlling musical score elements according to the performance proficiency Xd may be performed.

[0086] (4) The performance proficiency Xd for each analysis section B of a piece of music in a unit period D (e.g., one day) may be displayed, for example, on an analysis screen G as illustrated in FIG. 16. The analysis screen G in FIG. 16 is an image in which a time axis At is drawn in the shape of a circle equidistant from a center C. Multiple points p are set on the time axis At. The multiple points p include one start point pS and multiple pass points pT. The start point pS corresponds to the start and end points of the performance by the performer Ua. Each pass point pT corresponds to a point in the middle of the performance. The space between two adjacent points p on the circumference corresponds to, for example, one analysis section B.

[0087] At each point p on the time axis At, the performance proficiency Xd at that point p is expressed by the distance from the center C. That is, the time series of the performance proficiency Xd is expressed by a broken line that starts at the start point pS, goes around in a circular direction (e.g., counterclockwise), and returns to the start point pS (i.e., the end point of the song). The analysis screen G in Fig. 16 allows the user U to visually and intuitively grasp the change in the performance proficiency Xd over time within the song.

[0088] 17 and 18, a plurality of different types of performance proficiency Xd (Xd_1, Xd_2) may be displayed on a circular analysis screen G. The relationship between performance proficiency Xd_1 and performance proficiency Xd_2 is arbitrary, but the following relationship is exemplified: [A] Evaluation values ​​calculated for performances from different periods (e.g., today and yesterday). [B] Evaluation values ​​calculated using different evaluation methods. [C] Evaluation values ​​calculated for performances under different performance conditions. [D] Evaluation values ​​calculated for the performances of different performers Ua. The target period of [A] is not limited to the combination of today and the previous day, and may be changed arbitrarily.

[0089] In the analysis screen G of Fig. 17, the time series of the performance proficiency Xd_1 and the time series of the performance proficiency Xd_2 are displayed in parallel along the circular time axis At similar to the example of Fig. 16. The time series of the performance proficiency Xd_1 and the time series of the performance proficiency Xd_2 may be displayed in different display modes.

[0090] 17, the user U can visually and intuitively grasp the temporal relationship between the performance proficiency level Xd_1 and the performance proficiency level Xd_2. Note that three or more different types of performance proficiency levels Xd may be displayed on the circular analysis screen G similar to that of FIG.

[0091] The analysis screen G in Figure 18 is a circular image in which a semicircular time axis At1 and a semicircular time axis At2 are connected to each other with a common center C. The point in time p where the base end of the time axis At1 and the base end of the time axis At2 are connected corresponds to the start point pS of the performance. The point in time p where the end of the time axis At1 and the end of the time axis At2 are connected corresponds to the end point pE of the performance. In addition, a passing point pT indicating a point in the middle of the performance is set on each of the time axes At1 and At2.

[0092] At each point p on the time axis At1 (start point pS, each pass point pT, end point pE), performance proficiency Xd_1 at that point p is represented by the distance from the center C. That is, the time series of performance proficiency Xd_1 is represented by a broken line along the time axis At1 from the start point pS to the end point pE. Similarly, at each point p on the time axis At2 (start point pS, each pass point pT, end point pE), performance proficiency Xd_2 at that point p is represented by the distance from the center C. That is, the time series of performance proficiency Xd_2 is represented by a broken line along the time axis At2 from the start point pS to the end point pE. Performance proficiency Xd_1 and performance proficiency Xd_2 may be displayed in different display modes.

[0093] 18, the user U can visually and intuitively grasp the temporal relationship between the performance proficiency level Xd_1 and the performance proficiency level Xd_2. Note that a plurality of different types of performance proficiency levels Xd may be displayed along each of the time axes At1 and At2 in FIG.

[0094] 16 to 18, the interval between two circumferentially adjacent time points p on the time axis At (At1, At2) corresponds to any section in the music (for example, analysis section B). For example, the interval between two time points p on the time axis At may correspond to one measure of the music, or a predetermined number of measures. Furthermore, although FIGS. 16 to 18 illustrate the display of performance proficiency X (specifically, performance proficiency Xd), a similar format of analysis screen G may also be used to display performance amounts Y (Ya, Yb, Yc, Yd).

[0095] (5) The format of the analysis screen Gy2 showing the distribution of the performance amount Yd is not limited to the examples shown above and may be changed as desired. For example, in the examples shown above, a rectangular image superimposed on each analysis section B was used as the performance amount image E43, but the format of the performance amount image E43 is arbitrary. For example, similar to the proficiency image E23 of the analysis screen Gx2, a figure of a predetermined shape (e.g., an ellipse) may be displayed as the performance amount image E43 for each analysis section B. Furthermore, in the examples shown above, the performance amount image E43 covers both the right-hand and left-hand parts of the musical score E42, but the performance amount images E43 may be displayed separately for the right-hand and left-hand parts of the musical score E42. A line graph or bar graph showing the performance amount Yd may be displayed as the performance amount image E43.

[0096] In the above-described embodiments, a performance amount image E43 corresponding to the performance amount Yd is displayed together with the score E42, but the display control unit 33 may control the display manner of the score elements in the score E42 according to the performance amount Yd. Specifically, the display control unit 33 changes the display manner (e.g., display color, size, shape, etc.) of the score elements in each analysis section B according to the performance amount Yd for that analysis section B. Note that both the display of the performance amount image E43 corresponding to the performance amount Yd and the control of the score elements according to the performance amount Yd may be executed.

[0097] (6) In the above-described embodiments, a period of one measure is exemplified as the analysis section B, but the analysis section B is not limited to this example. For example, the analysis section B may be a portion corresponding to a predetermined number of measures in a piece of music, a portion corresponding to a predetermined number of notes (e.g., a section corresponding to one note), or a portion obtained by dividing a piece of music by practice symbols (numbers). In other words, the analysis section B may be a period longer or shorter than one measure.

[0098] (7) In the above-described embodiments, one of a plurality of types of analysis screens G is selectively displayed on display device 25. However, a plurality of types of analysis screens G may be displayed in parallel on display device 25. For example, a form in which analysis screen Gx1 and analysis screen Gx2 are displayed in parallel on display device 25, or a form in which analysis screen Gy1 and analysis screen Gy2 are displayed in parallel on display device 25 may be assumed. Furthermore, analysis screen Gx1, analysis screen Gx2, analysis screen Gy1, and analysis screen Gy2 may be displayed in parallel on display device 25.

[0099] (8) In the above-described embodiments, the analysis results of a past performance by performer Ua are displayed on the analysis screen G. However, the analysis screen G showing the analysis results of the performance by performer Ua may be displayed on the display device 25 in real time in parallel with the performance by performer Ua. The contents of the analysis screen G may be updated moment by moment in parallel with the performance by performer Ua. Furthermore, the analysis results of performances at different points in time may be displayed in parallel on the display device 25. For example, the analysis results of the performance by performer Ua in a first period and the analysis results of the performance by performer Ua in a second period may be displayed in parallel on the display device 25. The first period and the second period are different periods in the past. Furthermore, the first period may be a past period, and the second period may be a period of the current performance by performer Ua.

[0100] (9) While the above-described embodiments illustrate the case where the performer Ua plays one piece of music, the above-described embodiments are similarly applicable to the performance of multiple pieces of music. For example, an analysis screen Gx1 showing a time series of the performance proficiency Xc across multiple pieces of music, an analysis screen Gx2 showing a distribution of the performance proficiency Xd across multiple pieces of music, an analysis screen Gy1 showing a time series of the performance amount Yc across multiple pieces of music, or an analysis screen Gy2 showing a distribution of the performance amount Yd across multiple pieces of music may be displayed on the display device 25.

[0101] (10) In the above-described embodiments, the performance data P is in MIDI format, specifying the pitch and duration of each note played by the performer Ua. However, the format of the performance data P is not limited to the above examples. For example, sound data representing the waveform of the musical sound emitted by the keyboard instrument 10 as a result of the performance of the performer Ua may be used as the performance data P. The sound data is generated by collecting the musical sound emitted by the keyboard instrument 10 with a sound collection device. As shown in the above examples, the performance data P is comprehensively expressed as data representing the performance by the performer Ua.

[0102] (11) The score E22 on the analysis screen Gx2 or the score E42 on the analysis screen Gy2 is not limited to a standard score with notes arranged on a staff. For example, as illustrated in FIG. 19, a schematic score explaining the order of performance of each measure may be displayed as the score E22 or E42. Furthermore, a composition score showing the composition of a piece of music without including the individual notes of the piece of music may be displayed as the score E22 or E42. Furthermore, for example, a tablature showing the fingering positions for each string of a stringed instrument such as a guitar may be displayed as the score E22 or E42.

[0103] (12) The method of calculating the performance proficiency X may be changed as desired. For example, the number or frequency of each performance error made by the performer Ua may be weighted by a weighting value set for each type of performance error. The performance proficiency X is, for example, a numerical value that expresses the number of performance errors as a number or a ratio.

[0104] For example, the first analysis unit 321 may analyze the performance (e.g., fingering or eye movement) of the performer Ua by analyzing a video of the performer Ua, and calculate the performance proficiency X according to the analysis results. Alternatively, the first analysis unit 321 may analyze the performance (e.g., fingering or eye movement) of the performer Ua by analyzing a detection signal generated by a sensor attached to the body of the performer Ua, and calculate the performance proficiency X according to the analysis results.

[0105] The performance proficiency X may be calculated based on the number of times a specific performance technique is observed in the performance of the performer Ua in the piece. For example, the performance proficiency X may be calculated based on the number of times a performance technique is observed, such as a change in pitch such as a leap, a double note such as a chord, a change in the time of onset or offset, or the simultaneous observation of multiple performance techniques. The performance proficiency X may be calculated separately for the performance of the performer Ua using both hands and for the performance of the performer Ua using one hand.

[0106] Two or more of the above-mentioned methods for calculating the performance proficiency level X may be combined. For example, regardless of the method for calculating the performance proficiency level X, the number or frequency of each performance error may be weighted by a weight value set for each type of performance error. Furthermore, regardless of the method for calculating the performance proficiency level X, performance data P (acoustic data) representing the waveform of musical sounds emitted by the keyboard instrument 10 may be used to calculate the performance proficiency level X.

[0107] (13) As the performer Ua becomes more skilled at playing a piece of music, there is a tendency for the performance time of the piece of music (e.g., the duration of one performance of the piece of music) to approach a standard performance time (hereinafter referred to as "standard time Tref"). Taking this tendency into consideration, the performance time of the piece of music by the performer Ua may be used as the performance proficiency X. For example, the performance analysis unit 32 calculates the performance time of the piece of music as the performance proficiency X by analyzing the performance data P. For example, the length of time required to play a specific section or all sections of the piece of music is calculated as the performance proficiency X. The display control unit 33 displays an analysis screen G in FIG. 20 that shows the time series of the performance proficiency X.

[0108] The analysis screen G in FIG. 20 displays a time series of performance proficiency X using a line graph. The analysis screen G also displays a standard time Tref. The standard time Tref is, for example, the required time for performance represented by the reference data R. The analysis screen G also displays an acceptable range δ including the standard time Tref. The acceptable range δ is the range of performance time within which the performer Ua can be evaluated as being proficient in performance. Specifically, the acceptable range δ is set to a range of a predetermined percentage (for example, ±10%) of the standard time Tref. When the performer Ua first begins practicing a piece of music, the performance proficiency X (performance time) will be a value that significantly deviates from the standard time Tref. As the performer Ua becomes more proficient in performance, the performance proficiency X (performance time) will approach the standard time Tref. As with the above-mentioned embodiments, the analysis screen G in FIG. 20 also allows the user U to visually and intuitively grasp the general trend of changes in performance proficiency X over time.

[0109] (14) In the above-described embodiments, the analysis screen G is exemplified as relating to a performance by one performer Ua, but the results of analyzing performances by multiple performers Ua may also be displayed on the analysis screen G. For example, a form in which the performances by each of the multiple performers Ua are displayed sequentially on the analysis screen G, or a form in which performances by the multiple performers Ua are displayed in parallel (simultaneously) on the analysis screen G is conceivable.

[0110] For example, attribute information is associated with each of the multiple pieces of performance data P stored in the storage device 22. The attribute information for each piece of performance data P is information that represents the attributes of the performer Ua who performed the performance related to that performance data P. Examples of the attributes of the performer Ua include age, generation, gender, grade, region, or class. In addition, the performance tendencies of the performer Ua, such as the frequency of performance, are also included in the attributes of the performer Ua.

[0111] When a specific attribute is designated by an operation on the operation device 24, the display control unit 33 extracts performance data P corresponding to the attribute from the plurality of performance data P stored in the storage device 22, and displays the analysis screen G using the extracted performance data P. For example, as illustrated in Fig. 21, the analysis screen Gx2 displays a name E24 (child class) representing the attribute to be extracted.

[0112] (15) In the above-described embodiments, six types of performance conditions corresponding to the combination of Condition 1 (Run / Section) and Condition 2 (Together / Right / Left) are illustrated as shown in the example of FIG. 8, but other conditions may be added to the performance conditions. For example, [A] The range of performance within the song (e.g., bars 1-4 / bars 5-8), [B] For example, whether or not a pedal such as a sostenuto pedal is operated (operated / not operated), [C] The tempo of the performance (for example, the same as the original song, faster than the original song, or slower than the original song), Conditions such as the above may be added to the performance conditions.

[0113] In addition, some of the performance conditions exemplified above may be deleted. For example, condition 2 (Together / Right / Left) may be omitted from the performance conditions.

[0114] (16) In each of the above forms, Analysis screen Gx1 shows the time series of performance proficiency Xc, Analysis screen Gx2 showing the distribution of performance proficiency Xd, The analysis screen Gy1 shows the time series of the performance volume Yc, Analysis screen Gy2 showing the distribution of performance volume Yd and Although an example has been given in which four types of analysis screens G are displayed, it is not essential that all of the analysis screens G (Gx1, Gx2, Gy1, Gy2) be displayed. For example, only one of the four types of analysis screen G exemplified above may be displayed. Furthermore, two or more types of analysis screen G selected from the four types exemplified above may be displayed.

[0115] In a configuration in which the analysis screen Gx1 and the analysis screen Gx2 are not displayed, the calculation of the performance proficiency X (first analysis unit 321 / step S1) may be omitted. In a configuration in which the performance proficiency X is not displayed, the reference data R may be omitted. Furthermore, in a configuration in which the analysis screen Gy1 and the analysis screen Gy2 are not displayed, the calculation of the performance amount Y (second analysis unit 322 / step S2) may be omitted. In a configuration in which the musical score (E22, E42) is not displayed, the musical score data M may be omitted.

[0116] Furthermore, it is not necessary to calculate all types of performance proficiency X (Xa, Xb, Xc, Xd), but it is sufficient to calculate the performance proficiency X required to display the analysis screen G. Similarly, it is not necessary to calculate all types of performance amounts Y (Ya, Yb, Yc, Yd), but it is sufficient to calculate the performance proficiency X required to display the analysis screen G.

[0117] (17) In the above-described embodiments, the performer Ua plays the keyboard instrument 10, but the type of instrument played by the performer Ua may be changed as desired. For example, the above-described embodiments can be applied to the performance of any instrument, such as a string instrument, a wind instrument, or a percussion instrument.

[0118] (18) As mentioned above, the functions of the information processing system 20 illustrated above are realized by cooperation between one or more processors constituting the control device 21 and a program stored in the storage device 22. The program according to the present disclosure may be provided in a form stored on a computer-readable recording medium and installed on a computer. The recording medium may be, for example, a non-transitory recording medium, such as an optical recording medium (optical disk) such as a CD-ROM, but may also include any type of recording medium, such as a semiconductor recording medium or a magnetic recording medium. Note that a non-transitory recording medium includes any recording medium other than a transitory, propagating signal, and does not exclude volatile recording media. Furthermore, in a configuration in which a distribution device distributes a program via a communication network, the storage medium that stores the program in the distribution device corresponds to the non-transitory recording medium described above.

[0119] (19) The term "nth" (n is a natural number) in this application is used only as a formal and convenient label to distinguish each element in the description and does not have any substantive meaning. Therefore, there is no room for restrictive interpretation of the position of each element or the order of production, etc., based on the term "nth."

[0120] D: Notes From the above description, for example, preferred aspects of the present disclosure can be understood as follows: Note that, in order to facilitate understanding of each aspect, reference numerals in the drawings are conveniently written in parentheses below, but this is not intended to limit the present disclosure to the illustrated aspects.

[0121] An information processing method according to one aspect (aspect 1) of the present disclosure acquires a plurality of pieces of performance data representing a musical instrument performance, calculates a performance proficiency (Xc) for each performance period (T) by analyzing the plurality of pieces of performance data, and displays a time series of the performance proficiency (Xc) for each performance period (T) on a display device. In the above aspect, the time series of the performance proficiency (Xc) calculated for each unit period by analyzing the plurality of pieces of performance data is displayed. Therefore, the general trend of change in the performance proficiency (Xc) over time can be visually and intuitively grasped. Note that the analysis screen Gx1 in FIG. 3 is an example of a display according to aspect 1.

[0122] "Performance data" is data in any format that represents a musical instrument performance. For example, time-series data that represents the time series of performance content (e.g., musical notes) or audio data that represents the waveform of a performance sound are examples of "performance data." Note that "plural performance data" may be a collection of performance data that represents a performance by a single performer, or a collection of performance data that represents performances by multiple different performers. Furthermore, each of the multiple performance data may be a collection of performance data that represents a performance of a single piece of music, or a collection of performance data that represents the performance of different pieces of music.

[0123] "Performance proficiency" is an index that represents the degree of proficiency in playing a musical instrument. Specifically, performance proficiency is calculated based on the difference between reference data that represents an exemplary performance and the performance data. However, performance proficiency may also be calculated based on an evaluation that does not require comparison with reference data, such as the stability of pitch or performance speed. In other words, comparison with reference data is not required to calculate performance proficiency.

[0124] In a specific example (Aspect 2) of Aspect 1, the calculation of the performance proficiency (Xc) involves calculating a performance proficiency (Xb) for each piece of performance data by analyzing the multiple pieces of performance data, and calculating a representative value of the performance proficiency (Xb) for the performance period (T) as the performance proficiency (Xc) for that performance period (T). In the above aspect, the representative value of the performance proficiency (Xb) for each piece of performance data for that performance period is calculated and displayed as the performance proficiency (Xc) for that performance period. Therefore, it is possible to accurately grasp the tendency for the performance proficiency (Xc) to change over time for each performance period.

[0125] An information processing method according to one aspect (aspect 3) of the present disclosure acquires a plurality of performance data representing a musical instrument performance, calculates a performance proficiency (Xd) for each analysis section (B) of a musical piece by analyzing the plurality of performance data, and displays the distribution of the performance proficiency (Xd) for the musical piece on a display device. In the above aspect, the distribution of the performance proficiency (Xd) calculated for each analysis section of the musical piece by analyzing the plurality of performance data is displayed. Therefore, it is possible to visually and intuitively grasp the general trend of the distribution of the performance proficiency (Xd) (e.g., which parts of the musical piece are lacking in proficiency). Note that the analysis screen Gx2 in FIG. 4 is an example of a display according to aspect 3.

[0126] The "distribution of the performance proficiency level in a piece of music" refers to the spread of high and low levels of performance proficiency levels in different sections of the piece of music. Note that the "piece of music" may be one piece of music or multiple pieces of music.

[0127] In a specific example (Aspect 4) of Aspect 3, the calculation of the performance proficiency (Xd) involves calculating a performance proficiency (Xa) for each analysis section (B) by analyzing the multiple pieces of performance data, and calculating a representative value of the performance proficiency (Xa) for each analysis section (B) in unit period D as the performance proficiency (Xd) for that analysis section (B). In the above aspect, the representative value of the performance proficiency (Xa) for each analysis section is calculated and displayed as the performance proficiency (Xd) for that analysis section. This allows for an accurate understanding of the distribution trend of the performance proficiency (Xd) in a piece of music.

[0128] An information processing method according to one aspect (aspect 5) of the present disclosure acquires a plurality of pieces of performance data representing the performance of a musical instrument, calculates a performance amount (Yc) for each unit period (D) by analyzing the plurality of pieces of performance data, and displays a time series of the performance amount (Yc) for each unit period (D) on a display device. In the above aspect, a time series of the performance amount calculated for each unit period by analyzing the plurality of pieces of performance data is displayed. Therefore, the tendency of the performance amount to change over time for each unit period can be visually and intuitively grasped. The analysis screen Gy1 in FIG. 5 is an example of a display according to aspect 5.

[0129] "Amount of performance" is an indicator of the total amount of playing of an instrument. Specifically, the duration of performance or the number of times a performance is performed is an example of "amount of performance." When focusing on practicing a musical instrument, "amount of performance" can also be expressed as "amount of practice (duration of practice or number of practice times)."

[0130] In a specific example (aspect 6) of aspect 5, the calculation of the performance amount (Yc) involves calculating the performance amount (Yb) for each piece of performance data by analyzing the multiple pieces of performance data, and calculating the cumulative value of the performance amount (Yb) for the unit period (D) as the performance amount (Yc) for that unit period (D). In the above aspect, the cumulative value of the performance amount (Yb) for each piece of performance data for that unit period is calculated and displayed as the performance amount (Yc) for that unit period. Therefore, it is possible to accurately grasp the tendency for the performance amount (Yc) of a piece of music to change over time for each unit period.

[0131] The "accumulated value" of the unit performance amount is, for example, the sum or weighted sum of a plurality of unit performance amounts corresponding to different unit periods.

[0132] An information processing method according to one aspect (aspect 7) of the present disclosure acquires a plurality of performance data representing the performance of a musical instrument, calculates a performance amount (Yd) for each analysis section (B) of a musical piece by analyzing the plurality of performance data, and displays the distribution of the performance amount (Yd) in the musical piece on a display device. In the above aspect, the distribution of the performance amount (Yd) calculated for each analysis section of the musical piece by analyzing the plurality of performance data is displayed. Therefore, it is possible to visually and intuitively grasp the general trend regarding the distribution of the performance amount (Yd) in the musical piece (for example, which parts of the musical piece are lacking in performance). Note that the analysis screen Gy2 in FIG. 6 is an example of a display according to aspect 7.

[0133] In a specific example (aspect 8) of aspect 7, the calculation of the performance amount (Yd) involves calculating the performance amount (Ya) for each analysis section (B) by analyzing the multiple pieces of performance data, and calculating the cumulative value of the performance amount (Ya) for each analysis section (B) in the unit period (D) as the performance amount (Yd) for that analysis section (B). In the above aspect, the cumulative value of the performance amount for each analysis section is calculated and displayed as the performance amount for that analysis section. This allows for an accurate understanding of the distribution trend of the performance amount in a piece of music.

[0134] In a specific example (Aspect 9) of any of Aspects 5 to 8, the calculation of the performance amount (Yc) involves calculating a performance amount (Yc_k) for each of a plurality of performance conditions, and the display of the performance amount (Yc) involves displaying the performance amount (Yc_k) corresponding to one or more of the plurality of performance conditions on a display device. In the above aspects, the performance amount (Yc_k) corresponding to one or more of the plurality of performance conditions is displayed. Therefore, the tendency of the performance amount (Yc_k) for a specific performance condition can be visually and intuitively grasped.

[0135] The "performance conditions" are conditions related to the performance of an instrument. For example, the "performance conditions" may include whether the entire piece of music is being played (whole performance) or only a part of the piece of music (partial performance), whether the keyboard instrument is being played with the right hand, left hand, or both hands, etc.

[0136] A program according to one aspect (aspect 10) of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple performance data representing the performance of an instrument, a performance analysis unit that calculates performance proficiency (Xc) for each performance period (T) by analyzing the multiple performance data, and a display control unit that displays a time series of performance proficiency (Xc) for each performance period (T) on a display device.

[0137] A program according to one aspect (aspect 11) of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple performance data representing the performance of an instrument, a performance analysis unit that calculates performance proficiency (Xd) for each analysis section (B) of a piece of music by analyzing the multiple performance data, and a display control unit that displays the distribution of performance proficiency (Xd) in the piece of music on a display device.

[0138] A program according to one aspect (aspect 12) of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple performance data representing the performance of an instrument, a performance analysis unit that calculates the performance amount (Yc) for each unit period (D) by analyzing the multiple performance data, and a display control unit that displays a time series of the performance amount (Yc) for each unit period (D) on a display device.

[0139] A program according to one aspect (aspect 13) of the present disclosure causes a computer system to function as a performance data acquisition unit that acquires multiple performance data representing the performance of an instrument, a performance analysis unit that calculates the performance amount (Yd) for each analysis section (B) of a musical piece by analyzing the multiple performance data, and a display control unit that displays the distribution of the performance amount (Yd) in the musical piece on a display device. [Explanation of symbols]

[0140] 100...Performance system, 10...Keyboard instrument, 20...Information processing system, 21...Control device, 22...Storage device, 23...Communication device, 24...Operation device, 25...Display device, 31...Performance data acquisition unit, 32...Performance analysis unit, 321...First analysis unit, 322...Second analysis unit, 33...Display control unit.

Claims

1. Acquire a plurality of performance data representing the performance of a musical instrument; By analyzing the plurality of performance data, a performance proficiency level is calculated for each performance period including a series of performances over a predetermined number of times; A time series of the performance proficiency for each performance period is displayed on a display device. An information processing method implemented by a computer system.

2. In calculating the performance proficiency, calculating a performance proficiency level for each piece of performance data by analyzing the plurality of pieces of performance data; A representative value of the performance proficiency during the performance period is calculated as the performance proficiency for the performance period. The information processing method according to claim 1.

3. Acquire a plurality of performance data representing the performance of a musical instrument; calculating a performance amount for each analysis section of the music piece by analyzing the plurality of performance data; displaying the distribution of the performance amounts in the piece of music on a display device; In calculating the amount of performance, calculating a performance amount for each analysis section by analyzing the plurality of pieces of performance data; The cumulative value of the performance amount for each analysis section in the unit period is calculated as the performance amount for the analysis section. An information processing method implemented by a computer system.

4. a performance data acquisition unit that acquires a plurality of performance data representing the performance of a musical instrument; a performance analysis unit that calculates a performance proficiency for each performance period including a series of performances over a predetermined number of times by analyzing the plurality of performance data; a display control unit that displays a time series of the performance proficiency for each performance period on a display device; A program that makes a computer system function as a

5. a performance data acquisition unit that acquires a plurality of performance data representing the performance of a musical instrument; a performance analysis unit that calculates a performance amount for each analysis section of a musical piece by analyzing the plurality of performance data; a display control unit that displays the distribution of the performance amounts in the piece of music on a display device; A program that causes a computer system to function as The performance analysis unit calculating a performance amount for each analysis section by analyzing the plurality of pieces of performance data; The cumulative value of the performance amount for each analysis section in the unit period is calculated as the performance amount for the analysis section. program.

Images