Data generation device and program

Abstract

Data generation device (10), comprising: a capture part (101) that captures measurement data showing measured values ​​captured in chronological order, showing one of a plurality of positions, including at least one position below a rest position and an end position of a key, or showing one of a plurality of positions contained within a movable range of an element coordinating with the key, for each of a plurality of keys; a data generation part (105) that generates display data for displaying a screen showing the measured values ​​corresponding to each of the plurality of buttons based on the acquired measurement data, such that the measured values ​​corresponding to each of the plurality of buttons are displayed accordingly on a plurality of band-like regions in the screen, each corresponding to the plurality of buttons along a time axis, wherein the displayed measured values ​​correspond to a sub-area on the time axis, and are extracted from the measured values ​​corresponding to each of the plurality of buttons; and a specification part (103) that specifies a period from a key press to a key release, based on the measured values, wherein the data generation part (105) further generates display data such that the period from key press to key release, corresponding to the plurality of keys, is displayed on the plurality of band-like regions along the time axis.

Description

Technical field

[0001] The present invention relates to a technology for generating data corresponding to playing a piano. State of the art

[0002] There is a technology in which playing a piano is recorded with a sensor that measures the movement of a key. A method is known in which the playing thus recorded is represented by displaying a pressed key. There is a method in which, for example, in an area where a key pitch is defined vertically and a time axis horizontally, the content of the playing is displayed in a ribbon-like image extending along the time axis by arranging a period (a period from pressing the key to releasing it) during which the key is pressed. This method is commonly referred to as a "piano roll." For example, as disclosed in JP 2014-186 154 A, various representation methods using the piano roll are being investigated.

[0003] For example, piano instruments that can detect the pressing of a key by means of a sensor are known from US 2005 / 0 204 908 A1, JP 2014-186 154 A and US 7 982 118 B1. Summary of the invention: Technical problem

[0004] One piece of information recorded when a piano performance is a key pressed, the time of key press, and the time of key release. This information is used in a general piano roll display. However, compared to an actual performance, this display offers very little detail. With such a display, broad aspects of the performance can be visually discerned, while subtle details may go unnoticed. Therefore, even if a player intends to improve their technique by analyzing their own performance, the amount of information provided by a general piano roll display is insufficient.

[0005] One of the objectives of the present invention is to enable the display of a larger amount of information by using a region defined by the pitch of a key and a time axis, such as the piano roll display. Solution to the problem

[0006] The subject matter of the independent claims solves the technical problem. The dependent claims describe further preferred embodiments, and this description discloses how the invention can be carried out. According to one embodiment of the present invention, a data generation device comprises: a sensing part that acquires measurement data showing measured values ​​that indicate the behavior of a button or an element coordinated with the button, in chronological order according to each of a plurality of buttons; and a data generation part that generates display data for showing a screen that displays the measured values ​​corresponding to a plurality of buttons along the same time axis based on the measurement data, wherein the displayed measured values ​​correspond to a sub-range on a time axis that is extracted from the measured values ​​corresponding to each of the buttons based on the measured values.

[0007] An area displaying the measured values ​​on the screen can be divided into bands along a time axis corresponding to each of the multiple buttons; and a change in the measured value in a band-divided region can be represented by a change in position in a latitude direction within the region.

[0008] An area displaying the measured values ​​on the screen can be divided into bands along a time axis corresponding to each of the multiple buttons; and a change in the measured value in a band-divided region can be represented by a color change in the region.

[0009] An area displaying the measured values ​​on the screen can be divided into bands along a time axis corresponding to each of the multiple buttons; and a change in the measured value in the band-divided region can be represented by a change in the occupancy in the latitude direction of the region.

[0010] The data generation device may include a specific part for indicating a period of time from pressing the button until releasing the button based on the measured values, and the display data further serves to indicate the period of time corresponding to a plurality of buttons on the screen.

[0011] Measurement values ​​relating to the behavior of both the button and the element coordinating with the button can be displayed on the screen.

[0012] The display data can include data for further display of a score, for displaying a first instruction screen to assign a position on a time axis on the screen, and for displaying a second instruction screen to assign a position corresponding to that position in the score.

[0013] The data acquisition unit can also capture secondary measurement data, displaying second readings that reflect operator behavior in chronological order. These secondary readings, which spread across a region corresponding to multiple key presses, are displayed on the screen along the timeline, and changes in the secondary reading can be indicated by color changes.

[0014] Operator behavior can include the behavior of a pedal or an element coordinating with the pedal.

[0015] Furthermore, a playback component can be provided that performs the playback of the period corresponding to an instructed area on the screen based on pronunciation data that defines the content of the pronunciation in chronological order.

[0016] Furthermore, according to one embodiment of the present invention, a program is provided for executing a computer to acquire measurement data that chronologically displays measured values ​​showing the behavior of a button or an element coordinating with the button, corresponding to each of the plurality of buttons, and to generate display data that shows a screen for displaying the measured values ​​corresponding to a plurality of buttons along the same time axis, based on the measurement data, and which displays by extracting a range of a part on a time axis according to the measured values ​​corresponding to each of the buttons. Advantageous effects of the invention

[0017] According to the present invention, a larger amount of information can be displayed when using a region defined by the pitch of a key and a time axis, such as the piano roll display. Brief description of the drawings Fig. Figure 1 is a diagram showing the constitution of a system in one embodiment of the present invention. Fig. Figure 2 is a diagram showing the structure of a piano in one embodiment of the present invention. Fig. Figure 3 is a block diagram showing the construction of a measuring device in one embodiment of the present invention. Fig. Figure 4 is a block diagram showing a hardware constitution of an analysis support device in an embodiment of the present invention. Fig. Figure 5 is a block diagram showing the constitution of an analysis support function in an embodiment of the present invention. Fig. Figure 6 is a diagram showing an example of an analysis support screen in an embodiment of the present invention. Fig. Figure 7 is a diagram showing an example of a key behavior pattern in an embodiment of the present invention. Fig. Figure 8 is a diagram showing an example of a pedal behavior pattern in an embodiment of the present invention. Fig. Figure 9 is a flowchart to illustrate an analysis support process in one embodiment of the present invention. Fig. Figure 10 is a flowchart to illustrate a drawing process in an embodiment of the present invention. Description of the embodiments

[0018] The following section describes in detail, with reference to the diagrams, a system in one embodiment of the present invention. An embodiment shown below is an example of embodiments of the present invention; the present invention is not limited to these embodiments. Furthermore, in the diagrams referenced in the present embodiment, a part or a part with a similar function is designated with the same or a similar reference numeral (reference numeral with only A or B after the number), and repetition of the description may be omitted. <Ausführungsform> [1. Overview of the system]

[0019] Fig. Figure 1 is a diagram illustrating the configuration of a system in one embodiment of the present invention. This system comprises an analysis support device 1, a measuring device 30, a sound recording device 40, and a piano 50. When a user plays the piano 50, the behavior of the keys and pedals is measured by the measuring device 30. A measurement result is provided to the analysis support device 1. The sound recording device 40 is, for example, a microphone and converts an input sound into an electrical signal (sound signal). The sound recording device 40 can be equipped with a memory that records the sound signal. A playing tone input into the sound recording device 40 is provided to the analysis support device 1.The analysis support device 1 provides the user with information entered via information output devices such as a display and a speaker. Each of the system's components is described in detail below. [2nd piano]

[0020] In this example, "piano 50" refers to a general upright piano. It should be noted that "piano 50" can be any acoustic piano other than an upright piano. Furthermore, "piano 50" can be an electronic musical instrument, such as an electronic piano, without being limited to acoustic pianos. In this example, part of the measuring device 30 is located in "piano 50".

[0021] Fig. Figure 2 is a diagram showing the structure of a piano in an embodiment of the present invention. The piano 50 is an example of a keyboard instrument having a keyboard on its front panel, in which a plurality of keys 52, operated by a player, and pedals 53 are arranged. In this example, there are a plurality of pedals 53, but at least one damper pedal is included. A hammer 54 is provided to respond to each of the keys 52. The hammer 54 is an element coordinated with the key 52 and moves when the key 52 is pressed, transmitting a force via an action mechanism to strike a string 55 corresponding to each of the keys 52. The string 55 produces a tone through the strike of the hammer 54.

[0022] A damper 58 is moved by a damper actuation mechanism. The damper actuation mechanism moves the damper 58 such that a contact state of the damper 58 and the string 55 is controlled according to a depress amount of the key 52 and a step amount of the pedal 53. [3. Measuring device]

[0023] Fig. Figure 3 is a block diagram showing the configuration of the measuring device in one embodiment of the present invention. As described above, part of the measuring device 30 is installed in the piano 50. The following refers to Fig. 2 and Fig. 3 the measuring device 30 is described. The measuring device 30 comprises a key position measuring unit 32, a pedal position measuring unit 33, a hammer position measuring unit 34 and a data output device 35.

[0024] The key position measuring unit 32 contains key sensors, one for each of the keys 52. The key position measuring unit 32 measures a position (corresponding to the amount of depression) of each of the keys 52 by the key sensor as a continuous value (fine resolution) and outputs a measurement value indicating a measurement result (hereinafter referred to in some cases as "a key position measurement"). The measurement value is output accordingly for each of the keys 52. It should be noted that the key sensor can output a measurement value indicating that the key 52 has passed a specific key position, rather than outputting the measurement value corresponding to the position of the key 52. ​​The specific pressure positions are a multitude of positions within the range of a rest position of the key 52 to an end position. The multitude of positions can be a position that causes a transition to a tone-generating state, such as the start of tone generation or the start of damping.In this way, the measured value output by the key position measuring unit 32 can be information indicating the behavior of the key 52.

[0025] The pedal position measuring unit 33 contains pedal sensors, one for each of the pedals 53. The pedal position measuring unit 33 measures a position (corresponding to a step value) of each of the pedals 53 using the pedal sensor as a continuous value (fine resolution) and outputs a measurement value indicating a measurement result (hereinafter referred to in some cases as the "pedal position measurement"). This measurement value is output for each of the pedals 53 accordingly. It should be noted that the pedal sensor can output a measurement value indicating that the pedal 53 has passed a specific position, rather than outputting the measurement value corresponding to the position of the pedal 53. The specific positions are a multitude of positions contained within a moving range of the pedal. Therefore, the measurement values ​​output by the pedal position measuring unit 33 can provide information indicating the behavior of the pedal 53.When the following description refers to pedal 53, this refers to the damper pedal. Accordingly, the pedal position measurement corresponds to the position of the damper pedal (step amount).

[0026] The hammer position measuring unit 34 contains a hammer sensor, one for each of the hammers 54. The hammer position measuring unit 34 measures a position (corresponding to a degree of movement) of each of the hammers 54 using the hammer sensor as a continuous value (fine resolution) and outputs a measurement value indicating a measurement result (hereinafter referred to in some cases as the "hammer position measurement"). This measurement value is output for each of the hammers 54 accordingly. It should be noted that the hammer sensor can output a measurement value indicating that the hammer 54 has passed a specific position, rather than outputting the measurement value corresponding to the position of the hammer 54. The specific positions are a multitude of positions contained within a moving range of the hammer. Therefore, the measurement values ​​output by the hammer position measuring unit 34 can provide information indicating the behavior of the hammer 54.

[0027] The data output device 35 is located, for example, on the underside of a keybed of the piano 50. The data output device 35 comprises a data generation unit 351 and an interface 353, and based on the information output by the key position measuring unit 32, the pedal position measuring unit 33 and the hammer position measuring unit 34, measurement data and control data are generated and output.

[0028] The data generation unit 351 generates measurement and control data based on the information output by the key position measurement unit 32, the pedal position measurement unit 33, and the hammer position measurement unit 34. The measurement data includes the key position measurements corresponding to each of the keys 52, the hammer position measurements corresponding to each of the hammers 54, and the pedal position measurement corresponding to the pedal 53 (damper pedal). The control data is obtained by converting each of the measurement values ​​into a predetermined data format (e.g., MIDI format) that chronologically defines a tone generation sequence. The control data includes information such as note number, note on, note off, velocity (on velocity (key velocity at the time of note on), off velocity (key velocity at the time of note off)), and control change (pedal step amount).

[0029] Interface 353 is configured to send and receive data via an external connection, either wired or wirelessly. Measurement and control data generated by the data generation unit 351 are output to the external device connected to interface 353. The external device can be an arithmetic processing device or a recording medium such as a semiconductor memory. In this example, the external device comprises the analysis support device 1. It should be noted that the measurement and control data can be output to the external device in real time or after being stored as chronological information along with time information in a memory. In either case, the measurement and control data contain chronologically ordered information.For example, the measurement data are the data that display each measured value chronologically. What has been described above is a description of the measuring device 30. [4. Analysis support device]

[0030] The analysis support device 1 generates information to support the analysis of a user's game content based on information output by the measuring device 30. Functions implemented in the analysis support device 1 include a function (analysis support function) for generating display data to show a detail (referred to in some cases below as the "analysis support screen") of a user's game content on a screen (a display unit 17 described below). The analysis support device 1 can be described as a data generation device for generating data for displaying the analysis support screen such as this one. [4-1. Hardware configuration of the analysis support device].

[0031] Fig. Figure 4 is a block diagram showing a hardware configuration of the analysis support device in one embodiment of the present invention. The analysis support device 1 is a device capable of performing a predetermined function by executing a program, for example, on a personal computer. The analysis support device 1 comprises a control unit 11, a storage unit 13, an operating unit 15, a display unit 17, and an interface 19. These components are interconnected via a bus.

[0032] The control unit 11 contains an arithmetic processing circuit, such as a CPU. The control unit 11 implements various types of functions in the analysis support device 1 by executing a control program stored in the memory unit 13 via the CPU. The implemented functions include the analysis support functions described above.

[0033] Storage unit 13 is a storage device such as non-volatile memory or a hard disk. Storage unit 13 contains a control program for implementing the analysis support functions. The control program can be computer-executable and can be provided in a state stored on a recording medium readable by the computer, such as a magnetic recording medium, an optical recording medium, a magneto-optical recording medium, or a semiconductor memory. In this case, the analysis support device 1 can be equipped with a device for reading the recording medium. Alternatively, the control program can be downloaded via a network.

[0034] Storage unit 13 can store the measurement data and control data acquired by measuring device 30. In addition, storage unit 13 stores score data for various musical pieces. This score data, for example, displays the audio production content of music and is data that can also be presented as a score. It should be noted that the individual data can be stored in an external storage device (server, recording medium) that can be connected via cable or wirelessly, instead of being stored in storage unit 13.

[0035] The operating unit 15 is an input device, such as a control knob, a keypad, and a handheld device, provided on a control panel and a remote control, and outputs a signal to the control unit 11 according to an input command. A user instruction can be entered into the analysis support device 1 using the operating unit 15.

[0036] The display unit 17 is a display device, such as a liquid crystal display or an organic EL display, and shows a screen based on the control provided by the control unit 11. This screen displays the display data generated by the analysis support function. It should be noted that the control unit 15 and the display unit 17 together can form a control panel.

[0037] Interface 19 is capable of sending and receiving data via a wired or wireless connection to the external device. The measurement and control data generated in the measuring device 30 are acquired by the analysis support device 1 via interface 19. Furthermore, an audio signal or similar signal generated in the recording device 40 is also acquired by the analysis support device 1 via interface 19. Additionally, an audio output device, such as a loudspeaker, can be connected to interface 19. In this case, the audio signal can be provided by the analysis support device 1 to the loudspeaker, allowing the sound to be played back. [4-2. Software configuration of the analysis support device]

[0038] An analysis support function is described that is implemented when the control unit 11 of the analysis support device 1 executes the control program. It should be noted that part or all of the configuration that implements the analysis support function described below can be implemented by the hardware.

[0039] Fig. Figure 5 is a block diagram showing the constitution of the analysis support function in an embodiment of the present invention. The analysis support function 10 comprises a data acquisition part 101, a specification part 103, a display data generation part 105, a playback position command part 111, a playback part 113, and a score acquisition part 121.

[0040] The data acquisition unit 101 acquires the measurement data and the control data from the measuring device 30. In addition, the data acquisition unit 101, in this example, acquires an audio signal from the recording device 40.

[0041] Specification part 103 specifies a period until note-in and note-out, i.e., a period from pressing the key until releasing the key (hereinafter referred to in some cases as "a key press period"), for each of the keys based on the control data acquired by data acquisition part 101. As described above, the control data is the data generated by the measuring device 30 based on the measured value. Therefore, specification part 103 can be said to specify the key press period based on the measured value.

[0042] A score acquisition unit 121 acquires the score data of music ordered by a user from the storage unit 13. The score acquisition unit 121 analyzes the control data acquired by the measuring device 30 or an audio signal acquired by the recording device 40, compares it with a variety of score data stored in the storage unit 13 and can acquire score data that corresponds to a very similar piece of music.

[0043] The display data generation unit 105 generates display data for the display of an analysis support screen on the display unit 17 based on various types of information such as measurement data, control data, and score data. The display data is stored in the memory unit 13. The control unit 11 initiates the display of the analysis support screen on the display unit 17 based on the display data.

[0044] Fig. Figure 6 is a diagram showing an example of the analysis support screen in an embodiment of the present invention. In this example, the analysis support screen comprises a player score region 700, a score region 800, and a control symbol region 900.

[0045] The player results region 700 is a region that, similar to a piano roll display, shows an image corresponding to the game content. In this region, a pitch (corresponding to a note number) KN of a key is defined vertically, and a time t is defined horizontally. Vertically, a key image 710 is displayed, showing an arrangement of keys corresponding to a pitch. It should be noted that player results region 700 displays a portion of a total game period; by scrolling the display in one direction along a time axis, a range of the displayed period can be varied.

[0046] Here, following a general representation of piano rolls, a key press period is often expressed by a ribbon-like image. However, in the present example, instead of simply displaying a playing result with a ribbon-like image, the playing content can be captured in more detail by a key behavior image 770. Furthermore, in this example, the pedal behavior is also displayed as a pedal behavior image 730 in the same region as the region where the key behavior image 770 is displayed. Both the key behavior image 770 and the pedal behavior image 730 are images that vary depending on the measurement and control data. These images are described in more detail below.

[0047] In the player results region 700, a larger view can be displayed by specifying a particular range. For example, by specifying a range in Fig. The region SA shown in section 6 is extended and displayed in such a way that it overlaps with a region of a part of the display unit 17 (e.g., a display that is in Fig. 7 is shown).

[0048] In player score region 700, an instruction screen 750 (first instruction screen) is displayed, showing a playback position. Instruction screen 750 is used to assign a position on a timeline within player score region 700.

[0049] Score region 800 is a region that displays a score based on score data captured by score capture part 121. Score region 800 displays an instruction screen 850 (second instruction screen) that shows a playback position. Instruction screen 850 is an image of the instruction for a position in the score. The position in the score corresponds to a position on a timeline instructed by instruction screen 750. Therefore, if a position instructed by instruction screen 750 varies, a position in the score instructed by instruction screen 850 will also vary. Note that score region 800 may not exist.

[0050] A position on the timeline in the player result region 700 and a position on the score in the score region 800 are linked by a so-called score alignment technique. This technique analyzes game content (measurement data, control data, or audio signal) and connects a timeline of the game content with a timeline of the audio production content of the given music. By assigning, for example, each note of the game content and each note of the audio production content of the music, it is possible to determine which part of the music is performed, even with fluctuations in the game speed. At this point, using the score data and a correspondence relationship between the game and the music, a position on the timeline of the game content and a position on an image of the score can also be assigned.Although various known techniques can be applied to this technique, techniques disclosed, for example, in JP 2017-181 724 A and JP 6 187 132 B2 can be used.

[0051] A control symbol region 900 is a region displaying a variety of symbols that receive user input. These symbols allow the user to change a position (a position on a timeline in the player score region 700) as instructed by an instruction screen 750. In this example, four symbols are displayed. These symbols receive, sequentially from the left, a fast rewind, a short pause, a play start, and a fast forward.

[0052] Back to Fig. 5, the description continues. The Playback Position command part 111 determines a position on the timeline in the player score region 700, which corresponds to operating the icons in a control icon region 900. For example, if the playback start is determined by the icon, a position to be determined is forwarded from a position defined at that time over time. The Playback Position command part 111 outputs a specific position to the Playback part 113 as the playback position. At that time, the instruction screen 750 and the instruction screen 850 change a position defined according to the playback position.

[0053] The playback section 113 plays back an audio signal captured by the sound recording device 40 when a playback start instruction is received via an operation on the symbol in the control symbol region 900. A playback position on the time axis is instructed by the playback position instruction section 111. At this point, instead of playing back an audio signal, the tone based on the control data can be played back using a sound source. Thus, both the audio signal and the control data can be referred to as tone production data, which chronologically define the content of the tone to be played back (produced tone). What has been described above is a description of one constitution of the analysis support function. [4-3. Key behavior diagram]

[0054] A detailed image of key behavior 770 is then displayed in the player result region 700. Here, with Fig. 7. A description is given that is an example of how the SA region is represented by expansion.

[0055] Fig. Figure 7 is a diagram showing an example of a key behavior pattern in one embodiment of the present invention. As shown in Fig. As shown in Figure 7, the band-divided regions BN (BN-1, BN-2, BN-3) are arranged according to a division KN for each key. The key behavior image 770, corresponding to one key of each pitch, is displayed in a region BN (in this example, region BN-2), which is subdivided according to the key. In this example, the key behavior image 770 contains a band-like image CD, a key position image KP, and a hammer position image HP. The band-like image CD is an image displayed with a predefined width along a partition of region BN. Both the key position image KP and the hammer position image HP are images expressed in a line and, desirablely, have distinct shapes that can differ from one another. In this example, a dotted line (a key position image KP) and a solid line (a hammer position image HP) represent different shapes.Because the different shape, the difference in line width, the difference in line color are illustrated.

[0056] The ribbon-like image CD is displayed based on the control data. A lateral region (direction of time t: direction of the time axis) of the ribbon-like image CD is defined by a region from a note time on Non to a note time off Noff, i.e., by the key press period. A vertical region (a pitch direction KN) of the ribbon-like image CD has a length corresponding to the magnitude of the on-speed Von at a position of the note on Non and a length corresponding to the magnitude of the off-speed Voff at a position of the note off Noff. This length can be expressed as an occupancy in the latitude direction of the region BN. The ribbon-like image CD becomes trapezoidal when the on-speed Von and the off-speed Voff are different. As an example in Fig. As shown in Figure 7, an On-Speed ​​value (V) can be displayed adjacent to a Note's position set to Non. Furthermore, an Off-Speed ​​value (Voff) can be displayed near a Note's Off position (Noff). In this example, the On-Speed ​​value "43" and the Off-Speed ​​value "2C" are encoded in hexadecimal.

[0057] The key position image KP (dotted line) is displayed based on a measurement value corresponding to each key shown by the measurement data. The key position image KP is an image showing a position (a depression amount) corresponding to region BN. A key position at any given time t corresponds to a vertical direction (a pitch KN direction) within region BN. In this example, under region BN, on a high-pitch side (a side of region BN-1 within region BN-2), the key is shown in a rest position (a position that is not pressed). On a low-pitch side, the key is shown in an end position (a fully depressed position). A starting point DS of the key position image KP corresponds to a time at which a key press is initiated.The endpoint DE of the key position image KP corresponds to a point in time at which a constant time HT has elapsed since the key has come to rest in its rest position. This allows a user to confirm a movement of the key from the moment it is pressed until it is released (a point in time after it has moved a short distance from the key release).

[0058] The hammer position image HP (a solid line) is displayed based on a measurement corresponding to each hammer shown by the measurement data. The hammer position image HP is an image showing the position of a hammer (a movement amount) coordinated with the key corresponding to region BN. A position of the hammer at any given time t corresponds to a vertical direction of region BN. In this example, on a side with low pitch, the hammer in region BN is in a default position (a position of the hammer when the key is not pressed). On the other side, with high pitch, the hammer is in a position where it strikes a string. The hammer position image HP is displayed in the area corresponding to the starting point DS to the endpoint DE above.This allows a user to confirm the movement of the hammer from pressing the key until releasing it (a point in time after it is slightly away from the key release). It should be noted that both the start point DS and the end point DE can be determined based on the movement of the hammer.

[0059] As described above, the key position image KP and the hammer position image HP do not display measurements corresponding to a full period, but rather measurements obtained by extracting a portion of the data on the time axis. Displaying this data by extracting a portion in this way improves visibility in the 700-player score region. A method for displaying data by extracting such data is described in the analysis support process described below. [4-4. Pedal behavior pattern]

[0060] The following describes pedal behavior image 730. Pedal behavior image 730 is displayed based on a measurement corresponding to a pedal, which shows the measurement data. Pedal behavior image 730 is an image corresponding to a position (a step amount) of the pedal, and the measurements at any given time are displayed by extending across a variety of regions BN. In this example, the measurements at any given time are displayed across the entire region BN, which is shown in player score region 700. At this point, pedal behavior image 730 expresses the measurements through a color change. In a Fig. In the example shown, each of the regions L0, L1, and L2 is represented by a different color. Region L0 shows a period in which the pedal is in a rest position (a state in which the pedal is not depressed). On the other hand, region L2 shows a period in which the pedal is in an end position (a state in which the pedal is fully depressed). Region L1 shows a period in which the pedal is in a position between the rest position and the end position.

[0061] The color change in pedal behavior image 730 shows, as an example, at least one or a change in a multitude of combinations of color, saturation, and brightness. It should be noted that in a state where the pedal is in a rest position, the color can be made identical to the background of the player result region 700. In this case, the color change can be caused in such a way that pedal behavior image 730 significantly alters the transmission level.

[0062] Fig. Figure 8 is a diagram showing an example of the pedal behavior pattern in one embodiment of the present invention. Fig. Section 8 describes a color change in the pedal behavior image 730 in a more easily understandable way. Fig. 7, when the pedal is between the rest position and the end position, although region L1 is one brightness level in Fig. Figure 8, shown, illustrates an example with three stages. This provides a more detailed representation of the pedal's position. In a diagram where a time axis runs laterally and brightness is shown vertically, a change in the color (brightness) of the pedal's behavior over time is shown in Figure 730. In this example, the brightness decreases as the pedal approaches its rest position and increases as it approaches its end position. In an example of Fig. Figure 8 shows a state in which the pedal has been pressed, followed by a state in which the pedal is pressed again after a single return. Following this example, even when the pedal is released, the color change is faster if the pedal is pressed again (the color change is abrupt).

[0063] It should be noted that the brightness can be displayed by differentiating between several levels. At this point, the resolution of the pedal position measurement and the resolution (corresponding to the number of levels) of the brightness contained in the measurement data can be set to be the same or different. In this case, the pedal position measurement can be converted into each of the brightness levels using a predefined calculation method. [4-5. Analysis Support Process]

[0064] An analysis support treatment performed by the analysis support function 10 is described with reference to Fig. 9 described. The analysis support process is started by a user instruction.

[0065] Fig. Figure 9 is a flowchart describing the analysis support process in one embodiment of the present invention. The control unit 11 acquires the measurement data received from the measuring device 30 (step S100). The measurement data acquired here includes first measurement data, which chronologically shows key position and hammer position measurements, and second measurement data, which chronologically shows pedal position measurements. It should be noted that in this example, the control data is also acquired. In addition, an audio signal is acquired from the audio recording device 40.

[0066] The control unit then generates 11 display data for the analysis support screen (step S200), based on each of the acquired pieces of information. As described above, the analysis support screen contains at least the player score region 700. Player score region 700 is a region where measurements corresponding to each of the keys are displayed along a time axis as the key behavior image 770. Additionally, the key behavior image 770 corresponding to a plurality of keys is displayed along the same time axis. At this point, measurements within a portion of the time axis are displayed as key behavior image 770 over an entire duration. Subsequently, among the processes that generate the display data, a drawing process for displaying the key position image KP and the hammer position image HP is described. [4-6. Drawing process of key position image KP and hammer position image HP]

[0067] Fig. Figure 10 is a flowchart describing a drawing process in one embodiment of the present invention. The drawing process is executed according to each of the keys. First, the control unit 11 initializes itself at time t=0 (step S201) and continues the process from t to t=t + 1 (step S203). The control unit 11 reads a key position measurement KPm(t) at time t and a hammer position measurement HPm(t) at time t from the measurement data (step S205). At this point, when KPm(t) exceeds the last data and the measurement data is complete (step S207; Yes), the control unit 11 terminates the drawing process. If, on the other hand, the measurement data does not end (step S207; No), the control unit 11 determines whether KPm(t) = 0 (the key is in a rest position) or not (step S211). If KPm (t) = 0 (step S211; Yes), control unit 11 returns to step S203 and continues a process.

[0068] If KPm(t) is not 0 (step S211; No), the control unit 11 records KPm(t) and HPm(t) at a position corresponding to a time t in region BN, which corresponds to a target key (step S213). The control unit 11 advances time t until t = t + 1 (step S215). The control unit 11 reads a key position measurement KPm(t) and a hammer position measurement HPm(t) from the measurement data (step S217). At this point, when KPm(t) exceeds the last data and the measurement data is complete (step S219; Yes), the control unit 11 terminates the drawing process. If, however, the measurement data is not complete (step S219; No), the control unit 11 determines whether KPm(t) is 0 or not (step S221). If KPm (t) is not 0 (step S221; No), the control unit 11 sets a hold time to tc= 0 (step S223), returns to step S213 and continues a process.Repeating the process draws the key position image KP and the hammer position image HP.

[0069] In the case of KPm (t) = 0 (step S221; Yes), the control unit 11 transitions from tc to tc = tc + 1 (step S225) and determines whether tc = HT or not (step S227). This HT corresponds to the one in Fig.The constant time HT described in section 7 is used. If tc is not HT (step S227; No), control unit 11 returns to step S213 and continues the process. If tc = HT (step S227; Yes), control unit 11 initializes to tc = 0 (step S229), returns to step S203, and continues the process. Thus, at KPm(t) = 0, the process continues until tc = HT is reached, until a state is reached where KPm(t) is not 0, i.e., until the next key press, the drawing of the key position image KP and the hammer position image HP is stopped. That is, the key position measurement and the hammer position measurement are partially extracted on the time axis and displayed in performance result region 700 as the key position image KP and the hammer position image HP. What has been described above is a description of the drawing process.

[0070] It should be noted that, due to this drawing process, if a user performs an initial key press followed by a release, and immediately afterwards a second key press, the first and second key presses can be integrated as a single Key Behavior Image 770 (the key position image KP and the hammer position image HP). Since in this case a key press period consists of two durations, there are two ribbon-like images CD in a Key Behavior Image 770, even though the key position image KP and the hammer position image HP are each one. For example, in the case of a playing procedure where a key is struck repeatedly, there are many ribbon-like images CD in a Key Behavior Image 770. [5. Content of the analysis support]

[0071] According to the analysis support device 1, the following analysis support features can be provided to users in an analysis support screen (especially the player result region 700). (1) According to the key position diagram KP and the hammer position diagram HP, when playing (key pressing operation) where keys are used that are separated in pitch, details of key pressing operations with corresponding keys can be easily compared because they are displayed on the same timeline. For example, when playing a melody and an accompaniment, it is easy to compare at what time the keys are pressed. (2) Using the key position image KP and the hammer position image HP, a relationship between a key movement and a hammer movement coordinated with the key can be easily confirmed. Thus, a correlation between the behavior of the hammer and the key pressing method (large or small key press amount, strong or weak, or repeated strike) can be easily confirmed. (3) According to the pedal behavior image 730, a key of any pitch can be easily confirmed due to its relationship with the key position image KP, since it is displayed distributed over the region BN, which corresponds to a plurality of keys, via a positional relationship on a time axis between the time of key press and the time of pedal depress. At this time, the sound distortion is also confirmed by the playback of a tone signal. (4) Whether the same tendency exists in the similar phrase when using the key-pressing method, or whether there is a certain habit of pressing the key with the same finger, can be easily confirmed. At this point, a part with a similar phrase can be readily confirmed by confirming the display in score region 800. <modifikationsbeispiel>

[0072] Although one embodiment of the present invention has been described above, an embodiment of the present invention can be modified in various ways, as shown below. Furthermore, the modified examples described below can be applied in various combinations. (1) In the player result region 700 in the above illustration, an image (or an image obtained by modification of the waveform) showing the waveform of an audio signal captured by a sound recording device 40 may be displayed on the same time axis. (2) In the player result region 700 in the above embodiment, the pedal behavior image 730 may not be displayed. (3) In the player result region 700 in the foregoing embodiment, the key behavior image 770 may not be displayed. In this case, a piano roll display, as in the conventional technique, i.e., an image showing a key press period for each of the keys, may be displayed in an area where the pedal behavior image 730 is displayed. (4) In the preceding embodiment, although a value of an on-speed Von and a value of an off-speed Voff were displayed by numerical values ​​in a ribbon-like image CD, a value of the key position image KP, a value of the hammer position image HP, or a value of the pedal behavior image 730 can be displayed in a similar manner. At this time, by extracting a point at which the measurement caused a predetermined change, a measurement of that point can be displayed. (5) Although the key position image KP and the hammer position image HP are linear images showing the measured values ​​with a position in the vertical direction in the region BN, in the foregoing embodiment any image may be used as long as an image is displayed by a method that can visually detect a variation of the measured value, such as an image (linear or band-like) that expresses the measured value by changing the color. (6) In the foregoing embodiment, an image based on a color change, such as the pedal behavior image 730, which is distributed across region BN corresponding to a plurality of keys, can represent operator behavior, such as that of a rotary controller, instead of pedal behavior. That is to say, an image displayed across region BN corresponding to a plurality of keys is not limited to an image indicating pedal behavior, as long as the operator's behavior in entering a command is not related to pitch. (7) In the foregoing embodiment, although the pedal behavior image 730 was displayed in response to the behavior of the pedal, an element coordinating with the pedal, e.g. one that displays the behavior of the damper, can also be used. (8) In the foregoing embodiment, the key behavior image 770 included the key position image KP, the hammer position image HP and the belt-like image CD, but if at least one of these images is included, part of the image may be missing. (9) In the preceding embodiment, the key position image KP was displayed based on the position of the key, but it can also be displayed based on a physical quantity that indicates behavior such as velocity or acceleration. The situation is the same for the hammer position image HP and the pedal behavior image 730. (10) In the player result region 700 in the foregoing embodiment, a predetermined image can be displayed if the relationship of at least two from the key position image KP, the hammer position image HP, the ribbon image CD and the pedal behavior image 730 satisfies the predetermined condition, at a position corresponding to the relationship that satisfies the condition. (11) The analysis support function 10 in the foregoing embodiment may not have any other configurations as long as at least the data acquisition part 101 and the display data generation part 105 are provided. Reference symbol list

[0073] 1...Analysis support device, 10...Analysis support function, 11...Control unit, 13...Storage unit, 15...Operating unit, 17...Display unit, 19...Interface, 30...Measuring device, 32...Key position measuring unit, 33...Pedal position measuring unit, 34...Hammer position measuring unit, 35...Data output device, 40...Sound recording device, 50...Piano, 52...Key, 53...Pedal, 54...Hammer, 55...String, 58...Damper, 101...Data acquisition section, 103...Specification section, 105...Display data generation section, 111...Playback position command section, 113...Playback section, 121...Score acquisition section, 351...Data generation section, 353...Interface, 700...Player score region, 710...Keyboard image, 730...Pedal behavior image, 750...Instruction image, 770...Key behavior image, 800...Score region, 850...Instruction image, 900...Control symbol region.< / modifikationsbeispiel>

Claims

A data generating device (10), comprising:a detecting part (101) that detects measurement data showing measurement values ​​detected in chronological order, showing one of a plurality of positions including at least one position among a rest position and an end position of a key, or showing one of a plurality of positions included within a movable range of a key coordinating member, for each of a plurality of keys;a data generation part (105) that generates display data for displaying a screen displaying the measurement values ​​corresponding to each of the plurality of keys based on the acquired measurement data, so that the measurement values ​​corresponding to each of the plurality of keys are respectively displayed on a plurality of band-like regions in the screen corresponding to the plurality of keys along a time axis, the displayed measurement values ​​corresponding to a partial region on the time axis and extracted from the measurement values ​​corresponding to each of the plurality of keys; and a specification part (103) that specifies a period from a key press to a key release based on the measurement values, wherein the data generation part (105) further generates display data so that the period from the key press to the key release corresponding to the plurality of keys is displayed on the plurality of band-like regions along the time axis. A data generating device (10) according to claim 1, wherein a change in the measured value in a band-like divided region is represented by a position change in the width direction in the region. A data generating device (10) according to claim 1, wherein a change in the measured value in a band-like divided region is represented by a color change in the region. A data generating device (10) according to claim 1, wherein a change in the measured value in the band-like divided region is represented by an occupancy change in the width direction of the region. Data generating device (10) according to one of claims 1 to 4, wherein measured values ​​showing both the one of the plurality of positions of the key and the one of the plurality of positions of the element coordinating with the key are displayed on the screen. A data generating device (10) according to any one of claims 1 to 5, wherein the display data includes data for further displaying a score, for displaying a first instruction image for instructing a position on a time axis on the screen, and for displaying a second instruction image for instructing a position in the score corresponding to the position. The data generation device (10) according to any one of claims 1 to 6, wherein the acquisition part (101) further acquires second measurement data showing second measurement values ​​indicating a behavior of an operator in chronological order, the second measurement values ​​are displayed along the time axis extending over an area corresponding to a plurality of keys on the screen, and a change in the second measurement value is represented by a color change. A program for executing a computer:for acquiring measurement data showing measurement values ​​acquired in chronological order showing one of a plurality of positions, including at least one position among a rest position and a final position, of a key or one of a plurality of positions included within a movable range of a member coordinating with the key, for each of a plurality of keys;andgenerating display data for displaying a screen displaying the measurement values ​​corresponding to each of the plurality of keys based on the acquired measurement data, so that the measurement values ​​corresponding to each of the plurality of keys are respectively displayed on a plurality of band-like regions in the screen corresponding to the plurality of keys along a time axis, the displayed measurement values ​​corresponding to a partial range on the time axis and extracted from the measurement values ​​corresponding to each of the plurality of keys; andspecifying a period from a key press to a key release based on the measurement values, wherein, in the generated display data for displaying the screen, display data for displaying the period from the key press to the key release corresponding to the plurality of keys on the plurality of band-like regions along the time axis is generated and displayed. A data generation device (10), comprising: an acquisition part (101) that acquires measurement data showing measurement values ​​representing one of a plurality of positions of an operator included within a movable range; a data generation part (105) that generates display data for displaying a screen showing information regarding a movement of a plurality of keys based on the measurement data, such that the measurement values ​​corresponding to each of the plurality of keys are respectively displayed on a plurality of band-like regions in the screen respectively corresponding to the plurality of keys along a time axis, and wherein the measurement values ​​along the time axis are displayed by a color change on the plurality of band-like regions;anda specifying part (103) that specifies a period from a key press to a key release based on the measured values,wherein the data generating part (105) further generates display data such that the period from a key press to a key release corresponding to the plurality of keys is displayed on the plurality of band-like regions along the time axis; Data generating device (10) according to claim 9, wherein the operator comprises a pedal or an element coordinating with the pedal. A program for executing a computer:for acquiring measurement data showing measurement values ​​indicating one of a plurality of positions included within a movable range of an operator;for generating display data for displaying a screen showing information regarding a movement of a plurality of keys based on the measurement data, such that the measurement values ​​corresponding to each of the plurality of keys are respectively displayed on a plurality of band-like regions in the screen respectively corresponding to the plurality of keys along a time axis, and wherein the measurement values ​​along the time axis are displayed by a color change on the plurality of band-like regions;andspecifying a period from a key press to a key release based on the measured values,wherein, in the generated display data for displaying the screen, display data for indicating the period from key press to key release corresponding to the plurality of keys on the plurality of band-like regions along the time axis is generated and displayed.;

Images