Performance motion transmission system, performance motion transmission control device, method and program

Abstract

One aspect of the present invention includes a musical instrument unit used for performance by a first user who serves as a transmission source of performance motion, a stimulation presentation unit placed on a body part of a second user to whom the performance motion is transmitted, and a performance motion transmission control device connected to each of these units. The performance motion transmission control device acquires MIDI data generated in time series in accordance with the first user's performance motion from the musical instrument unit, and collates the acquired MIDI data with basic motion pattern information of the performance motion stored in advance, along a time axis. The performance motion transmission control device thereby determines a first body part used for the first user's performance motion, generates a control signal that generates a stimulus for transmitting the determined first body part of the first user to a corresponding second body part of the second user, and outputs the control signal to the stimulation presentation unit.

Description

[Technical Field]

[0001] One aspect of the present invention relates to a performance motion transmission system used to transmit the performance motion of a skilled person playing a keyboard instrument to a beginner, and a performance motion transmission control device, method, and program used in this system. [Background technology]

[0002] As a method for transmitting the movements of an expert playing a musical instrument to a general user such as a beginner, for example, Non-Patent Document 1 proposes a method for transmitting the movements of the expert's fingers to a general user by detecting the movements of the expert's fingers with an electromyographic sensor and using EMS (Electrical Muscle Stimulation) to provide electrical stimulation to the muscles that move the general user's fingers in accordance with the detected movements of the fingers, thereby transmitting the movements of the expert's fingers to a general user. Using this method, it is possible to transmit the movements of the expert's fingers when playing the piano, for example, and allow the general user to experience them.

[0003] Furthermore, as another approach to using EMS to allow general users to experience the finger movements of an expert when playing the piano, for example, a method disclosed in Non-Patent Document 2 has been proposed. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Jun Nishida and Kenji Suzuki, “BioSync: A paired wearable device for blending kinesthetic experience”, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems,2017. [Non-patent document 2] Arinobu Niijima et al, “Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills”, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5.3 (2021): 1-17. Summary of the Invention [Problem to be solved by the invention]

[0005] However, the methods described in Non-Patent Documents 1 and 2 require the attachment of electromyographic sensors to the body parts used in the performance movements of the expert. This requires time and effort to attach the sensors, and there is also the possibility that the sensors may adversely affect the performance movements of the expert, posing a problem in terms of feasibility. On the other hand, a method has also been proposed that uses motion capture to recognize the performance movements of an expert. However, this method requires multiple cameras as external sensors, and further requires recognition processing to recognize the finger movements from the images. This creates another problem: the system becomes large-scale.

[0006] This invention was made in light of the above circumstances, and aims to provide a technology that makes it possible to convey the performance movements of an expert to a general user such as a beginner without using an external sensor. [Means for solving the problem]

[0007] In order to solve the above problems, one aspect of the musical performance motion transmission system according to the present invention includes a musical instrument unit used by a first user to play a musical performance and serving as a transmission source of the musical performance motion, a stimulus presentation unit disposed on a body part of a second user to be transmitted the musical performance motion, and a musical performance motion transmission control device connected to each of these units. The musical performance motion transmission control device acquires MIDI (Musical Instruments Digital Interface) data generated in accordance with the musical performance motion of the first user from the musical instrument unit, and collates the acquired MIDI data with pre-stored basic motion pattern information of the musical performance motion along a time axis to determine a first body part in the musical performance motion of the first user. The musical performance motion transmission control device generates a stimulus for transmitting the determined first body part of the first user to a corresponding second body part of the second user, and outputs the stimulus control signal to the stimulus presentation unit.

[0008] According to one aspect of the present invention, the MIDI data output from the musical instrument unit in response to the performance movements of the first user, which is the source of the data, is compared with pre-stored basic movement pattern information for the performance movements to determine the body parts used in the performance movements of the first user. As a result, there is no need to prepare external sensors such as electromyography sensors or cameras to determine the performance movements of the first user. This reduces the burden on the first user associated with wearing external sensors and also prevents the system configuration from becoming larger and more complicated. [Effects of the Invention]

[0009] That is, according to one aspect of the present invention, it is possible to provide a technique that enables the performance action of a transmission source user to be transmitted to a transmission destination user without using an external sensor. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a performance action transmission system according to an embodiment of the present invention. [Figure 2]FIG. 2 is a block diagram showing an example of the hardware configuration of the performance action transmission control device included in the system shown in FIG. [Figure 3] FIG. 3 is a block diagram showing an example of the software configuration of the performance action transmission control device included in the system shown in FIG. [Figure 4] FIG. 4 is a flowchart showing an example of the processing procedure and processing contents of the control processing executed by the control unit of the musical performance action transmission control device shown in FIG. [Figure 5] FIG. 5 is a diagram showing an example of fingering information stored in the fingering information storage unit of the performance action transmission control device shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] [One embodiment] (Configuration example) (1) System FIG. 1 is a diagram showing an example of the configuration of a performance action transmission system according to an embodiment of the present invention.

[0013] The performance motion transmission system according to one embodiment of the present invention includes a performance motion transmission control device PS, which is the core of the system. This performance motion transmission control device PS is connected to a musical instrument unit MI1 and a terminal device UT used by an experienced user, who are the source of the performance motion, and an electrical stimulation presentation unit SU, which applies electrical stimulation to the muscles in the forearm HD responsible for keyboard operation of a general user, who is the destination of the performance motion. Note that NI2 in the figure indicates a keyboard instrument used by a general user.

[0014] In this example, the musical instrument unit MI1 comprises a keyboard instrument such as an electronic piano and a MIDI (Musical Instruments Digital Interface) controller, and outputs MIDI data from the MIDI controller in response to key operations on the keyboard instrument.

[0015] MIDI data includes a note number indicating the range of the operated key, a note-on indicating that the key has been pressed, a note-off indicating that the key has been released (key-off), and a velocity indicating the strength of the sound operated (for example, the speed at which the key is operated). Of these, velocity indicates the strength of the sound on a 128-level scale from "0-127," with mp (mezzo piano) being "64," "127" being the strongest, "1" being the weakest, and a value of "0" indicating a key-off.

[0016] The instrument unit MI1 can be applied to any type of electronic instrument that can handle MIDI information, in addition to an electronic piano. For example, if it is applied to an electronic guitar, it will be possible to convey the finger movements of an experienced user involved in arpeggio playing to a general user.

[0017] The terminal device UT is, for example, a personal computer, and is used to register fingering information representing basic motion patterns of musical performances in the musical performance motion transmission control device PS. The fingering information specifies the type of finger to be used by the user to operate the keyboard corresponding to each note in the musical score data used by an experienced user in performance.

[0018] As the terminal device UT, in addition to a personal computer, other information processing terminals such as a smartphone or a tablet terminal may be used.

[0019] The electrical stimulation presentation unit SU is composed of an electrical stimulation generator ES and a plurality of electrodes E1, E2 connected to the electrical stimulation generator ES. The electrodes E1, E2 are attached to the forearm HD of a typical user using a band BD so that they are in contact with the skin. At this time, the positions of the electrodes E1, E2 are set to correspond to the muscles on the forearm HD that move the fingers used to play the keyboard.

[0020] The electrical stimulation generator ES generates a low-frequency electrical stimulation signal suitable for muscular contraction, for example, by superimposing a stimulation frequency of 15 to 200 Hz on a reference frequency of several kHz to 20 kHz. The electrical stimulation generator ES supplies the generated electrical stimulation signal to the electrodes E1 and E2. Each of the electrodes E1 and E2 consists of a pair of electrodes, and the electrical stimulation signal is supplied between the pair of electrodes. The reference frequency, stimulation frequency, and signal strength of the electrical stimulation signal can be arbitrarily controlled by a control signal output from the performance motion transmission control device PS, and can be arbitrarily set depending on the type and condition of the muscle to be stimulated.

[0021] (2) Performance motion transmission control device PS 2 and 3 are block diagrams showing an example of the hardware and software configurations of the performance action transmission control device PS, respectively.

[0022] The performance action transmission control device PS is, for example, a personal computer, and has a control section 1 that uses a hardware processor such as a central processing unit (CPU). A storage unit having a program storage section 2 and a data storage section 3, and an input / output interface (hereinafter, interface will be abbreviated as I / F) section 4 are connected to the control section 1 via a bus 5.

[0023] The musical instrument unit MI1, terminal device UT, and electrical stimulus generator ES are connected to the input / output I / F section 4 via signal cables such as USB (Universal Serial Bus) cables. The input / output I / F section 4 receives fingering information representing basic movement pattern information for performance movements from the terminal device UT and receives MIDI data from the musical instrument unit MI1. The input / output I / F section 4 also outputs electrical stimulus control signals generated by the control section 1 (described later) to the electrical stimulus generator ES.

[0024] Note that a wireless interface that employs a low-power wireless data transmission standard such as Bluetooth (registered trademark) or Wi-Fi (registered trademark) may be used as the input / output I / F unit 4. Using a wireless interface eliminates the need for signal cables connecting the performance motion transmission control device PS with the electrical stimulus generator ES, musical instrument unit MI1, and terminal device UT.

[0025] The program storage unit 2 is configured by combining, for example, a nonvolatile memory such as a solid state drive (SSD) as a storage medium that can be written to and read from at any time, and a nonvolatile memory such as a read only memory (ROM), and stores middleware such as an operating system (OS) as well as application programs required to execute various control processes according to the first embodiment. Hereinafter, the OS and each application program will be collectively referred to as the program.

[0026] The data storage unit 3 is, for example, a combination of a non-volatile memory such as an SSD that can be written to and read from at any time, and a volatile memory such as a RAM (Random Access Memory), and the storage area includes a fingering information storage unit 31 and a stimulus control information storage unit 32.

[0027] The fingering information storage unit 31 is used to store fingering information representing basic movement patterns for playing an electronic piano, acquired from the terminal device UT. In this example, the fingering information defines the movement of the fingers when operating the keyboard in association with each note on the musical score.

[0028] Stimulation control information used to generate electrical stimulation control signals is stored in the stimulation control information storage unit 32. The stimulation control information includes information indicating the correspondence between the fingers used to operate the keyboard and the electrodes E1, E2 that move the muscles corresponding to these fingers, and information indicating the correspondence between the sound intensity represented by the velocity included in the MIDI data and the intensity of the electrical stimulation.

[0029] The control unit 1 has, as processing functions used to carry out one embodiment of the present invention, a fingering information acquisition processing unit 11, a MIDI data acquisition processing unit 12, a body part determination processing unit 13, and an electrical stimulation control signal generation processing unit 14. Each of the above processing units 11 to 14 is realized by causing a hardware processor in the control unit 1 to execute an application program stored in the program storage unit 2.

[0030] Note that part or all of the processing units 11 to 14 may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC (Application Specific Integrated Circuit).

[0031] The fingering information acquisition processing unit 11 acquires fingering information from the terminal device UT via the input / output I / F unit 4, and stores the acquired fingering information in the fingering information storage unit 31.

[0032] The MIDI data acquisition processor 12 acquires, via the input / output I / F unit 4, MIDI data that is output in real time from the musical instrument unit MI1 that the skilled user uses for playing during a lesson.

[0033] The body part determination processing unit 13 collates the acquired MIDI data with the fingering information stored in the fingering information storage unit 31 along the time axis, and identifies the body part, in this example, the finger, used to operate the keyboard for each note. An example of the body part determination processing will be described in the operation example.

[0034] Based on the body part determination result by the body part determination processor 13, the electrical stimulation control signal generation processor 14 references the stimulation control information stored in the stimulation control information storage unit 32 and reads information indicating the electrodes E1, E2 corresponding to the muscles to be subjected to electrical stimulation. The electrical stimulation control signal generation processor 14 also reads information indicating the intensity of the electrical stimulation corresponding to the sound intensity represented by the velocity included in the MIDI data from the stimulation control information. The electrical stimulation control signal generation processor 14 then generates an electrical stimulation control signal based on the read information and outputs the generated electrical stimulation control signal from the input / output I / F unit 4 to the electrical stimulation generator ES. An example of the electrical stimulation control signal generation process will be described below with reference to an operational example.

[0035] (Example of operation) Next, an example of the operation of the performance action transmission control device PS configured as above will be described. FIG. 4 is a flowchart showing an example of the processing procedure and processing contents of the control processing executed by the control unit 1 of the musical performance action transmission control device PS.

[0036] (1) Memorizing fingering information The fingering information, which is created by the terminal device UT, specifies the type of finger to use to operate the keyboard corresponding to each note in the musical score data, for example. Figure 5 shows an example of fingering information, where F1, F2, F3, F4, and F5 represent the thumb, index finger, middle finger, ring finger, and little finger, respectively.

[0037] The control unit 1 of the performance action transmission control device PS monitors a request for setting fingering information in step S10. When a request for setting fingering information is received from the terminal device UT in this state, under the control of the fingering information acquisition processing unit 11, the control unit 1 receives the fingering information transmitted from the terminal device UT via the input / output I / F unit 4 in step S11, and stores the received fingering information in the fingering information storage unit 31.

[0038] The fingering information may be obtained by the terminal device UT from a seller of musical score data, and the obtained musical score data may be set as fingering information in the performance action transmission control device PS. Alternatively, a plurality of fingering information items expected to be used may be stored in advance in the fingering information storage unit 31 of the performance action transmission control device PS, and an experienced user may select and specify the fingering information to be used when performing.

[0039] (2) Transmission of performance movements When transmitting a performance motion, the electrical stimulation presentation unit SU is attached to the forearm HD of the general user to which the motion is to be transmitted. The attachment position of this electrical stimulation presentation unit SU is set so that the electrodes E1 and E2 contact the skin at positions corresponding to the muscles that move the fingers of the forearm HD.

[0040] In this state, the experienced user who is the source of the performance action inputs a lesson start request to the performance action transmission control device PS from the terminal device UT, and starts the performance action on the musical instrument unit MI1 of the electronic piano.

[0041] (2-1) Acquiring MIDI data The control unit 1 of the performance motion transmission control device PS monitors the start of the lesson in step S12. When a lesson start request is input from the terminal device UT in this state, the control unit 1 of the performance motion transmission control device PS receives, in step S13, the MIDI data output from the musical instrument unit MI1 in response to the performance motion, via the input / output I / F unit 4 under the control of the MIDI data acquisition processing unit 12. At this time, the MIDI data acquisition processing unit 12 temporarily stores the received MIDI data in a buffer in the data storage unit 3 for the next body part determination process.

[0042] (2-2) Identifying the body parts used in the performance When the MIDI data is acquired, the control unit 1 of the performance motion transmission control device PS determines the body part used by the skilled user in the performance motion under the control of the body part determination processing unit 13 as follows: In this example, the body part is determined to be the finger.

[0043] That is, first, in step S14, a note-on, which indicates a pressing operation of a key on the electronic piano, is determined from the MIDI data. Then, when a note-on is detected, in step S15, the body part determination processor 13 determines the finger used by the skilled user to press the key based on the note number included in the MIDI data, as follows:

[0044] That is, the body part determination processing unit 13 compares the note number of the MIDI data with the note whose time position corresponds to the fingering information stored in the fingering information storage unit 31, and if there is a match, determines the type of finger associated with that note.

[0045] For example, if the note number indicates the note "E," the finger information associated with the time position of the corresponding note "E" in the fingering information is F3, so it is determined that the finger used to play the keyboard is the "middle finger." Similarly, if the note number indicates the note "F," the finger information associated with the time position of the corresponding note "F" in the fingering information is F1, so it is determined that the finger used to play the keyboard is the "thumb." Similarly, each time a note-on is detected in the MIDI data, it determines the finger information associated with the note of that note number from the fingering information.

[0046] (2-3) Generation of electrical stimulation control signals The control unit 1 of the performance action transmission control device PS then generates an electrical stimulation signal under the control of the electrical stimulation control signal generation processing unit 14 as follows. That is, in step S16, the electrical stimulation control signal generation processing unit 14 first reads information indicating the part of the body to be stimulated that corresponds to the finger information determined by the body part determination processing unit 13 from the stimulation control information storage unit 22. As a result, for example, if the finger information is the "middle finger," the "lumbrical muscle," which is the muscle that moves the middle finger, is identified.

[0047] At the same time, in step S17, the electrical stimulation control signal generating unit 14 reads information representing the intensity of the electrical stimulation from the stimulation control information storage unit 22 based on the velocity included in the MIDI data in association with the note number. This sets the intensity of the electrical stimulation according to the sound strength represented by the velocity. The information representing the intensity of the electrical stimulation may be, for example, the current value of the EMS.

[0048] In step S18, the electrical stimulation control signal generation processor 14 next designates electrode E1 or E2 corresponding to the muscle identified based on the finger information as the supply destination of the EMS signal and generates an electrical stimulation control signal that specifies the set intensity of the electrical stimulation. Then, in step S19, the electrical stimulation control signal generation processor 14 outputs the generated electrical stimulation control signal from the input / output I / F unit 4 to the electrical stimulation generator ES.

[0049] Therefore, the electrical stimulation generator ES generates an EMS signal having a current value corresponding to the intensity of the electrical stimulation specified by the electrical stimulation control signal, and this EMS signal is supplied to the electrode E1 or E2 specified by the electrical stimulation control signal.

[0050] As a result, electrical stimulation is applied by EMS to the muscles of the general user's forearm HD, which is the transmission destination, and the corresponding fingers of the general user bend in response to this electrical stimulation. In other words, the finger movements used by the skilled user to operate the keyboard are transmitted to the general user as the same finger movements. Furthermore, the higher the electrical stimulation intensity (current value), the greater the muscle output, so the fingers bend at a speed corresponding to the current value of the EMS signal, which changes the strength with which the keys are struck. Therefore, the strength with which the skilled user strikes the keys is transmitted to the general user's keyboard operation.

[0051] During the output period of the electrical stimulation control signal, the electrical stimulation control signal generation processor 14 detects a note-off from the MIDI data in step S20. Then, in step S19, it continues to output the electrical stimulation control signal until a note-off is detected. On the other hand, once a note-off is detected, the electrical stimulation control signal generation processor 14 stops outputting the electrical stimulation control signal in step S21. This also stops the electrical stimulation generator ES from applying electrical stimulation to the corresponding muscle in the user's forearm HD, thereby ending the user's keyboard striking operation, i.e., the user releases the key.

[0052] (2-4) Deciding when the lesson will end When the control unit 1 of the performance action transmission control device PS stops outputting the electrical stimulus control signal in response to the detection of the note-off, it determines in step S22 whether the lesson has ended. If the result of this determination is that the lesson is continuing, the process returns to step S13 and repeats the performance action transmission control process of steps S13 to S22. In contrast, if, for example, an experienced user inputs an instruction to end the lesson on the terminal device UT, the control unit 1 of the performance action transmission control device PS returns to a standby state.

[0053] (Actions and Effects) As described above, in one embodiment, the performance motion transmission control device PS receives MIDI data output from the musical instrument unit MI1 in response to the performance motion of the experienced user, which is the transmission source. Based on the note numbers included in the received MIDI data, the performance motion transmission control device PS identifies the fingers used by the experienced user to play the keys from pre-stored fingering information. At the same time, the performance motion transmission control device PS determines the strength of the expert user's keyboard strokes based on the velocities associated with the note numbers in the MIDI data. Based on the identified finger information and information indicating the strength of the strokes, the performance motion transmission control device PS generates an electrical stimulation control signal and outputs it to the electrical stimulation generator ES. The electrical stimulation generator ES then supplies an EMS signal to the electrodes W1, E2 attached to the forearm HD of the general user.

[0054] In other words, by using MIDI data, it is possible to determine the fingers used by an experienced user to operate the keyboard and the strength of the operation, and based on the results of this determination, it is possible to communicate the experienced user's keyboard operation to a general user in real time.

[0055] Therefore, according to one embodiment, there is no need to prepare external sensors such as electromyography sensors or cameras to determine the keyboard operation of an experienced user, thereby reducing the burden on an experienced user associated with wearing external sensors and further preventing the system configuration from becoming larger and more complex.

[0056] [Other embodiments] In the above embodiment, the case where finger movements for operating the keys of an electronic piano are transmitted is explained as an example, but foot movements may also be transmitted. Furthermore, in addition to keyboard instruments such as electronic pianos, the present invention can be applied to any instrument, including string instruments, wind instruments, and percussion instruments, as long as it has a built-in MIDI controller or can be connected to a MIDI controller.

[0057] In the above embodiment, the processing functions of the performance action transmission control device PS are provided in a user terminal such as a personal computer, but the processing functions of the performance action transmission control device PS may be provided in a server computer located on the Web or in the cloud, or may be distributed between the user terminal and the server computer.

[0058] In addition, the processing procedures and processing contents of the processing functions provided by the performance action transmission control device, the types and configurations of stimuli presented to the user by the stimulus presentation unit, etc. can be modified and implemented in various ways within the scope of the gist of this invention.

[0059] Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.

[0060] In short, this invention is not limited to the above-described embodiments, and in the implementation stage, the components can be modified and embodied without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined. [Explanation of symbols]

[0061] PS: Performance motion transmission control device SU: Electrical stimulation presentation unit ES...electrical stimulation generator E1,E2…electrode BD...Band MI1, MI2...Musical instrument unit UT: Terminal device HD: Forearm 1...Control unit 2...Program memory section 3...Data storage unit 4...Input / output interface 5...Bus 11...Fingering information acquisition processing unit 12...MIDI data acquisition processing section 13...Body part determination processing unit 14...Electrical stimulation control signal generation processing unit 31...Fingering information storage section 32...Stimulus control information storage unit

Claims

1. The device includes a musical instrument unit used by a first user who is a source of a musical performance action, a stimulus presentation unit that is placed on a body part of a second user who is a destination of the musical performance action, and a control device that is connected to the musical instrument unit and the stimulus presentation unit, The control device a storage unit that stores basic movement pattern information of body parts used by the first user in the musical performance movement; a first processing unit that acquires MIDI (Musical Instruments Digital Interface) data generated in time series in response to the performance action from the musical instrument unit; a second processing unit that collates the MIDI data with the basic movement pattern information along a time axis and determines a first body part used in the performance movement of the first user; a third processing unit that generates a stimulus control signal for presenting a stimulus to a second body part of the second user corresponding to a first body part of the first user, and outputs the generated stimulus control signal to the stimulus presentation unit; A performance motion transmission system comprising:

2. A performance motion transmission control device is connected to a musical instrument unit used by a first user as a transmission source of the performance motion and a stimulus presentation unit disposed on a body part of a second user as a transmission destination of the performance motion, a storage unit for storing basic movement pattern information of the playing movement; a first processing unit that acquires, from the musical instrument unit, MIDI (Musical Instruments Digital Interface) data that is generated in time series in accordance with the performance action of the first user; a second processing unit that collates the MIDI data with the basic movement pattern information along a time axis and determines a first body part used by the first user in the musical performance; a third processing unit that generates a stimulus control signal for presenting a stimulus to a second body part of the second user corresponding to the first body part of the first user, and outputs the generated stimulus control signal to the stimulus presentation unit; A performance action transmission control device comprising:

3. 3. The performance motion transmission control device according to claim 2, wherein the second processing unit determines the first body part used by the first user in the performance motion by matching the note number included in the MIDI data with the basic motion pattern information along a time axis.

4. The third processing unit sets a stimulus intensity based on a velocity included in the MIDI data, generates the stimulus control signal for presenting the stimulus at the set stimulus intensity to the second body part of the second user corresponding to the first body part of the first user, and outputs the generated stimulus control signal to the stimulus presentation unit. The performance action transmission control device according to claim 2.

5. the stimulation presentation unit has a function of presenting electrical stimulation by EMS (Electrical Muscle Stimulation), The third processing unit generates the stimulus control signal for presenting an electrical stimulus corresponding to the stimulus intensity to the second body part of the second user corresponding to the first body part used in the playing action by the first user, and outputs the generated stimulus control signal to the stimulus presentation unit. The performance action transmission control device according to claim 4.

6. A performance motion transmission control method executed by a control device connected to a musical instrument unit used by a first user to perform a performance and a stimulus presentation unit disposed on a body part of a second user to transmit the performance motion, the control device comprising: acquiring, from the musical instrument unit, MIDI (Musical Instruments Digital Interface) data that is generated in time series in response to the performance action of the first user; a step of collating the MIDI data with pre-stored basic movement pattern information of the musical performance movement along a time axis, and determining a first body part used by the first user in the musical performance movement; generating a stimulus control signal for presenting a stimulus to a second body part of the second user corresponding to the first body part of the first user, and outputting the generated stimulus control signal to the stimulus presentation unit; A performance action transmission control method comprising:

7. 6. A program for causing a processor included in the performance action transmission control device to execute at least one of the processes performed by the first to third processing units included in the performance action transmission control device according to any one of claims 2 to 5.

Images