Control device, control method, and control system

Abstract

To provide a control device, a control method, and a control system that allow at least two control devices to control an electronic musical instrument that can be connected to one control device.SOLUTION: In a control system S, headphones 30 and a pedal device 1 communicate with each other through first communication w1, and the pedal device 1 and a mobile terminal 50 communicate with each other through second communication w2. Thereby, even if the headphones 30 can be connected to only one control device, a control instruction from the pedal device 1 can be transmitted to the headphones 30 via the first communication w1, and a control instruction from the mobile terminal 50 can be transmitted to the headphones 30 via the second communication w2 and the first communication w1.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a control device, a control method, and a control system.

Background Art

[0002] Non-Patent Document 1 discloses headphones that are used in pairing with a mobile terminal. The headphones can control the volume, the amount of effect of built-in acoustic effects, etc. by operating the touch panel on the paired mobile terminal.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Recently, there has been an increasing demand for electronic musical instruments to control the volume and the like not only by operating with a control device that can be operated at hand like a mobile terminal but also by a control device that can be operated at foot like a pedal device. However, since the headphones of Non-Patent Document 1 can be connected to only one control device by pairing, although the headphones can be controlled from one control device, there is a problem that the headphones cannot be controlled from a plurality of control devices.

[0005] The present invention has been made to solve the above-described problems, and an object thereof is to provide a control device, a control method, and a control system that enable control from at least two control devices for an electronic musical instrument that can be connected to one control device.

Means for Solving the Problems

[0006] To achieve this object, the control device of the present invention is a device for controlling an electronic musical instrument, and includes an input means for inputting a control instruction, a first communication means for performing wireless communication with the electronic musical instrument, a second communication means for performing wireless communication with a second control device for controlling the electronic musical instrument, and an instruction transmission means for transmitting, via the first communication means, the control instruction input by the input means and a second control instruction received from the second control device via the second communication means to the electronic musical instrument. A determination means for determining whether or not a second control instruction received from the second control device via the second communication means is a control instruction for itself; It is provided with.

[0007] The control method of the present invention is a method executed by a control device connected to an electronic musical instrument and a second control device for controlling the electronic musical instrument via wireless communication, and includes an input step of inputting a control instruction, a first communication step of performing wireless communication with the electronic musical instrument, a second communication step of performing wireless communication with a second control device for controlling the electronic musical instrument, and an instruction transmission step of transmitting, by the first communication step, the control instruction input in the input step and a second control instruction received from the second control device via the second communication step to the electronic musical instrument. A determination step for determining whether or not a second control instruction received from the second control device in the second communication step is a control instruction for itself; It is provided with.

[0008] Further, the control system of the present invention is a control system including an electronic musical instrument, a second control device for controlling the electronic musical instrument, and a control device connected to the electronic musical instrument and the second control device via wireless communication. The second control device includes a transmission means for transmitting a second control instruction to the control device. The control device includes an input means for inputting a control instruction, a first communication means for performing wireless communication with the electronic musical instrument, a second communication means for performing wireless communication with the second control device, and an instruction transmission means for transmitting, via the first communication means, the control instruction input by the input means and a second control instruction received from the second control device via the second communication means to the electronic musical instrument. A determination means for determining whether or not a second control instruction received from the second control device via the second communication means is a control instruction for itself; It is provided with.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Mode for Carrying Out the Invention

[0010] Hereinafter, preferred embodiments will be described with reference to the accompanying drawings. Referring to FIG. 1, the outline of the control system S of the present embodiment will be described. FIG. 1 is a diagram showing the outline of the control system S. The control system S is composed of a pedal device 1, headphones 30, and a mobile terminal 50. The pedal device 1 and the headphones 30 are connected by wireless communication, and the pedal device 1 and the mobile terminal 50 are also connected by wireless communication.

[0011] The pedal device 1 is a device that inputs operations of settings related to performance (for example, volume, level of acoustic effects, etc.) from a user H who performs music, and creates and transmits a control instruction, which is information for instructing control to other devices (specifically, the headphones 30 and the mobile terminal 50) based on parameters according to the operation amount. The pedal device 1 also has a function of transmitting the control instruction transmitted from the mobile terminal 50 to the headphones 30, and a function of transmitting a response to the control instruction of the mobile terminal 50 transmitted from the headphones 30 to the mobile terminal 50. These transmissions will be described later with reference to FIGS. 3 to 6.

[0012] The headphones 30 are an electronic musical instrument that outputs performance sounds based on the performance of the electric guitar G of the user H. The electric guitar G and the headphones 30 are wirelessly connected by a musical instrument transmission device Gt connected to the electric guitar G. The performance signal output when the user H performs the electric guitar G is transmitted to the headphones 30 via the musical instrument transmission device Gt.

[0013] In the headphones 30, performance sounds corresponding to the received performance signals are output from the speakers R and L. At this time, acoustic effects such as delay and distortion can be added to the output performance sounds, and the degree of the acoustic effects is changed according to parameters from the pedal device 1 or the mobile terminal 50.

[0014] Note that the device for transmitting the performance signal to the headphones 30 is not limited to the electric guitar G connected to the musical instrument transmitting device Gt. For example, other electric musical instruments or electronic musical instruments such as an electronic drum or an electronic wind instrument connected to the musical instrument transmitting device Gt may also be used.

[0015] The mobile terminal 50 is an information processing device (computer) that transmits control instructions to the above-described pedal device 1 and headphones 30. The control instructions input from the mobile terminal 50 are transmitted to the headphones 30 via the pedal device 1. As a result, the pedal device 1 and the headphones 30 can be controlled from the mobile terminal 50.

[0016] Here, referring to FIG. 2, the configurations of the pedal device 1 and the headphones 30 will be described. FIG. 2(a) is a side view of the pedal device 1 in the left direction, FIG. 2(b) is a side view of the pedal device 1 in the right direction, and FIG. 2(c) is a rear view of the pedal device 1. The pedal device 1 is provided with a pedal switch 15, an operator 16, an LED 17, a DC input terminal 18, a MIDI output terminal 19 for wired connection to an external device conforming to the MIDI (Musical Instrument Digital Interface) standard, and a communication terminal 20 for wired connection to an external information processing device.

[0017] The pedal switch 15 is provided at the upper part of the pedal device 1 and is a device that detects the angle when stepped on by the foot of the user H. The pedal switch 15 is configured like a "see - saw" with a predetermined position as a fulcrum, and a parameter corresponding to the angle of the pedal switch 15 that changes when stepped on by the foot of the user H is output. The said parameter is transmitted to the headphones 30 and the mobile terminal 50 via wireless communication. In the present embodiment, a MIDI - standard control change message (hereinafter abbreviated as "CC message") including the parameter acquired based on the pedal switch 15 is transmitted from the pedal device 1.

[0018] The pedal device 1 is configured so that the angle of the pedal switch 15 that outputs the maximum parameter and the angle of the pedal switch 15 that outputs the minimum parameter can be calibrated. Also, by stepping on the tip side (the left side of the paper surface in Fig. 2(a)) of the pedal switch 15 with a stepping force equal to or greater than a predetermined value, the "number" of the CC message can be switched to a predetermined value.

[0019] The operator 16 is an input device for inputting an instruction to start pairing with other devices from the user H and is provided on the back surface of the pedal device 1. The LED 17 is a device that outputs the state of the pedal device 1 and the connection state with the headphones 30 and the mobile terminal 50 by the lighting color and blinking, and is provided on the left and right side surfaces and the back surface of the pedal device 1. The DC input terminal 18 is a terminal for inputting a direct - current to the pedal device 1 and is provided on the back surface of the pedal device 1. The power input from the DC input terminal 18 is used as the power supply for the pedal device 1. Although not shown, a battery is built into the pedal device 1, and when no direct - current is input from the DC input terminal 18, the power supplied from the battery is used as the power supply for the pedal device 1.

[0020] Note that the data transmitted from the pedal device 1 is not limited to the MIDI - standard CC message, and other MIDI - standard messages such as system exclusive messages (hereinafter abbreviated as "SysEx messages") may also be used.

[0021] Next, the headphones 30 will be described. FIG. 2(d) is an external view of the headphones 30. In addition to the speakers R and L described above, the headphones 30 are provided with an operator 37 and an LED 38 that outputs the state of the headphones 30 and the connection state with the pedal device 1 in a lighting color or blinking manner.

[0022] The operator 37 is an input device for inputting various instructions such as the volume of the performance sound output from the speakers R and L by the user H, the switching of the acoustic effects added to the performance sound, and the connection start instruction to the pedal device 1, and a plurality of operators 37 are provided on the headphones 30. When music is reproduced by the headphones 30, the operator 37 functions to control the reproduction of music such as play / stop and fast forward.

[0023] Next, with reference to FIGS. 3 to 6, the communication establishment procedure and information transmission / reception among the pedal device 1, the headphones 30, and the mobile terminal 50 will be described. First, with reference to FIG. 3(a), the communication establishment procedure between the pedal device 1 and the headphones 30 will be described.

[0024] FIG. 3(a) is a diagram for explaining the communication establishment procedure between the pedal device 1 and the headphones 30. In communication devices such as the pedal device 1, the headphones 30, and the mobile terminal 50 of the present embodiment, a communication mode is set, and communication is performed according to the set communication mode. The communication mode is provided with a "central" for instructing other communication devices and a "peripheral" for responding to instructions from other communication devices in which the central is set.

[0025] In the mobile terminal 50 of the present embodiment, the central is set, and in the headphones 30, the peripheral is set. In the pedal device 1, when communicating with the central mobile terminal 50, the peripheral is used, and when communicating with the peripheral headphones 30, the central is used. That is, the pedal device 1 is configured such that the central and the peripheral can be switched or can operate simultaneously according to the communication mode of the communication partner.

[0026] When establishing communication with the headphones 30 and the mobile terminal 50, the pedal device 1 first attempts to establish communication with the headphones 30 for which the peripheral is set. At this time, the pedal device 1 is regarded as the central communication device and checks whether it has received the advertising packet AD. The advertising packet AD is a signal transmitted by the peripheral communication device when establishing communication with the central communication device. When the pedal device 1 receives the advertising packet AD, it establishes communication with the communication device that is the source of the advertising packet AD.

[0027] In Fig. 3(a), when the pedal device 1 receives the advertising packet AD transmitted from the headphones 30, the first communication w1, which is communication with the headphones 30, is established, and the headphones 30 and the pedal device 1 are paired. The operation of the user H on the pedal device 1 in this case will be described.

[0028] First, when the user H double-clicks the operator 16, the central function and the peripheral function are alternately (toggle) switched. The central function is the function for the pedal device 1 to connect to the peripheral communication device, and the peripheral function is the function for the pedal device 1 to connect to the central communication device. When the central function is set in the pedal device 1, the lighting color of the LED 17 becomes white, and when the peripheral function is set, the lighting color of the LED 17 becomes blue.

[0029] First, the central function will be described. When the operator 16 is double-clicked and the central function is switched to, it switches to the "reception standby mode" that waits for the reception of the advertising packet AD transmitted from the peripheral communication device, that is, the headphones 30. In this reception standby mode, the LED 17 blinks slowly in white.

[0030] In the state of the reception standby mode, by single-clicking the operator 16, it switches to the "scan mode" for receiving the advertising packet AD from the headphones 30. In this scan mode, the LED 17 blinks quickly in white. In the scan mode, when the pairing with the headphones 30 is successful by receiving the advertising packet AD from the headphones 30, it switches to the "connection completed mode". In this connection completed mode, the LED 17 lights up in white. With such a white lighting or blinking state of the LED 17, the user H can grasp the pairing status with the headphones 30.

[0031] Via the first communication w1 established in this way, the control instruction from the central pedal device 1 is transmitted to the headphones 30, and the response to the control instruction from the headphones 30 is transmitted to the pedal device 1.

[0032] Note that the establishment of the first communication w1 with the pedal device 1 is not limited to the headphones 30, and other communication devices with peripherals set, for example, the portable effector 300 in Fig. 3(a) or the floor-mounted type effector 310, etc. may also be used. These effectors 300, 310 are all devices connected to the electric guitar G (see Fig. 1) and output the performance sound with added acoustic effects according to the performance signal from the electric guitar G.

[0033] Next, referring to Fig. 3(b), the communication establishment procedure between the pedal device 1 and the mobile terminal 50 by the peripheral function will be described. Fig. 3(b) is a diagram for explaining the communication establishment procedure between the pedal device 1 and the mobile terminal 50. The pedal device 1 establishes a connection with the central communication device, that is, the mobile terminal 50, by the peripheral function.

[0034] When the operator 16 is double-clicked and switches to the peripheral function, it switches to the "transmission standby mode" for waiting to transmit the advertising packet AD to the mobile terminal 50. In the transmission standby mode, the LED 17 blinks slowly in blue.

[0035] In the standby mode, by single-clicking the operator 16, it switches to the "advertising mode" where the mobile terminal 50 transmits the advertising packet AD. In this advertising mode, the LED 17 blinks quickly in blue. When the mobile terminal 50 can be paired with the advertising packet AD transmitted by the pedal device 1 in the advertising mode state, it switches to the "connection completed mode". In this connection completed mode, the LED 17 lights up in blue. With such a lit or blinking state of the blue LED 17, the user H can grasp the pairing status with the mobile terminal 50.

[0036] Through the second communication w2 established in this way, a control instruction from the central mobile terminal 50 is transmitted to the pedal device 1, and a response corresponding to the control instruction is transmitted from the pedal device 1 to the mobile terminal 50. In the present embodiment, both the first communication w1 and the second communication w2 are communicated based on the Bluetooth (registered trademark) Low Energy (BLE) standard, but the first communication w1 or the second communication w2 may be communicated based on a communication standard other than the BLE standard.

[0037] When the second communication w2 is established, if the mobile terminal 50 determines that the advertising packet AD contains information indicating that communication with the headphones 30 has been established, the mobile terminal 50 can determine that it is possible to communicate with the headphones 30 via the pedal device 1. In such a case, "ABC+" is displayed on the LCD 57 of the mobile terminal 50. On the other hand, when the advertising packet AD does not contain information indicating that communication with the headphones 30 has been established, "ABC" (not shown) is displayed on the LCD 57.

[0038] Here, "ABC" is a name for identifying the device, and for example, a model number, a product ID, or an abbreviation thereof is adopted. From the "ABC+" or "ABC" displayed on the LCD 57, the user H can immediately determine whether the pedal device 1 has completed the establishment of communication with the headphones 30.

[0039] Here, whether the mobile terminal 50 and the headphones 30 are connected via the pedal device 1 can also be determined by checking the lighting color or the lighting or blinking state of the LED 17 of the pedal device 1. Specifically, after the pedal device 1 attempts to pair with the headphones 30 and confirms successful pairing by the blue lighting of the LED 17, if the pedal device 1 then attempts to pair with the mobile terminal 50 and confirms successful pairing by the white lighting of the LED 17, it can be confirmed that the mobile terminal 50 and the headphones 30 are connected. However, since the pedal device 1 is placed at the feet of the user H, the user H who plays the electric guitar G has to change their posture, such as putting down the electric guitar G once and bending down to be able to visually recognize the LED 17.

[0040] On the other hand, since the mobile terminal 50 can be placed at the user H's hand, the user H can confirm whether the pedal device 1 has completed the establishment of communication with the headphones 30 by the display of "ABC+" or "ABC" without putting down the electric guitar being played and without changing their posture. Also, the LCD 57 on which these are displayed can provide a more flexible and colorful display compared to the LED 17, so it can visually present to the user H whether the headphones 30 and the mobile terminal 50 are connected with good visibility.

[0041] Note that the case where the advertising packet AD contains information indicating that communication with the headphones 30 has been established / the case where such information is not contained is not limited to being displayed on the LCD 57. For example, it may be output as audio, or output using other methods. When outputting as audio, if the information is contained, it may be output as "ABC+" in audio, and if the information is not contained, it may be output as "ABC" in audio.

[0042] Also, in the mobile terminal 50, among the pedal device 1 and the headphones 30, the communication device to be controlled is configured to be selectable by switching an application (hereinafter abbreviated as "app"). In FIG. 3(b), since the app for controlling the headphones 30 is being executed in the mobile terminal 50, "Headphones" is displayed on the LCD 57. On the other hand, when the app for controlling the pedal device 1 is being executed in the mobile terminal 50, "Pedal Device" (see FIG. 4(b)) is displayed on the LCD 57.

[0043] In this way, after the first communication w1 and the second communication w2 are established, from the communication device to be controlled by the mobile terminal 50, an Inquire-Only Message IQ of the MIDI standard, which is information about the communication device such as the version information of the control programs 32a and 52a (see FIG. 8), is acquired. The acquisition of the Inquire-Only Message IQ will be described with reference to FIG. 4.

[0044] FIG. 4(a) is a diagram for explaining the acquisition of the Inquire-Only Message IQ from the headphones 30 of the mobile terminal 50, and FIG. 4(b) is a diagram for explaining the acquisition of the Inquire-Only Message IQ from the pedal device 1 of the mobile terminal 50. In FIG. 4(a), when the mobile terminal 50 requests the Inquire-Only Message IQ from the headphones 30, first, the mobile terminal 50 creates the feature request data SR for instructing the request for the Inquire-Only Message IQ.

[0045] The feature request data SR includes a "Model ID" that represents the name and type of the communication device that requests the Inquire-Only Message IQ, that is, the communication device that the mobile terminal 50 is controlling. In FIG. 4(a), since the communication device to be controlled by the mobile terminal 50 is the headphones 30, a unique ID for specifying the headphones 30 is set in the Model ID of the feature request data SR.

[0046] The feature request data SR created in this way is first transmitted to the pedal device 1 that has established the second communication w2 with the mobile terminal 50. In the pedal device 1, the received feature request data SR is transmitted to the headphones 30 via the first communication w1, and the model ID included in the feature request data SR is confirmed.

[0047] In FIG. 4(a), since the model ID included in the feature request data SR is "headphones", the pedal device 1 determines that the received feature request data SR is not for itself and discards the received feature request data SR. That is, the pedal device 1 passes the received feature request data SR through the headphones 30 (through).

[0048] The headphones 30 confirm the model ID of the feature request data SR received from the pedal device 1, and when it is its own, transmit its own ink wire message IQ to the pedal device 1. Such an ink wire message IQ includes the model ID of the headphones 30, similar to the feature request data SR.

[0049] The pedal device 1 that has received the ink wire message IQ from the headphones 30 transmits the ink wire message IQ to the mobile terminal 50 and confirms whether the model ID included in the ink wire message IQ is its own. In FIG. 4(a), since the model ID included in the ink wire message IQ is the ID that identifies the headphones 30, the pedal device 1 determines that the received ink wire message IQ is not for itself and discards the received ink wire message IQ.

[0050] The mobile terminal 50 that has received the ink wire message IQ from the pedal device 1 checks whether the model ID included in the ink wire message IQ is its own. In FIG. 4(a), the model ID included in the ink wire message IQ is the ID that identifies the headphones 30. In this case, the mobile terminal 50 acquires the information regarding the headphones 30 included in the ink wire message IQ and uses it for subsequent control instructions to the headphones 30.

[0051] Also, as shown in FIG. 4(b), when the control target of the mobile terminal 50 is the pedal device 1 and the ink wire message IQ of the pedal device 1 is requested, similarly, a unique ID that identifies the pedal device 1 is set in the model ID of the attribute request data SR transmitted from the mobile terminal 50, and the attribute request data SR is transmitted to the pedal device 1.

[0052] The pedal device 1 transmits the received attribute request data SR to the headphones 30 and checks the model ID of the attribute request data SR. In FIG. 4(b), since the model ID of the attribute request data SR is the ID that identifies the pedal device 1, it transmits its own ink wire message IQ to the mobile terminal 50. Such an ink wire message IQ includes the model ID of the pedal device 1.

[0053] The mobile terminal 50 that has received the ink wire message IQ from the pedal device 1 checks whether the model ID included in the ink wire message IQ is its own. In FIG. 4(b), the model ID included in the ink wire message IQ is the ID that identifies the pedal device 1. In this case, the mobile terminal 50 acquires the information regarding the pedal device 1 included in the ink wire message IQ and uses it for subsequent control instructions to the pedal device 1.

[0054] On the other hand, also in the headphones 30 that have received the feature request data SR from the pedal device 1, the model ID of the feature request data SR is confirmed. In FIG. 4(b), since the model ID of the received feature request data SR is "pedal device" and does not match that of the headphones 30, the received feature request data SR is discarded.

[0055] In this way, in the mobile terminal 50, after the second communication w2 with the pedal device 1 is established, the ink wire message IQ is acquired from the pedal device 1 or the headphones 30 to be controlled, and then used for subsequent control instructions. As a result, immediately after the communication with the control target is established, appropriate control instructions can be transmitted according to the functions and specifications of the control target.

[0056] In particular, when the control target of the mobile terminal 50 is the headphones 30, it can be specifically grasped that the communication device connected via the pedal device 1 is the headphones 30. Also, since the version information of the control program 32a (see FIG. 8) of the headphones 30 is acquired by the ink wire message IQ, it can be confirmed from the mobile terminal 50 whether the control program 32a is updated to an appropriate version.

[0057] Next, with reference to FIG. 5, the control of the headphones 30 and the pedal device 1 by operating the mobile terminal 50 will be described. FIG. 5(a) is a diagram for explaining the control of the headphones 30 by operating the mobile terminal 50, and FIG. 5(b) is a diagram for explaining the control of the pedal device 1 by operating the mobile terminal 50.

[0058] In FIG. 5(a), an example is shown in which the volume of the performance sound output from the mobile terminal 50 to the headphones 30 is changed. Note that the object of operating the headphones 30 from the mobile terminal 50 is not limited to this. For example, the degree of the acoustic effect of the performance sound output from the mobile terminal 50 to the headphones 30 may be operated, or other settings of the headphones 30 may be operated.

[0059] In Fig. 5(a), when an instruction to update the volume of the headphones 30 to 35 is input from the user H to the mobile terminal 50 via the touch panel 56 (see Fig. 8), the mobile terminal 50 creates a control instruction RS for requesting the instruction to the headphones 30. The control instruction RS includes the parameter to be updated (in Fig. 5(a), "volume·35") and the model ID of the control target (the ID identifying the headphones 30 in Fig. 5(a)). The mobile terminal 50 transmits a SysEx message of the MIDI standard configured to include such a control instruction RS to the pedal device 1.

[0060] The pedal device 1 that has received the SysEx message transmits the SysEx message to the headphones 30 and checks the model ID included in the control instruction RS of the SysEx message. In Fig. 5(a), since the model ID included in the control instruction RS is the ID identifying the headphones 30 and is not a request for the pedal device 1, the pedal device 1 discards the received SysEx message.

[0061] The headphones 30 that have received the SysEx message from the pedal device 1 check the model ID included in the control instruction RS of the SysEx message. In Fig. 5(a), since the model ID included in the control instruction RS is the ID identifying the headphones 30, the headphones 30 update their own volume using the parameter ("volume·35") included in the control instruction RS. As a result, the volume of the headphones 30 is updated in response to the request from the mobile terminal 50.

[0062] Fig. 5(b) illustrates the case of changing the type of the acoustic effect controlled by the pedal device 1 from the mobile terminal 50. Note that what can be changed from the mobile terminal 50 is not limited to the type of the acoustic effect controlled by the operation of the pedal device 1. For example, the target controlled by the pedal device 1 may be changed from the acoustic effect to the volume, or may be changed to other setting items.

[0063] In FIG. 5(b), when an instruction to change the acoustic effect controlled by the pedal device 1 to "reverb" is input from the user H to the mobile terminal 50 via the touch panel 56, the mobile terminal 50 creates a control instruction RS that includes the parameter to be updated (in FIG. 5(b), "acoustic effect (represented as "FX" in the figure) · reverb") and the model ID of the control target (in FIG. 5(b), the ID that identifies the pedal device 1). The mobile terminal 50 then transmits a SysEx message conforming to the MIDI standard that includes the created control instruction RS to the pedal device 1.

[0064] Upon receiving the SysEx message, the pedal device 1 transmits the SysEx message to the headphones 30 and checks the model ID included in the control instruction RS of the SysEx message. In FIG. 5(b), since the model ID included in the control instruction RS is the ID that identifies the pedal device 1, the pedal device 1 uses the parameter (acoustic effect · reverb) included in the control instruction RS to change the acoustic effect controlled by the operation of its own pedal switch 15. As a result, in response to the request from the mobile terminal 50, the acoustic effect controlled by the pedal device 1 is changed.

[0065] Next, referring to FIG. 6(a), the control of the headphones 30 by the operation of the pedal device 1 will be described. FIG. 6(a) is a diagram for explaining the control of the headphones 30 by the operation of the pedal device 1. In FIG. 6(a), an example of updating the volume of the headphones 30 in response to the operation of the pedal switch 15 of the pedal device 1 is illustrated. At this time, it is assumed that an application that controls the headphones 30 is also being executed on the mobile terminal 50.

[0066] When the user H steps on the pedal switch 15 of the pedal device 1 with their foot, parameters corresponding to the angle of the pedal switch 15 are transmitted to the headphones 30 and the mobile terminal 50. At this time, a CC message conforming to the MIDI standard that includes the acquired parameters is transmitted to the headphones 30 and the mobile terminal 50.

[0067] When the headset 30 receives a CC message including an update instruction CC from the pedal device 1, it updates its volume using the parameters included in the update instruction CC.

[0068] Then, it creates a response instruction PS including the parameters included in the update instruction CC and its own model ID, and transmits a SysEx message of the MIDI standard including the response instruction PS to the pedal device 1.

[0069] The pedal device 1 that has received the SysEx message including the response instruction PS transmits the SysEx message to the mobile terminal 50 and checks the model ID included in the response instruction PS of the SysEx message. In Fig. 6(a), the model ID included in the response instruction PS is the ID that identifies the headset 30 and is not a request for the pedal device 1, so the pedal device 1 discards the received SysEx message.

[0070] In the mobile terminal 50, a SysEx message including an update instruction CC and a response instruction PS is transmitted from the pedal device 1. Among these, the mobile terminal 50 discards the update instruction CC while acquiring the SysEx message including the response instruction PS. It checks the model ID of the response instruction PS of the acquired SysEx message, and when it matches the control target of itself (the headset 30 in Fig. 6(a)), it updates the corresponding setting (the volume in Fig. 6(a)) using the parameters of the response instruction PS.

[0071] That is, in the mobile terminal 50, while discarding the update instruction CC based on the pedal switch 15 from the pedal device 1, when the parameters are updated based on the update instruction CC based on the pedal switch 15 from the pedal device 1 in the headset 30, its setting is updated by the response instruction PS transmitted at that time. Therefore, when the setting of the headset 30 is updated by the update instruction CC of the pedal device 1, the setting of the mobile terminal 50 is updated. Thus, the update instruction CC of the pedal device 1 can be surely reflected in the settings of the headset 30 and the mobile terminal 50.

[0072] Here, generally, the headphones 30 can communicate with only one communication device. In contrast, in the control system S of the present embodiment, the headphones 30 and the pedal device 1 communicate via the first communication w1, and the pedal device 1 and the mobile terminal 50 communicate via the second communication w2.

[0073] Accordingly, it is possible to transmit a control instruction from the central pedal device 1 to the headphones 30, and it is also possible to transmit a control instruction from the central mobile terminal 50 to the headphones 30 via the second communication w2 and the first communication w1. Therefore, it is possible to provide a flexible function by the mobile terminal 50, the pedal device 1, and the headphones 30, and it is possible to communicate two central pedal devices 1 and mobile terminals 50 and one peripheral headphones 30 without passing through other communication devices, so that the configuration of the communication device and its cost can be minimized.

[0074] In addition, in the first communication w1 and the second communication w2 of the present embodiment, the control instruction RS from the mobile terminal 50 and the update instruction CC from the pedal device 1 can be transmitted through the same communication path.

[0075] By the way, in the present embodiment, since the control instruction RS or the update instruction CC can be input from each of the pedal device 1 and the mobile terminal 50, in the pedal device 1, the timing at which the control instruction RS from the mobile terminal 50 is transmitted to the headphones 30 and the update instruction CC based on the pedal switch 15 are transmitted to the headphones 30 may overlap. The processing in such a case will be described with reference to FIG. 6(b).

[0076] FIG. 6(b) is a diagram for explaining the case where the transmission timings of the control instruction RS and the update instruction CC overlap. In FIG. 6(b), it shows the case where the control instruction RS from the mobile terminal 50 is first transmitted to the headphones 30 by the pedal device 1, and during the transmission, the pedal switch 15 is operated and the update instruction CC based thereon is created.

[0077] In such a case, after the transmission of the previously transmitted control instruction RS is completed, the transmission of the update instruction CC is started. Thereby, even when the timing of transmitting the control instruction RS and the update instruction CC from the pedal device 1 to the headphones 30 overlaps, the transmission to these headphones 30 can be surely completed without missing either or both of the control instruction RS and the update instruction CC.

[0078] Next, with reference to FIG. 7, the functions of the pedal device 1 will be described. FIG. 7 is a functional block diagram of the pedal device 1. As shown in FIG. 7, the pedal device 1 includes a first communication means 501, a reception buffer 502, a transmission buffer 503, a second communication means 504, a reception buffer 505, a transmission buffer 506, an instruction transmission means 507, the above-described pedal switch 15, a first storage unit 508, a determination means 509, a change means 510, a MIDI message generation unit 511, the above-described operator 16, a pairing mode transition unit 512, a second storage unit 513, a first communication establishment determination unit 514, and an advertising packet generation unit 515.

[0079] The first communication means 501 is a means for wirelessly communicating with the headphones 30 and is realized by the CPU 10 described later in FIG. 8. The reception buffer 502 temporarily stores the data received by the first communication means 501 and is realized by the RAM 12 described later in FIG. 8. The transmission buffer 503 temporarily stores the data to be transmitted by the first communication means 501 and is realized by the RAM 12.

[0080] The second communication means 504 is a means for wireless communication with the mobile terminal 50, and is realized by the CPU 10. The reception buffer 505 temporarily stores the data received by the second communication means 504, and is realized by the RAM 12. The transmission buffer 506 temporarily stores the data to be transmitted by the second communication means 504, and is realized by the RAM 12. Further, the data such as the SysEx message from the headphones 30 received by the first communication means 501 and stored in the reception buffer 502 is sent to the transmission buffer 506, and the data is transferred from the transmission buffer 506 to the mobile terminal 50 via the second communication means 504.

[0081] The instruction transmission means 507 is a means for transmitting the CC message (control instruction) created by the MIDI message generation unit 511 based on the input from the pedal switch 15 and the SysEx message (second control instruction) received from the mobile terminal 50 via the second communication means 504 to the headphones 30 via the first communication means 501, and is realized by the CPU 10. The instruction transmission means 507 has a serialization unit 507a that serializes the CC message created by the MIDI message generation unit 511 and the SysEx message received from the mobile terminal 50 via the second communication means 504. The CC message and the SysEx message serialized by the serialization unit 507a are transmitted to the headphones 30 via the transmission buffer 503 and the first communication means 501.

[0082] In this way, the CC message based on the input from the pedal switch 15 and the SysEx message received from the mobile terminal 50 via the second communication means 504 are transmitted to the headphones 30 via the first communication means 501. Thereby, even when the headphones 30 can be connected to only one control device, the headphones 30 can be controlled by the two control devices of the pedal device 1 and the mobile terminal 50.

[0083] Furthermore, the serialization unit 507a serializes the CC message created by the MIDI message generation unit 511 and the SysEx message received from the mobile terminal 50 via the second communication means 504, so that the CC message and the SysEx message can be transmitted through the same communication path of the first communication means 501.

[0084] Next, the creation of the above-mentioned CC message will be described. The first storage unit 508 stores the model ID and version information of the pedal device 1, and is realized by the flash ROM 11 described later in FIG. 8. The determination means 509 is a means for determining whether the SysEx message received from the mobile terminal 50 via the second communication means 504 and the reception buffer 505 is a control instruction for itself, and is realized by the CPU 10.

[0085] The changing means 510 is a means for changing the CC message generated by the MIDI message generation unit 511 based on the pedal switch 15 according to the SysEx message when it is determined by the determination means 509 that the SysEx message received via the second communication means 504 is a control instruction for itself, and is realized by the CPU 10.

[0086] The MIDI message generation unit 511 creates a CC message based on the parameters input from the pedal switch 15 and the model ID and version information of the first storage unit 508, and is realized by the CPU 10. In the MIDI message generation unit 511, when it is determined by the determination means 509 that the SysEx message received via the second communication means 504 is a control instruction for itself, the CC message generated by the MIDI message generation unit 511 based on the pedal switch 15 is changed according to the SysEx message. Thereby, the control target controlled based on the operation of the pedal switch 15 can be changed by the SysEx message from the mobile terminal 50.

[0087] Next, the operation at the time of establishing communication with the mobile terminal 50 will be described. The pairing mode transition unit 512 determines whether the operator 16 has been double-clicked or single-clicked to transition to the advertising mode described above in Fig. 3(b), and is realized by the CPU 10. The second storage unit 513 stores the information of the pedal device 1 itself ("ABC") and the information indicating that communication has been established between the information of the pedal device 1 itself and the headphones 30 ("ABC+"), and is realized by the flash ROM 11.

[0088] The first communication establishment determination unit 514 acquires information from the second storage unit 513 according to whether communication with the headphones 30 by the first communication means 501 has been established, and is realized by the CPU 10. Specifically, when communication with the headphones 30 by the first communication means 501 has not been established, the first communication establishment determination unit 514 acquires the information of the pedal device 1 itself from the second storage unit 513, and when communication with the headphones 30 by the first communication means 501 has been established, the first communication establishment determination unit 514 acquires the information of the pedal device 1 itself and the information indicating that communication with the headphones 30 has been established from the second storage unit 513.

[0089] When it is determined by the pairing mode transition unit 512 that the device is in the advertising mode, the advertising packet generation unit 515 creates an advertising packet AD based on the information acquired from the first communication establishment determination unit 514 and transmits it to the mobile terminal 50 via the second communication means 504, and is realized by the CPU 10. The advertising packet AD generated by the advertising packet generation unit 515 is transmitted to the mobile terminal 50 via the transmission buffer 506 and the second communication means 504.

[0090] That is, the advertising packet AD transmitted from the advertising packet generation unit 515 to the mobile terminal 50 includes information about the pedal device 1 itself and information indicating that communication with the headphones 30 has been established when communication with the headphones 30 by the first communication means 501 has been established. Thereby, the mobile terminal 50 connected to the headphones 30 via the pedal device 1 can determine that it can actually communicate with the headphones 30.

[0091] Next, the electrical configuration of the control system S will be described with reference to FIG. 8. FIG. 8 is a block diagram showing the electrical configuration of the control system S. The headphones 30 include a CPU 31, a flash ROM 32, and a RAM 33, which are respectively connected to an input / output port 35 via a bus line 34. Further connected to the input / output port 35 are a musical instrument receiving device 36, the above-described operator 37 and LED 38, an amplifier 39, a wireless communication device 40 for wirelessly communicating with the pedal device 1, and a gyro sensor 41.

[0092] The CPU 31 is an arithmetic unit that controls each unit connected by the bus line 34. The flash ROM 32 is a rewritable non-volatile storage device that stores programs, fixed-value data, etc. to be executed by the CPU 31, and stores a control program 32a and model ID data 32b in which the model ID of the above-described headphones 30 is stored. When the control program 32a is executed by the CPU 31, the headphone processing of FIG. 9 is executed. The RAM 33 is a memory for the CPU 31 to rewriteably store various work data, flags, etc. during program execution.

[0093] The instrument receiver 36 is a device that receives the performance signal wirelessly communicated from the above-described instrument transmitter Gt. The amplifier 39 is a device that amplifies the performance sound created by the CPU 31. The speakers R and L described above are connected to the amplifier 39, and the performance sound amplified by the amplifier 39 is output to the speakers R and L. The gyro sensor 41 is a sensor that detects the angular velocity, and the amounts of movement, inclination, and rotation of the head of the user H wearing the headphones 30 in the up and down, front and back, and left and right directions are respectively detected.

[0094] The headphones 30 are configured to be able to output a mixed sound of a performance sound (the "first musical sound") based on the performance signal input from the electric guitar G via the instrument receiver 36 and a musical sound (the "second musical sound") input from the mobile terminal 50 or the like via the wireless communication device 40.

[0095] Furthermore, in the mixed sound, for at least one of the first musical sound and the second musical sound, the virtual position where those musical sounds are output can be changed according to the amount of movement or inclination of the head of the user H detected by the gyro sensor 41. For example, by setting the virtual position where the second musical sound, which is a drum sound, is output behind the user H who is playing the electric guitar G, even when the inclination of the head of the user H wearing the headphones 30 and playing the electric guitar G changes, the user H can hear the drum sound always output from behind.

[0096] Next, the electrical configuration of the pedal device 1 of the control system S will be described. The pedal device 1 has a CPU 10, a flash ROM 11, and a RAM 12, which are respectively connected to the input / output port 14 via the bus line 13. Further connected to the input / output port 14 are the above-described pedal switch 15, operator 16, and LED 17, and the wireless communication device 22 for wirelessly communicating with the headphones 30 and the mobile terminal 50.

[0097] The CPU 10 is an arithmetic unit that controls each part connected by the bus line 13. The flash ROM 11 is a rewritable non-volatile storage device that stores programs, fixed-value data, etc. to be executed by the CPU 10. The control program 11a and the model ID data 11b in which the model ID of the above-described headphones 30 is stored are stored. When the control program 11a is executed by the CPU 10, the pedal process in FIG. 11(a) is executed.

[0098] The RAM 12 is a memory for the CPU 10 to store various work data, flags, etc. in a rewritable manner during program execution. A transfer data memory 12a that stores the SysEx message received from the headphones 30 or the portable terminal 50 and its destination, and a performance data memory 12b that stores the CC message created based on the pedal switch 15 are provided.

[0099] Next, the electrical configuration of the portable terminal 50 of the control system S will be described. The portable terminal 50 has a CPU 51, a flash ROM 52, and a RAM 53, which are respectively connected to the input / output port 55 via the bus line 54. Further connected to the input / output port 55 are a wireless communication device 58 for wireless communication with the pedal device 1, a touch panel 56 to which an instruction from the user H is input, and the above-described LCD 57.

[0100] The CPU 51 is an arithmetic unit that controls each part connected by the bus line 54. The flash ROM 52 is a rewritable non-volatile storage device that stores programs, fixed-value data, etc. to be executed by the CPU 51, and the control program 52a is stored. When the control program 52a is executed by the CPU 51, the portable terminal process in FIG. 13 is executed. More specifically, the control program 52a includes an application that targets the above-described pedal device 1 and an application that targets the headphones 30, and the portable terminal process corresponding to the application activated according to the operation of the touch panel 56 is executed. The details of the portable terminal process will be described later with reference to FIG. 13.

[0101] The RAM 53 is a memory for the CPU 51 to store various work data, flags, etc. in a rewritable manner during program execution, and an IQ memory 53a for storing the above-described ink wire message IQ is provided.

[0102] Next, with reference to FIGS. 9 to 13, the processing of the control system S will be described. First, the processing executed by the CPU 31 of the headphones 30 will be described. FIG. 9 is a flowchart of the headphone processing. The headphone processing is processing that is executed when the power of the headphones 30 is turned on.

[0103] The headphone processing first checks whether a connection start operation is instructed by the user H to the operator 37 to start a connection with another communication device such as the pedal device 1 (S1). Specifically, when the operator 37 is long-pressed, it is determined that the connection start operation has been performed. In the processing of S1, if the connection start operation has been performed (S1: Yes), peripheral connection processing (S2) is executed. Here, with reference to FIG. 10(a), the peripheral connection processing will be described.

[0104] FIG. 10(a) is a flowchart of the peripheral connection processing. The peripheral connection processing is executed by the CPU 31 of the headphones 30, and equivalent processing is also executed by the CPU 10 of the pedal device 1.

[0105] The peripheral connection processing first transmits the advertising packet AD described above in FIG. 3 to other communication devices (S20). The transmission of the advertising packet AD to other communication devices is performed using the wireless communication device 40 in the case of the headphones 30, and is performed using the wireless communication device 22 in the case of the pedal device 1. Hereinafter, communication with other communication devices in the peripheral connection processing is assumed to be performed using the wireless communication device 40 in the case of the headphones 30 and using the wireless communication device 22 in the case of the pedal device 1.

[0106] After the process of S20, it is checked whether a connection request is received from another communication device according to the advertising packet AD transmitted in the process of S20 (S21). In the process of S21, when a connection request is received (S21: Yes), connection processing is performed with the other communication device from which the connection request was transmitted (that is, the pedal device 1 or the mobile terminal 50) (S22).

[0107] On the other hand, in the process of S21, when a connection request has not been received (S21: No), it is checked whether a predetermined time or more has elapsed since the start of transmission of the advertising packet AD in the process of S20 (S23). In the process of S23, when a predetermined time or more has not elapsed since the start of transmission of the advertising packet AD (S23: No), the processes below S20 are re-executed. After the process of S22, or in the process of S23, when a predetermined time or more has elapsed since the start of transmission of the advertising packet AD (S23: Yes), the peripheral connection process is terminated.

[0108] Return to FIG. 9. In the process of S1, when a connection start operation is not performed (S1: No), or after the peripheral connection process of S2, it is checked whether the feature request data SR described above in FIG. 4 is received (S3). In the process of S3, when the feature request data SR is received (S3: Yes), a feature request response process (S4) is executed. Here, with reference to FIG. 10(b), the feature request response process will be described.

[0109] FIG. 10(b) is a flowchart of the feature request response process. The feature request response process is executed by the CPU 31 of the headset 30, and equivalent processes are also executed by the CPU 10 of the pedal device 1.

[0110] The feature request response process first checks whether the model ID of the received feature request data SR is its own (S30). Specifically, the model ID included in the feature request data SR is compared with its own model ID, that is, in the case of the headphones 30, the model ID of the model ID data 32b, or in the case of the pedal device 1, the model ID of the model ID data 11b, and it is checked whether they match.

[0111] In the process of S30, if the model ID of the feature request data SR is its own (S30: Yes), its own inquiry message IQ (see Fig. 4) is created, and the created inquiry message IQ is transmitted (returned) to the source of the feature request data SR, that is, the pedal device 1 or the mobile terminal 50 (S31). This transmission is assumed to be performed using the wireless communication device 40 in the case of the headphones 30 and using the wireless communication device 22 in the case of the pedal device 1.

[0112] On the other hand, in the process of S30, if the model ID of the feature request data SR is not its own (S30: No), the received feature request data SR is discarded (S32). After the processes of S31 and S32, the feature request response process ends.

[0113] Return to Fig. 9. In the process of S3, if the feature request data SR has not been received, or after the process of S4, it is checked whether a SysEx message has been received (S5). In the process of S5, if a SysEx message has been received (S5: Yes), it is checked whether the model ID of the control instruction RS in the SysEx message matches the model ID of the model ID data 32b (S6).

[0114] In the process of S6, when the model ID of the control instruction RS in the SysEx message matches the model ID of the 32-bit model ID data (S6: Yes), the settings are updated using the parameters included in the control instruction RS of the SysEx message (S7). On the other hand, when the model ID of the control instruction RS in the SysEx message does not match the model ID of the 32-bit model ID data (S6: No), the received SysEx message is discarded (S8).

[0115] In the process of S5, when no SysEx message is received (S5: No), or after the processes of S7 and S8, it is checked whether the CC message (see Fig. 6(a)) described above in Fig. 6 is received (S9). In the process of S9, when a CC message is received (S9: Yes), it is checked whether the headphone 30 is in the mode of updating its settings according to the received CC message (S10).

[0116] In the process of S10, when it is in the mode of updating its settings according to the received CC message (S10: Yes), the settings are updated using the parameters of the update instruction CC included in the CC message (S11).

[0117] After the process of S11, a response instruction PS (see Fig. 6(a)) is created from the parameters of the update instruction CC of the CC message received in the process of S9 and the model ID of the 32-bit model ID data, and the SysEx message incorporating the response instruction PS is transmitted (returned) to the source of the CC message, that is, the pedal device 1. On the other hand, in the process of S10, when it is not in the mode of updating its settings according to the received CC message (S10: No), the received CC message is discarded (S13).

[0118] In the process of S9, when the CC message has not been received (S9: No), after the processes of S12 and S13, the specific process (S14) is executed. The specific process is other processes performed by the headphones 30. For example, it includes outputting the performance sound based on the performance signal input from the electric guitar G via the musical instrument receiving device 36 and the performance sound input from the mobile terminal 50 via the pedal device 1 to the speakers R and L via the amplifier 39. After the specific process of S14, the processes below S1 are repeated.

[0119] Next, the process executed by the CPU 10 of the pedal device 1 will be described. Fig. 11(a) is a flowchart of the pedal process. The pedal process is a process executed when the power of the pedal device 1 is turned on.

[0120] The pedal process first checks whether a connection scan start operation for instructing the start of reception of the advertising packet AD from another communication device (specifically, the headphones 30) has been performed (S50). Specifically, as described above with reference to Fig. 3(a), when the user H double-clicks the operator 16 until the lighting color of the LED 17 becomes white (i.e., the central function), and then the user H single-clicks the operator 16, when the scan mode is transitioned, it is determined that the connection scan start operation has been performed. In the process of S50, when the connection scan start operation has been performed (S50: Yes), the central connection process (S51) is executed. Here, with reference to Fig. 11(b), the central connection process will be described.

[0121] FIG. 11(b) is a flowchart of the central connection process. The central connection process is executed by the CPU 10 of the pedal device 1, and equivalent processing is also executed by the CPU 51 of the mobile terminal 50. The central connection process first starts receiving the advertising packet AD (S70). In the case of the pedal device 1, the advertising packet AD is received using the wireless communication device 22, and in the case of the mobile terminal 50, it is received using the wireless communication device 58. Hereinafter, communication with other communication devices in the central connection process is performed using the wireless communication device 22 in the case of the pedal device 1 and using the wireless communication device 58 in the case of the mobile terminal 50.

[0122] After the process of S70, it is checked whether the advertising packet AD has been received from another communication device (S71). In the process of S71, if the advertising packet AD has been received (S71: Yes), a connection request is sent to the communication device that has received the advertising packet AD (S72), and connection processing with the communication device is performed (S73).

[0123] In the process of S71, if the advertising packet AD has not been received (S71: No), it is checked whether a predetermined time or more has elapsed since the start of receiving the advertising packet AD by the process of S70 (S74). In the process of S74, if a predetermined time or more has not elapsed since the start of receiving the advertising packet AD (S74: No), the processes below S70 are repeated.

[0124] On the other hand, in the process of S74, if a predetermined time or more has elapsed since the start of receiving the advertising packet AD (S74: Yes), or after the process of S73, the central connection process ends. By such central connection processing and the above-described peripheral connection processing, the first communication w1 between the headphones 30 and the pedal device 1 and the second communication w2 between the pedal device 1 and the mobile terminal 50 are established.

[0125] Return to Fig. 11(a). In the process of S50, if the connection scan start operation is not performed (S50: No), or after the central connection process of S51, it is confirmed whether a connection start operation has been performed from the operator 16 (S52). Specifically, as described above with reference to Fig. 3(b), until the lighting color of the LED 17 becomes blue (i.e., the peripheral function), user H double-clicks the operator 16, and then, when user H single-clicks the operator 16 and transitions to the advertising mode, it is determined that a connection start operation has been performed. In the process of S52, if a connection start operation has been performed (S52: Yes), it is confirmed whether communication has been established with another communication device in the central connection process of S51 (S53).

[0126] In the process of S53, if communication has been established with another communication device in the central connection process (S53: Yes), the information of the communication device with which communication has been established (see Fig. 3(b)) and its own information are added to the advertising packet AD (S54). In the process of S53, if communication has not been established with another communication device in the central connection process (S53: No), its own information is added to the advertising packet AD (S55). After the processes of S54 and S55, the peripheral connection process of S2 described above is executed.

[0127] In the process of S52, if a connection start operation is not performed (S52: No), or after the process of S2, it is confirmed whether the feature request data SR (see Fig. 4) has been received (S56). In the process of S55, if the feature request data SR has been received (S56: Yes), the above-mentioned feature request response process (S4) is executed. In the process of S56, if the feature request data SR has not been received (S56: No), the process of S4 is skipped. After the processes of S4 and S56, the pedal device transmission / reception process (S57) is executed, and the processes of S50 and below are repeated. Here, with reference to Fig. 12, the pedal device transmission / reception process will be described.

[0128] FIG. 12 is a flowchart of the pedal device transmission / reception process. The pedal device transmission / reception process first checks whether a SysEx message has been received (S80). In the process of S80, if a SysEx message has been received (S80: Yes), the received SysEx message, its transmission destination, and the transfer data memory 12a are saved (S81). Specifically, when the SysEx message is received from the mobile terminal 50, the headphones 30 are set as the transmission destination, and when the SysEx message is received from the headphones 30, the mobile terminal 50 is set as the transmission destination.

[0129] After the process of S81, it is checked whether the model ID of the control instruction RS in the SysEx message matches the model ID of the model ID data 11b (S82). In the process of S82, if the model ID of the control instruction RS in the SysEx message matches the model ID of the model ID data 11b (S82: Yes), the settings of itself are updated using the parameters included in the control instruction RS of the SysEx message (S83). Thereby, for example, if the control instruction RS of the SysEx message received from the mobile terminal 50 is to change the acoustic effect controlled by the pedal device 1 to "delay", hereafter, the acoustic effect whose effect amount is controlled by the pedal switch 15 of the pedal device 1 is changed to "delay".

[0130] On the other hand, if the model ID of the control instruction RS in the SysEx message does not match the model ID of the model ID data 11b (S82: No), the received SysEx message is discarded (S84).

[0131] In the process of S80, when no SysEx message is received (S80), after the processes of S83 and S84, it is checked whether the pedal switch 15 has been operated (S85). In the process of S85, if the pedal switch 15 has been operated (S85: Yes), parameters corresponding to the angle are obtained from the pedal switch 15, and an update instruction CC is created based on the obtained parameters. A CC message including the created update instruction CC is created (S86). After the process of S86, the created CC message is stored in the performance data memory 12b (S87).

[0132] In the process of S85, if the pedal switch 15 has not been operated (S85: No), or after the process of S87, it is checked whether there is an untransmitted or transmitting SysEx message in the transfer data memory 12a (S88). In the process of S88, if there is an untransmitted or transmitting SysEx message in the transfer data memory 12a (S88: Yes), the SysEx message in the transfer data memory 12a is transmitted to the transmission destination stored in the transfer data memory 12a (S89).

[0133] On the other hand, in the process of S88, if there is no untransmitted or transmitting SysEx message in the transfer data memory 12a (S88: No), it is checked whether there is an untransmitted or transmitting CC message in the performance data memory 12b (S90).

[0134] In the process of S90, if there is an untransmitted or transmitting CC message in the performance data memory 12b (S90: Yes), the CC message in the performance data memory 12b is transmitted to each of the communication devices connected to the pedal device 1 (S91). On the other hand, in the process of S90, if there is no untransmitted or transmitting CC message in the performance data memory 12b (S90: No), the process of S91 is skipped.

[0135] That is, even when a SysEx message is received from the mobile terminal 50 or the headphones 30, and the pedal switch 15 is operated while the received SysEx message is in an unsent or transmitting state and a CC message is created, after the transmission of the previously received SysEx message is completed, the transmission of the subsequently created CC message is started. By serializing the received SysEx message and CC message for transmission in this way, the SysEx message and the CC message can be transmitted through the same communication path (the first communication w1 or the second communication w2).

[0136] After the processing of S89, S90, and S91, the pedal device transmission / reception processing is terminated.

[0137] Next, the processing executed by the CPU 51 of the mobile terminal 50 will be described. FIG. 13 is a flowchart of the mobile terminal processing. The mobile terminal processing is processing that is executed when an activation instruction for an application that targets the pedal device 1 or an application that targets the headphones 30 is input by an operation of the user H via the touch panel 56.

[0138] The mobile terminal processing first checks (S100) whether a connection scan start operation for instructing the start of reception of an advertising packet AD from another communication device (specifically, the pedal device 1) has been performed from the touch panel 56. Specifically, in the mobile terminal 50, after an application that targets the pedal device 1 or an application that targets the headphones 30 is started, a button (not shown) for starting a connection scan displayed on the LCD 57 is selected via the touch panel 56, it is determined that a connection scan start operation has been performed. In the processing of S100, if a connection scan start operation has been performed (S100: Yes), the above-described central connection processing (S51) is executed.

[0139] After the central connection process of S51, it is checked whether the advertising packet AD received in the central connection process contains information on the communication device with which communication has been established (S101). In the process of S105, if the advertising packet AD contains information on the communication device with which communication has been established (S101: Yes), "ABC+" is displayed on the LCD57 (S102). On the other hand, in the process of S105, if the advertising packet AD does not contain information on the communication device with which communication has been established (S101: No), "ABC" is displayed on the LCD57 (S103).

[0140] After the processes of S102 and S103, based on the model ID of the control target of the running application (that is, the pedal device 1 or the headset 30), feature request data SR is created and transmitted to the connected communication device (specifically, the pedal device 1) (S104).

[0141] In the process of S100, if the connection scan start operation has not been performed (S100: No), or after the process of S104, it is checked whether an ink wire message IQ has been received (S105). In the process of S105, if an ink wire message IQ has been received (S105: Yes), the received ink wire message IQ is stored in the IQ memory 53a (S106). On the other hand, in the process of S105, if an ink wire message IQ has not been received (S105: No), the process of S106 is skipped.

[0142] After the processes of S105 and S106, mobile terminal transmission / reception processing (S107) is executed, and the processes of S100 and below are repeated. Here, with reference to FIG. 14, the mobile terminal transmission / reception processing will be described.

[0143] Figure 14 is a flowchart of the mobile terminal transmission / reception process. The mobile terminal transmission / reception process first checks whether a SysEx message has been received (S120). In the process of S120, if a SysEx message has been received (S120: Yes), it is checked whether the model ID of the control instruction RS in the SysEx message matches the model ID of the control target of the running application (S121).

[0144] In the process of S121, if the model ID of the control instruction RS in the SysEx message matches the model ID of the control target of the running application (S121: Yes), the settings of itself are updated using the parameters included in the control instruction RS of the SysEx message (S122). On the other hand, if the model ID of the control instruction RS in the SysEx message does not match the model ID of the control target of the running application (S121: No), the received SysEx message is discarded (S123).

[0145] In the process of S120, if a SysEx message has not been received (S120: No), or after the processes of S122 and S123, it is checked whether a CC message has been received (S124). In the process of S124, if a CC message has been received (S124: Yes), it is checked whether it is in the mode of updating the settings of itself by the CC message (S125).

[0146] In the process of S125, if it is in the mode of updating the settings of itself by the CC message (S125: Yes), the settings of itself are updated using the parameters of the update instruction CC included in the CC message (S126). On the other hand, in the process of S125, if there is no mode of updating the settings of itself by the received CC message (S125: No), the received CC message is discarded (S127).

[0147] In the process of S124, when a CC message is received (S124: Yes), or after the processes of S126 and S127, it is confirmed whether a parameter (for example, the volume in Fig. 5(a) or the type of acoustic effect in Fig. 5(b)) is input from user H via the touch panel 56 (S128). In the process of S128, when a parameter is input (S128: Yes), the own settings are updated using the input parameter (S129).

[0148] After the process of S129, a control instruction RS is created from the input parameter, the model ID of the control target of the running application, and the ink wire message IQ in the IQ memory 53a. A SysEx message including the created control instruction RS is created and transmitted to the connected communication device (specifically, the pedal device 1) (S130). Thereby, the control instruction RS from the mobile terminal 50 is transmitted to the pedal device 1 and the headphones 30.

[0149] In the process of S128, when no parameter is input from the touch panel 56 (S128: No), or after the process of S130, the mobile terminal transmission / reception process is terminated.

[0150] Although described based on the above embodiments, it can be easily inferred that various improvements and modifications are possible.

[0151] In the above embodiment, the headphones 30 and the effectors 300, 310 (see Fig. 3(a)) are exemplified as the devices connected to the pedal device 1 and the mobile terminal 50, but it is not limited thereto. Electronic musical instruments other than the headphones 30 and the effectors 300, 310, for example, the synthesizer 350 shown in Fig. 15 may be connected. That is, in the control system S' shown in Fig. 15, the first communication w1 described above is established between the synthesizer 350 and the pedal device 1.

[0152] In the modification example, sheet music is displayed on the LCD 57 of the mobile terminal 50. The position of the displayed sheet music is configured to change by operating the touch panel 56. At this time, the position of the sheet music displayed on the LCD 57 is also configured to change by operating the pedal switch 15 of the pedal device 1.

[0153] In the synthesizer 350 in the modification example, a keyboard 354, setting keys 355 for inputting various settings, and a sheet music LCD 356 are mainly arranged. The keyboard 354 is provided with a plurality of keys 354a and is an input device for acquiring performance information by the performance of the user H. MIDI standard performance information corresponding to the key pressing / key releasing operation of the key 354a by the user H is output to the CPU 351 (see FIG. 16).

[0154] The sheet music LCD 356 is a display device on which the same sheet music as that displayed on the LCD 57 of the above-described mobile terminal 50 is displayed. The sheet music and its display position displayed on the sheet music LCD 356 are transmitted from the mobile terminal 50 and the pedal device 1.

[0155] That is, when the display position of the sheet music is changed on the mobile terminal 50, or when the display position of the sheet music is changed by the pedal switch 15 of the pedal device 1, a sheet music equivalent to that displayed on the LCD 57 of the mobile terminal 50 is displayed on the sheet music LCD 356. Thereby, the display position of the sheet music of one synthesizer 350 can be changed from two mobile terminals 50 and the pedal device 1. In particular, since the pedal switch 15 of the pedal device 1 is operated by the user H's footstep, the user H can change the display position of the sheet music on the sheet music LCD 356 without leaving the hand from the keyboard 354.

[0156] Next, referring to FIG. 16, the electrical configuration of the control system S' in the modified example will be described. FIG. 16 is a block diagram showing the electrical configuration of the control system S'. The synthesizer 350 of the control system S' has a CPU 351, a flash ROM 352, and a RAM 353, which are connected via a bus line 357, respectively. Further connected to the bus line 357 are the above-described keyboard 354, setting key 355, music score LCD 356, a wireless communication device 358 that communicates wirelessly with the pedal device 1, a sound source 359, and a Digital Signal Processor 360 (hereinafter referred to as "DSP 360"). The DSP 360 is also connected to the sound source 359.

[0157] The CPU 351 is an arithmetic unit that controls each part connected by the bus line 357. The flash ROM 352 is a rewritable non-volatile storage device that stores programs, fixed-value data, etc. to be executed by the CPU 351, and stores a control program 352a and model ID data 352b in which the model ID is stored. When the control program 352a is executed by the CPU 351, processing equivalent to the headphone processing in FIG. 9 is executed. Note that the specific processing (S14) in the headphone processing is processing specific to the synthesizer 350, and the details will be described later with reference to FIG. 17.

[0158] The RAM 353 is a memory for the CPU 351 to store various work data, flags, etc. in a rewritable manner during program execution. The sound source 359 is a device that outputs waveform data corresponding to the performance information input from the CPU 351. The DSP 360 is an arithmetic unit for performing arithmetic processing on the waveform data input from the sound source 359. A digital-to-analog converter (DAC) 361 is connected to the DSP 360, an amplifier 362 is connected to the DAC 361, and a speaker 363 is connected to the amplifier 362.

[0159] Next, the processing executed by the CPU 351 of the synthesizer 350 will be described. The processing related to the communication between the pedal device 1 and the mobile terminal 50 in the synthesizer 350 is substantially the same as the processing of the headphones 30, except for the connection start operation (S1) and the specific processing (S14) of the headphone processing in FIG. 9 in the above embodiment. In the synthesizer 350, when a predetermined setting key 355 is long-pressed, it is determined that the connection start operation in the processing of S1 of the headphone processing has been performed.

[0160] Next, the specific processing (S14) of the synthesizer 350 will be described. FIG. 17 is a flowchart of the specific processing of the synthesizer 350 in the modified example. The specific processing of the synthesizer 350 first performs switch event processing (S200). In the switch event processing, it is confirmed whether the setting key 355 has been operated. If the setting key 355 has been operated, the processing corresponding to the setting key 355 is performed.

[0161] After the processing of S200, keyboard event processing (S201) is performed. In the keyboard event processing, it is detected which key 354a on the keyboard 354 has been pressed or released. After the processing of S201, MIDI processing is performed (S202). In the MIDI processing, the output and stop of the performance sound are performed according to the operation of the key 354a detected in the processing of S201, and the score and the display position of the score to be displayed on the score LCD 356 are obtained from the parameters included in the update instruction CC from the pedal device 1 and the control instruction RS of the mobile terminal 50.

[0162] After the processing of S202, automatic performance processing (S203) is performed. In this automatic performance processing, concert magic performance processing, automatic accompaniment processing, demonstration processing, etc. are performed. After the processing of S203, score display processing (S204) is performed. In the score display processing, an image of the score is created based on the score and the score display position obtained in the MIDI processing and is displayed on the score LCD 356. As a result, a score equivalent to the score displayed on the LCD 57 of the mobile terminal 50 is displayed on the score LCD 356. After the processing of S204, other processing (S205) related to the synthesizer 350 is performed, and the specific processing ends.

[0163] In the modification example, although an example is given in which the musical score displayed on the LCD 57 of the mobile terminal 50 is displayed on the score LCD 356 of the synthesizer 350 and the position of the musical score displayed on the score LCD 356 is changed by operations from the pedal device 1 and the mobile terminal 50, the present invention is not limited thereto. For example, in the musical scores displayed on the LCD 57 and the score LCD 356, the display mode (for example, color, size of musical notes, markings) of musical notes and the like to be currently played may be configured to be changeable, and the musical notes and the like whose display mode is changed by operations of the mobile terminal 50 and the pedal device 1 may be changed (advanced, retreated, etc.). Further, by operations of the mobile terminal 50 and the pedal device 1, the volume of the performance sound output by the synthesizer 350, the degree and type of the acoustic effect added to the performance sound may be configured to be changeable.

[0164] In the above embodiment, the pedal device 1 having the pedal switch 15 is exemplified as the control device, but the present invention is not limited thereto. For example, the control device may be a device having a switch for switching on / off states, or a device having a "knob" or a fader capable of variably controlling the output parameters. Further, a device that uses sensor information (for example, a device that acquires the change amount of an acceleration sensor and controls a control target according to the change amount) may be used as the control device, or a device capable of setting other parameters may be used as the control device.

[0165] In the above embodiment, the mobile terminal 50 that executes the control program 52a is exemplified as the central communication device that transmits control instructions to the headphones 30 and the pedal device 1, but the present invention is not limited thereto. For example, by executing the control program 52a on an information processing device such as a PC or a tablet terminal, these may be used as the central communication device that transmits control instructions to the headphones 30 and the pedal device 1. Further, a dedicated device that stores the control program 52a in a ROM or the like and executes only the control program 52a may be used as the central communication device that transmits control instructions to the headphones 30 and the pedal device 1.

Explanation of reference numerals

[0166] 30 Headphones (Electronic Musical Instrument) 300, 310 Effectors (Electronic Musical Instrument) 350 Synthesizer (Electronic Musical Instrument) 50 Mobile Terminal (Second Control Device) 1 Pedal Device (Control Device) S Control System 15 Pedal Switches (Part of Input Means) S85 - S87 Input Means, Input Steps S89 First Communication Means, Instruction Sending Means, First Communication Step, Instruction Sending Step S91 Second Communication Means, Instruction Sending Means, Second Communication Step, Instruction Sending Step S82 Determination Means, Determination Step S83 Change Means, Change Step

Claims

1. A control device for controlling an electronic musical instrument, input means for inputting a control instruction, first communication means for performing wireless communication with the electronic musical instrument, second communication means for performing wireless communication with a second control device that controls the electronic musical instrument, instruction transmission means for transmitting, via the first communication means, the control instruction input by the input means and the second control instruction received from the second control device via the second communication means to the electronic musical instrument, determination means for determining whether the second control instruction received from the second control device via the second communication means is a control instruction for itself, A control device, comprising the above.

2. The control device according to claim 1, wherein the instruction transmission means serializes the control instruction input by the input means and the second control instruction received from the second control device via the second communication means, and then transmits the serialized data to the electronic musical instrument via the first communication means.

3. The control device according to claim 1 or 2, further comprising change means for changing the control instruction input by the input means according to the second control instruction when it is determined by the determination means that the second control instruction received from the second control device via the second communication means is a control instruction for itself.

4. The control device according to any one of claims 1 to 3, wherein the first communication means performs wireless communication based on the Bluetooth (registered trademark) Low Energy standard.

5. The control instruction is an instruction using a MIDI standard control change message, The control device according to any one of claims 1 to 4, wherein the second control instruction is an instruction using a MIDI standard system exclusive message.

6. The control device is a pedal device, The second control device is a mobile terminal, and the control device according to any one of claims 1 to 5 is characterized thereby.

7. A control method executed by a control device connected to an electronic musical instrument and a second control device for controlling the electronic musical instrument via wireless communication, comprising: an input step of inputting a control instruction; a first communication step of performing wireless communication with the electronic musical instrument; a second communication step of performing wireless communication with a second control device for controlling the electronic musical instrument; an instruction transmission step of transmitting, to the electronic musical instrument by the first communication step, the control instruction input in the input step and a second control instruction received from the second control device via the second communication step; a determination step of determining whether or not the second control instruction received from the second control device in the second communication step is a control instruction for itself; The control method is characterized by comprising the above steps.

8. The instruction transmission step serializes the control instruction input in the input step and the second control instruction received from the second control device in the second communication step, and transmits the serialized data to the electronic musical instrument by the first communication step. The control method according to claim 7 is characterized by this.

9. When it is determined in the determination step that the second control instruction received from the second control device in the second communication step is a control instruction for itself, the control method according to claim 7 or 8 is characterized by comprising a change step of changing the control instruction input in the input step according to the second control instruction.

10. A control system including an electronic musical instrument, a second control device for controlling the electronic musical instrument, and a control device connected to the electronic musical instrument and the second control device via wireless communication, the second control device includes transmission means for transmitting a second control instruction to the control device; the control device includes input means for inputting a control instruction; a first communication means for wirelessly communicating with the electronic musical instrument; a second communication means for wirelessly communicating with the second control device; an instruction transmission means for transmitting to the electronic musical instrument via the first communication means a control instruction input by the input means and a second control instruction received from the second control device via the second communication means; a determination means for determining whether or not the second control instruction received from the second control device via the second communication means is a control instruction for itself; A control system, characterized by comprising the above.

11. The control system according to claim 10, wherein the instruction transmission means of the control device serializes a control instruction input by the input means and a second control instruction received from the second control device via the second communication means, and then transmits the serialized data to the electronic musical instrument via the first communication means.

12. The control system according to claim 10 or 11, wherein the control device includes a changing means for changing the control instruction input by the input means according to the second control instruction when it is determined by the determination means that the second control instruction received from the second control device via the second communication means is a control instruction for itself.

Images