Information processing method and electronic musical instrument

Abstract

The invention provides an information processing method and an electronic musical instrument, which can improve the usefulness of the electronic musical instrument. The electronic musical instrument includes: a communication unit capable of performing short-range wireless communication with a terminal; and a processing unit that, when the terminal performs an operation following an operation mode including the following operation while the electronic musical instrument and the terminal are in a state in which the short-range wireless communication can be performed, performs processing for transmitting the corresponding data when the communication unit receives a request for reading the data, and transmits the corresponding data to the electronic musical instrument when the electronic musical instrument and the terminal are in a state in which the short-range wireless communication can be performed. And when data to be written and a write request thereof are received via the communication unit, write processing of the data to be written is performed, the operation being repeated in a predetermined pattern at least one of transmission of a read request and transmission of the data to be written and the write request thereof.

Description

[0001] This invention is a divisional application of the invention patent application filed on July 11, 2019, with application number 201980098350.7 and title "Information Processing Method and Electronic Musical Instrument". Technical Field

[0002] This invention relates to an information processing method and an electronic musical instrument. Background Technology

[0003] Previously, there was an information processing device that, when approaching a predetermined distance from an antenna conforming to the Near Field Communication (NFC) standard, reads information stored in a wireless tag connected to the antenna and performs processing corresponding to the order (sequence) of multiple reads (e.g., Patent Document 1). Furthermore, there is a technology that, when a mobile terminal is detected to be within the NFC communication radius, establishes NFC communication, exchanges information to convert to Bluetooth (BT) communication, and receives information about the printing object via BT communication for printing purposes (e.g., Patent Document 2).

[0004] Existing technical documents

[0005] Patent documents

[0006] Patent Document 1: Japanese Patent Application Publication No. 2015-052209

[0007] Patent Document 2: Japanese Patent Application Publication No. 2017-001394 Summary of the Invention

[0008] The problem that the invention aims to solve

[0009] The purpose of this invention is to provide an information processing method and an electronic musical instrument that can improve the usefulness of electronic musical instruments.

[0010] Technical means to solve the problem

[0011] One aspect of the present invention is an information processing method, wherein one of an electronic musical instrument and a terminal capable of short-range wireless communication with the electronic musical instrument performs an operation following an operation pattern during the period when the electronic musical instrument and the terminal are in a state capable of performing the short-range wireless communication, namely, repeatedly performing at least one of sending data readout requests and sending write object data and write requests in a predetermined pattern.

[0012] When the electronic musical instrument and the other terminal receive the read request, they process the sending of corresponding data. When they receive the write object data and its write request, they process the writing of the write object data.

[0013] Furthermore, another aspect of the present invention is an electronic musical instrument, comprising:

[0014] The short-range wireless communication unit is capable of short-range wireless communication with a terminal; and

[0015] The processing unit, when the terminal performs an operation following an operation mode including the following actions during the period when the electronic musical instrument and the terminal are in a state where the short-range wireless communication is possible, performs the processing of sending corresponding data when a read request is received using the short-range wireless communication unit, and performs the writing processing of the write object data when write object data and its write request are received via the short-range wireless communication unit, wherein the operation is to repeatedly perform at least one of sending the read request of data and sending the write object data and its write request in a predetermined pattern. Attached Figure Description

[0016] Figure 1 An example of an information processing system illustrating an implementation method.

[0017] Figure 2 This is a table that shows a list of the processes that an electronic musical instrument system can perform.

[0018] Figure 3 (A) is a sequence diagram representing action example 1 corresponding to item number 1 in the table. Figure 3 (B) is a sequence diagram representing action example 2 corresponding to item number 2 in the table.

[0019] Figure 4 (A) is a sequence diagram representing action example 3 corresponding to item number 3 in the table. Figure 4 (B) is a sequence diagram representing action example 4 corresponding to item number 4 in the table.

[0020] Figure 5 This is a flowchart illustrating the processing of the electronic musical instrument in Action Example 5.

[0021] Figure 6 This is a flowchart representing the terminal processing example in action example 5.

[0022] Figure 7 This is a flowchart illustrating the processing of the electronic musical instrument in Action Example 6.

[0023] Figure 8 This is a flowchart representing the terminal processing example in action example 6.

[0024] Figure 9 This is a flowchart illustrating the processing example of the electronic musical instrument in Action Example 7.

[0025] Figure 10 This is a flowchart representing the terminal processing example in action example 7.

[0026] Figure 11 This is a flowchart illustrating the processing example of the electronic musical instrument in Action Example 8.

[0027] Figure 12 This is a flowchart representing the terminal processing example in action example 8.

[0028] Figure 13 This is a flowchart illustrating the processing example of the electronic musical instrument in Action Example 9.

[0029] Figure 14 This is a flowchart representing the terminal processing example in action example 9.

[0030] Figure 15 This is a flowchart representing the terminal processing example in action example 10.

[0031] Figure 16 This is a flowchart representing the terminal processing example in action example 11.

[0032] Figure 17 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 12.

[0033] Figure 18 This is a flowchart representing the terminal processing example in action example 12.

[0034] Figure 19 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 13.

[0035] Figure 20 This is a flowchart representing the terminal processing example in action example 13.

[0036] Figure 21 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 15.

[0037] Figure 22 This is a flowchart representing the terminal processing example in action example 15.

[0038] Figure 23 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 16.

[0039] Figure 24 This is a flowchart representing the terminal processing example in action example 16.

[0040] Figure 25This is a flowchart illustrating the processing example of the electronic musical instrument in action example 17.

[0041] Figure 26 This is a flowchart representing the terminal processing example in action example 17.

[0042] Figure 27 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 18.

[0043] Figure 28 This is a flowchart representing the terminal processing example in action example 18.

[0044] Figure 29 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 19.

[0045] Figure 30 This is a flowchart representing the terminal processing example in action example 19.

[0046] Figure 31 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 20.

[0047] Figure 32 This is a flowchart representing the terminal processing example in action example 20.

[0048] Figure 33 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 21.

[0049] Figure 34 This is a flowchart representing the terminal processing example in action example 21.

[0050] Figure 35 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 22.

[0051] Figure 36 This is a flowchart representing the terminal processing example in action example 22.

[0052] Figure 37 This is a flowchart illustrating the processing example of the electronic musical instrument in action example 23.

[0053] Figure 38 This is a flowchart representing the terminal processing example in action example 23.

[0054] Figure 39 This indicates that Example 1 applies.

[0055] Figure 40 (A) indicates that Example 2 applies. Figure 40 (B) indicates Figure 40 A close-up view of the back of (A). Figure 40 (C) represents the terminal.

[0056] Figure 41 (A) indicates that Example 3 applies. Figure 41 (B) represents the terminal.

[0057] Figure 42 This is an illustration of Action Mode 4.

[0058] Figure 43 These are explanatory diagrams for Action Mode 5 and Action Mode 6.

[0059] Figure 44 This is an illustration of Action Mode 7.

[0060] Figure 45 This is an illustration of Action Mode 8.

[0061] Figure 46 This represents an example of the processing associated with action mode 8 (change in the frequency of read request publication).

[0062] Figure 47 An example of a table used for frequency changes.

[0063] Figure 48 This is a flowchart illustrating the processing of the second example of frequency change.

[0064] Figure 49 This is a flowchart representing the third example of changing the frequency of read requests.

[0065] [Explanation of Symbols]

[0066] 1: Network

[0067] 10: Electronic musical instruments

[0068] 11: MCU

[0069] 12, 23: Input devices

[0070] 13, 25: Monitor

[0071] 14, 27: Speakers

[0072] 15: Performance controls

[0073] 16, 26: NFC module

[0074] 16A, 26A: Communication ICs

[0075] 16B, 26B: Antenna

[0076] 20: Terminal

[0077] 21: Processor

[0078] 22: Storage device

[0079] 24: Communication Interface

[0080] 28: Audio Source Module

[0081] 29: Sensors

[0082] 30: Camera

[0083] 31: GPS receiver

[0084] 32: MIC

[0085] 33: Battery

[0086] 50: Terminal

[0087] B1, B2: Bus

[0088] S1, S2, S11, S12, S21~S24, S31~S34, S001~S049, S101~S144, S151~S152, S201~S 203. S211~S213, S221~S224, S231~S235, S301~S304, S401~S404, S501~S507: Steps Detailed Implementation

[0089] Regarding electronic musical instruments, in order to improve their operability and expand their applications, it is desirable to incorporate wireless communication capabilities. However, wireless communication technologies such as Bluetooth (a registered trademark) or Local Area Network (LAN) require prior connection processing between devices, which is cumbersome.

[0090] In this embodiment, an electronic musical instrument system that achieves the following objectives will be described. Specifically, by effectively utilizing the convenience of NFC (Near Field Communication), a user convenience is improved, and bidirectional data communication between the electronic musical instrument and a terminal (e.g., a smartphone) is enabled. This allows for real-time transmission and reception of performance information or machine settings (internal parameters) between the terminal and the electronic musical instrument. Furthermore, in the electronic musical instrument system of this embodiment, for electronic musical instruments with small operating components or displays, NFC communication allows the use of the user interface (input device and display) provided by the terminal. This improves the operability of the electronic musical instrument.

[0091] In this embodiment, a structure as described below will be explained. For example, the structure employs a near-field wireless communication function integrated into the electronic musical instrument, thereby enabling real-time data communication. For instance, near-field wireless communication can be used to transmit and receive performance information required by the electronic musical instrument (e.g., control data of the electronic musical instrument: Musical Instrument Digital Interface (MIDI) data) between the electronic device and a mobile terminal such as a smartphone. Furthermore, in this embodiment, the processing of data transmission and reception that continues in real time while keeping the near-field wireless communication terminal close together will be described.

[0092] In this specification, the term "short-range wireless communication" refers to short-range (several meters to several centimeters or less) wireless communication in accordance with communication standards such as NFC, FeliCa (registered trademark), and Radio Frequency Identifier (RFID). However, the wireless communication standards are not limited to the examples described. Furthermore, wireless communication also includes, but is not limited to, communication using contactless integrated circuit (IC) cards. The following embodiments illustrate examples of short-range wireless communication in accordance with NFC standards.

[0093] Regarding an electronic musical instrument system that includes the aforementioned structure, and in an embodiment includes an electronic musical instrument and a terminal capable of short-range wireless communication with the electronic musical instrument, the information processing method described below will be explained.

[0094] (1) During the period when the electronic musical instrument and the terminal capable of short-range wireless communication with the electronic musical instrument are in a state capable of short-range wireless communication, one of the following actions follows an action pattern: repeatedly sending data readout requests and sending write object data and write requests in a predetermined pattern.

[0095] (2) When the electronic musical instrument and the other of the terminals receive the read request, they perform the corresponding data sending process. When they receive the write object data and its write request, they perform the write object data writing process.

[0096] The specified patterns include: [1] repeated sending of data read requests, [2] repeated sending of write object data and its write requests, and [3] N repeated sending of the read requests and M repeated sending of the write requests.

[0097] The action pattern includes the following action patterns <1> to <3> based on the specified patterns [1] to [3].

[0098] <1> Repeatedly send data read requests. The number of repetitions should be an appropriate number, such as 2 or more.

[0099] <2> Repeatedly send the data to be written and the write request. The number of repetitions should be an appropriate number of times, more than 2.

[0100] <3> Alternately send N read requests and M write requests for object data. N and M are integers greater than or equal to 1. The number of alternations can be set appropriately.

[0101] The action mode may also include the following action modes <4> to <8>.

[0102] <4> Based on the content of the data obtained by sending the data read request, perform one of the following: sending the data read request or sending the object data and its write request.

[0103] <5> If a failure is detected in communication between sending a read request for data and sending a write request for object data, a read request for data is sent.

[0104] <6> If a failure is detected in communication between sending a read request for data and sending write object data and its write request, then send write object data and its write request.

[0105] <7> If there is data to be sent, send the data to be written and the write request. If there is no data to be sent, repeatedly send the data read request.

[0106] <8> When there is data to be sent, during the process of repeatedly sending data to be written and sending write requests, data read requests are sent at specified times. When there is no data to be sent, data read requests are sent repeatedly.

[0107] In the information processing method, the following structure can also be adopted: the electronic musical instrument performs prescribed processing based on control information received from the terminal. The control information is simply any processing and action that the electronic musical instrument performs based on. According to this structure, the terminal can be used as the input device for the electronic musical instrument.

[0108] In the information processing method, the following structure can also be adopted: the terminal provides a user interface, which serves as the playing operation tool for the electronic musical instrument, to the user, and sends the playing information obtained through the user interface operation to the electronic musical instrument. The electronic musical instrument then performs prescribed processing using the playing information received from the terminal. In this way, the playing operation tool for the electronic musical instrument can be extended using the terminal. The prescribed processing using the playing information includes, but is not limited to, the storage of playing information, the updating of playing information maintained by the electronic musical instrument, and the output of music corresponding to the playing information.

[0109] In the information processing method, the following structure can also be adopted: the terminal sends control information that changes the appearance of the electronic musical instrument to the electronic musical instrument, and the electronic musical instrument processes the change of its appearance according to the control information received from the terminal. In this way, the appearance of the electronic machine can be changed using the operation of the terminal.

[0110] In the information processing method, the following structure can also be adopted: The terminal sends its authentication information to the electronic musical instrument. If the electronic musical instrument determines that the terminal's authentication information is valid, it enables the specified function while the electronic musical instrument and the terminal are in a state where they can conduct short-range wireless communication. If the short-range wireless communication between the electronic musical instrument and the terminal is deactivated, the specified function is disabled. In this way, by controlling the distance between the terminal and the electronic musical instrument, the specified function (a specific function) can be enabled / disabled.

[0111] In the information processing method, the following structure can also be adopted: the terminal sends the control information of the electronic musical instrument received via the network to the electronic musical instrument. In this way, the electronic machine can be controlled remotely by the terminal via the network.

[0112] In the information processing method, the following structure can also be adopted: the terminal sends the time information it possesses to the electronic musical instrument. This allows accurate time information to be provided to the electronic musical instrument, thereby improving the precision of the electronic musical instrument's functions that utilize the time information.

[0113] In information processing methods, the following structure can also be adopted: the change in sensor values ​​detected by the sensors of the terminal per unit time, or control information based on the change, is sent to the electronic musical instrument. In this way, by changing the position or tilt of the terminal, the change in the sensor values ​​of the terminal changes, thereby controlling the operation of the electronic musical instrument. The control information can be information that controls the operation or processing of the electronic musical instrument, or information that causes the electronic musical instrument to output music.

[0114] In the information processing method, the location information detected in the terminal is sent to the electronic musical instrument. The electronic musical instrument then changes its state to correspond to the state of the sending location. This allows for a simple method to set the electronic musical instrument's state to match the sending location.

[0115] In information processing methods, the following structure can also be adopted: the terminal sends the control information of the electronic musical instrument, obtained through voice input, to the electronic musical instrument. In this way, the same effect as essentially giving the electronic musical instrument voice operation functionality can be achieved.

[0116] In information processing methods, the following structure can also be adopted: the electronic musical instrument uses the electromotive force generated by the radio waves of write or read requests as a power source for prescribed processing. This reduces power consumption when the electronic musical instrument operates on batteries. Alternatively, it makes operation of a machine without a power source or a power supply function possible.

[0117] In information processing methods, the following structure can also be adopted: the terminal receives information indicating the state of the electronic musical instrument from the electronic musical instrument and displays it on a display device. In this way, even if the electronic musical instrument does not have a display device, the user can refer to the information indicating the state of the electronic musical instrument.

[0118] In the information processing method, the following structure can also be adopted: the terminal receives performance information from the electronic musical instrument and displays the corresponding sheet music information on a display device. Thus, when playing an electronic musical instrument, the user can refer to the sheet music by displaying it on the terminal's display device.

[0119] In the information processing method, the following structure can also be adopted: the terminal receives performance information from the electronic musical instrument and outputs music corresponding to the performance information. In this way, it is possible to listen to music based on performance information from an electronic machine that does not have a sound source.

[0120] In the information processing method, the following structure can also be adopted: the terminal receives performance information from the electronic musical instrument and displays information evaluating the performance determined by the performance information on a display device. In this way, lessons can be received by referring to the information evaluated by the user.

[0121] In the information processing method, the following structure can also be adopted: the terminal receives information indicating the currently installed firmware in the electronic musical instrument, and based on the information indicating the latest firmware, displays information indicating whether the firmware of the electronic musical instrument needs to be updated on a display device. This makes it easy to update the firmware of the electronic musical instrument to the latest version.

[0122] In the information processing method, the following structure can also be adopted: the terminal receives information related to the operation of the electronic musical instrument from the electronic musical instrument, and displays information supporting the operation of the electronic musical instrument, which is associated with the operation-related information, on a display device. In this way, by referring to the operation-supporting information, the operability of the terminal can be improved; for example, the user can avoid accidental operation of the terminal. The supporting information can be any information that helps the user, and can also be information indicating the process or information from the corresponding page of the operation manual.

[0123] In the information processing method, the following structure can also be adopted: the terminal receives information related to the operation of the electronic musical instrument from the electronic musical instrument, and performs operations on the camera of the terminal in association with the information related to the operation of the electronic musical instrument. In this way, the camera of the terminal can be controlled through the operation of the electronic musical instrument.

[0124] In information processing methods, the following structure can also be adopted: the terminal edits the data received from the electronic musical instrument and sends the edited data back to the electronic musical instrument. In this way, appropriate information can be sent back to the electronic musical instrument.

[0125] In information processing methods, the following structure can also be adopted: an electronic musical instrument edits the data received from the terminal and sends the edited data back to the terminal. This allows the appropriately formatted information to be further displayed on the terminal's display device.

[0126] Furthermore, the information processing method can also employ the following structure: the terminal adjusts the frequency of issuing read requests based on the remaining battery power. This allows for the suppression of power consumption and efficient battery utilization.

[0127] Furthermore, the information processing method can also employ the following structure: the terminal changes the frequency of issuing read requests based on the switching of the screen displayed on the terminal. This allows the frequency of read requests to be set to correspond to the frequency of the functions or services provided through the screen, thus achieving energy savings.

[0128] Furthermore, the information processing method can also employ the following structure: the terminal adjusts the frequency of issuing read requests based on the period during which no input is received from the terminal. This avoids unwarranted data reads during non-input periods, thereby reducing power consumption.

[0129] Furthermore, in the information processing method, it is preferable to adopt the following structure: the electronic musical instrument uses the energy of radio waves received from the terminal to transmit data to the terminal. In this way, it is possible to avoid operating the electronic musical instrument as a wireless transmitting device.

[0130] The information processing method and electronic musical instrument of the embodiments will be described below with reference to the accompanying drawings. The structure of the embodiments is shown as an example and is not limited to the structure of the embodiments.

[0131] <Structure of Information Processing Systems>

[0132] Figure 1 This illustrates an example of an information processing system (electronic musical instrument system) according to an embodiment. The information processing system includes an electronic musical instrument 10 and a terminal 20 that communicates with the electronic musical instrument 10 via NFC (an example of near-field wireless communication).

[0133] Electronic musical instruments 10 include, for example, various types of electronic musical instruments that imitate keyboard instruments (piano, organ, synthesizer, etc.), percussion instruments (drums, etc.), string instruments (guitar, violin, etc.), and wind instruments (saxophone, etc.). The types of electronic musical instruments are not limited to the examples described.

[0134] The electronic musical instrument 10 includes a microcontroller (MCU) 11 as a processing unit, an input device 12, a display 13, a speaker 14, and playing controls 15, all connected to bus B1. An NFC module 16 is connected to the MCU 11. The NFC module 16 is an example of a communication unit, including a communication integrated circuit (IC) 16A and an antenna 16B. The NFC module 16 can also be connected to the MCU 11 via bus B1.

[0135] The MCU11 comprises a combination of a processor (such as a Central Processing Unit (CPU)), storage devices (such as Read Only Memory (ROM), Random Access Memory (RAM), and hard disk), and integrated circuits (such as Application Specific Integrated Circuit (ASIC) and Field Programmable Gate Array (FPGA)) for controlling the electronic musical instrument 10. The processor performs various processes by executing programs stored in the storage devices. In this embodiment, the MCU11 is described as including circuitry constituting a sound source module (synthesizer). The sound source module may also be treated as a separate component from the MCU11. The electronic musical instrument 10 may also sometimes not include a sound source module.

[0136] Input device 12 includes keys, buttons, switches, etc., for various operations of the electronic musical instrument 10. Display 13 displays information. Speaker 14 outputs music based on music (audio) signals. Music includes instrument sounds, human or animal sounds (speech), instrument sounds, and sounds other than speech. Playing controls 15 are keyboards, percussion surfaces, piston valve keys, etc., operated by the user of the electronic musical instrument 10 for playing. MCU 11 generates performance data (e.g., MIDI data) corresponding to the operations of the playing controls. MIDI data contains multiple performance parameters. The performance data is stored in a storage device included in MCU 11. The storage device may also be located externally to MCU 11.

[0137] The MCU11 uses a sound source module to generate music signals based on MIDI data. The music signal generation can be achieved through either software processing executed by a program or hardware processing using a circuit. The corresponding audio is output from the speaker 14. The MCU11 displays performance-related information such as information input via the input device 12, the results of operations, and MIDI-based performance parameters on the display 13. Furthermore, the display 13 is not a necessary component of the electronic musical instrument 10. Moreover, the display 13 may sometimes be a simple display using only a liquid crystal display (LCD) to display specified text.

[0138] The communication IC 16A of the NFC module 16 performs communication control in accordance with the NFC communication specification. The communication IC 16A includes an NFC tag device. The NFC tag device has a data storage area (memory), and when the antenna 16B receives a read command radio wave, it reads the data stored in the built-in memory of the NFC tag device. The data is transmitted, for example, carried by a reflected wave of the read command radio wave. Furthermore, when the antenna 16B receives data and a data write command radio wave, the NFC tag device of the communication IC 16A writes (stores) the received data to the built-in memory or sends it to the MCU 11.

[0139] Terminal 20 is a smart device such as a smartphone, tablet, or personal computer (PC) that can communicate with the electronic musical instrument 10 via NFC. Terminal 20 is not limited to the example described above. Furthermore, terminal 20 can also be a fixed terminal.

[0140] Terminal 20 includes a processor 21, a storage device 22, an input device 23, an interface (IF) 24, a display 25, an NFC module 26, a speaker 27, an audio source module (synthesizer) 28, a sensor 29, a camera 30, a Global Positioning System (GPS) receiver 31, and a microphone (MIC) 32, all connected to bus B2. Terminal 20 is equipped with a battery 33, and its components can operate using power supplied from the battery 33.

[0141] The processor 21, such as a CPU, executes programs stored in the storage device 22 to perform prescribed processing. The storage device 22 includes main storage (RAM, ROM) and auxiliary storage (hard disk, solid-state drive, SSD, etc.). The main storage device is used as a storage area for data or programs, the working area of ​​the processor 21, and a buffer area for communication data. The auxiliary storage device is used for storing data or programs.

[0142] Communication IF24 is responsible for communication functions in accordance with the prescribed wireless communication specifications. These wireless communication specifications include Long Term Evolution (LTE), Wireless LAN (Wireless Fidelity, Wi-Fi), Bluetooth (a registered trademark), Bluetooth Low Energy (BLE), Zigbee, etc. Terminal 20 may have two or more communication IFs corresponding to these specifications. However, the wireless communication specifications are not limited to these.

[0143] Input device 23 includes keys, buttons, switches, touch panels, etc., for information input. Display 25 displays information. Speaker 27 outputs voice. Sound source module 28 generates music signals based on performance data (performance parameters) such as MIDI. Sensor 29 includes at least one of an accelerometer, gyroscope, geomagnetic sensor, etc., to detect specified physical quantities. Camera 30 captures images of the subject. GPS receiver 31 receives radio waves from GPS satellites to detect location information. MIC 32 is used for voice input.

[0144] NFC module 26 includes communication IC 26A and antenna 26B. Communication IC 26A performs communication control conforming to NFC communication specifications. Communication IC 26A includes an NFC reader / writer device. The NFC reader / writer device, according to instructions from processor 21 (application), transmits radio waves from antenna 26B to either read data from the NFC tag device or write data to the NFC tag device. The NFC reader / writer device delivers the data received from antenna 26B to processor 21. The transmission of read or write requests is repeated while terminal 20 and electronic musical instrument 10 are in a state where NFC communication is possible (NFC module 16 is in a positional relationship or environment where it can receive radio waves from NFC module 26). The transmission frequency is appropriately set according to the size or attributes of the data. By repeatedly transmitting such read or write requests, data larger than the storage capacity of the NFC tag chip can be transmitted from MCU 11 to terminal 20 via NFC module 16, or from terminal 20 to NFC module 16. In the NFC communication between the electronic musical instrument 10 and the terminal 20, actions can be performed in accordance with the action modes <1> to <8>.

[0145] The electronic musical instrument 10 and the terminal 20 can communicate bidirectionally via NFC. As an example, the NFC module 16 (NFC tag device) is a passive type module (passive tag), using energy supplied from the NFC module 26 (NFC reader / writer) to deliver the data to be transmitted to the NFC module. In other words, it is driven by receiving radio waves from the reader / writer and carries the data to be transmitted in the reflected wave of the radio waves, thereby transmitting data to the reader / writer. However, passive communication methods can be electromagnetic coupling, electromagnetic induction, or radio wave communication.

[0146] The description illustrates a structure where the electronic musical instrument 10 operates as an NFC tag (passive tag) and the terminal 20 operates as an NFC reader / writer. It also illustrates an example where the terminal 20 sends a read request to the electronic musical instrument 10, and the electronic musical instrument sends data corresponding to the read request to the terminal 20. Furthermore, it illustrates a scenario where the terminal 20 sends write target data and its write request to the electronic musical instrument, thereby transmitting data from the terminal 20 to the electronic musical instrument 10. However, it is also possible for the communication IC 16 of the electronic musical instrument 10 to have an NFC reader / writer device, and the communication IC 26 of the terminal 20 to have an NFC tag device, performing NFC communication based on read / write commands from the electronic musical instrument 10. In other words, the communication unit (NFC module 16) performing near-field wireless communication of the electronic musical instrument 10 can include passive tags, active tags, or semi-active tags, but a structure including passive tags is preferred. In other words, it is preferable to adopt the following structure, in which the electronic musical instrument 10 uses the energy of the radio waves received from the terminal 20 to send data to the terminal 20.

[0147] like Figure 1 As shown, in the electronic musical instrument 10, the communication IC 16A of the NFC module is connected to the MCU 11, and the communication IC 16A transmits data provided by the MCU 11 from the antenna 16B. The data can also be data stored in a memory accessible to the communication IC 16A and directly acquired by the communication IC 16A. Alternatively, a structure can be adopted where the data is managed by the MCU 11, and the communication IC 16A acquires the data via the MCU 11 (requesting data from the MCU 11 and receiving data supplied from the MCU 11). Furthermore, in the terminal 20, data received by the communication IC 26A via the antenna 26B of the NFC module 26 can be sent to the processor 21. Moreover, reverse data transmission and reception can also be performed.

[0148] In other words, NFC communication can be used to send data from one device (electronic musical instrument 10, terminal 20) to another device. The data sent to the recipient includes data generated in real-time within the device, data read from storage devices managed by the device, and data acquired by the device from external sources. The data sent to the recipient includes data related to the electronic musical instrument 10 (instrument association data). Instrument association data may include parameters for setting the state of the electronic musical instrument 10 (parameters representing settings implemented on the electronic musical instrument 10: setting parameters) or performance information. Performance information may be, for example, MIDI data. Setting parameters may include parameters for MIDI implementation or data for setting multiple functions (menus) of the electronic musical instrument 10 (also called configuration data). Instrument association data is sometimes specific to a single electronic musical instrument 10, and sometimes it is common data shared by multiple electronic musical instruments 10.

[0149] <Action Example>

[0150] The following describes an example of the operation of an electronic musical instrument system. Figure 2 This is a table listing the processes (functions) that the electronic musical instrument system can perform. Item numbers (No.) 1 to 4 are "basic" processes. Item numbers (No.) 5 to 23 are "application" processes that use the application executed by terminal 20. The association number indicates the number of the "basic" function associated with the "application". The following describes the action examples corresponding to the item numbers.

[0151] <<Action Example 1>>

[0152] Figure 3 (A) is a sequence diagram representing the action example (action example 1) corresponding to item number 1 in the table. Action example 1 is an action example that reflects the inherent data of the electronic musical instrument 10 (machine) to the electronic musical instrument 10. Figure 3 In step (A), when the NFC module 26 (communication IC 26A) of terminal 20 establishes an NFC communication link with the NFC module 16 (communication IC 16A) of electronic musical instrument 10, it transmits the inherent data of electronic musical instrument 10 from antenna 26B to electronic musical instrument 10 (S1). This transmission is performed, for example, by sending inherent data and a write command (write request) through NFC module 26. However, data reception by electronic musical instrument 10 can also be performed by sending a read command to terminal 20 through NFC module 16. The transmission of inherent data and a write request, or the transmission of a read command (S1), can be repeated more than twice (operation mode <1> or <2>).

[0153] In the NFC module 16, the communication IC 16A transmits the inherent data received via antenna 16B to the MCU 11. The MCU 11 performs processing to reflect the inherent data (S2). For example, if the inherent data is performance information (MIDI data), the MCU 11 generates music data based on the MIDI data and controls the music output. Alternatively, if the inherent data is a parameter for setting the state of the electronic musical instrument 10, the MCU 11 sets the parameter. According to Operation Example 1, inherent data is sent from terminal 20 to electronic musical instrument 10 using NFC communication, and electronic musical instrument 10 reflects the inherent data. The reflection of inherent data can be performed automatically by the MCU 11 or by user operation.

[0154] <<Action Example 2>>

[0155] Action Example 2 is an example of terminal 20 receiving machine-specific data from electronic musical instrument 10. Figure 3 (B) is a sequence diagram representing the action example (action example 2) corresponding to item number 2 in the table. Figure 3 In step (B), when the NFC module 16 of the electronic musical instrument 10 establishes an NFC communication link with the NFC module 26 of the terminal 20, the NFC module 16 sends the inherent data of the electronic musical instrument 10 to the terminal 20 (S11). This sending can be performed either by receiving a read command (read request) of inherent data from the NFC module 26, or by sending a write request of inherent data to the NFC module 26. The action of S11 can also be performed by repeating the read request or write request more than twice (action mode <1> or <2>).

[0156] In terminal 20, processor 21 receives embedded data via NFC module 26 and performs the prescribed receiving process (S12). The receiving process includes: simply storing the embedded data in storage device 22, displaying it on display 25, and performing playback processing based on the embedded data. Moreover, the processes in S11 and S12 of Operation Example 1 can be repeated.

[0157] <<Action Example 3>>

[0158] Figure 4 (A) is a sequence diagram representing the action example (action example 3) corresponding to item number 3 in the table. Figure 4 In (A), through S11 ( Figure 3 Using the same method (NFC communication) as (B), the inherent data is sent from the electronic instrument 10 to the terminal 20 (S21).

[0159] In step S22, the processor 21, which receives the intrinsic data from the NFC module 26, performs editing processing on the intrinsic data. For example, the processor 21 displays the intrinsic data and a user interface (UI) that serves as the editing environment for the intrinsic data on the display 25, and accepts editing information for the intrinsic data input using the input device 23. Thus, intrinsic data (e.g., performance information (MIDI data)) can be obtained from the electronic musical instrument 10 and edited using the terminal 20. Editing can also be performed by the processor 21 according to a predefined automatic editing algorithm.

[0160] When the editing process is complete, the processor 21 hands the edited intrinsic data to the NFC module 26, and the NFC module 26 sends the edited intrinsic data along with the write command to the electronic musical instrument 10 (S23). The processing in S23 is related to... Figure 3 The processing in (A) S1 is the same as that in S2. In the electronic musical instrument 10, the MCU 11 receives the edited intrinsic data and performs a reflection process based on the intrinsic data (S24). The reflection process is the same as that in S2. In addition, the operation of Action Example 3 can also be performed by repeating S21 to S23. For example, the electronic musical instrument 10 can also repeatedly perform the process of sending a write request in S21 and a read request in S23 to perform the desired data reflection (Operation Mode <3>).

[0161] <<Action Example 4>>

[0162] Figure 4 (B) is a sequence diagram representing the action example (action example 4) corresponding to item number 4 in the table. Figure 4 In (B), through S1 ( Figure 3 Using the same method (NFC communication) as (A), the inherent data is sent from the terminal 20 to the electronic musical instrument 10 (S31).

[0163] In step S32, the MCU11, which receives the intrinsic data from the NFC module 26, performs editing processing on the intrinsic data. For example, the MCU11 displays the intrinsic data and a UI (User Interface) that forms the editing environment for the intrinsic data on the display 13, and accepts editing information for the intrinsic data input using the input device 12. Thus, intrinsic data (e.g., performance information (MIDI data)) can be obtained from the terminal 20 and edited using the electronic musical instrument 10. Editing can also be performed according to a predefined automatic editing algorithm.

[0164] When the editing process is complete, MCU11 hands over the edited intrinsic data to NFC module 16, utilizing S11 ( Figure 3In the same manner as (B), the NFC module 16 sends the edited intrinsic data to the terminal 20 (S33). In the terminal 20, the processor 21 receives the edited intrinsic data and performs reflection processing based on the intrinsic data (S34). Alternatively, the actions of Action Example 4 can also be performed repeatedly through S31 to S33. For example, the terminal 20 can repeatedly perform the processing of sending a write request in S31 and a read request in S33 to achieve the desired data reflection (Action Mode <3>).

[0165] According to Action Examples 1 to 4, it is possible to use NFC communication to send and receive proprietary data (MIDI data, configuration data of electronic musical instrument 10, etc.) between electronic musical instrument 10 and terminal 20, and to reflect proprietary data. Furthermore, it is possible to edit proprietary data using either electronic musical instrument 10 or terminal 20, and send the result to the other device. The Action Examples 5 to 23 described below are applicable to the action modes <1> to <3> described in Action Examples 1 to 4.

[0166] <<Action Example 5>>

[0167] The action example (action example 5) of item number 5 in the table represents the action when a display device is attached to the electronic musical instrument 10 (display function attachment action). Figure 5 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 5. As an example, Figure 5 The processing is performed by the MCU 11, which executes the program (application) installed on the electronic musical instrument 10.

[0168] Figure 5 In step S001, the MCU11 determines whether the NFC module 16 (communication IC 16) of the electronic musical instrument 10 has entered the area (NFC communication detection area) where it can communicate with the NFC module 26 of the terminal 20 via NFC. This determination is based on whether the antenna 16B receives (detects) radio waves from the antenna 26B of the NFC module 26.

[0169] If it is determined that the area has not yet been entered (NFC module not yet detected), then MCU11 determines whether to terminate the action in Action Example 5 (S002). If it is determined in S002 that the action should be terminated, then the action ends. Figure 5 If the above is not the case, the processing will return to S001.

[0170] In S001, if the NFC module 26 of the terminal 20 is close enough to determine that it has entered the area where the electronic musical instrument 10 and the terminal 20 can communicate via NFC, then the MCU 11 will proceed to S003.

[0171] In step S003, MCU11 reads data representing the machine information (identification information of electronic musical instrument 10: machine ID) of electronic musical instrument 10 and passes it to communication IC16A. Communication IC16A performs impedance control to respond to the NFC transmission output from antenna 26B on the terminal side, and delivers the data to be transmitted from antenna 16B to terminal 20. That is, the power supplied from antenna 26B is used to supply (transmit) the data to be transmitted. Moreover, communication IC16A performs demodulation / decoding processing on the radio waves received from antenna 16B, and delivers data representing the response result to the machine information transmitted from terminal 20 to MCU11.

[0172] In step S004, MCU11 determines whether the electronic musical instrument 10 and the terminal 20 are in an authenticated state (communication is permitted). If they are not in an authenticated state, MCU11 initiates the authentication process between the electronic musical instrument 10 and the terminal 20. The authentication process is performed through the following steps.

[0173] (1) Send the authentication request of the electronic musical instrument 10 to the terminal 20.

[0174] (2) Receive the result of processing the authentication request made using terminal 20.

[0175] (3) Determine whether to allow communication with terminal 20 based on the processing result of the authentication request.

[0176] If communication with terminal 20 is permitted, the authentication process is considered complete and the device is in an authenticated state. Conversely, if communication is not permitted, the authentication process is considered incomplete.

[0177] In S006, MCU11 determines whether the authentication has been completed normally. If it is not determined that the authentication has been completed normally, the action in Action Example 5 ends. If it is determined that the authentication has been completed normally (in the case of successful authentication), MCU11 proceeds to S007.

[0178] In S007, MCU11 determines whether to continue the action of Example 5. If it determines to continue, the process proceeds to S008. In S008, MCU11 determines whether the electronic musical instrument 10 and the terminal 20 are within a communicable area. The process in S008 is the same as that in S001. If it is determined in S008 that the two are not within the area, MCU11 returns to S001 and waits for the terminal 20 to approach again. Conversely, if it is determined that the two are within the area, the process proceeds to S008A. Alternatively, if it is determined in S008 that the two are not within the area, the action of Example 5 can also be terminated.

[0179] In S008A, MCU11 resets the count value of a counter (not shown) to start counting and determines whether the count value has reached the threshold Th. The process in S008A is repeated until the count value is determined to have reached the threshold Th. If the count value is determined to have reached the threshold Th, the process proceeds to S009. The threshold can be set appropriately. Alternatively, by counting down (countdown), when the count value becomes 0, it can also be determined that the threshold Th has been reached.

[0180] In S009, MCU11 transmits the inherent data generated by the electronic musical instrument 10 through its operation to terminal 20. For example, a user operates input device 12 to input information representing parameters (internal parameters) corresponding to settings implemented on the electronic musical instrument 10. MCU11 then passes the input information to communication IC16A.

[0181] The communication IC 16A uses power supplied from the NFC module 26 to send the transmission target data received from the MCU 11 from the antenna 16B to the NFC module 26. After processing in S009, processing returns to S007. Therefore, until the terminal 20 is moved away from the electronic musical instrument 10 and both the terminal 20 and the electronic musical instrument 10 are outside the area, the data generated in the electronic musical instrument 10 can be sent to the terminal 20 using the processing in S009.

[0182] Figure 6 This is a flowchart illustrating the processing example of terminal 20 in action example 5. As an example, Figure 6 The processing is performed by the processor 21 that executes the program (application) installed on the terminal 20.

[0183] Figure 6 The processing of S101 to S106 shown is the same as that of S001 to S006, so the description is omitted. The processor 21 of the terminal 20 successfully completes the authentication operation with the electronic musical instrument 10 (the authentication between the two parties is completed normally), and becomes capable of sending and receiving data with the electronic musical instrument 10.

[0184] The processing in S107, S108, and S108A is the same as that in S007, S008, and S008A. In S109, the processor 21 acquires the data from the electronic musical instrument 10 that has been received using the antenna 26B and demodulated by the communication IC 26A.

[0185] In S110, the processor 21 determines whether the data received from the communication IC 26A contains data requesting a change in the display state of the display 25. If such data is included, the processor 21 performs display control on the display 25, changing the display content of the display 25 (S111). This allows the display 25 to display data received from the electronic musical instrument 10, such as information indicating the latest setting parameters of the electronic musical instrument 10. When the processing in S110 ends, the process returns to S107.

[0186] Therefore, until a no decision is made in S107 or S108, information based on data received from the electronic musical instrument 10 is displayed on the display 25 of the terminal 20, and the displayed content is changed according to the content of the data.

[0187] According to Example 5, the following advantages are available. Specifically, the machine (electronic musical instrument 10) sometimes has a structure that cannot display its internal settings (internal parameter states) (e.g., a structure without a display). In this case, by bringing the terminal 20 close to the electronic musical instrument 10 (e.g., placing it on the frame of the electronic musical instrument 10), both are placed within a communicable area. Authentication is then performed between communication IC16A and communication IC26A, enabling NFC communication.

[0188] In the electronic musical instrument system of this embodiment, as long as both the electronic musical instrument 10 and the terminal 20 are within the same area, the electronic musical instrument 10 continuously transmits data (repeatedly performing data transmission processing). On the other hand, as long as both are within the same area, the terminal 20 continuously receives data transmitted from the electronic musical instrument 10 (repeatedly performing data reception processing). Therefore, the desired information based on the data received from the electronic musical instrument 10 can be displayed on the display 25 of the terminal 20, and the displayed content can be changed according to the update status of the data in the electronic musical instrument 10.

[0189] In this way, the terminal 20 operates as a display device (shower) for the electronic musical instrument 10 via NFC communication. Normal NFC communication involves only one data transmission and reception when the two devices are close together, but in this embodiment, NFC communication (data transmission and reception) is performed continuously and repeatedly. Therefore, information based on newly generated data due to the operation of the electronic musical instrument 10 can be displayed in real time on the display 25 of the terminal 20.

[0190] By referring to the screen on display 25, users can visually confirm the internal settings (setting parameters) of the electronic musical instrument 10. Therefore, in electronic musical instruments that do not have a display or whose display form is limited, user convenience or the usefulness of the electronic musical instrument can be improved.

[0191] Furthermore, in the description, the example of data sent from the electronic musical instrument 10 is set as data of newly generated internal parameters in the electronic musical instrument 10. However, the data may also be MIDI data (performance information) generated by the operation of the playing operation device 15 (the user's playing action). Moreover, the data is not limited to data generated in real time, but may also be data read from and sent from a storage device. The type of data is not limited to internal parameters or MIDI data.

[0192] Based on action example 5, the advantages described below are obtained [1] and [2].

[0193] [1] By setting the electronic musical instrument 10 and the terminal 20 to a near state or to a state that is farther away than the near state, the user can control the enabling / disabling of the communication state between the two.

[0194] [2] The authentication process between the electronic musical instrument 10 and the terminal 20 is implemented through application (application layer) control (by MCU 11 and processor 21). Thus, flexible communication, as in the example below, can be achieved using proximity actions.

[0195] [Example 1] It enables multiple terminals 20 to communicate with multiple electronic musical instruments 10 in a free order and combination.

[0196] [Example 2] When communication is resumed after it has stopped, it can continue from the previous state.

[0197] [Example 3] Since the communication between the two machines is initiated by the physical action of approaching each other, it is easy to clearly identify the target machine for communication by visual inspection.

[0198] <<Action Example 6>>

[0199] Figure 2 The action of item number 6 in the table (action example 6) is an action to add operation components to the electronic musical instrument 10. In action example 6, a graphical user interface (GUI) representing the playing operation components is displayed on the screen of the display 25 of the terminal 20. Through the operation of the GUI, the user can obtain the effect of operating the playing operation component 15 of the electronic musical instrument 10 or the additional playing operation components related to the electronic musical instrument 10.

[0200] Figure 7 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 6. Figure 7 Example 5 of the processing and action of S001 to S008A in the middle ( Figure 5The same applies, so further explanation is omitted. If this determination is made in S008, the process proceeds to S010. When the terminal 20 is brought close to the electronic musical instrument 10 by placing the terminal 20 on the frame of the electronic musical instrument 10, the processes of S001 to S008 are performed, and the NFC communication between the two continues repeatedly.

[0201] In S010, MCU11 uses NFC module 16 to receive data representing information (operation information) generated by operations performed through terminal 20 (the GUI of the performance control device). Example 6 describes the case where the operation information is MIDI data generated by operations performed through the GUI on terminal 20, but operation information is not limited to MIDI data.

[0202] In S011, MCU11 determines, based on the data received in S010, whether it is necessary to update the data held by the electronic musical instrument 10 (e.g., MIDI data generated corresponding to the operation of the playing operation unit 15). If no data is received in S010 and it is determined that no update is needed based on the received data, MCU11 returns to S007. Conversely, if it is determined that an update is needed, the process proceeds to S012.

[0203] In S012, MCU11 performs data reception processing, such as updating the stored data. For example, MCU11 updates the MIDI data stored by the electronic musical instrument 10 based on the MIDI data received from terminal 20. When the processing in S012 ends, the process returns to S007.

[0204] Figure 8 This is a flowchart representing the processing example of terminal 20 in action example 6. Figure 8 Example 5 of the processing and operation of S101 to S108A shown ( Figure 6 The same applies, so the explanation is omitted. If this determination is made in S108A, the process proceeds to S112. In S112, the processor 21 uses the screen data shown in the storage device 22 to display a GUI representing the playing operation of the electronic musical instrument 10 on the display 25 of the terminal 20. The user can operate the GUI through the touch panel of the display 25. The GUI can be either a GUI that imitates the playing operation 15 included in the electronic musical instrument 10, or a GUI that imitates a playing operation different from the playing operation 15 (an additional playing operation). In Operation Example 6, an example of displaying a GUI that imitates an additional playing operation will be explained.

[0205] In the loop of S108, S108A, and S112, when the user operates the GUI, the processor 21 generates MIDI data corresponding to the GUI operation. In S112, the MIDI data is sent to the electronic musical instrument 10 using the NFC module 26.

[0206] Alternatively, the user of terminal 20 can start the performance operation after accessing the GUI of the performance operation on the display 25 by operating the input device 23 of terminal 20. Figure 8 The processing.

[0207] According to Action Example 6, the terminal 20 can be used as an additional playing device. For example, if the electronic instrument 10 is a keyboard instrument, the processor 21 (application) of the terminal 20 displays the additional keyboard as a GUI on the display 25. When the keyboard is operated, MIDI data of sounds that cannot be produced by the operation of the playing device 15 of the electronic instrument 10 (e.g., sounds of a higher octave / lower octave) is generated.

[0208] In the electronic musical instrument 10, when an additional performance operation is performed while the speaker 14 is outputting a sound corresponding to the operation of the performance operation 15 (in the performance state), the MIDI data corresponding to this operation is sent to the electronic musical instrument 10, and the MCU 11 causes the music corresponding to this MIDI data to be output from the speaker 14.

[0209] Thus, according to Action Example 6, the same effect as extending the electronic musical instrument 10 can be achieved. Furthermore, the GUI display simulating a portion of the performance control 15 can be made larger than the actual performance control 15, either together with or replacing the added performance control. Therefore, even when a portion of the performance control 15 is difficult to operate (e.g., the performance control 15 is small, located in a difficult-to-reach area), the same effect (outputting the same sound) as operating the corresponding performance control 15 can be easily obtained via the touch display 25.

[0210] According to Action Example 6, the electronic musical instrument 10 can be expanded in a simple way, thereby increasing the range of performance. Moreover, the operability of the electronic musical instrument 10 can be improved, that is, the user's convenience can be improved. In addition, according to Action Example 6, the advantages [1] and [2] described in Action Example 5 can also be obtained.

[0211] <<Action Example 7>>

[0212] Figure 2Action Example 7 (item number 7) in the table represents an action that changes the appearance of the electronic musical instrument 10 through operation from the terminal. In Action Example 7, appearance change data of the electronic musical instrument 10 is sent to the electronic musical instrument 10 via NFC communication, thereby changing the appearance of the electronic musical instrument 10. The appearance change includes: a change in the display mode of the display (display 13) included in the electronic musical instrument 10, a change in the lighting and flashing state of the light-emitting parts (lamp, light-emitting diode (LED)), and a change in the position of the movable parts of the electronic musical instrument 10.

[0213] Appearance change data may represent, for example, control parameters of a controller (IC) for a display or light-emitting component, or a controller for a motor or actuator that controls the position of a movable component. Appearance change data can be a pre-prepared dataset or data generated using the camera 30 or pen input function included in terminal 20. In other words, any method can be used to generate appearance change data.

[0214] Figure 9 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 7. Figure 9 Example 5 of the processing and action of S001~S008 and S008A ( Figure 5 The process is the same, so further explanation is omitted. If this determination is made in S008A, the process proceeds to S013. In S013, MCU11 receives data from terminal 20. S014 is performed by MCU11 determining whether the data received in S013 contains data for appearance changes.

[0215] If it is determined that the data received in S013 does not contain data for appearance change, the process returns to S007; otherwise, the process proceeds to S015. In S015, the MCU11 controls the controller of the controlled object (display, light-emitting parts, engine, etc.) based on the appearance change data (changing the set parameters). This causes a change in the controlled object, thereby changing the appearance of the electronic musical instrument 10.

[0216] Figure 10 This is a flowchart representing the processing example of terminal 20 in action example 7. Figure 10 The processing of S101 to S108A shown is the same as the processing of Action Example 5. Figure 6The same applies, so the explanation is omitted. If this determination is made in S108A, the process proceeds to S113. In S113, the processor 21, for example, reads the appearance change data stored in the storage device 22 and sends the appearance change data to the electronic musical instrument 10 using the NFC module 26. When the process in S113 ends, the process returns to S108. In S113, a GUI for user input of appearance change data may also be displayed on the display 25.

[0217] According to Action Example 7, the appearance of the electronic musical instrument 10 can be changed using the terminal 20. Thus, the user's personality can be expressed in the appearance of the electronic musical instrument 10. Furthermore, the functionality of the electronic musical instrument 10 can be expanded. Moreover, according to Action Example 7, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0218] <<Action Example 8>>

[0219] Figure 2 The action example (action example 8) for item number 8 in the table represents the action of sending the performance information of the electronic musical instrument 10 to the terminal 20, so that the score is displayed on the display 25. Figure 11 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 8.

[0220] Figure 11 The processing of S001 to S008A and the processing of action example 5 ( Figure 5 The same applies, so further explanation is omitted. If this determination is made in S008A, the process proceeds to S016. In S016, when the user performs an operation (playing) on ​​the playing operation unit 15, the MCU 11 generates playing information (MIDI data). The MCU 11 uses the NFC module 16 to send the MIDI data to the terminal 20.

[0221] Figure 12 This is a flowchart representing the processing example of terminal 20 in action example 8. Figure 12 The processing of S101 to S106 shown is the same as the processing of Action Example 5. Figure 6 The process is the same as in S104 or S106, so the explanation is omitted. If this determination is made in S104 or S106, the process proceeds to S106A. In S106A, the processor 21 executes the application for displaying sheet music, causing the sheet music display screen to be displayed on the monitor 25. Furthermore, the processor 21 sends a request to read the performance information to the electronic musical instrument 10, thus becoming ready to receive performance information from the electronic musical instrument 10. Subsequently, the process proceeds to S107. The processes of S107, S108, and S108A are the same as in Action Example 5 ( Figure 6 The same processing is described in ().

[0222] When S108A ends and the process proceeds to S114, the processor 21 performs data reception processing and determines whether the received data contains performance information (MIDI data) (S115). If it is determined that the data does not contain performance information, the process returns to S106A; if it is determined that the data contains performance information, the process proceeds to S116.

[0223] In S116, the processor 21 uses the performance information to generate sheet music information and displays the sheet music based on the sheet music information on the sheet music display screen of the display 25. Through repeated and continuous NFC communication between the terminal 20 and the electronic musical instrument 10, the performance information of the electronic musical instrument 10 is sent to the terminal 20 in real time, and the sheet music corresponding to the performance information is displayed on the display 25.

[0224] According to Action Example 8, user convenience and the usefulness of the electronic musical instrument 10 can be improved. Moreover, according to Action Example 8, the advantages described in Action Example 5[1] and[2] can also be obtained.

[0225] <<Action Example 9>>

[0226] Figure 2 The action example (action example 9) for item number 9 in the table represents the action of sending the inherent data of the electronic musical instrument 10 to the terminal 20 and displaying it on the terminal 20. Figure 13 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 9.

[0227] Figure 13 The processing of S001 to S007 and the processing of action example 5 ( Figure 5 Since they are the same, further explanation is omitted. However, if in Figure 13 If this determination is made in S007, the process proceeds to S008A. When the count value reaches or exceeds the threshold Th, the process proceeds to S018. If it is determined in S007 that the region is outside (S007, No), the process proceeds to S017. In S017, MCU11 determines whether to terminate the action of action example 9. If it is determined to terminate the action, the action of action example 9 ends; otherwise, the process returns to S007.

[0228] In S018, MCU11 determines what kind of communication request the terminal 20 is making to the electronic musical instrument 10. If the communication request is determined to be a read request, the process proceeds to S019. Conversely, if the communication request is determined to be a write request or a write request, the process proceeds to S020. If the communication request has not yet arrived, the process returns to S007. However, if the communication request has not yet arrived, the process can also return to S001. Additionally, Figure 13 In this context, the processing of S008A can also occur between S018 and S020, or between S018 and S019, instead of between S107 and S118. Furthermore, the threshold Th can be the same or different between the reception and transmission of inherent data.

[0229] In S019, MCU11 performs the following process: according to the read request, it reads the inherent data of electronic musical instrument 10 (the setting parameters implemented on electronic musical instrument 10) from the storage device and sends it to terminal 20. Then, the process returns to S007. However, it may also return to S001.

[0230] In S020, the MCU 11 writes the write target data (the inherent data of the electronic musical instrument 10) received from the terminal 20 to the storage device according to the write request. Thus, the inherent data is overwritten (updated), and the changes to the inherent data made in the terminal 20 are reflected in the electronic musical instrument 10. Through the change of the inherent data, i.e., the setting parameters, MIDI execution or the state of the electronic musical instrument 10 changes. Furthermore, when the processing in S020 ends, the process returns to S007. However, it may also return to S001.

[0231] Figure 14 This is a flowchart representing the processing example of terminal 20 in action example 9. Figure 14 The processing of S101 to S107 shown is the same as the processing in Action Example 5 ( Figure 6 The same applies, therefore the explanation is omitted. However, if in Figure 14 If a no-determination is made in S107, the process proceeds to S117; if the determination is not true, the process proceeds to S108A. In S117, the processor 21 determines whether to end the action of action example 9. If the determination is to end the action, the action of action example 9 ends; otherwise, the process returns to S107. In S108A, the counter is counted until it is determined that the count value has reached or exceeded the threshold. When it is determined that the count value has reached or exceeded the threshold, the process proceeds to S118.

[0232] In S118, the processor 21 determines what kind of communication request the terminal 20 made to the electronic musical instrument 10. If it is determined in S118 that a read request (Read) was made to the electronic musical instrument 10 as a communication request, the process proceeds to S119. Conversely, if it is determined that a write request (Write) was made to the electronic musical instrument 10 as a communication request, the process proceeds to S120. If it is determined that no communication request was made or has not yet been made (Not request), the process returns to S107. However, in the case where no communication request was made or has not yet been made, the process may also return to S001.

[0233] In S119, MCU11 receives the intrinsic data sent from electronic musical instrument 10 according to the read request and displays it on display 25. Furthermore, MCU11 provides an environment for the user to edit the intrinsic data using input device 23, accepting the user's editing input. Processor 21 stores the edited intrinsic data in storage device 22. Then, processing returns to S007. However, it may also return to S001.

[0234] In S120, the following process is performed: based on the write request, the NFC module 26 sends the intrinsic data (the intrinsic data edited in S119) intended for transmission to the electronic musical instrument 10. The process then returns to S007. However, it may also return to S001. Additionally, Figure 14 In this context, the processing in S108A can also occur between S118 and S120, or between S118 and S119, instead of between S107 and S118. Furthermore, the threshold Th can be the same or different between the reception and transmission of inherent data.

[0235] According to Action Example 9, Terminal 20 can read the setting parameters (intrinsic data) implemented on Electronic Instrument 10 from Electronic Instrument 10 and display them on Display 25 of Terminal 20. At this time, Terminal 20 can accept editing input of setting parameters, store the edited setting parameters, and send them to Electronic Instrument 10. In Electronic Instrument 10, the edited setting parameters are used to update (overwrite) the setting parameters. As a result, the MIDI execution or status (menu) of Terminal 20 is changed.

[0236] In cases where the electronic musical instrument 10 does not have a display or the display is of low quality, the inherent data can be displayed and edited using the terminal 20, thereby improving user convenience and the usefulness of the electronic musical instrument. Moreover, according to Operation Example 9, the advantages described in Operation Example 5[1] and[2] can also be obtained.

[0237] <<Action Example 10>>

[0238] Figure 2 Action example 10 in the table (Action Example 10) indicates sending the performance information of electronic instrument 10 to terminal 20, and outputting music based on the performance information from terminal 20. The processing of electronic instrument 10 in Action Example 10 is similar to the processing of electronic instrument 10 in Action Example 8 (…). Figure 11 The same applies, so the explanation is omitted. In other words, in Action Example 10, the terminal 20 is also brought close to the electronic musical instrument 10, and the performance information (MIDI data) generated in the electronic musical instrument 10 is sent to the terminal 20 via NFC communication.

[0239] Figure 15This is a flowchart representing the processing example of terminal 20 in action example 10. Figure 15 The processing of S101 to S106 shown is the same as the processing of terminal 20 in Action Example 5. Figure 6 The same as in S104 or S106, therefore the explanation is omitted. If this determination is made in S104 or S106, the process proceeds to S106B. In S106B, the processor 21 executes the application for displaying the timbre of the sound source and displays the timbre display screen on the display 25. Moreover, the processor 21 sends a request to read out the performance information to the electronic instrument 10, becoming ready to receive performance information from the electronic instrument 10. Subsequently, the process proceeds to S107. S107, S108, and S108A are the same as in Action Example 5 ( Figure 6 The same processing is described in ().

[0240] When the process proceeds from S108A to S121, the processor 21 performs data receiving processing and determines whether the received data contains performance information (MIDI data) (S122). If it is determined that there is no performance information, the process returns to S106B; if it is determined that there is performance information, the process proceeds to S123.

[0241] In step S123, processor 21 uses sound source module 28 to generate a music signal based on performance information, and outputs the music corresponding to the music signal from speaker 27. Furthermore, processor 21 displays information representing the timbre based on the music signal on display 25 based on the performance information. The timbre display is optional.

[0242] According to Action Example 10, when the electronic musical instrument 10 lacks a sound source module (synthesizer) or the sound source module has weak performance, the music played by the electronic musical instrument 10 can be output from the terminal 20 using the terminal 20. This improves user convenience and the usability of the electronic musical instrument 10. Furthermore, according to Action Example 10, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0243] <<Action Example 11>>

[0244] Figure 2 Action example 11 (Action Example 11) in the table indicates the action of sending the performance information of electronic instrument 10 to terminal 20 to determine the performance status. The processing of electronic instrument 10 in Action Example 11 is the same as the processing of electronic instrument 10 in Action Example 8. Figure 11 The same applies, so the explanation is omitted. In Action Example 11, performance information (MIDI data) is also sent from the electronic instrument 10 to the terminal 20.

[0245] Figure 16This is a flowchart representing the processing example of terminal 20 in action example 11. Figure 16 In addition to the processing of S106C and S123A, the processing examples are the same as those in action example 10 ( Figure 15 )same.

[0246] The processing in S106C is performed when this determination is made in S104 and S106. In S106C, the processor 21 executes the user's course application and displays the course screen on the display 25. Moreover, the processor 21 sends a request to read the performance information to the electronic musical instrument 10, thus becoming ready to receive performance information from the electronic musical instrument 10.

[0247] In S123A, the processor 21 displays course-related information on the course screen, including information on the user's performance status based on performance information, information on the textbook's performance status, and information on the user's performance score or comments based on comparison with the textbook. The user can refer to the course screen to understand areas for improvement in their performance. As a result, user convenience and the usefulness of the electronic musical instrument 10 can be improved. Moreover, according to Operation Example 11, the advantages described in Operation Example 5 [1] and [2] can also be obtained.

[0248] <<Action Example 12>>

[0249] Figure 2 The action example (action example 12) for item number 12 in the table indicates that the machine information (firmware association information) of the electronic musical instrument 10 is sent to the terminal 20 to confirm the firmware update. Figure 17 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 12.

[0250] Figure 17 The processing shown, apart from the processing in S016A, is similar to the processing of the electronic musical instrument 10 in Action Example 8 ( Figure 11 The same applies. In action example 8, S016, the performance information is sent to terminal 20. Conversely, in... Figure 17 In S016A, MCU11 sends the machine information of electronic musical instrument 10 to terminal 20. The machine information includes, for example, firmware association information such as the firmware version installed on electronic musical instrument 10.

[0251] Additionally, in Operation Example 12, in S016A, MCU11 receives a firmware association information read request from terminal 20 and sends the firmware association information to terminal 20. However, the setting for the electronic musical instrument to send firmware association information in S106A can also be pre-implemented through user operation of input device 12.

[0252] Figure 18This is a flowchart representing the processing example of terminal 20 in action example 12. Figure 18 In addition to the processing of S106D, S124, S125, and S126, the processing examples are the same as action example 11 ( Figure 16 )same.

[0253] S106D is performed when this determination is made in S104 and S106. In S106D, the processor 21 executes the firmware verification application and displays the firmware verification screen on the display 25. Furthermore, the processor 21 sends a firmware association information read request to the electronic musical instrument 10, thus entering a state where firmware association information can be received from the electronic musical instrument 10.

[0254] In S121, when the processor 21 receives firmware association information from the electronic musical instrument 10, it obtains information indicating the latest version of the firmware and compares it with the firmware association information to determine whether the firmware association information indicates the latest version of the firmware (S124).

[0255] If the firmware association information indicates that the firmware is the latest version, the processor 21 displays information indicating that the firmware is the latest version on the confirmation screen of the display 25 (S125). Conversely, if the firmware association information does not indicate that the firmware is the latest version, the processor 21 displays a message urging the user to update the firmware to the latest version on the confirmation screen of the display 25 (S126).

[0256] According to Action Example 12, the user can use Terminal 20 to check the firmware version of Electronic Musical Instrument 10 and update it to the latest version as needed. According to Action Example 12, user convenience or the usefulness of Electronic Musical Instrument 10 can be improved. Moreover, according to Action Example 12, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0257] <<Action Example 13>>

[0258] Figure 2 The action example (action example 13) for item number 13 in the table represents the action of sending the operation information of the electronic musical instrument 10 to the terminal 20, and the terminal 20 providing operation guidance information to the user. Figure 19 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 13.

[0259] Figure 19 The processing shown, apart from the processing in S016B, is similar to the processing of the electronic musical instrument 10 in Action Example 12 ( Figure 15 The actions are the same. In action example 12, S016A, machine information is sent to terminal 20. In contrast, in... Figure 19In S016B, MCU11 sends the operation information of electronic musical instrument 10 to terminal 20. The operation information may be, for example, information representing the user's operation history of electronic musical instrument 10. If the operation history is about the machines included in electronic musical instrument 10, information identifying these machines and the operation information may also be sent.

[0260] In addition, in Operation Example 13, in S016B, MCU11 receives a read request for operation information from terminal 20 and sends the operation information to terminal 20. However, the setting for the electronic musical instrument to send operation information in S106B can also be implemented in advance by the user's operation of input device 12.

[0261] Figure 20 This is a flowchart representing the processing example of terminal 20 in action example 13. Figure 20 In addition to the processing of S106E, S127, and S128, the processing examples are the same as action example 12 ( Figure 18 )same.

[0262] S106E is performed when this determination is made in S104 and S106. In S106E, the processor 21 executes an application that supports the operation of the electronic musical instrument 10, and displays an operation guide screen on the display 25. Furthermore, the processor 21 sends a request to read operation information to the electronic musical instrument 10, thus entering a state where it can accept operation information from the electronic musical instrument 10.

[0263] In S127, the processor 21 determines whether the data or information received in S121 from the electronic musical instrument 10 contains operation information. If it is determined that operation information is contained, the processor 21 proceeds the processing to S128; otherwise, the processing returns to S108.

[0264] In S128, operation support information (operation guide) is displayed on the guide screen to inform the user. According to Action Example 13, the user can learn to operate the electronic musical instrument 10 by referring to the guide screen of the terminal 20. As a result, the user's convenience or the usefulness of the electronic musical instrument 10 can be improved. Moreover, according to Action Example 12, the advantages [1] and [2] described in Action Example 5 can also be obtained.

[0265] <<Action Example 14>>

[0266] Figure 2 The action example (action example 14) for item number 14 in the table is roughly the same as action example 13. In S128, the processor 21 displays the corresponding page of the instruction manual for the electronic musical instrument 10 as operation support information on the guide screen. As a result, useful information can also be provided to the user.

[0267] <<Action Example 15>>

[0268] Figure 2 The action example (action example 15) of item number 15 in the table represents the action of controlling the activation / deactivation of a specific function of the electronic musical instrument 10 based on the distance from the terminal 20. Figure 21 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 15.

[0269] Figure 21 The processing of S001 to S008 and S008A in Example 5 is similar to the processing of the electronic musical instrument 10. Figure 5 Similarly, the explanation is omitted. However, in action example 15, if the determination is yes in S002 and no in S006, S007, and S008, the specific function of the electronic musical instrument 10 is disabled (S025).

[0270] If this determination is made in S008, the process proceeds to S022. In S022, MCU11 receives user authentication information from terminal 20. In S023, MCU11 determines whether the user authentication information is for a licensed user of electronic musical instrument 10 (whether the user authentication information is appropriate (OK)). If the user authentication information is deemed appropriate, MCU21 enables the specific function of electronic musical instrument 10 (enable state) (S024). Conversely, if the user authentication information is deemed inappropriate, the process proceeds to S025, and the specific function is disabled.

[0271] Figure 22 This is a flowchart representing the processing example of terminal 20 in action example 15. Figure 12 The processing of S101 to S106 shown is the same as the processing of Action Example 5. Figure 6 The same applies, so the explanation is omitted. If this determination is made in S104 or S106, the process proceeds to S106F.

[0272] In S106F, the processor 21, for example, verifies the content of information representing the user authentication status stored in the storage device 22. The processor 21 sets the authentication status parameters (indicating that the user can use an electronic musical instrument with specific functions) with reference to information indicating that the user can use an electronic musical instrument with specific functions (e.g., stored in the storage device 22).

[0273] Example 5 of the processing and actions of S107, S108 and S108A ( Figure 6If this determination is made in S108A, then the process in S129 is performed. In S129, the processor 21 determines whether user authentication for the electronic musical instrument 10, which is the communication target, has been completed. If it is determined that authentication has not been completed, the processor 21 sends the user authentication information (including the authentication status parameters set in S106F) to the electronic musical instrument 10. If it is determined that authentication has been completed in S129 and the process in S130 has ended, the processor 21 returns the process to S107.

[0274] According to Action Example 15, by using NFC communication to send user authentication information from Terminal 20 to Electronic Musical Instrument 10, the specific functions of Electronic Musical Instrument 10 can be made effective. In other words, personal authentication of Electronic Musical Instrument 10 can be performed. Moreover, according to Action Example 15, the advantages described in Action Example 5[1] and[2] can also be obtained.

[0275] <<Action Example 16>>

[0276] Figure 2 The action example (Action Example 16) for item number 16 in the table represents the action of remotely operating the electronic musical instrument 10 using terminal 20. For example... Figure 1 As shown, terminal 20 can communicate with terminal 50 via network 1. By operating terminal 50, terminal 20 can be remotely operated via network 1. In action example 16, terminal 20 is remotely operated while it is brought close to the electronic musical instrument 10. Figure 23 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 16.

[0277] Figure 23 The processing of S001~S008, S008A in the example is the same as the processing in action example 5. Figure 5 Similarly, the explanation is omitted. In S026, MCU11 receives data from terminal 20. In S027, MCU11 determines whether the data received in S026 contains operation information. If it does not contain operation information, the process returns to S007; if it does contain operation information, MCU11 controls the action or state of electronic musical instrument 10 according to the operation information (S029).

[0278] Figure 24 This is a flowchart representing the processing example of terminal 20 in action example 16. Figure 24 The processing of S101 to S106, S107, S108, and S108A shown is the same as the processing of Action Example 5. Figure 6 Since they are the same, the explanation is omitted.

[0279] Figure 24If this determination is made in both S104 and S106, the process proceeds to S106G. In S106G, the processor 21 of terminal 20 configures terminal 20 to accept requests from terminals different from terminal 20 (e.g., via network 1) via network 1. Figure 1 The status of the operation information (remote operation information) of the electronic musical instrument 10 (terminal 50).

[0280] The processor 21 of terminal 20 receives and processes operation information sent from terminal 50 via network 1 (S107A), and uses NFC module 26 to send it to electronic musical instrument 10. Electronic musical instrument 10 receives this operation information (S131) ​​and performs control based on the operation information.

[0281] According to Action Example 16, the electronic musical instrument 10 can be remotely operated via Network 1 using Terminal 20. This improves user convenience and the usefulness of the electronic musical instrument 10. Furthermore, according to Action Example 16, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0282] <<Action Example 17>>

[0283] Figure 2 The action example (action example 17) for item number 17 in the table is the action of transmitting the time information of the electronic musical instrument 10 to the terminal 20. Figure 25 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 17.

[0284] Figure 25 The processing shown, apart from the processing in S030, is the same as the processing in Action Example 5 ( Figure 5 The same. Therefore, regarding Figure 25 The description of processes other than S030 is omitted. In S030, time information is received from terminal 20, and the time information is used for specified processing, such as updating applications within the electronic musical instrument 10 that use the time information.

[0285] Figure 26 This is a flowchart representing the processing example of terminal 20 in action example 17. Figure 26 The processing shown, apart from the processing in S132, is the same as the processing in Action Example 5 ( Figure 6 The same. Therefore, regarding Figure 26 The description of the processing other than S132 is omitted. In S132, the processor 21 of the terminal 20 uses the NFC module 26 to send the time information shown by the built-in clock installed in the terminal 20 to the electronic musical instrument 10.

[0286] According to Action Example 17, in the absence of a clock in the electronic musical instrument 10, time information can be provided from the terminal 20 to update or correct the time used by the electronic musical instrument 10. This eliminates the need for the user to synchronize the time of the electronic musical instrument 10, thus improving user convenience and the usefulness of the electronic musical instrument 10. Furthermore, according to Action Example 17, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0287] <<Action Example 18>>

[0288] Figure 2 The action example (action example 18) for item number 18 in the table indicates that the sensor 29 included in the terminal 20 will be... Figure 1 The sensor 29 transmits sensor data, such as the detected physical quantities, to the electronic musical instrument 10. The sensor 29 includes, for example, at least one of an accelerometer, a gyroscope, and a magnetometer. The processor 21 is capable of calculating the change in the physical quantities obtained from each sensor per unit time. This change is processed as an operational quantity for the playing operation of the electronic musical instrument 10. In other words, MIDI data corresponding to the difference between the sensor values ​​is generated and sent to the electronic musical instrument 10. Figure 27 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 18.

[0289] Figure 27 The processing shown, apart from the processing in S031, is the same as the processing in action example 5 ( Figure 5 The same. Therefore, regarding Figure 27 The description of processing other than S031 is omitted. In S031, MCU11 receives performance information from terminal 20 and performs actions corresponding to the performance information, such as generating music signals corresponding to the performance information and outputting music based on the music signals.

[0290] Figure 28 This is a flowchart representing the processing example of terminal 20 in action example 18. Figure 28 In the processing shown, the processing of S101 to S108 and S108A is the same as the processing of Action Example 5 ( Figure 6The process in S107B is the same as that in S107, so the explanation is omitted. The processing in S107B is executed when this determination is made in S107. The processor 21 uses the sensor 29 within the terminal 20 to obtain sensor values. In S133, the previously obtained sensor values ​​are compared with the currently obtained sensor values, generating performance information corresponding to their difference (the amount of change per unit time). In S134, the performance information is sent to the electronic musical instrument 10, and the current sensor value is stored in the storage device 22 for comparison in the following S133. The sensor value in the following S133 is used as the previous sensor value.

[0291] According to Action Example 18, performance information corresponding to the change in sensor value of sensor 29 on terminal 20 is sent to electronic musical instrument 10, causing it to output music corresponding to the performance information. In this way, terminal 20 can be used as the performance operator for electronic musical instrument 10, improving user convenience and the usefulness of electronic musical instrument 10. Furthermore, according to Action Example 18, the advantages described in Action Example 5 [1] and [2] can also be obtained. Control information corresponding to the change in value of electronic musical instrument 10 can be generated and sent to electronic musical instrument, replacing performance information, so that electronic musical instrument 10 can also perform actions corresponding to the control information.

[0292] <<Action Example 19>>

[0293] Figure 2 The action example (action example 19) of item number 19 in the table indicates the action of using the camera 30 of the terminal 20 to shoot according to the operation of the electronic musical instrument 10. Figure 29 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 19.

[0294] Figure 29 The processing shown, apart from the processing in S032, is the same as the processing in action example 5 ( Figure 5 The same. Therefore, regarding Figure 29The description of processes other than S032 is omitted. In S032, the MCU11 sends the operation information (control information) of the camera 30 corresponding to the operation of the electronic musical instrument 10 to the terminal 20. The operation of the electronic musical instrument 10, such as the operation of the playing operation device 15, and the operation content (control content) of the camera 30 are pre-associated. When the MCU11 detects the operation of the electronic musical instrument 10, it performs the following process: it retrieves the corresponding operation information of the camera 30 from the storage device and sends it to the terminal 20. However, it is also possible to input the operation information of the camera 30 into the electronic musical instrument 10 and send the operation information to the terminal 20. The operation information may also be operation information generated in real time in S032 according to the operation of the input device 13, and stored in the storage device of the electronic musical instrument 10, and read out in S032 by the operation of the input device 13.

[0295] Figure 30 This is a flowchart representing the processing example of terminal 20 in action example 19. Figure 29 In the processing shown, the processing of S101 to S108 and S108A is the same as the processing of terminal 20 in Action Example 5 ( Figure 6 The same applies, so the explanation is omitted. In S106H, the processor 21 executes the shooting application, displays the shooting screen of the camera 30 on the display 25, and enters a state of receiving operation information from the electronic musical instrument 10 for the camera 30. The processor 21 receives data sent from the electronic musical instrument 10 (S135), and if it determines that the data contains operation information of the camera 30 (yes in S136), it performs control of the camera 30 corresponding to the operation information (focus adjustment, flash on / off, shutter press, etc.) (S137).

[0296] According to Action Example 19, the operation of the electronic musical instrument 10 can control the movement of the camera 30 on the terminal 20. This improves user convenience and the usefulness of the electronic musical instrument 10. Moreover, according to Action Example 19, the advantages described in Action Example 5[1] and[2] can also be obtained.

[0297] <<Action Example 20>>

[0298] Figure 2 The action example (action example 20) of item number 20 in the table represents the following action: the location information of terminal 20 obtained by using the GPS receiver of terminal 20 is sent to electronic musical instrument 10, so that electronic musical instrument 10 performs control or action corresponding to the location information. Figure 31 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 20.

[0299] Figure 31The processing shown, apart from the processing in S033, is the same as the processing in action example 5 ( Figure 5 The same. Therefore, regarding Figure 31 The description of processes other than S033 is omitted. In S033, MCU11 performs prescribed control or actions corresponding to the location information of terminal 20 received from terminal 20. For example, based on the correspondence between the location shown by the location information and the sending location, MCU11 enables / disables the prescribed functions of electronic musical instrument 10 or the content possessed by electronic musical instrument 10, so that electronic musical instrument 10 conforms to the specifications corresponding to the sending location (the outlet (distribution) location of electronic musical instrument 10).

[0300] Figure 32 This is a flowchart representing the processing example of terminal 20 in action example 20. Figure 32 In the processing shown, the processing of S101 to S108, and S108A is the same as the processing of terminal 20 in Action Example 5 ( Figure 6 The same applies, so the explanation is omitted. In S107C, the processor 21 uses the GPS receiver 31 to obtain information indicating the current location of the terminal 20. In S138, the location information obtained in S107C is sent to the electronic musical instrument 10.

[0301] According to Action Example 20, the electronic musical instrument 10 obtains location information from the terminal 20 and sets the state of the electronic musical instrument 10 accordingly to the sending location (changing it to a specification supported by the sending location). That is, it performs actions or controls based on location information. As a result, user convenience and the usefulness of the electronic musical instrument 10 are improved. Moreover, according to Action Example 20, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0302] <<Action Example 21>>

[0303] Figure 2 The action example (action example 21) for item number 21 in the table indicates that the control information of the voice assistant function of terminal 20 is sent to electronic musical instrument 10 to operate the electronic musical instrument 10. Figure 33 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 21.

[0304] Figure 33 The processing shown, apart from the processing in S034, is similar to the processing of the electronic musical instrument 10 in Action Example 5 ( Figure 5Since the process is the same as S034, the description of the processing other than S034 is omitted. In S034, MCU11 receives control information from terminal 20 based on the voice assistant function of terminal 20, and performs the prescribed control or action corresponding to the control information. For example, MCU11 enables / disables the function corresponding to the control information, or changes the status or parameters.

[0305] Figure 34 This is a flowchart representing the processing example of terminal 20 in action example 21. Figure 32 In the processing shown, the processing of S101 to S107, S108, and S108A is the same as the processing of Action Example 5 ( Figure 6 The process is the same as described above, so the explanation is omitted. In S106I, the processor 21 executes the application for the voice assistant, displays the voice assistant waiting screen on the display 25, and enters a state where it accepts voice commands (voice input) input from the MIC 32. In S107D, the processor 21 generates control information corresponding to the voice command. If it is determined in S139 that there is control information that should be sent to the electronic musical instrument 10, the processor 21 sends the control information to the electronic musical instrument 10 in S140.

[0306] According to Action Example 21, control information based on voice commands input to Terminal 20 is sent to Electronic Musical Instrument 10, and Electronic Musical Instrument 10 performs actions or controls corresponding to the control information. This improves user convenience and the usefulness of Electronic Musical Instrument 10. Furthermore, according to Action Example 21, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0307] <<Action Example 22>>

[0308] Figure 2 The action example (action example 22) for item number 22 in the table represents the action of using the electromotive force generated by the NFC transmission wave (the radio wave transmitted by the NFC module 26) of the terminal 20 to start the electronic musical instrument 10 for sound production processing. Figure 35 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 22.

[0309] In S041, it is determined whether a start instruction for the electronic musical instrument 10 has been input (e.g., whether the power switch has been turned on). If it is determined that a start instruction has been input, the process proceeds to S043; otherwise, the process proceeds to S042.

[0310] In S043, the electronic musical instrument 10 is powered on, and the MCU 11 performs sound output (MIDI data generation and music output processing based on this MIDI data) corresponding to the operation of the playing control 15. In S044, the MCU 11 determines whether the power supply has been stopped by setting the power switch to off, etc. If it is determined that the power supply has been stopped, the process proceeds to S046. If it is determined that the power supply has not been stopped, the MCU 11 determines whether a stop action is required (S045). If it is determined that a stop action is required, the process proceeds to S046. In S046, the power is set to off (S046). Figure 35 The processing ends. If it is determined in S045 that no action needs to be stopped, the processing returns to S043.

[0311] If a no determination is made in S041, then in S042, it is determined whether the terminal 20 and the electronic musical instrument 10 are within an area where NFC communication is possible. If it is determined that they are not within the area, the process returns to S041. Conversely, if it is determined that they are within the area, power generated by the electromotive force generated by receiving radio waves from the NFC module 26 using the antenna 16B is supplied to the MCU 11 (S047). The MCU 11 generates MIDI data according to the operation of the playing operation unit 15, and the music (sound) corresponding to the MIDI data is output from the speaker 14 (S048). In S049, it is determined whether the terminal 20 has left the area where NFC communication with the electronic musical instrument 10 is possible. If so, the process proceeds to S046; if not, the process returns to S047.

[0312] Figure 36 This is a flowchart illustrating the processing example of terminal 20 in action example 22. In S141, it is determined whether terminal 20 is within an area where it can communicate with the electronic musical instrument 10. If it is determined that terminal 20 is not within the area, the processing returns to S141; if it is determined that terminal 20 is within the area, the processing proceeds to S142.

[0313] In S142, NFC communication with the electronic musical instrument 10 begins, and radio waves that generate an electromotive force in the electronic musical instrument 10 are transmitted (radiated). The transmission of radio waves is continuous. Furthermore, data transmission and reception are performed as needed. In S143, it is determined whether the terminal 20 is outside the designated area. If it is not determined to be outside the area, the process returns to S142; if it is determined to be outside the area, the process proceeds to S144. In S144, the transmission of radio waves used to generate the electromotive force is stopped, and the process ends. Figure 36 The processing.

[0314] According to Operation Example 22, when the terminal 20 and the electronic musical instrument 10 are within a designated area (where NFC communication is possible), the terminal 20 sends radio waves to the electronic musical instrument 10, and the electronic musical instrument 10 uses the power generated by the electromotive force produced by receiving the radio waves to perform designated actions such as music output. Therefore, when the electronic musical instrument 10 operates using power from a battery, battery power consumption can be reduced. Furthermore, even when the electronic musical instrument 10 (product) is not powered on, or when the product does not have a power supply function, the product can still be started. This improves user convenience and the usefulness of the electronic musical instrument 10. Moreover, according to Operation Example 22, the advantages described in Operation Example 5 [1] and [2] can also be obtained. In addition, in the description of Operation Example 22, the operating power of the electronic musical instrument 10 is supplied via radio wave supply, but radio wave supply could also simply be setting the power supply of the electronic musical instrument 10 to the on state (similar to setting the power switch to the on state).

[0315] <<Action Example 23>>

[0316] Figure 2 The action example (action example 23) for item number 23 in the table represents the action of sending the information obtained by terminal 20 from the cloud service to electronic musical instrument 10. Figure 37 This is a flowchart illustrating the processing example of the electronic musical instrument 10 in action example 23.

[0317] Figure 37 The processing shown, apart from the processing in S047, is similar to the processing of the electronic musical instrument 10 in Action Example 5 ( Figure 5 Since the process is the same as S047, the description of the processing other than S047 is omitted. In S047, MCU11 receives control information from terminal 20 and performs the prescribed control or action corresponding to the control information. For example, MCU11 enables / disables functions or changes states or parameters corresponding to the control information.

[0318] Figure 38 This is a flowchart representing the processing example of terminal 20 in action example 23. Figure 32 In the processing shown, the processing of S101 to S106, S107, S108, and S108A is the same as the processing of terminal 20 in Action Example 5 ( Figure 6 Since the process is the same as described above, the explanation is omitted. In S106J, the processor 21 executes the application for cloud connection, establishes a connection with the designated server (terminal 50) via network 1 (cloud), and becomes capable of sending and receiving data with the server.

[0319] In S107E, the processor 21 sends data from the electronic musical instrument 10 to the server, or receives data from the server to the electronic musical instrument 10. In S151, it is determined whether there is data to be sent to the electronic musical instrument 10. If it is determined that there is data to be sent, the data is sent to the electronic musical instrument 10 via NFC communication (S152). Furthermore, in S152, the electronic musical instrument 10 receives the data to be sent to the server via NFC communication.

[0320] According to Action Example 23, the terminal 20 can be used as a relay device to send and receive data between the electronic musical instrument 10 and the server. As a result, the electronic musical instrument 10 can utilize the services provided by the server. Thus, user convenience and the usefulness of the electronic musical instrument 10 are improved. Moreover, according to Action Example 23, the advantages described in Action Example 5[1] and [2] can also be obtained.

[0321] <Example 1>

[0322] The following explains the applicable examples. Figure 39 This section describes an applicable example (Applicable Example 1) corresponding to Action Example 8. In Applicable Example 1, the electronic musical instrument 10 (electronic piano) has a built-in NFC module 16 (antenna and NFC tag device). The electronic musical instrument 10 does not have a display. For example, when the terminal 20 is placed on the electronic piano, the NFC module 26 (antenna and NFC reader / writer device) of the terminal 20 and the NFC module 16 of the electronic musical instrument 10 are in a state where NFC communication can be performed (proximity state). At this time, when the terminal 20 receives information indicating the title of the piece to be played from the electronic musical instrument 10 via NFC communication as performance information and supplies it to the application (processor 21), the processor displays the sheet music corresponding to the title of the piece on the display 25. Thus, the user can play while looking at the sheet music.

[0323] Furthermore, when NFC module 26 and NFC module 16 are in a communicable state, the MCU 11 of the electronic musical instrument 10 sends information indicating the status of the electronic musical instrument 10 (indicating the current settings applied to the electronic musical instrument 10) to the terminal 20 via NFC communication. The terminal 20 then displays the settings information on the display 25. Thus, the user can use the terminal 20 to know the status of the electronic instrument 10. Moreover, when the user inputs information to change the settings into the terminal 20 and gives an instruction to send it to the electronic musical instrument 10, information related to this change is sent to the electronic musical instrument 10, and the MCU 11 processes the setting change. Thus, the data (change information) from the terminal 20 is reflected in the electronic musical instrument 10.

[0324] <Example 2>

[0325] Figure 40 (A) Figure 40 (C) indicates the applicable example (applicable example 2) corresponding to action example 5. In applicable example 2, the electronic musical instrument 10 is an electronic saxophone. Figure 40 (A) shows the front of the electronic musical instrument 10. An NFC module 16 (antenna and NFC tag device) (actually built-in) is located at the lower end of the electronic musical instrument 10. Figure 40 (B) indicates Figure 40 A partial enlarged view of the back of (A). On the back, there is a simple display 13 using a seven-segment LCD to display the status of the electronic instrument 10 in codes (numbers, etc.). Figure 40 (C) represents terminal 20. When terminal 20 is brought close to NFC module 16, NFC module 26 (antenna and NFC reader / writer device) built into terminal 20 becomes communicative with NFC module 16. MCU 11 of electronic musical instrument 10 sends information indicating the state of electronic musical instrument 10 (information indicating the current settings implemented on electronic musical instrument 10) to terminal 20 via NFC communication. Terminal 20 displays the setting information in detail on display 25. Thus, the user can refer to the detailed state of electronic instrument 10 in an easily understandable display format. Furthermore, similar to Application Example 1, the user can input information to change the settings into terminal 20 and give instructions to send them to electronic musical instrument 10. Then, information related to the change is sent to electronic musical instrument 10, and MCU 11 performs the setting change processing.

[0326] <Example 3>

[0327] Figure 41 (A) and Figure 41 (B) indicates the applicable example (applicable example 3) corresponding to action example 10. In applicable example 3, the electronic musical instrument 10 is a keyboard (…). Figure 41 (A)). At the left end of the electronic musical instrument 10, there is an NFC module 16 (antenna and NFC tag device) (actually built-in). The electronic musical instrument 10 does not have a sound source module. Figure 41(B) represents terminal 20. When terminal 20 is brought close to NFC module 16, NFC module 26 (antenna and NFC reader / writer device) built into terminal 20 becomes communicable with NFC module 16. In this state, when the user operates the playing operation 15 (keyboard) to play, their playing information (MIDI data) is sent from electronic instrument 10 to terminal 20 via NFC communication. The processor 21 of terminal 20 uses the sound source module 28 to generate a music signal based on MIDI data and outputs it from speaker 27. Thus, the user can listen to the music played. Moreover, the processor 21 displays information (charts) on display 25 representing the timbre of the MIDI-based music played. Thus, the user can use terminal 20 to listen to their own music played and can grasp the timbre by referring to display 25.

[0328] <Explanation of Action Modes 4-8>

[0329] (Action Mode <4>)

[0330] Figure 42 This indicates a processing example related to action mode <4>. As an example, the processing entity is the MCU11 of the electronic musical instrument 10 or the processor 21 of the terminal 20. As an example, it is set to the processor 21 of the terminal 20, but it can also be the MCU11 or something else.

[0331] In S201, processor 21 receives data from electronic musical instrument 10 by sending a read request to the electronic musical instrument 10. In S202, processor 21 determines the content of the received data. In S203, processor 21 sends a read request or writes object data and a write request based on the content of the received data. For example, in S202, processor 21 determines the end of the data; if the received data does not contain an end portion, it sends a read request to obtain the next data; if it contains an end portion, it sends data indicating the end of data reception and a write request. However, the content of the data or the determination based on the data content can be appropriately set.

[0332] (Action modes <5>, <6>)

[0333] Figure 43 This describes processing examples related to action modes <5> and <6>. For example, the processing entity is the MCU 11 of the electronic musical instrument 10 or the processor 21 of the terminal 20. For example, it is the processor 21 of the terminal 20, but it could also be the MCU 11 or something else.

[0334] In S211, the processor 21 sends a read request for data toward the electronic musical instrument 10, or sends write object data and a write request. In S212, it is determined whether the communication using the read request or write request has failed or succeeded. For example, if a response to the read or write request is not received within a specified period, the communication is determined to have failed. The method for determining whether the communication is successful is not limited to the above.

[0335] In S212, if communication is determined to be successful, the process ends. Conversely, if communication is determined to be unsuccessful, the processor 21 sends a read request or a write request. This can be either a resend of the request sent in S211 or vice versa. Sending a read request in S211 and a write request in S213 could be, for example, requesting a record indicating failure from the communication object. Sending a write request in S211 and a read request in S213 could be, for example, obtaining data from the communication object again to generate the write request data.

[0336] (Action Mode <7>)

[0337] Figure 44 This indicates a processing example related to action mode <7>. As an example, the processing entity is either the MCU 11 of the electronic musical instrument 10 or the processor 21 of the terminal 20. As an example, it is the processor 21 of the terminal 20, but it could also be the MCU 11 or something else.

[0338] In S221, it is determined whether there is data to be sent. If it is determined that there is data to be sent, the processor 21 performs a write request to send the data as write data (S222). Conversely, if it is determined that there is no data to be sent, the processor 21 sends a read request for the data (S223). In S224, it is determined whether the process has ended. Figure 44 If the process does not end, the process returns to S221.

[0339] according to Figure 44 In the case of no data to be sent, the read request is repeatedly sent (S223). When data to be sent is generated (S221, yes), a write request is sent (S222). For example, imagine a situation where the terminal 20 receives performance information from the electronic musical instrument 10 in real time while sending an instruction for the next action to the electronic musical instrument 10.

[0340] (Action Mode <8>)

[0341] Figure 45This indicates a processing example related to action mode <8>. As an example, the processing entity is either the MCU 11 of the electronic musical instrument 10 or the processor 21 of the terminal 20. As an example, it is the processor 21 of the terminal 20, but it could also be the MCU 11 or something else.

[0342] In S231, it is determined whether there is data to be sent. If it is determined that there is data to be sent, the processor 21 determines whether it is time to read the data (S232). The time to read the data is determined, for example, by the full count of a periodic timer. Alternatively, in S232, it may wait for the count value to reach a threshold Th as shown in S008A or S108A. In this case, if it is determined that it is not time to read the data, the processor 21 sends the data to be sent and the write request thereto (S233).

[0343] On the other hand, if it is determined that there is no data to send and it is a read opportunity, the processor 21 sends a data read request (S234). In S235, it is determined whether the process has ended. Figure 45 If the process is determined not to end, the process returns to S231.

[0344] Thus, in action mode <8>, when there is data to be sent, the sending of the data and its write request are repeatedly executed. However, during this repeated sending process, when the designated read opportunity arrives, a data read request is sent. Action mode <8> can be used, for example, to obtain the next instruction during the ongoing data writing process.

[0345] Action patterns <1> to <8> can be combined appropriately. Furthermore, action patterns <4> to <8> can be appropriately incorporated into the action examples 5 to 23 described above.

[0346] <Frequency Change of Read Requests>

[0347] <<First example>>

[0348] The following describes a first example of processing changes to the frequency of read requests. For example, the timing determination (S232) for the periodic read requests of the operation mode <8> is applied. Figure 5 The processing of S008A as described in the document or Figure 6 The processing of S108A, as described in the document, is initiated when the count value reaches or exceeds the threshold Th.

[0349] By changing the threshold Th, the time until the count value reaches or exceeds the threshold can be changed. This means that when the processing of S008A and S108A occurs periodically, the frequency of data transmission and reception between the electronic instrument 10 and the terminal 20 can be changed by changing the length of the threshold Th.

[0350] The frequency (threshold Th) can be determined, for example, based on the type of application installed on terminal 20 that uses data acquired from electronic musical instrument 10 for target processing. For instance, if the application acquires data from electronic musical instrument 10 with high real-time requirements, a high frequency is set. Conversely, if the application processes data with low real-time requirements, such as the current settings parameters of electronic musical instrument 10, a low frequency can be set. The frequency (threshold) can also be changed manually by the user of terminal 20.

[0351] For example, in Application Example 1 corresponding to Action Example 8, regarding the application installed on terminal 20, in order to display sheet music in real time, the threshold value Th for determining the frequency of the readout request is set to the minimum or a small value as the default value. On the other hand, reading data from the electronic musical instrument 10 at a high frequency means that the remaining power of battery 33 will decrease more rapidly than in the case of a lower frequency.

[0352] therefore, Figure 46 The processing shown in S301 to S304 can also be performed in Figure 12 The process is performed between S108 and S108A. In S301, the processor 21 determines the battery 33 ( Figure 1 Check whether the remaining charge of the battery (obtained by measuring the battery voltage) is lower than the threshold Th2. If it is determined that the remaining charge is lower than the threshold Th2, the process proceeds to S302; otherwise, the process proceeds to S303.

[0353] In S302, the processor 21 displays a screen on the display 25 showing the decreasing battery power and asking whether a frequency change (e.g., a frequency reduction) is needed. The user refers to the display 25 to input whether a change is needed.

[0354] In S303, processor 21 determines whether there is an input indicating a change in S302. If it is determined that there is an input indicating a change, processor 21 changes the threshold Th (S304). Regarding Application Example 1, the value of threshold Th is increased by at least one level. By increasing the value of threshold Th, the time it takes for the count value to reach threshold Th increases, and the frequency decreases. Subsequently, the process proceeds to S108A. Moreover, if it is determined in S303 that there is an input indicating that no change is needed, the process also proceeds to S108A. In this case, no threshold change is performed.

[0355] according to Figure 46In the processing described in Application Example 1, during the process of displaying sheet music on terminal 20, when the remaining power of battery 33 falls below a threshold, a screen (dialog box) is displayed on display 25 asking whether the frequency (threshold) needs to be changed. When a change is entered, the threshold is changed to a larger value, and the frequency decreases. As a result, the update frequency of the sheet music displayed on display 25 decreases, but the rate at which the remaining power of battery 33 decreases slows down, thus allowing the service to continue.

[0356] Figure 46 The processing is not limited to applicable example 1 (action example 8, Figure 12 The processing of S301 to S304 can also be inserted between S108 and S108A in action examples other than action example 8. Furthermore, the processing of S301 to S304 can also be applied to the case where the sending side of the read request is the electronic musical instrument 10. In other words, it can also be... Figure 5 Processing steps S301 to S304 are inserted between S008 and S008A. Furthermore, the threshold can be changed not only by increasing the threshold but also by decreasing it. For example, if the frequency recovers to a level exceeding the threshold Th2, the threshold Th can be decreased by one level or more to increase the frequency. Thus, terminal 20 can also use a structure that changes the frequency of data dissemination requests based on the remaining battery power of terminal 20's battery 33.

[0357] <<Second Example>>

[0358] A second example of handling changes to the frequency of readout requests will be explained. In the first example, the case where the frequency (threshold Th) can be changed based on the real-time nature of the data was explained. Whether the data is real-time is sometimes related to the screen of the application used for operating or controlling the electronic musical instrument 10, which is displayed on the terminal 20.

[0359] For example, one application installed on terminal 20 is that it receives information from electronic musical instrument 10 indicating operation instructions for playing instruments corresponding to the rhythm or tempo of the music being played and displays this information on display 25 of terminal 20. The operation instructions are given by displaying a screen showing the score of the music (score display screen) on display 25, and displaying the portion of the score that corresponds to the current playing position in a special form (e.g., changing color). Since the information indicating the portion of the score to be changed (operation instructions) requires real-time processing, data readout requests from electronic musical instrument 10 must be made at a high frequency.

[0360] On the other hand, the application can sometimes be used to set the status parameters (configuration settings) of the electronic musical instrument 10. In this case, the application displays a configuration screen on the display 25, reads information representing the current status parameters from the electronic musical instrument 10, and displays it on the configuration screen. Real-time performance is not required for this information representing the status parameters.

[0361] Thus, there exists a situation where, within a single application on the terminal, there are two states (modes): a screen requiring high-frequency music score display (mode 1), and a screen for transmitting and receiving setting information between the terminal 20 and the electronic musical instrument 10 (configuration screen: mode 2), where there are no issues at low frequencies. In other words, the readout speed (readout request frequency) of data related to the display sometimes differs depending on the screen displayed on the monitor 25. The second example illustrates an instance where the frequency changes according to the user's screen operations, specifically an example where the readout request frequency changes based on the screen.

[0362] Figure 47 This example illustrates a table used for frequency changes. The table is stored in storage device 22 and referenced by processor 21. In the second application, the frequency (threshold Th) of read requests is managed for each screen. That is, a table representing the correspondence between each screen (e.g., a sheet music display screen, a configuration screen, etc.) and the threshold Th is stored in storage device 22. Figure 47 In the example table shown, the screen identifiers (SC1, SC2, SC3, ...) are stored in correspondence with the thresholds Th (Th001, Th002, Th003, ...) for each screen. For the screen identifier, a number assigned to the screen or an address storing the screen's display data is used. The threshold Th is set to a value corresponding to the screen. In the second example, the threshold Th (Th002) corresponding to the configuration screen (identifier: SC2) is set to a value smaller than the threshold Th (Th001) corresponding to the music score display screen (identifier SC1).

[0363] Figure 48 This is a flowchart illustrating the second example of frequency change processing, showing the processes S401 to S404 executed between S008 or S108, and between S008A and S108A. Assume that at the beginning of S401, a music score display screen (SC1) is displayed on the monitor 25. In S401, the processor 21 determines whether a screen switching instruction has been input through operation of the input device 23, etc. If it is determined that a screen switching instruction has been input, the process proceeds to S402; otherwise, the process proceeds to S403.

[0364] In S402, the processor 21 performs screen switching processing. For example, the processor 21 performs the following control: acquires information (screen identifier) ​​indicating the target screen to be switched obtained through the screen switching instruction input, and reads out the data of the corresponding screen and displays it on the display 25. As an example, assume that the music score display screen currently displayed is switched to the configuration screen.

[0365] In S403, processor 21 refers to the correspondence table between the screen and the threshold Th ( Figure 47 The threshold Th (Th002) corresponding to the screen identifier SC2 of the configuration screen is obtained. By comparing it with the current threshold Th (Th001), it is determined whether the threshold Th needs to be changed. If it is determined that the threshold Th needs to be changed, the process proceeds to S404; otherwise, the process proceeds to S008A (S108A).

[0366] In S404, the threshold Th (Th002) read from the corresponding table is set to the new threshold Th. Then, the process proceeds to S008A (S108A). As a result, the frequency of readout requests decreases while the configuration screen is displayed. Furthermore, in S401, if a switching instruction from the configuration screen to the music score display screen is input, after processing in S402 and S403, the threshold Th is changed to the value (Th001) corresponding to the music score display screen (SC1) (restored). As a result, the frequency of readout requests increases.

[0367] According to the second example, terminal 20 changes the frequency (threshold Th) of issuing read requests based on the switching of the screen displayed on terminal 20. This allows data to be read at a frequency corresponding to the functions provided to the user through the screen. Furthermore, by changing the frequency based on screen switching, the data read frequency can be set to a frequency corresponding to the level of real-time performance, thereby avoiding the issuance of unnecessary data read requests and reducing power consumption.

[0368] Additionally, the second example illustrates the frequency of switching between two screens controlled within an application. However, the two screens can also be controlled by different applications (another application is launched when a screen switch is triggered, and this application displays the switched screen). Alternatively, the processing in S402 can be placed after S404, with the screen switching occurring after the threshold Th changes.

[0369] <<The Third Case>>

[0370] Figure 49 This is a flowchart of the third example, representing a change in the frequency (threshold Th) of read requests. Figure 49 The flowcharts (S501 to S505) are, for example, inserted after S008 or S108.

[0371] In S501, the processor 21 determines whether there is input to the terminal 20. If input is detected, the process proceeds to S505. Conversely, if no input is detected, the process proceeds to S502.

[0372] In S502, the processor 21 increments the count value of the counter used to count non-input time by 1. In S503, the processor 21 determines whether the count value is above the specified threshold Th3 (the threshold for non-input time). If the count value is determined to be above the threshold Th3, the process proceeds to S504; otherwise, the process returns to S501.

[0373] If the process proceeds to S504, the processor 21 reduces the value of the threshold Th, which is related to the frequency of the read request, to a predetermined value. The absence of input suggests that the user is not using the application. When the application is not in use, data does not need to be read at the usual frequency, thus reducing the frequency suppresses power consumption associated with the read request issuance. The processing in S504 is performed by rewriting the current value (set value) of the threshold Th to the value of the threshold Th at the time of its decrease, stored in a certain storage area. At this time, the processor 21 saves the original value to the predetermined storage area (storage location).

[0374] When S504 ends, processing proceeds to the next step. The next step may be any one of S008A, S108A, S301, or S401. The same applies to the case where a "no" decision is made in S506 (described later) and the case where processing has ended in S507.

[0375] If the process proceeds to S505, processor 21 resets the counter. In S506, processor 21 determines whether the current value of threshold Th is the value that decreased by S504. This determination can be made, for example, based on whether the original value stored in the storage location exists (or NULL if not). However, other methods are also possible.

[0376] If the current value of threshold Th is determined to be a value that decreased through S504, then processor 21 restores the value of threshold Th to its original value (S507). This process is performed, for example, by rewriting the current value of threshold Th using the saved original value. If the process of S507 has ended, or if the current value of threshold Th is determined not to be a decreasing value (e.g., the value in the storage location is empty (NULL)) (No in S506), the process of S506 ends and proceeds to the next step.

[0377] As described above, in the third example, terminal 20 changes the frequency (threshold Th) of issuing read requests based on the non-input period of terminal 20. That is, when the non-input time reaches or exceeds the threshold Th3, the frequency is reduced to save energy. On the other hand, if there is input, the reduced threshold is restored (raised) to set the desired frequency of read requests. The structure shown in the embodiment can be appropriately combined without departing from the purpose.

Claims

1. An information processing method, wherein During the period when the electronic musical instrument and the terminal capable of short-range wireless communication with the electronic musical instrument are in a state capable of performing the short-range wireless communication, The terminal performs a transmission action following an action pattern that includes at least one of the following: repeatedly sending data read requests and sending write object data and write requests in a predetermined pattern. When the electronic musical instrument receives the readout request corresponding to the action mode, it performs corresponding data readout processing on the terminal. When the electronic musical instrument receives the write object data corresponding to the action mode and the write request, it performs the write object data writing process. The sending action of the terminal and the reading and writing processes of the electronic musical instrument are performed based on the hardware state of at least one of the terminal and the electronic musical instrument.

2. The information processing method according to claim 1, wherein... The data corresponding to the readout process performed by the electronic musical instrument is stored in the built-in memory of the electronic musical instrument.

3. The information processing method according to claim 2, wherein... When the terminal receives the data corresponding to the readout processing from the electronic musical instrument, the terminal stores the received data in the terminal's built-in memory.

4. The information processing method according to claim 1, wherein... The data to be written to the electronic musical instrument is written to the instrument's built-in memory.

5. The information processing method according to claim 1, wherein... The electronic musical instrument processes music output based on the electromotive force generated by the radio waves of the read request or write request emitted by the terminal.

6. The information processing method according to claim 5, wherein... When the electronic musical instrument and the terminal are in a state where close-range wireless communication is not possible, the terminal stops sending the read request and / or stops sending the write object data and its write request.

7. The information processing method according to claim 1, The terminal adjusts the frequency at which it sends the read request based on its remaining battery power.

8. The information processing method according to claim 1, The terminal changes the frequency of sending the read request based on the switching of its own display screen.

9. The information processing method according to claim 1, The terminal adjusts the frequency of sending the read request based on the time during which it has not received user input.

10. An electronic musical instrument, comprising: The communications unit is capable of short-range wireless communication with the terminal; as well as The processing unit, when the terminal performs an operation following an operation pattern including the following actions during a period when the electronic musical instrument and the terminal are in a state capable of performing the short-range wireless communication, performs corresponding data reading processing on the terminal when the communication unit receives a read request for data corresponding to the operation pattern, and performs write processing for the write object data when the communication unit receives write object data and a write request corresponding to the operation pattern. The action described therein involves repeatedly performing at least one of the following actions in a prescribed pattern: sending the read request and sending the write object data and its write request. The sending action of the terminal and the reading and writing processes of the electronic musical instrument are performed based on the hardware state of at least one of the terminal and the electronic musical instrument.

Images