Electronic keyboard instrument, information processing method and program

Abstract

To provide an information processing device, a sound output device, an information processing method and a program, which can achieve natural sound corresponding to a position of a user.SOLUTION: An information processing device includes a processing unit for adjusting a musical sound signal for outputting musical sound corresponding to depression of keys of a keyboard instrument from a sound output device worn and used by a user on the basis of the depressed key and position information related to a position of the sound output device. Thus, natural sound corresponding to the position of the user is realized.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an electronic keyboard instrument. , love The present invention relates to an information processing method and a program. [Background technology]

[0002] Conventionally, there has been known an information processing device that supplies a musical sound signal corresponding to a key depression of a keyboard instrument such as an electronic piano to a sound output device such as a speaker, and causes the sound output device to output a musical sound corresponding to the key depression (for example, Patent Document 1). Some such information processing devices are capable of outputting musical sounds from a wearable sound output device (for example, headphones or earphones) that is worn by a user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-271436 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when a wearable sound output device is used, the output position of the musical sound is fixed near the ear, Musical sound source In this case, the way the musical tones sound is heard will be constant regardless of the user's position relative to the device, which may make the tones sound unnatural or monotonous.

[0005] The object of the present invention is to provide an electronic keyboard that can realize natural sounds according to the user's position. musical instrument , love The present invention provides an information processing method and a program. [Means for solving the problem]

[0006] In order to solve the above problems, the present invention One aspect of relating to Electronic keyboard instruments is a sound output device worn by a user and obtains pan volume coefficients corresponding to the position information, the pan volume coefficients being set in correspondence with the respective keys of the keyboard; The musical tone signal for outputting musical tones The pan volume factor Adjust based on a processing unit for performing the . [Effects of the Invention]

[0010] According to the present invention, natural sound can be realized according to the user's position. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 illustrates a musical sound output system. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of the electronic piano. [Figure 3] FIG. 2 is a block diagram showing the functional configuration of the headphones. [Figure 4] FIG. 10 is a diagram illustrating a method for identifying the position of headphones. [Figure 5] FIG. 10 is a diagram illustrating an example of the positional relationship between the position of a sound source and the position of headphones. [Figure 6] FIG. 10 is a diagram showing the pan volume coefficient as a function of the y-coordinate of the headphones, corresponding to the key of C7. [Figure 7] FIG. 10 shows the absolute volume coefficient as a function of the y-coordinate of the headphones, corresponding to the key of C7. [Figure 8] 10 is a flowchart illustrating a control procedure for a musical sound output process. [Figure 9] 10 is a flowchart illustrating a control procedure for a musical sound output process according to Modification 1. [Figure 10] 10 is a diagram showing a delay time of the output timing of a musical tone according to Modification 2. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0013] <Configuration of the musical sound output system> FIG. 1 is a diagram showing a musical sound output system 100 according to this embodiment. The musical sound output system 100 includes an electronic piano 1 (information processing device, keyboard instrument), and headphones 2a and 2b connected to the electronic piano 1 so as to enable wireless data communication. The headphones 2 are one type of sound output device that is worn on the user's head when used. The following description will be given taking as an example a situation in which a user Ua uses the headphones 2a and a user Ub uses the headphones 2b to play duets on the electronic piano 1. Furthermore, any one of the headphones 2a and 2b will be referred to as "headphones 2," and any one of the users Ua and Ub will be referred to as "user U."

[0014] The electronic piano 1 includes a housing 10, an array antenna 17, and a keyboard 18 provided on the housing 10. The array antenna 17 has a first antenna 171 and a second antenna 172, and is used to wirelessly send and receive signals to and from the headphones 2. The keyboard 18 has a plurality of keys 181 including white keys and black keys. When a key 181 on the keyboard 18 is pressed by a user Ua or Ub, the electronic piano 1 transmits to the headphones 2a or 2b a musical sound signal for outputting a musical sound having a volume (loudness), pitch, and timbre corresponding to the key 181 pressed from the headphones 2a or 2b.

[0015] The headphones 2 include a left speaker 24L (first sound output unit), a right speaker 24R (second sound output unit), and a headphone antenna 26 used for wirelessly transmitting and receiving signals to and from the electronic piano 1. The left speaker 24L outputs a musical sound (first musical sound) to the left ear of the user U based on a first musical sound signal received from the electronic piano 1. The right speaker 24R outputs a musical sound (second musical sound) to the right ear of the user U based on a second musical sound signal received from the electronic piano 1. In this way, the musical sound signal transmitted from the electronic piano 1 to the headphones 2 includes a first musical sound signal on the left channel for outputting the musical sound from the left speaker 24L, and a second musical sound signal on the right channel for outputting the musical sound from the right speaker 24R. The headphones 2 are stereo headphones that output musical sounds separately from the left speaker 24L and the right speaker 24R based on the first musical sound signal and the second musical sound signal.

[0016] In this embodiment, the y-axis is defined as an axis parallel to the arrangement direction of the keys 181 on the keyboard 18 (the long side direction of the housing 10) and extending from the low-pitched keys 181 toward the high-pitched keys 181. The x-axis is defined as an axis perpendicular to the y-axis on a plane passing through the y-axis and the headphone antenna 26 and extending from the electronic piano 1 toward the seating positions of the users Ua and Ub. The origin O of the x-axis and y-axis is defined as the midpoint between the first antenna 171 and the second antenna 172. The position of the headphone antenna 26 within the xy plane is defined as the position of the headphones 2. The position of the headphone antenna 26 can be defined as the position of a predetermined point (representative point) within the headphone antenna 26. The positions of the headphones 2a and 2b are not usually on the same plane, and an xy plane is defined for each of the headphones 2a and 2b. In other words, the x-axis is defined separately for each of the headphones 2. The position of headphones 2a in the xy plane corresponding to headphones 2a is defined as position P1(x1,y1), and the position of headphones 2b in the xy plane corresponding to headphones 2b is defined as position P2(x2,y2). In FIG. 1, for convenience of explanation, the two xy planes corresponding to headphones 2a and 2b are not distinguished and are depicted as a single xy plane (the same applies to FIGS. 4 and 5). Below, the position of any headphones 2 in the xy plane corresponding to that headphone 2 is referred to as "position P." Furthermore, it is assumed that user U faces in the -x direction, i.e., toward the keyboard 18, and that the right speaker 24R of headphones 2 is located on the +y side of the left speaker 24L.

[0017] In the musical sound output system 100 of this embodiment, the electronic piano 1 detects the positions P1 and P2 of the headphones 2a and 2b on the xy plane, and adjusts the musical sound signals to be transmitted to the headphones 2a and 2b according to the detected positions. The method of adjusting the musical sound signals will be described later.

[0018] <Digital piano configuration> FIG. 2 is a block diagram showing the functional configuration of the electronic piano 1. The electronic piano 1 includes a CPU 11 (Central Processing Unit), a RAM 12 (Random Access Memory), a ROM 13 (Read Only Memory), a volume sensor 14, a pitch designation switch 15, a wireless communication unit 16, an array antenna 17, and a bus 19. The various components of the electronic piano 1 are connected via the bus 19.

[0019] The CPU 11 is a processor that reads and executes a program 131 stored in the ROM 13 and performs various arithmetic processing to control the operation of each part of the electronic piano 1. The CPU 11 corresponds to a "processing unit." The processing unit may have multiple processors (e.g., multiple CPUs), and the multiple processes performed by the CPU 11 of this embodiment may be executed by these multiple processors. In this case, the multiple processors correspond to a "processing unit." In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.

[0020] The RAM 12 provides a working memory space for the CPU 11 and stores temporary data. The RAM 12 may include a non-volatile memory. The RAM 12 stores position data 121 (position information) relating to the position of the headphones 2.

[0021] The ROM 13 is a non-transitory recording medium that can be read by the CPU 11 as a computer. The ROM 13 stores the program 131 as well as data that is referenced when the program 131 is executed. The program 131 is stored in the ROM 13 in the form of computer-readable program code.

[0022] The volume sensor 14 detects the strength of key depression of the key 181 and outputs a detection signal corresponding to the detected key depression strength to the CPU 11. An ADC (analog-digital converter) or a digital input port (not shown) is provided between the volume sensor 14 and the bus 19.

[0023] The pitch designation switch 15 detects a pressed key 181 out of a plurality of keys 181 included in the keyboard 18, and outputs a detection signal indicating the pitch of the musical tone of the detected pressed key 181 to the CPU 11. A digital input port (not shown) is provided between the pitch designation switch 15 and the bus 19.

[0024] The wireless communication unit 16 includes a wireless IC having a modulation / demodulation circuit, a signal processing circuit, etc., and performs wireless communication with the headphones 2 via the array antenna 17 according to a predetermined communication standard. The communication standard may be, for example, Bluetooth (registered trademark), but is not limited to this. The wireless communication unit 16 modulates musical sound signals for outputting musical sounds from the headphones 2 by frequency shift keying and transmits the modulated musical sound signals from the array antenna 17. When the array antenna 17 (first antenna 171 and second antenna 172) receives position detection signals modulated by frequency shift keying and transmitted from the headphones 2, the wireless communication unit 16 demodulates the received signals to acquire and analyze the position detection signals, thereby identifying the position of the headphones 2. Note that at least a part of the process of analyzing the position detection signals to identify the position of the headphones 2 may be executed by the CPU 11. A method for detecting the position of the headphones 2 will be described later. A digital input / output port (not shown) that controls input and output of data to and from the wireless communication unit 16 is provided between the wireless communication unit 16 and the bus 19.

[0025] Note that the components of the electronic piano 1 are not limited to those described above. For example, the electronic piano 1 may also include setting buttons for setting the tone color of the musical sound output in response to the depression of the key 181, a display unit for displaying the settings made by the setting buttons, and the like.

[0026] <Headphone configuration> FIG. 3 is a block diagram showing the functional configuration of the headphones 2. The headphones 2 include a CPU 21, a RAM 22, a ROM 23, a left speaker 24L having a signal conversion amplifier 241L and a coil 242L, a right speaker 24R having a signal conversion amplifier 241R and a coil 242R, a high-frequency signal processing unit 25, a headphone antenna 26, and a bus 27. The components of the headphones 2 are connected via the bus 27.

[0027] The CPU 21 is a processor that reads and executes a program 231 stored in the ROM 23 and performs various arithmetic processing to control the operation of each part of the headphones 2. The headphones 2 may have multiple processors (for example, multiple CPUs), and the multiple processes executed by the CPU 21 of this embodiment may be executed by these multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.

[0028] The RAM 22 provides a working memory space for the CPU 21 and stores temporary data. The RAM 22 may include a non-volatile memory.

[0029] The ROM 23 is a non-transitory recording medium that can be read by the CPU 21 as a computer. The ROM 23 stores not only the program 231 but also data that is referenced when the program 231 is executed. The program 231 is stored in the ROM 23 in the form of computer-readable program code.

[0030] The signal conversion amplifier 241L includes a DAC (digital-to-analog converter) that converts digital musical sound signals input from the CPU 21 into analog musical sound signals, and a headphone amplifier that amplifies the converted analog musical sound signals and outputs them as drive current to the coil 242L. When a drive current is input to the coil 242L, a magnetic flux is generated, and a magnetic core (not shown) and a vibrating part connected to the magnetic core vibrate due to electromagnetic induction, causing musical sound to be output from the left speaker 24L. The structure and operation of the signal conversion amplifier 241R and coil 242R of the right speaker 24R are the same as those of the signal conversion amplifier 241L and coil 242L, respectively, and therefore will not be described here.

[0031] The high-frequency signal processing unit 25 processes radio waves transmitted from the electronic piano 1 and detected by the headphone antenna 26, converts them into digital musical sound signals, and outputs them to the CPU 21. In more detail, the high-frequency signal processing unit 25 demodulates the received signals modulated by frequency shift keying back to baseband signals, converts them into digital musical sound signals using an ADC, and outputs them to the CPU 21. The high-frequency signal processing unit 25 also modulates position detection signals used to detect the position of the headphones 2 by frequency shift keying, and transmits them from the headphone antenna 26.

[0032] <Operation of the musical sound output system> Next, the operation of the musical sound output system 100 will be described, focusing on the adjustment of the musical sound signal according to the position of the headphones 2.

[0033] If the musical tones corresponding to the pressed keys 181 on the electronic piano 1 are output directly from the headphones 2, the output position of the musical tones is fixed near the ears, so the way the musical tones sound (volume, etc.) remains constant regardless of the relative positions of the user U (user U's ears) and the electronic piano 1. For this reason, it is difficult to reproduce natural sounds that change depending on the relative positions of the user U and the instrument, as occurs when playing an acoustic instrument.

[0034] Therefore, in the musical sound output system 100 of this embodiment, the position of the headphones 2 is detected, and the musical sound signal to be transmitted to the headphones 2 is adjusted so as to produce a natural sound according to the detected position. More specifically, the musical sound signal is adjusted based on the pressed key 181 and position data 121 relating to the position of the headphones 2. The operation related to this adjustment will be described below.

[0035] FIG. 4 is a diagram illustrating a method for identifying the position of the headphones 2. In FIG. FIG. 4 shows the positions of the first antenna 171 and the second antenna 172 on the xy plane, and the position P1 of the headphones 2a (headphone antenna 26). The first antenna 171 and the second antenna 172 are provided in positions that are in different directions from the position P of the headphones 2a. If the distance between the position P1 of the headphones 2a and the first antenna 171 and the distance between the position P2 of the headphones 2a and the second antenna 172 are different, the timing at which the first antenna 171 and the second antenna 172 receive the radio waves of the position detection signal transmitted by the headphone antenna 26 differs, resulting in a phase difference in the received radio waves corresponding to the difference in distance. Based on this phase difference, it is possible to identify the angle θ from the x-axis of the direction from the origin O toward the position P1 of the headphones 2a (the direction of the headphones 2 as seen from the origin O). Furthermore, the strength of the radio waves of the position detection signal received by the first antenna 171 and the second antenna 172 decreases as the distance to the position P1 of the headphones 2a increases. Therefore, it is possible to identify the distance r from the origin O to the position P1 of the headphones 2a based on the strength of the radio waves received by the first antenna 171 and the second antenna 172 (for example, the average value of the reception strength by the first antenna 171 and the reception strength by the second antenna 172). When the angle θ and the distance r are identified, it is possible to identify the coordinates (x1, y1) of the position P1 in the xy coordinate system. Similarly, it is possible to identify the coordinates (x2, y2) of the position P2 of the headphones 2b. The identified positions (coordinates) of the headphones 2a and 2b are stored in the RAM 12 as position data 121. In this way, in this embodiment, the position data 121 relating to the position of the headphones 2 is generated based on the reception timing and reception strength of the position detection signal by the first antenna 171 and the reception timing and reception strength of the position detection signal by the second antenna 172.

[0036] When the position P1 of the headphones 2 is identified, the positional relationship between the sound source positions corresponding to the keys 181 of the keyboard 18 and the positions P1 and P2 of the headphones 2 in the position data 121 is identified.

[0037] FIG. 5 is a diagram showing an example of the positional relationship between the sound source position Ps and the position of the headphones 2. In FIG. In this embodiment, assuming that the keyboard 18 is that of a grand piano GP, the position of the string S of the grand piano GP corresponding to each key 181 is used as the sound source position Ps corresponding to each key 181. For example, as shown in Fig. 5, when the key 181C corresponding to the high note "C7" is pressed, the position on the string S corresponding to the "C7" key 181C on the virtual grand piano GP (for example, the position where the string S is struck by the hammer) is set as the sound source position Ps.

[0038] In this embodiment, it is assumed that user Ua is sitting in front of key 181C, and the y coordinate of position P1 of headphones 2a used by user Ua is equal to the y coordinate of sound source position Ps. Also, it is assumed that user Ub is sitting on the lower bass side than user Ua, and the y coordinate of position P2 of headphones 2b used by user Ub is on the -y side of the y coordinate of sound source position Ps.

[0039] For a user U using the headphones 2, it is natural for the musical sound to sound softer the farther from the sound source position Ps. More specifically, when the left and right ears are different distances from the sound source position Ps, it is natural for the musical sound to sound louder to the ear closer to the sound source position Ps than to the ear further away. To reproduce this sound, when a certain key 181 is pressed, the CPU 11 of the electronic piano 1 of this embodiment adjusts the musical sound signal based on the positional relationship between the sound source position Ps corresponding to the pressed key 181 and the position P of the headphones 2 based on the position data 121. More specifically, the CPU 11 adjusts the musical sound signal so that the volume of the musical sound decreases the greater the distance between the sound source position Ps and the position P of the headphones 2. Furthermore, the CPU 11 identifies a first positional relationship between the sound source position Ps and the position of the left speaker 24L and a second positional relationship between the sound source position Ps and the position of the right speaker 24R based on the position data 121, and adjusts a first musical sound signal (left channel) for the left speaker 24L and a second musical sound signal (right channel) for the right speaker 24R based on the first positional relationship and the second positional relationship. Specifically, the CPU 11 adjusts the first musical sound signal based on the first positional relationship so that the volume of the musical sound output from the left speaker 24L decreases as the distance between the sound source position Ps and the left speaker 24L increases. The CPU 11 also adjusts the second musical sound signal based on the second positional relationship so that the volume of the musical sound output from the right speaker 24R decreases as the distance between the sound source position Ps and the right speaker 24R increases.

[0040] Specifically, as shown in FIGS. 1 and 5, a case where key 181C corresponding to the high note "C7" is pressed will be described as an example. The headphones 2a at position P1 have the same y coordinate as the sound source position Ps, so the musical sound signals are adjusted so that musical sounds of the same volume are heard from the left speaker 24L and the right speaker 24R. On the other hand, the headphones 2b at position P2 are located further in the -y direction than the sound source position Ps, and therefore the left speaker 24L is farther from the sound source position Ps than the right speaker 24R. Therefore, the musical sound signal is adjusted so that the volume of the musical sound output from the left speaker 24L is smaller than the volume of the musical sound output from the right speaker 24R.

[0041] The volume of the left and right musical sound signals is adjusted by multiplying the volume of the elements contained in the musical sound signals by a pan volume coefficient. In the example shown in Fig. 5, for headphones 2a located at position P1, the first musical sound signal of the left channel and the second musical sound signal of the right channel are multiplied by the same pan volume coefficient. For headphones 2b located at position P2, the first musical sound signal of the left channel is multiplied by a pan volume coefficient smaller than the second musical sound signal of the right channel. As a result, the volume of the musical sound output from the left speaker 24L becomes smaller than the volume of the musical sound output from the right speaker 24R.

[0042] FIG. 6 is a diagram showing the pan volume coefficients according to the y coordinate of the headphones 2, corresponding to the C7 key 181. The dashed line in Fig. 6 indicates the pan volume coefficient applied to the first musical sound signal of the left channel, and the solid line indicates the pan volume coefficient applied to the second musical sound signal of the right channel. As shown in Fig. 6, when the y coordinate coincides with the coordinate = y1 of the sound source position Ps corresponding to the key "C7" 181C, the pan volume coefficients of the left channel and the right channel are equal. Furthermore, the difference between the pan volume coefficients of the left channel and the right channel increases as the y coordinate position moves away from y1. Therefore, for headphone 2a whose y coordinate is y1, the left and right pan volume coefficients are equal, and for headphone 2b whose y coordinate is y2, the pan volume coefficient of the left channel is smaller than the pan volume coefficient of the right channel. The data of the pan volume coefficients shown in FIG. 6 is generated in advance in correspondence with each of the plurality of keys 181 included in the keyboard 18 and stored in the ROM 13.

[0043] 5, the headphones 2b at position P2 are farther from the sound source position Ps than the headphones 2a at position P1. Therefore, the musical sound signals are adjusted so that the volume of the musical sounds output from the headphones 2b (the average volume of the musical sounds on the left and right) is smaller than the volume of the musical sounds output from the headphones 2a (the average volume of the musical sounds on the left and right).

[0044] The absolute volume is adjusted by multiplying the volume of the musical sound signal by an absolute volume coefficient. In the example shown in Fig. 5, the musical sound signal output to headphone 2b is multiplied by an absolute volume coefficient that is smaller than the musical sound signal output to headphone 2a. As a result, the volume of the musical sound output from headphone 2b becomes smaller than the volume of the musical sound output from headphone 2a.

[0045] FIG. 7 is a diagram showing the absolute volume coefficients according to the y coordinate of the headphones 2, corresponding to the key 181 of C7. As shown in Fig. 7, the absolute volume coefficient is largest when the y coordinate coincides with the y coordinate = y1 of the sound source position Ps corresponding to the "C7" key 181C, and decreases as the y coordinate moves away from y1. Note that in Fig. 7, the difference in the y coordinate between the sound source position Ps and the position of the headphones 2 is regarded as the distance between the sound source position Ps and the position of the headphones 2, but this is not limiting, and the absolute volume coefficient may be determined according to the actual distance that also takes into account the difference in the x coordinate between the sound source position Ps and the position of the headphones 2. In other words, the horizontal axis of the graph in Fig. 7 may represent the actual distance from the sound source position Ps on the xy plane. The data of the absolute volume coefficients shown in FIG. 7 is generated in advance in correspondence with each of the plurality of keys 181 included in the keyboard 18 and stored in the ROM 13.

[0046] <Control procedure for musical sound output processing> Next, a control procedure by the CPU 11 for the musical sound output process for outputting musical sounds from the headphones 2 will be described. FIG. 8 is a flowchart illustrating the control procedure of the musical sound output process. The musical sound output process is executed in parallel for each of the headphones 2a and 2b. When the musical sound output process starts, the CPU 11 of the electronic piano 1 determines whether it is time to detect the position of the headphones 2 (step S101). The timing to detect the position of the headphones 2 can be set appropriately within a frequency range that allows the user U to feel that the sound changes in response to changes in position or posture, and may be, for example, about once every 0.1 seconds to once every second. Note that when step S101 is executed for the first time (i.e., when the pan volume coefficient and absolute volume coefficient have not yet been acquired in steps S103 and S104, which will be described later), the CPU 11 determines that it is time to detect the headphones 2, and branches to "YES" in step S101.

[0047] If it is determined that it is time to detect the position of the headphones 2 ("YES" in step S101), the CPU 11 causes the wireless communication unit 16 to detect the position of the headphones 2 using the algorithm described above, and acquires data related to the detected position of the headphones 2 (step S102). The CPU 11 also stores the acquired data related to the position of the headphones 2 in the position data 121. The headphones 2 also repeatedly transmit position detection signals at a frequency that allows the array antenna 17 to receive the position detection signals from the headphones 2 at the execution timing of step S102.

[0048] The CPU 11 acquires a pan volume coefficient corresponding to each of the multiple keys 181 based on the y coordinate of the headphones 2 (step S103). For example, for the "C7" key 181C, the CPU 11 acquires values ​​for each of the left and right channels that correspond to the y coordinate of the headphones 2 from the pan volume coefficient graph shown in Fig. 6. Similarly, for each of the other keys 181, the CPU 11 acquires a pan volume coefficient corresponding to the y coordinate of the headphones 2 for each of the left and right channels.

[0049] The CPU 11 acquires the absolute volume coefficient corresponding to each of the multiple keys 181 based on the y coordinate of the headphones 2 (step S104). For example, for the key 181C of "C7", the CPU 11 acquires the value corresponding to the y coordinate of the headphones 2 from the absolute volume coefficient graph shown in Fig. 7. Similarly, for each of the other keys 181, the CPU 11 acquires the absolute volume coefficient corresponding to the y coordinate of the headphones 2.

[0050] When step S104 is completed, or when it is determined in step S101 that it is not time to detect the position of the headphones 2 ("NO" in step S101), the CPU 11 proceeds to step S105. Here, if the process branches to "NO" in step S101, steps S103 and S104 have already been executed at least once, so the pan volume coefficient last acquired in step S103 and the absolute volume coefficient last acquired in step S104 are held and used in the subsequent processes. In step S105, the CPU 11 determines whether or not each of the multiple keys 181 on the keyboard 18 is in a pressed state. Furthermore, when it is determined that the key 181 is not in a pressed state ("NO" in step S105), the CPU 11 determines whether or not the musical sound volume is "0" (step S106). In step S106, the CPU 11 determines that the musical sound volume is not "0" if, for example, the damper pedal is depressed when the key depression ends and the sound is still being sustained after the key depression ends. If the musical sound volume is determined to be "0" ("YES" in step S106), the CPU 11 returns the process to step S101.

[0051] If it is determined in step S105 that a key is pressed (YES in step S105), or if it is determined in step S106 that the musical sound volume is not "0" (NO in step S106), the CPU 11 synthesizes a musical sound corresponding to the key pressed (or the last key pressed if the process branches to "NO" in step S106) (step S107). In more detail, the CPU 11 determines the volume of the musical sound at that time based on the key pressing strength detected by the volume sensor 14 at the time of key pressing and the elapsed time from the start of key pressing (and the elapsed time from the end of key pressing if the process branches to "NO" in step S106), and also determines the musical sound of the pitch corresponding to the pressed key 181, and generates a musical sound signal of the musical sound having the determined volume and pitch.

[0052] CPU 11 multiplies the volume of the musical sound by the pan volume coefficient corresponding to the pressed key 181 out of the pan volume coefficients obtained in step S103, and multiplies the volume of the musical sound by the absolute volume coefficient corresponding to the pressed key 181 out of the absolute volume coefficients obtained in step S104 (step S108). Regarding the pan volume coefficients, the first musical sound signal of the left channel is multiplied by the pan volume coefficient of the left channel, and the second musical sound signal of the right channel is multiplied by the pan volume coefficient of the right channel. In this way, the elements of the musical sound signals related to the volume of the musical sounds are adjusted.

[0053] The CPU 11 causes the wireless communication unit 16 to transmit the musical sound signal with the adjusted volume to the headphones 2 (step S109). As a result, musical sound with a volume corresponding to the first musical sound signal of the left channel is output from the left speaker 24L of the headphones 2 that have received the musical sound signal, and musical sound with a volume corresponding to the second musical sound signal of the right channel is output from the right speaker 24R.

[0054] The CPU 11 determines whether an instruction to end the musical sound output has been given (step S110). For example, the CPU 11 determines that an instruction to end the musical sound output has been given when an operation to turn off the power of the electronic piano 1 or the headphones 2 has been performed. If it is determined that an instruction to end the musical sound output has not been given ("NO" in step S110), the CPU 11 returns the process to step S101. The CPU 11 repeatedly executes the processes of steps S101 to S110 at a predetermined sampling period.

[0055] If it is determined that an instruction to end the musical sound output has been given ("YES" in step S110), the CPU 11 ends the musical sound output process.

[0056] <Variation 1> Next, a first modification of the above embodiment will be described. Below, differences from the above embodiment will be described, and a description of commonalities with the above embodiment will be omitted. In the above embodiment, the CPU 11 of the electronic piano 1 adjusted the musical sound signal based on the position of the headphones 2, but in Modification 1, the CPU 21 of the headphones 2 adjusts the musical sound signal based on the position of the headphones 2. In Modification 1, the CPU 21 of the headphones 2 corresponds to the "processing unit."

[0057] FIG. 9 is a flowchart illustrating a control procedure for the musical sound output process according to the first modification. The musical sound output process of FIG. When the musical sound output process is started, the CPU 21 determines whether or not it is time to detect the position of the headphones 2 (step S201). The process of step S201 is the same as the process of step S101 in FIG.

[0058] If it is determined that it is time to detect the position of the headphones 2 ("YES" in step S201), the CPU 21 acquires position information relating to the position of the headphones 2 (step S202). The position of the headphones 2 may be identified by the wireless communication unit 16 and array antenna 17 of the electronic piano 1, as in the above embodiment, and in this case, position information data for the headphones 2 is transmitted from the electronic piano 1 to the headphones 2. Alternatively, the headphones 2 may identify their own position. That is, the headphones 2 may be provided with an array antenna similar to the array antenna 17 in the above embodiment, and the positional relationship between the headphones 2 and the electronic piano 1 may be identified in response to receiving a position identification signal transmitted from the electronic piano 1, and the position of the headphones 2 may be identified from the identified positional relationship.

[0059] The CPU 21 acquires a pan volume coefficient corresponding to each of the multiple keys 181 based on the y coordinate of the headphones 2 (step S203). The CPU 21 also acquires an absolute volume coefficient corresponding to each of the multiple keys 181 based on the y coordinate of the headphones 2 (step S204). The processing of steps S203 and S204 is similar to the processing of steps S103 and S104 in FIG. 8.

[0060] When step S204 is completed, or when it is determined in step S201 that it is not time to detect the position of the headphones 2 ("NO" in step S201), the CPU 21 determines whether or not a musical sound signal has been received from the electronic piano 1 (step S205). Note that in Modification 1, the electronic piano 1 transmits the musical sound signal to the headphones 2 without adjusting the musical sound signal based on the position of the headphones 2.

[0061] If it is determined that a musical sound signal has been received ("YES" in step S205), CPU 21 multiplies the volume of the musical sound by the pan volume coefficient corresponding to the pressed key 181 among the pan volume coefficients acquired in step S203, and multiplies the volume of the musical sound by the absolute volume coefficient corresponding to the pressed key 181 among the absolute volume coefficients acquired in step S204 (step S206). The process in step S206 is the same as the process in step S108 in FIG. 8.

[0062] The CPU 21 supplies the first musical sound signal with the adjusted volume to the left speaker 24L and supplies the second musical sound signal with the adjusted volume to the right speaker 24R, thereby outputting musical sounds (step S207).

[0063] The CPU 21 determines whether an instruction to end the musical sound output has been given (step S208). If it is determined that an instruction to end the musical sound output has not been given ("NO" in step S208), the CPU 21 returns the process to step S201. If it is determined that an instruction to end the musical sound output has been given ("YES" in step S208), the CPU 21 ends the musical sound output process.

[0064] <Variation 2> Next, a second modification of the above embodiment will be described. The second modification differs from the above embodiment in that the output timing of the musical sound signals output from the left speaker 24L and the right speaker 24R of the headphones 2 is adjusted based on the position of the headphones 2. Below, differences from the above embodiment will be described, and explanations of points in common with the above embodiment will be omitted. The second modification may be combined with the first modification.

[0065] When the distance from the sound source position Ps to the right ear is different from the distance from the sound source position Ps to the left ear, strictly speaking, the timing at which the musical sound output from the sound source position Ps is heard differs between the left and right ears. To reproduce this phenomenon, in Modification 2, the CPU 11 adjusts the first musical sound signal of the left channel and the second musical sound signal of the right channel so that the greater the difference between the distance between the sound source position Ps and the left speaker 24L and the distance between the sound source position Ps and the right speaker 24R, the longer the delay time between the output start timing of the musical sound from the left speaker 24L or the right speaker 24R that is closer to the sound source position Ps and the output start timing of the musical sound from the one that is farther from the sound source position Ps. Specifically, the phases of the first musical sound signal of the left channel and the second musical sound signal of the right channel are shifted to create the delay time. One method for identifying the positions of the left speaker 24L and the right speaker 24R is to provide headphone antennas 26 to the left speaker 24L and the right speaker 24R, respectively, and identify the positions separately. Alternatively, the headphones 2 may be provided with one headphone antenna 26 and a sensor that detects the orientation of the headphones 2, and the positions of the left speaker 24L and the right speaker 24R may be derived based on the identified position of the headphone antenna 26 (representative position of the headphones 2) and the orientation of the headphones 2 identified from the detection result of the sensor.

[0066] FIG. 10 is a diagram showing delay times of the output timing of musical tones according to the second modification. The horizontal axis of Fig. 10 represents the difference between the distance from the sound source position Ps to the left speaker 24L and the distance from the sound source position Ps to the right speaker 24R. This difference may be the difference in distance in the y direction, or may be a value that takes into account the difference in distance in the x direction (the difference in distance in the xy plane). The vertical axis of Fig. 10 represents the delay time described above. As shown in FIG. 10, the output timings of the left and right musical tones are adjusted so that the delay time increases in proportion to the difference in distance from the sound source position Ps to the left and right speakers.

[0067] In the second modification, the volume of the musical tones output from the left speaker 24L and the right speaker 24R may be adjusted based on the position of the headphones 2, as in the above embodiment.

[0068] <Effects> As described above, the electronic piano 1 as an information processing device according to this embodiment includes a CPU 11 that adjusts musical sound signals for outputting musical sounds corresponding to the depression of keys 181 of the electronic piano 1 from the headphones 2 worn by the user U, based on the depressed keys 181 and the position data 121 relating to the position of the headphones 2. This makes it possible to realize natural sounds corresponding to the position of the user U relative to the keyboard instrument, just as when playing an actual keyboard instrument, even when listening to the musical sounds of a keyboard instrument using the headphones 2.

[0069] Furthermore, the CPU 11 adjusts elements of the musical sound signal related to the volume of the musical sound based on the position data 121. As a result, even when listening to the musical sounds of a keyboard instrument using the headphones 2, the musical sounds can be output from the headphones 2 at a natural volume according to the position of the user U relative to the keyboard instrument, just as if the user were playing an actual keyboard instrument.

[0070] Furthermore, the CPU 11 adjusts the musical sound signal based on the positional relationship between the sound source position Ps corresponding to the pressed key 181 and the position of the headphones 2 based on the position data 121. In this way, in response to the pressing of the key 181, the musical sound of the key 181 can be output with natural sound according to the positional relationship between the sound source position Ps corresponding to the key 181 and the position of the user U.

[0071] Furthermore, the CPU 11 adjusts the musical sound signal so that the volume of the musical sound decreases as the distance between the sound source position Ps and the position of the headphones 2 increases. This allows a musical sound to be output at a natural volume according to the distance between the sound source position Ps corresponding to the key 181 and the position of the user U in response to the depression of the key 181.

[0072] The headphones 2 also include a left speaker 24L that outputs a first musical sound to the left ear of the user U based on a first musical sound signal, and a right speaker 24R that outputs a second musical sound to the right ear of the user U based on a second musical sound signal, and the CPU 11 specifies a first positional relationship between the sound source position Ps and the position of the left speaker 24L and a second positional relationship between the sound source position Ps and the position of the right speaker 24R based on the position data 121, and adjusts the first musical sound signal and the second musical sound signal based on the first positional relationship and the second positional relationship. This allows the left speaker 24L and the right speaker 24R of the stereo headphones to output musical sounds with natural acoustics that correspond to the positions of the user U.

[0073] Furthermore, the CPU 11 adjusts the first musical tone signal based on the first positional relationship so that the volume of the first musical tone decreases as the distance between the sound source position Ps and the left speaker 24L increases, and adjusts the second musical tone signal based on the second positional relationship so that the volume of the second musical tone decreases as the distance between the sound source position Ps and the right speaker 24R increases. This allows the volume of the musical tone output to the ear closer to the sound source position Ps corresponding to the key 181 to be higher than the volume of the musical tone output to the ear further away. Therefore, it is possible to achieve sound with a natural volume balance between the left and right ears depending on the positional relationship between the sound source position Ps corresponding to the key 181 and the user U, just like when playing an acoustic keyboard instrument.

[0074] Furthermore, the CPU 11 according to the second modification adjusts the first and second musical sound signals based on the first and second positional relationships so that the delay time between the start of outputting musical sounds from the left speaker 24L or the right speaker 24R, whichever is closer to the sound source position Ps, and the start of outputting musical sounds from the left speaker 24L or the right speaker 24R, whichever is farther from the sound source position Ps, is longer the greater the difference between the distance between the sound source position Ps and the left speaker 24L and the distance between the sound source position Ps and the right speaker 24R, based on the first and second positional relationships. This allows the output timing of musical sounds for the ear farthest from the sound source position Ps corresponding to the keys 181 to be delayed compared to the output timing of musical sounds for the ear closest to the sound source position Ps. This allows musical sounds to be output at natural timing to the left and right ears, depending on the positional relationship between the sound source position Ps corresponding to the keys 181 and the user U, just as when playing an acoustic keyboard instrument.

[0075] The position data 121 also includes information relating to the position of each of the multiple headphones 2, and the CPU 11 adjusts each of the multiple musical sound signals for outputting musical sounds from each of the multiple headphones 2 based on the position data 121 and on the information relating to the position of the corresponding headphones 2 in the position data 121. This allows the headphones 2 used by each user U playing duets or multiple users U listening to a performance to output musical sounds with natural acoustics according to the position of each user U.

[0076] The device also includes a first antenna 171 and a second antenna 172 that are provided in different directions from the headphones 2 and receive position detection signals transmitted from the headphones 2, and the CPU 11 adjusts the musical sound signal based on position data 121 generated based on the reception timing and reception strength of the position detection signal by the first antenna 171 and the reception timing and reception strength of the position detection signal by the second antenna 172. This makes it possible to detect the position of the headphones 2 in real time, and to adjust the musical sound signal in real time so that the detected position is reflected.

[0077] Furthermore, the headphones 2 as a sound output device according to Modification 1 are headphones 2 worn by a user U, and include a CPU 21 that adjusts musical tone signals for outputting musical tones corresponding to the depression of a key 181 of the electronic piano 1 based on the depressed key 181 and position data 121 related to the position of the device itself, and a left speaker 24L and a right speaker 24R that output musical tones based on the musical tone signals adjusted by the CPU 21. As a result, even when listening to the musical tones of a keyboard instrument using the headphones 2, natural sound corresponding to the position of the user U relative to the keyboard instrument can be achieved, just like when playing an actual keyboard instrument. Furthermore, adjusting the musical tone signals on the headphones 2 side can reduce the processing load on the CPU 11 of the electronic piano 1, for example, when the musical tones of the electronic piano 1 are output to multiple headphones 2.

[0078] The information processing method according to this embodiment is an information processing method executed by a CPU 11 serving as a computer provided in the electronic piano 1 serving as an information processing device, and adjusts a musical sound signal for outputting a musical sound corresponding to a key 181 pressed on the electronic piano 1 from the headphones 2 worn by the user U, based on the pressed key 181 and position data 121 relating to the position of the headphones 2. As a result, even when listening to the musical sounds of a keyboard instrument using the headphones 2, natural sound corresponding to the position of the user U relative to the keyboard instrument can be realized, just as when playing an actual keyboard instrument.

[0079] Furthermore, the program 131 according to this embodiment causes the CPU 11, which serves as a computer provided in the electronic piano 1, which serves as an information processing device, to execute a process of adjusting a musical sound signal for outputting a musical sound corresponding to a key 181 pressed on the electronic piano 1 from the headphones 2 worn by the user U, based on the pressed key 181 and position data 121 relating to the position of the headphones 2. As a result, even when listening to the musical sounds of a keyboard instrument using the headphones 2, it is possible to achieve natural sound corresponding to the position of the user U relative to the keyboard instrument, just as if the user were playing an actual keyboard instrument.

[0080] <Other> The description in the above embodiment is merely an example of the information processing device, sound output device, information processing method, and program according to the present invention, and the present invention is not limited to this. For example, in the above embodiment, the electronic piano 1 is used as an example of the information processing device, but the information processing device is not limited to this. The information processing device may be a device provided separately from a keyboard instrument such as an electronic piano, such as a PC (personal computer).

[0081] Furthermore, the sound output device is not limited to headphones 2 as long as it is worn by the user. For example, the sound output device may be earphones or a bone conduction speaker. The location of the device is not limited to the head, and may be, for example, a neck speaker worn around the neck. The left speaker 24L and the right speaker 24R are not limited to devices that output musical sounds directly to the left and right ears, respectively. For example, like the bone conduction speaker and neck speaker described above, the left speaker 24L may output a first musical sound to the user's left ear, and the right speaker 24R may output a second musical sound to the user's right ear. Furthermore, the device is not limited to a stereo system in which musical sounds are output from left and right speakers based on separate musical sound signals, but may be a monaural system in which musical sounds are output from left and right speakers based on the same musical sound signal.

[0082] Furthermore, the keyboard instrument is not limited to an electronic piano, but may be any instrument having a keyboard, such as an organ, an electone, or an accordion.

[0083] Furthermore, the position of the string S corresponding to the key 181 on the virtual grand piano GP has been exemplified as the sound source position Ps corresponding to the key 181, but this is not limiting. For example, the position of the key 181 itself may be used as the sound source position Ps.

[0084] In the above embodiment, an example has been described in which the volume of a musical sound is adjusted based on the position of the headphones 2, but this is not limiting, and the pitch or tone of a musical sound may also be adjusted based on the position of the headphones 2. In other words, the CPU 11 may adjust at least one element of the musical sound signal, among the volume, pitch, tone, and output start timing, based on position information relating to the position of the headphones 2.

[0085] In the above embodiment, the musical tone signal is adjusted to reproduce a natural (realistic) sound like that of an acoustic musical instrument, but the present invention is not limited to this. For example, when the user U makes a specific gesture by moving his / her head (headphones 2), it may be possible to change the tone by manipulating the parameters of a specific effector in accordance with the gesture.

[0086] The headphones 2 may also be worn by audience members other than the performer of the electronic piano 1. Furthermore, if the audience member, user U, moves during a performance, the volume and other aspects of the musical tones output from the headphones 2 may be adjusted in accordance with the movement. Furthermore, it is also possible to achieve performance effects such as changing the overall pitch of the musical tones, modulating the key, or changing the timbre in accordance with the movement.

[0087] Furthermore, the number of headphones 2 to which the electronic piano 1 transmits musical tone signals is not limited to two, and musical tone signals adjusted based on the position of each headphone 2 may be transmitted to three or more headphones 2 .

[0088] Furthermore, in the above embodiment, an example has been described in which musical tone signals are transmitted by wireless data communication, but the present invention is not limited to this, and musical tone signals may be transmitted from the electronic piano 1 to the headphones 2 by wired data communication.

[0089] Furthermore, the number of antennas included in the array antenna 17 is not limited to two, and the array antenna 17 may include three or more antennas provided at positions that are oriented in different directions from the headphones 2 (headphone antenna 26).

[0090] In the above embodiment, as shown in FIG. 1, an example has been described in which the headphone antenna 26 is provided in the middle position between the left speaker 24L and the right speaker 24R in the headphones 2. However, this is not limiting, and the headphone antenna 26 may be provided in the left speaker 24L or the right speaker 24R.

[0091] Furthermore, in the above embodiment, the musical sound signal is adjusted based on the position of the headphones 2 on the xy plane that passes through the y-axis and the headphone antenna 26, but this is not limited to this. For example, the musical sound signal may be adjusted based on the coordinates on a horizontal plane (a plane parallel to the top surface of the keys 181 of the keyboard 18) when the position coordinates on the xy plane are projected onto the horizontal plane.

[0092] Furthermore, in the above embodiment, it is assumed that the user U faces in the -x direction, i.e., in the direction of the keyboard 18, and the right speaker 24R of the headphones 2 is positioned on the +y side of the left speaker 24L, but this is not limited to this. For example, the headphones 2 may be provided with a sensor that detects the orientation of the headphones 2, the orientation of the headphones 2 may be identified based on the detection result of the sensor, and the positions of the left speaker 24L and the right speaker 24R may be identified based on the identified orientation.

[0093] Furthermore, although an example has been described in which the position information relating to the position of the headphones 2 is acquired based on the reception results of the position detection signal by the array antenna 17, this is not limiting. For example, during a duet, information indicating whether the user U using the headphones 2 is on the left or right side may be used as the position information of the headphones 2. Furthermore, when the audience is using the headphones 2, the seat positions of the audience may be used as the position information of the headphones 2.

[0094] In the above description, an example has been disclosed in which ROMs 13 and 23 are used as computer-readable media for the program according to the present invention, but the present invention is not limited to this example. Other computer-readable media may be used, such as information recording media including HDDs, SSDs, flash memories, and CD-ROMs. Furthermore, a carrier wave may also be used as a medium for providing data for the program according to the present invention via a communication line.

[0095] Furthermore, it goes without saying that the detailed configurations and operations of the components of the musical sound output system 100, the electronic piano 1, and the headphones 2 in the above-described embodiment can be modified as appropriate without departing from the spirit of the present invention.

[0096] Although the embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and its equivalents. The inventions described in the claims originally attached to this application are as follows. The claim numbers described in the appendix are the same as those of the claims originally attached to this application. [Note] <Claim 1> An information processing device comprising: a processing unit that adjusts a musical sound signal for outputting a musical sound corresponding to a key pressed on a keyboard instrument from a sound output device worn by a user, based on position information relating to the pressed key and the position of the sound output device. <Claim 2> 2. The information processing device according to claim 1, wherein the processing unit adjusts elements of the musical sound signal relating to at least one of the volume, pitch, timbre, and output start timing of the musical sound based on the position information. <Claim 3> 3. The information processing device according to claim 1, wherein the processing unit adjusts the musical sound signal based on a positional relationship between a sound source position corresponding to the pressed key and a position of the sound output device based on the position information. <Claim 4> 4. The information processing apparatus according to claim 3, wherein the processing unit adjusts the musical sound signal so that the volume of the musical sound decreases as the distance between the sound source position and the sound output device increases. <Claim 5> the sound output device includes a first sound output unit that outputs a first musical sound to the left ear of the user based on the first musical sound signal, and a second sound output unit that outputs a second musical sound to the right ear of the user based on the second musical sound signal; The processing unit determining a first positional relationship between the position of the sound source and the position of the first sound output unit and a second positional relationship between the position of the sound source and the position of the second sound output unit based on the position information; adjusting the first musical sound signal and the second musical sound signal based on the first positional relationship and the second positional relationship; 5. The information processing device according to claim 3, wherein the information processing device is a computer. <Claim 6> The processing unit adjusting the first musical sound signal based on the first positional relationship so that the volume of the first musical sound decreases as the distance between the sound source position and the first sound output unit increases; adjusting the second musical sound signal based on the second positional relationship so that the volume of the second musical sound decreases as the distance between the sound source position and the second sound output unit increases; 6. The information processing device according to claim 5, <Claim 7> The information processing device according to claim 5, characterized in that the processing unit adjusts the first musical sound signal and the second musical sound signal based on the first positional relationship and the second positional relationship so that the larger the difference between the distance between the sound source position and the first sound output unit and the distance between the sound source position and the second sound output unit, the longer the delay time of the output start timing of the musical sound from one of the first sound output unit and the second sound output unit that is closer to the sound source position relative to the output start timing of the musical sound from one of the first sound output unit and the second sound output unit that is farther from the sound source position. <Claim 8> the position information includes information relating to the position of each of the plurality of sound output devices, The information processing device according to any one of claims 1 to 7, characterized in that the processing unit adjusts each of the plurality of musical sound signals for outputting the musical sounds from each of the plurality of sound output devices based on the position information, based on information relating to the position of the corresponding sound output device among the position information. <Claim 9> a first antenna and a second antenna that are provided at positions that are in different directions from the sound output device and that receive a position detection signal transmitted from the sound output device; the processing unit generates the position information based on a reception timing and a reception strength of the signal for position detection by the first antenna, and a reception timing and a reception strength of the signal for position detection by the first antenna. 9. The information processing device according to claim 1, wherein the information processing device is a computer. <Claim 10> A sound output device worn by a user, a processing unit that adjusts a musical tone signal for outputting a musical tone corresponding to a key depression of a keyboard instrument based on the key depression and position information relating to the position of the keyboard instrument; a sound output unit that outputs the musical sound based on the musical sound signal adjusted by the processing unit; A sound output device comprising: <Claim 11> An information processing method executed by a computer provided in an information processing device, An information processing method comprising: adjusting a musical sound signal for outputting a musical sound corresponding to a key pressed on a keyboard instrument from a sound output device worn by a user, based on positional information relating to the pressed key and the position of the sound output device. <Claim 12> A computer provided in the information processing device A program that executes a process of adjusting a musical sound signal for outputting a musical sound corresponding to a key pressed on a keyboard instrument from a sound output device worn by a user, based on position information relating to the pressed key and the position of the sound output device. [Explanation of symbols]

[0097] 1. Electronic piano (information processing device, keyboard instrument) 10. Cabinet 11 CPU (processing unit) 12 RAM 121 Location data (location information) 13 ROM 131 Programs 14 Volume Sensor 15 Pitch switch 16. Radio Communication Department 17 Array Antenna 171 First Antenna 172 Second Antenna 18 keys 181, 181C key 19 Bus 2, 2a, 2b Headphones (sound output device) 21 CPU (processing unit) 22 RAM 23 ROM 231 Programs 24L Left speaker (first sound output section) 24R Right speaker (second sound output unit) 241L, 241R signal conversion amplifier 242L, 242R coils 25 High frequency signal processing section 26 Headphone antenna 27 Bus 100 Musical Sound Output System GP Grand Piano Ps sound source position S string U, Ua, Ub users

Claims

1. Acquire position information of a sound output device worn by a user; a pan volume coefficient set in correspondence with each key on the keyboard, the pan volume coefficient corresponding to the position information being acquired; An electronic keyboard instrument comprising a processing unit that adjusts a musical tone signal for outputting a musical tone based on the pan volume coefficient.

2. the sound output device includes a first sound output unit that outputs a first musical sound to the left ear of the user based on the first musical sound signal, and a second sound output unit that outputs a second musical sound to the right ear of the user based on the second musical sound signal; The processing unit based on the position information, specifying a pan volume coefficient for the left ear of the user as a first positional relationship between the first sound output unit and a sound source position, which is the position of a key of the electronic keyboard instrument or the position of a string corresponding to the key when the keyboard of the electronic keyboard instrument is assumed to be a grand piano keyboard, and a pan volume coefficient for the right ear of the user as a second positional relationship between the second sound output unit and the sound source position; adjusting the first musical sound signal based on the pan volume coefficient for the left ear, and adjusting the second musical sound signal based on the pan volume coefficient for the right ear; 2. The electronic keyboard instrument according to claim 1.

3. the left ear pan volume coefficient and the right ear pan volume coefficient corresponding to a certain key on the keyboard are determined to be equal in value when the sound output device is at a certain position corresponding to the certain key in the arrangement direction of the keys on the keyboard, and to be different in value when the sound output device is at a position different from the certain position in the arrangement direction.

3. The electronic keyboard instrument according to claim 2.

4. the pan volume coefficient for the left ear and the pan volume coefficient for the right ear corresponding to the certain key are determined such that a difference between the pan volume coefficient for the left ear and the pan volume coefficient for the right ear increases as the position of the sound output device in the arrangement direction moves away from the certain position.

4. The electronic keyboard instrument according to claim 3.

5. The pan volume coefficient for the left ear and the pan volume coefficient for the right ear corresponding to the certain key are expressed as follows: the pan volume coefficient for the left ear is set to increase and the pan volume coefficient for the right ear is set to decrease as the sound output device moves away from the certain position in a first direction in the arrangement direction; the pan volume coefficient for the left ear is set to decrease and the pan volume coefficient for the right ear is set to increase as the sound output device moves away from the certain position in the arrangement direction in a second direction opposite to the first direction.

5. The electronic keyboard instrument according to claim 4.

6. The processing unit adjusting the first musical sound signal based on the first positional relationship so that the volume of the first musical sound decreases as the distance between the first sound output unit and the sound source position increases; adjusting the second musical sound signal based on the second positional relationship so that the volume of the second musical sound decreases as the distance between the second sound output unit and the sound source position increases; 6. The electronic keyboard instrument according to claim 2, wherein the first and second keys are connected to the first and second keys.

7. The processing unit adjusting the first musical sound signal and the second musical sound signal based on the first positional relationship and the second positional relationship so that the delay time of the output start timing of the musical sound from one of the first sound output unit and the second sound output unit that is farther from the sound source position becomes longer as the difference between the distance between the sound source position and the first sound output unit and the distance between the sound source position and the second sound output unit increases; 7. The electronic keyboard instrument according to claim 2, wherein the first and second keys are connected to the first and second keys.

8. the position information includes information relating to the position of each of the plurality of sound output devices, the processing unit adjusts each of the plurality of musical sound signals for outputting the musical sounds from the plurality of sound output devices based on information relating to the position of the corresponding sound output device in the position information, 8. The electronic keyboard instrument according to claim 1, wherein the electronic keyboard instrument is a keyboard.

9. An information processing method executed by a computer provided in an electronic keyboard instrument, Acquire position information of a sound output device worn by a user; a pan volume coefficient set in correspondence with each key on the keyboard, the pan volume coefficient corresponding to the position information being acquired; adjusting a musical sound signal for outputting a musical sound based on the pan volume coefficient; 1. An information processing method comprising:

10. The computer installed in the electronic keyboard instrument Acquire position information of a sound output device worn by a user; a pan volume coefficient set in correspondence with each key on the keyboard, the pan volume coefficient corresponding to the position information being acquired; adjusting a musical sound signal for outputting a musical sound based on the pan volume coefficient; A program characterized by executing a process.

Images