Shoulder-mounted speaker, sound image localization method, and sound image localization program

Abstract

To provide a shoulder-mounted speaker capable of localizing a sound image at an appropriate position according to the head posture even when the head posture cannot be detected like the shoulder-mounted speaker.SOLUTION: A shoulder-mounted speaker (1) includes a posture data detection unit (251) that detects the posture of a portion on which the shoulder-mounted speaker (1) is placed and acquires portion posture data obtained by converting the posture of the portion into data, a posture data correction unit (252) that corrects the acquired posture data to head posture data, and a sound image localization processing unit (254) that performs sound image localization processing on a sound signal using a head-related transfer function corresponding to the head posture data corrected by the posture data correction unit (252).SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] An embodiment of the present invention relates to a speaker that is mounted on a user's shoulder. [Background technology]

[0002] The wearable speaker device of Patent Document 1 is a speaker that is worn on the shoulder of a user. The wearable speaker device of Patent Document 1, for example, modifies the transfer function between the speaker and the user's ear according to the distance between the sensor and a part of the user's head (for example, the ear) detected by the sensor, thereby suppressing changes in tone due to head movement. In addition, conventionally, as a method for simulating stereophonic sound at the ear, there has been a sound processing device (for example, headphones) that controls a sound image using a head-related transfer function (HRTF) (for example, Patent Document 2). The sound processing device of Patent Document 2 performs head tracking and performs sound image localization by sequentially reading required HRTFs from a circumferential HRTF database. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-023104 A [Patent Document 2] International Publication No. 2017 / 135063 Summary of the Invention [Problem to be solved by the invention]

[0004] In the wearable speaker device of Patent Document 1, the sound image is located at the speaker position regardless of the head posture. In addition, the sound processing device of Patent Document 2 requires a sensor to detect the head posture. With headphones worn on the head as in Patent Document 2, it is possible to detect the head posture using a sensor, but with shoulder-mounted speakers as in Patent Document 1, which are not worn on the head, it is not possible to detect the head posture using a sensor. Therefore, it is difficult to achieve sound image localization as in Patent Document 2 with shoulder-mounted speakers.

[0005] An embodiment of the present invention aims to localize a sound image at an appropriate position according to the head posture even in a case where the head posture cannot be detected, such as in the case of a shoulder-mounted speaker. [Means for solving the problem]

[0006] A shoulder-mounted speaker according to one embodiment of the present invention comprises a posture data detection unit that detects the posture of a part on which the shoulder-mounted speaker is placed and acquires part posture data that digitizes the posture of the part, a posture data correction unit that corrects the acquired part posture data to head posture data, and a sound image localization processing unit that applies sound image localization processing to a sound signal using a head-related transfer function corresponding to the head posture data corrected by the posture data correction unit. Effect of the Invention

[0007] The shoulder-mounted speaker, sound image localization method, and sound image localization program of one embodiment of the present invention can localize a sound image to an appropriate position depending on the head posture, even in cases where the head posture cannot be detected, such as in the case of a shoulder-mounted speaker. [Brief description of the drawings]

[0008] [Figure 1] 1A and 1B are a plan view and a side view showing the appearance of a shoulder-mounted speaker. [Diagram 2] FIG. 2 is an explanatory diagram showing a state in which a user wears a shoulder-type speaker. [Diagram 3]This is a plan view showing the positions of the sound images of the five channels. [Figure 4] FIG. 1 is a block diagram showing an example of the configuration of a shoulder-mounted speaker. [Diagram 5] 1A and 1B are plan views of a shoulder-mounted speaker as viewed from the vertical direction, illustrating changes in the user's state. [Figure 6] FIG. 2 is an explanatory diagram showing an example of the flow of a signal input to a shoulder-mounted speaker. [Figure 7] 1 is a table showing the relationship between the shoulder tilt angle and the head angle. [Figure 8] 4 is a flowchart showing an example of the operation of the shoulder-mounted speaker. [Figure 9] FIG. 11 is a block diagram showing the configuration of a shoulder-mounted speaker according to a first modified example. [Figure 10] 13 shows a number of tables showing the relationship between shoulder tilt angle and head angle. [Figure 11] FIG. 11 is an explanatory diagram showing the flow of a signal input to the shoulder-mounted speaker of the first modified example. [Figure 12] 13 is a flowchart illustrating an example of an operation of a data calculation unit. [Figure 13] FIG. 11 is a block diagram showing the configuration of a shoulder-mounted speaker according to a second modified example. [Figure 14] 1 is a table showing the relationship between the shoulder tilt angle and the head angle in three directions. [Figure 15] 1A to 1C are front views of a shoulder-mounted speaker as viewed from the front of a user, illustrating changes in the user's state. [Figure 16] 1A-1C are side views of the shoulder-mounted speaker as viewed from the left side of a user, illustrating changes in the user's state. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The shoulder-mounted speaker 1 of this embodiment will be described with reference to the drawings. FIG. 1 is a plan view and a side view showing the appearance of the shoulder-mounted speaker 1. FIG. 2 is an explanatory diagram showing a state in which the shoulder-mounted speaker 1 is worn by a user. As shown in FIG. 1, the shoulder-mounted speaker 1 is formed in a U-shape composed of an arc-shaped arc portion and long portions extending from both ends of the arc portion when viewed from a plane (vertically upward) . The shoulder-mounted speaker 1 is worn so that the arc portion fits along the back of the user's neck as shown in FIG. 2. The shoulder-mounted speaker 1 is hung on the user's shoulder 51 so that the two long portions face forward from the shoulder 51.

[0010] As shown in Fig. 1, the shoulder speaker 1 is equipped with speakers 3L and 3R on each of the housings of the long portions. The user wears the shoulder speaker 1 so that the sound emitting portions of the speakers 3L and 3R face upward. More specifically, the user wears the speaker 3L so that it is located on the side of the user's left ear 52L. The user also wears the speaker 3R so that it is located on the side of the user's right ear 52R (see Fig. 2).

[0011] The shoulder-mounted speaker 1 is equipped with the sensor 4 and electrical circuits other than the sensor 4 inside the housing of the arc portion. The sensor 4 does not necessarily have to be equipped inside the housing of the shoulder-mounted speaker 1. The sensor 4 may be provided, for example, on the outside of the housing of the shoulder-mounted speaker 1.

[0012] The shoulder-mounted speaker 1 receives an audio signal from, for example, a mobile terminal (such as a smartphone or PC) or a television. The shoulder-mounted speaker 1 processes the received audio signal. The shoulder-mounted speaker 1 emits sound based on the processed audio signal from the speakers 3L and 3R.

[0013] In this example, the shoulder-mounted speaker 1 receives, for example, a stereo channel audio signal. The shoulder-mounted speaker 1 upmixes, for example, the received stereo channel audio signal into a five-channel audio signal. In this example, the five channels are front left FL, center C, front right FR, surround left SL, and surround right SR.

[0014] The shoulder-mounted speaker 1 performs sound image localization processing on the 5-channel audio signals upmixed from the stereo channels. More specifically, the shoulder-mounted speaker 1 generates an audio signal (L channel signal) in which a head-related transfer function from the position of the sound image to the left ear 52L is convolved in each channel, and an audio signal (R channel signal) in which a head-related transfer function from the position of the sound image to the right ear 52R is convolved in each channel.

[0015] The shoulder speaker 1 performs sound image localization processing according to the head posture data, so that the position of the sound image does not change even if the posture of the user's head 53 changes.

[0016] FIG. 3 is a plan view showing the positions of sound images of five channels. The head-related transfer function indicates a transfer function from a sound source to a user's head 53 (specifically, the user's left ear 52L and right ear 52R). As shown in FIG. 3, the head-related transfer function is a transfer function that is separated from the user by a predetermined distance, for example, 1 m, and expresses two transfer paths leading to the user's left ear 52L and right ear 52R for each of the five channels (front left FL, center C, front right FR, surround left SL, and surround right SR). In this example, the sound images of the front left FL and center C are localized to the left front of the user, the front right FR to the right front of the user, the surround left SL to the left rear of the user, and the surround right SR to the right rear of the user, respectively, when the user is viewed from above in the vertical direction and based on the user.

[0017] Here, the shoulder-mounted speaker 1 acquires the posture of the head 53 in order to perform sound image localization processing using a head-related transfer function. The shoulder-mounted speaker 1 corrects the posture (tilt angle) of the shoulder 51 to the posture (angle) of the head 53. In other words, the shoulder-mounted speaker 1 does not directly detect the posture of the head 53, but detects the angle at which the shoulder 51 is tilted, and acquires the head angle from the detected shoulder tilt angle. The shoulder tilt angle in this example is an example of part posture data of the present invention. Also, the head angle in this example is an example of head posture data of the present invention.

[0018] The configuration of the shoulder-mounted speaker 1 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the shoulder-mounted speaker 1. The shoulder-mounted speaker 1 includes a communication unit 21, a flash memory 22, a RAM 23, a signal processing unit 24, a CPU 25, an output unit 26, speakers 3L and 3R, and a sensor 4.

[0019] The communication unit 21 receives an audio signal from, for example, a mobile terminal or a television.

[0020] The signal processing unit 24 is configured with, for example, a DSP (Digital Signal Processing). The signal processing unit 24 performs signal processing on the received audio signal. In this example, the signal processing unit 24 upmixes the received stereo audio signal to five channels.

[0021] The flash memory 22 stores a table ta1 (see FIG. 7) that indicates the relationship between the shoulder tilt angle and the head angle. The table ta1 will be described in detail later. The flash memory 22 also stores head-related transfer functions corresponding to each of the five channels.

[0022] The CPU 25 reads out the operation program stored in the flash memory 22 into the RAM 23 and controls the shoulder type speaker 1 in an integrated manner. The CPU 25 also includes a posture data detection unit 251, a posture data correction unit 252, a head related transfer function acquisition unit 253, and a sound image localization processing unit 254. The CPU 25 executes the application program to read out the programs related to posture data detection processing, posture data correction processing, head related transfer function acquisition processing, and sound image localization processing from the flash memory 22 into the RAM 23. As a result, the CPU 25 constitutes the posture data detection unit 251, the posture data correction unit 252, the head related transfer function acquisition unit 253, and the sound image localization processing unit 254. The posture data detection unit 251, the posture data correction unit 252, the head related transfer function acquisition unit 253, and the sound image localization processing unit 254 will be described in detail later.

[0023] It should be noted that the program read by the CPU 25 does not need to be stored in the flash memory 22 of the shoulder speaker 1. For example, the program may be stored in a storage medium of an external device such as a server. In this case, the CPU 25 may read the program from the server (not shown) into the RAM 23 each time and execute it.

[0024] The output unit 26 is connected to the speakers 3L and 3R. The output unit 26 outputs the processed audio signal to the speakers 3L and 3R. The output unit 26 has a DA converter (hereinafter referred to as DAC) 261 and an amplifier (hereinafter referred to as AMP) 262. The DAC 261 converts the processed digital signal into an analog signal. The AMP 262 amplifies the analog signal to drive the speakers 3L and 3R. The output unit 26 outputs the amplified analog signal (audio signal) to the speakers 3L and 3R.

[0025] The speakers 3L and 3R emit sound based on the audio signal output from the output unit .

[0026] The sensor 4 is, for example, an angular velocity sensor, and is provided at the center of the arc portion of the housing. The sensor 4 is, for example, an angular velocity sensor that detects an angular velocity in a horizontal direction c1 with the vertical direction (direction z1) as its axis. In this example, the shoulder 51 is described as the part on which the shoulder speaker 1 is placed.

[0027] Fig. 5 is a plan view of the shoulder speaker 1 as viewed from the vertical direction, showing the change in state (from state 60 to state 61) when the user wears the shoulder speaker 1. The direction y1 shown by the dashed dotted line in Fig. 5 indicates the front-rear direction, with the upper side of the paper showing the rear side of the user and the lower side of the paper showing the front side of the user. The direction x1 shown by the dashed dotted line in Fig. 4 indicates the left-right direction, with the right side of the paper showing the left side of the user and the left side of the paper showing the right side of the user.

[0028] State 60 (the state of the user on the upper side of the paper in FIG. 5) indicates a state in which the user is facing forward, as shown in FIG. 5. State 61 (the state of the user on the lower side of the paper in FIG. 5) indicates a state in which the user is leaning to the left. Shoulder 51 in state 61 is leaned at a shoulder inclination angle a1 from the position of shoulder 51 in state 60 when the right direction is used as the reference direction.

[0029] The posture data detection unit 251, posture data correction unit 252, head-related transfer function acquisition unit 253, and sound image localization processing unit 254 will be described with reference to Fig. 6 and Fig. 7. Fig. 6 is an explanatory diagram showing an example of the flow of a signal input to the shoulder-mounted speaker 1. Fig. 7 is a table showing the relationship between the inclination angle of the shoulder and the angle of the head.

[0030] As shown in Fig. 6, posture data detection unit 251 detects the posture of shoulder 51 from the measurement value output by sensor 4. Posture data detection unit 251 calculates shoulder tilt angle a1 (see Fig. 5) based on the angular velocity detected by sensor 4. More specifically, posture data detection unit 251 detects shoulder tilt angle a1 when the shoulder tilts from the right in the direction indicated by dashed two-dot line d1 shown in Fig. 5. Posture data detection unit 251 outputs the calculated shoulder tilt angle a1 to posture data correction unit 252.

[0031] Posture data correction unit 252 corrects shoulder tilt angle a1 (part posture data) to head angle (head posture data) based on table ta1 shown in Fig. 7. That is, posture data correction unit 252 refers to table ta1 pre-stored in flash memory 22, and acquires the head angle corresponding to shoulder tilt angle a1 output from posture data detection unit 251. For example, as shown in Fig. 7, in the case of shoulder tilt angle a1, posture data correction unit 252 acquires head angle b1 corresponding to shoulder tilt angle a1 from table ta1.

[0032] Table ta1 is, for example, an average of a large amount of collected measurement data. The measurement data is a measurement of the inclination angle of the shoulders of a person in a sitting position and the angle of the head corresponding to the inclination angle of the shoulders. Note that table ta1 may be generated using a machine learning algorithm (for example, a neural network). An algorithm for calculating the head angle from the inclination angle of the shoulders is constructed by end-to-end learning using the above-mentioned large amount of collected measurement data, for example. In this case, the inclination angle of the user's shoulders is an element of the input data. Also, the angle of the head is an element of the output data. The algorithm generates the table by outputting the angle of the head relative to the inclination angle of the shoulders calculated from the sensor 4 of the shoulder-mounted speaker 1. In this case, the table is also created in advance.

[0033] The posture data correction unit 252 outputs the acquired head angle b1 to the head related transfer function acquisition unit 253.

[0034] The head-related transfer function acquisition unit 253 reads out a head-related transfer function corresponding to the head angle b1 from the flash memory 22. The head-related transfer function acquisition unit 253 outputs the read out head-related transfer function to the sound image localization processing unit 254. The head-related transfer function acquisition unit 253 outputs to the sound image localization processing unit 254 a head-related transfer function of the L channel corresponding to the speaker 3L and a head-related transfer function of the R channel corresponding to the speaker 3R.

[0035] The head-related transfer function acquisition unit 253 reads out a head-related transfer function according to the angle of the head from the flash memory 22 so that the position of the sound image does not move. More specifically, when the head is tilted from state 60 to state 61 at an angle b1° (for example, 30° counterclockwise around the vertical direction as an axis), the head-related transfer function acquisition unit 253 reads out a head-related transfer function when the head is tilted at an angle b1° (angle 30°) clockwise around the vertical direction as an axis. Note that when the head is tilted from state 60 to state 61 at an angle b1° (for example, 30° counterclockwise around the vertical direction as an axis), the head-related transfer function acquisition unit 253 may calculate a head-related transfer function when the position of the sound image is tilted at an angle b1° (angle -30°) clockwise around the vertical direction as an axis, and correct the head-related transfer function stored in the flash memory 22.

[0036] The sound image localization processing unit 254 convolves the head related transfer function for the L channel and the head related transfer function for the R channel with each of the audio signals upmixed into five channels by the signal processing unit 24. The sound image localization processing unit 254 generates a two-channel stereo audio signal from the five-channel audio signals convolved with the head related transfer functions.

[0037] The operation of the shoulder-type speaker 1 (operation relating to sound image localization) will be described with reference to Fig. 8. Fig. 8 is a flow chart showing an example of the operation of the shoulder-type speaker 1.

[0038] The shoulder-mounted speaker 1 acquires the measurement value of the sensor 4 (S1). The shoulder-mounted speaker 1 calculates the shoulder tilt angle a1 from the measurement value (S2). The shoulder-mounted speaker 1 corrects the shoulder tilt angle a1 to the head angle b1 using the table ta1 (S3). In other words, the shoulder-mounted speaker 1 acquires the head angle b1 corresponding to the shoulder tilt angle a1 by referring to the table ta1 stored in the flash memory 22. The shoulder-mounted speaker 1 acquires the head-related transfer function corresponding to the head angle b1 (S4). The shoulder-mounted speaker 1 performs sound image localization processing by convolving the head-related transfer function for the L channel and the head-related transfer function for the R channel with each of the upmixed five-channel audio signals (S5). The shoulder-mounted speaker 1 mixes the audio signals of each channel convolved with the head-related transfer function and outputs them as the audio signals of the L channel and the R channel (S6).

[0039] The shoulder-mounted speaker 1 of this embodiment acquires the head angle corresponding to the shoulder tilt angle a1 from the table ta1. Furthermore, the shoulder-mounted speaker 1 of this embodiment performs sound image localization processing by applying the head transfer function corresponding to the acquired head angle to the audio signal of each channel. This allows the shoulder-mounted speaker 1 of this embodiment to localize the sound image to the position of the sound image according to the position of the head 53 even if the position of the head 53 cannot be directly detected. Therefore, even if the position of the user's head 53 changes, the position of the sound image does not change.

[0040] It should be noted that the signal processing unit 24 is not limited to upmixing to 5 channels, but may upmix to 3 channels, 4 channels, 7 channels, 9 channels, or the like.

[0041] In the above embodiment, the shoulder-mounted speaker 1 upmixes a 2-channel stereo audio signal to 5 channels and performs a process of convolving a head-related transfer function on the audio signal upmixed to 5 channels, but this is not limiting. The shoulder-mounted speaker 1 may perform a process of convolving a head-related transfer function on the stereo audio signal without performing upmixing.

[0042] Furthermore, the communication unit 21 may receive a five-channel audio signal. In this case, the signal processing unit 24 outputs the audio signal to the sound image localization processing unit 254 without upmixing.

[0043] [Variation 1] The shoulder-mounted speaker 1A of the first modification will be described with reference to Figs. 9, 10, 11 and 12. Fig. 9 is a block diagram showing the configuration of the shoulder-mounted speaker 1A of the first modification. Fig. 10 shows a number of tables p1, p2 and p3 showing the relationship between the inclination angle of the shoulder and the angle of the head. Fig. 11 is an explanatory diagram showing the flow of signals input to the shoulder-mounted speaker 1A of the first modification. Fig. 12 is a flowchart showing an example of the operation of the data calculation unit 255.

[0044] 9, the CPU 25 is provided with a data calculation unit 255 that calculates the user's shoulder angle per unit time from the angle of shoulder 51 acquired by a posture data detection unit 251, which is different from the configuration of the shoulder-mounted speaker 1 of the above-described embodiment. The shoulder-mounted speaker 1A also differs from the shoulder-mounted speaker 1 described above in that a plurality of tables p1, p2, and p3 (three in FIG. 10) corresponding to the shoulder angle per unit time are stored in the flash memory 22. The tables p1, p2, and p3 will be described later.

[0045] In the shoulder-mounted speaker 1A of the modified example 1A, the angle of the head is calculated from the inclination angle of the shoulders, as in the shoulder-mounted speaker 1 of the above-mentioned embodiment. Incidentally, the angle of the head relative to the inclination angle of the shoulders 51 differs from person to person. For example, a person with little movement has a smaller angle of the head relative to the inclination angle of the shoulders 51 than a person with great movement. The magnitude of movement is calculated from the sum of the inclination angles of the shoulders (amount of movement) per unit time (for example, one minute). A person with little movement has a smaller angle of the shoulders per unit time, for example. Also, a person with great movement has a larger angle of the shoulders per unit time, for example.

[0046] Therefore, the shoulder-mounted speaker 1A calculates the total inclination angle of the shoulder 51 for each unit time, for example, one minute, as the amount of movement. The shoulder-mounted speaker 1A selects a table with a pattern corresponding to the amount of movement, and corrects the inclination angle of the shoulder 51 (for example, the shoulder inclination angle a1 shown in FIG. 5) to the angle of the head. The amount of movement in this example is an example of a parameter of the present invention.

[0047] The data calculation unit 255 acquires the shoulder tilt angle calculated by the posture data detection unit 251, and calculates the total of the shoulder 51 tilt angles acquired in one minute as the movement amount. For example, when the user tilts the shoulder 51 to the right by 20° in one minute from a state facing forward, and then tilts the shoulder 51 to the left by 10°, the data calculation unit 255 calculates the total of the user's shoulder 51 tilt angles as the movement amount=30°. The data calculation unit 255 outputs the calculated movement amount to the posture data correction unit 252 as shown in FIG. 11.

[0048] The operation of the data calculation unit 255 will be described with reference to Fig. 12. Note that the operation of the data calculation unit 255 shown in Fig. 12 is an example, and is not limited thereto. In addition, the data calculation unit 255 may calculate the angle of the shoulder tilted per minute periodically, for example, every 30 minutes.

[0049] The data calculation unit 255 acquires the shoulder tilt angle from the posture data detection unit 251 (S11). If one minute has not passed since the data calculation unit 255 started calculating the angle of the shoulder 51 tilted in one minute (S12: No), the data calculation unit 255 adds up the acquired shoulder tilt angle (S13). The data calculation unit 255 returns to the process of S11. If one minute has passed since the data calculation unit 255 started calculating the angle of the shoulder 51 tilted in one minute (S12: Yes), the data calculation unit 255 outputs the sum of the calculated angles to the posture data correction unit 252 (S14).

[0050] S13 may be performed before the determination step of S12. In this case, if one minute has not elapsed since the calculation of the amount of shoulder tilt 51 in one minute was started, the operation proceeds to S11.

[0051] The posture data correction unit 252 selects a table of a corresponding pattern from the amount of movement received from the data calculation unit 255. In the example shown in Fig. 10, the posture data correction unit 252 selects a table of a pattern according to the amount of movement received from three pattern tables p1, p2, and p3.

[0052] In this example, when the amount of movement is less than threshold th1 (e.g., 30°), posture data correcting unit 252 selects table p1 of pattern 1. When the amount of movement is equal to or greater than threshold th1 and less than threshold th2 (e.g., 120°), posture data correcting unit 252 selects table p2 of pattern 2. When the amount of movement is equal to or greater than threshold th2, posture data correcting unit 252 selects table p3 of pattern 3.

[0053] For example, when the amount of movement is 25°, since it is less than the threshold th1, posture data correction unit 252 selects table p1 of pattern 1. Posture data correction unit 252 corrects the inclination angle of the shoulder to the angle of the head based on table p1 of pattern 1.

[0054] In this way, the shoulder-type speaker 1A of the first modification selects a table with a pattern according to the amount of movement, and obtains the head angle from the selected table. This allows the shoulder-type speaker 1A of the first modification to obtain the head angle using a table more suitable for each user according to individual differences. Therefore, the shoulder-type speaker 1A of the first modification can localize a more accurate sound image.

[0055] Next, an example will be described in which the shoulder-mounted speaker 1A acquires the head angle from a table of patterns corresponding to the number of movements of the shoulder 51 (number of times the shoulder is tilted) per unit time.

[0056] For example, the number of times shoulder 51 moves per unit time (e.g., in one minute) differs from person to person. Even if the shoulder inclination angle is the same, a person who moves shoulder 51 few times in one minute and a person who moves shoulder 51 many times in one minute will have a different head angle corresponding to the shoulder inclination angle. For example, a person who moves many times will have a larger head angle relative to the shoulder inclination angle than a person who moves few times. Therefore, shoulder-mounted speaker 1A calculates the total number of times shoulder 51 moves in one minute (hereinafter, number of movements per minute). Shoulder-mounted speaker 1A uses a table with a pattern corresponding to the number of movements per minute to correct the inclination angle of shoulder 51 to the angle of head.

[0057] The data calculation unit 255 calculates the number of times shoulder 51 moves per minute based on the data received from the posture data detection unit 251. For example, when the data calculation unit 255 acquires from the posture data detection unit 251 the shoulder tilt angle that the user moves five times to the right and six times to the left per minute, the data calculation unit 255 determines that the number of times shoulder 51 moves per minute is 11. The data calculation unit 255 outputs the calculated number of times movement per minute to the posture data correction unit 252.

[0058] Posture data correction unit 252 selects a table of a pattern corresponding to the number of times of movement per minute. Also, posture data correction unit 252 corrects the angle of the shoulder (for example, the angle of the shoulder shown in FIG. 5) and the angle of the head calculated by posture data detection unit 251 based on the table of a pattern corresponding to the number of times of movement per minute.

[0059] Here, it is assumed that each table is classified according to the number of movements per minute. That is, each of tables p1, p2, and p3 is classified according to the number of movements per minute. For example, table p1 is classified according to the number of movements per minute being less than 5 times. Table p2 is classified according to the number of movements per minute being 5 times or more and less than 10 times. Table p3 is classified according to the number of movements per minute being 10 times or more.

[0060] When the number of movements per minute is less than threshold th1 (e.g., 5 times), posture data correction unit 252 selects table p1 of pattern 1. When the number of movements per minute is equal to or greater than threshold th1 and less than threshold th2 (e.g., 10 times), posture data correction unit 252 selects table p2 of pattern 2. When the number of movements per minute is equal to or greater than threshold th2, posture data correction unit 252 selects table p3 of pattern 3.

[0061] In this way, the shoulder-mounted speaker 1A of the first modification may select a table with a pattern according to the number of movements per minute, and obtain the head angle from the selected table. In this case, the shoulder-mounted speaker 1A of the first modification also obtains the head angle using a table more suitable for each user according to individual differences. Therefore, the shoulder-mounted speaker 1A of the first modification can localize a sound image more accurately.

[0062] In the first modification, the unit time is described as one minute, but the unit time may be longer or shorter than one minute. The tables may be classified by both the amount of movement and the number of movements. In this case, the shoulder-mounted speaker 1A calculates both the amount of movement and the number of movements, and selects a table of the corresponding pattern.

[0063] Moreover, the shoulder-mounted speaker 1A of the first modification may obtain the head angle using a table of a pattern according to the genre of the content. Even for the same user, the head angle relative to the shoulder inclination angle differs depending on the genre of each content such as games, TV images (including DVDs), or music. In this way, even for the same shoulder inclination angle, the head angle differs depending on the genre of the content the user is viewing. For example, the head angle relative to the shoulder inclination angle is larger for noisy music such as rock than for quiet music such as classical music. In such a case, the shoulder-mounted speaker 1A of the first modification can perform more accurate sound image localization processing by selecting an appropriate table according to the genre of the content. Note that information indicating the genre of the content is obtained from, for example, a smartphone. In this case, the shoulder-mounted speaker 1A of the first modification receives information from the smartphone via the communication unit 21.

[0064] [Variation 2] The shoulder-mounted speaker 1B of the second modification will be described with reference to Figs. 13, 14, 15 and 16. Fig. 13 is a block diagram showing the configuration of the shoulder-mounted speaker 1B of the second modification. Fig. 14 is tables ta1, ta2 and ta3 showing the relationship between the shoulder tilt angle and the head angle in three axial directions (vertical axis (yaw axis), front-rear axis (roll axis) and left-right axis (pitch axis)). Fig. 15 is a front view of the shoulder-mounted speaker 1B as seen from in front of the user, showing changes in the user's state. Fig. 16 is a side view of the shoulder-mounted speaker 1B as seen from the left side of the user, showing changes in the user's state.

[0065] The shoulder-mounted speaker 1B of the second modification is different from the above-mentioned example in that the shoulder tilt angle is corrected to the head angle according to the movement in three axial directions (vertical axis, front-rear axis, and left-right axis). Note that the same components as those in the above-mentioned embodiment are given the same reference numerals and the description will be omitted.

[0066] The shoulder-mounted speaker 1B of the second modification includes a three-axis angular velocity sensor 41, as shown in FIG. 13. The three-axis angular velocity sensor 41 detects the angular velocity of the inclination of the shoulder 51 in the horizontal direction c1 with the vertical direction as the axis (vertical axis). The posture data detection unit 251 calculates the inclination angle a1 (see FIG. 5) of the shoulder when inclined in the direction indicated by the two-dot chain line d1 from the right direction in FIG. 5, based on the angular velocity detected by the three-axis angular velocity sensor 41. The three-axis angular velocity sensor 41 detects the angular velocity of the inclination of the shoulder 51 in the rotation direction c2 with the front-rear direction (direction y1) as the axis (front-rear axis), as shown in FIG. The posture data detection unit 251 calculates the inclination angle ay1 of the shoulder when inclined in the direction indicated by the two-dot chain line d2 from the right direction in FIG. 15, based on the angular velocity detected by the three-axis angular velocity sensor 41. The triaxial angular velocity sensor 41 detects the angular velocity of the inclination of the shoulder 51 in a rotation direction c3 about the left-right direction (direction x1) as an axis (left-right axis) as shown in Fig. 16. The posture data detection unit 251 calculates the inclination angle ax1 of the shoulder inclined from the forward direction in the direction indicated by the two-dot chain line d3, based on the angular velocity detected by the triaxial angular velocity sensor 41.

[0067] Incidentally, the inclination angle a1 of the shoulder in the horizontal direction c1 has been explained in the above embodiment, and therefore a detailed explanation thereof will be omitted here.

[0068] The flash memory 22 stores a table ta1 corresponding to the shoulder inclination angle a1 (see FIG. 5) of the shoulder inclination about the vertical axis (horizontal direction c1), a table ta2 corresponding to the shoulder inclination angle ay1 (see FIG. 15) of the shoulder 51 inclining about the front-to-back axis, and a table ta3 corresponding to the shoulder inclination angle ax1 (see FIG. 16) of the shoulder 51 inclining about the left-right axis.

[0069] Tables ta2 and ta3 are generated by averaging a large amount of measurement data, similar to table ta1. Tables ta2 and ta3 may be generated using a machine learning algorithm such as a neural network.

[0070] The attitude data detection unit 251 outputs the calculation result to the attitude data correction unit 252 .

[0071] When the posture data correction unit 252 receives the shoulder tilt angle a1, it obtains the head angle from the table ta1 corresponding to the shoulder tilt angle a1. When the posture data correction unit 252 receives the shoulder tilt angle ay1, it obtains the head angle from the table ta2 corresponding to the shoulder tilt angle ay1. When the posture data correction unit 252 receives the shoulder tilt angle ax1, it obtains the head angle from the table ta3 corresponding to the shoulder tilt angle ax1.

[0072] The head-related transfer function acquisition unit 253 reads out head-related transfer functions corresponding to the angles of the head on the vertical axis, the front-rear axis, and the left-right axis, and outputs them to the sound image localization processing unit 254. Alternatively, the head-related transfer function acquisition unit 253 calculates head-related transfer functions corresponding to the angles of the head on the vertical axis, the front-rear axis, and the left-right axis, and outputs them to the sound image localization processing unit 254.

[0073] The shoulder-mounted speaker 1B of the second modification can obtain the inclination of the shoulder 51 in three axial directions from the three-axis angular velocity sensor 41, thereby localizing a more three-dimensional and more accurate sound image.

[0074] The description of the present embodiment should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiments. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope of the claims.

[0075] The shoulder-mounted speaker may include a three-axis acceleration sensor instead of the sensor 4 or the three-axis angular velocity sensor 41. The shoulder-mounted speaker may also determine the rotation angle of each axis based on the acceleration detected by the three-axis acceleration sensor. The shoulder-mounted speaker may also include both the angular velocity sensor and the three-axis acceleration sensor. In this case, the shoulder-mounted speaker can localize the sound image with higher accuracy by correcting the rotation angle calculated based on the detection value of the angular velocity sensor with the detection value of the three-axis acceleration sensor.

[0076] The shoulder-mounted speaker does not need to use a table to correct the shoulder tilt angle to the head angle. The posture data correction unit 252 may correct the shoulder tilt angle to the head angle based on a function that indicates the relationship between the shoulder tilt angle and the head angle. Since the shoulder-mounted speaker calculates the head angle using a function, it is possible to improve the detection accuracy of the head angle.

[0077] The multiple patterns described in the first modification do not have to be associated with at least one parameter of the amount of movement (speed) per unit time or the number of movements.

[0078] The shoulder-mounted speaker 1A of the first modification may be provided with, for example, a user interface that accepts user operations, and may be configured to accept operations from the user. In this case, the shoulder-mounted speaker 1A has a display unit that displays a plurality of patterns. The display unit displays a pattern A for people who move a lot and a pattern B for people who move little. The shoulder-mounted speaker 1A corrects the inclination angle of the shoulder to the angle of the head based on a table of the pattern selected by the user. This allows the shoulder-mounted speaker 1A to localize a sound image to the user's preference.

[0079] The shoulder-mounted speaker 1A may be configured to select a pattern based on information input by the user, such as gender and age. For example, the shoulder-mounted speaker 1A prepares a pattern A for people under 20 years old, a pattern B for people between 20 and 40 years old, and a pattern C for people over 40 years old. In this case, if the input information is a male under 20 years old, the shoulder-mounted speaker 1A selects the table of pattern A. If the input information is a male between 20 and 40 years old, the shoulder-mounted speaker 1A selects the table of pattern B.

[0080] Furthermore, the processing related to the sound image localization may be performed by a mobile terminal that transmits the audio signal. In this case, the shoulder-mounted speaker transmits the detection signal of the sensor to the mobile terminal via the communication unit 21, and the mobile terminal receives the stereo audio signal that has been subjected to the sound image localization processing. [Explanation of symbols]

[0081] 1, 1A, 1B...Shoulder-mounted speaker 41...3-axis angular rate sensor 51…Shoulder (part) 53...Head 251... Posture data detection unit 252...Attitude data correction unit 254…Sound image localization processing section c1…Horizontal direction ta1, ta2, ta3...tables p1, p2, p3...table (table of patterns) z1: Vertical direction

Claims

1. a posture data detection unit that detects a posture of a part on which the shoulder-mounted speaker is placed and acquires part posture data that digitizes the posture of the part; a posture data correction unit that corrects the acquired part posture data into head posture data; a sound image localization processing unit that performs sound image localization processing on a sound signal using a head related transfer function corresponding to the head posture data corrected by the posture data correction unit, A shoulder-mounted speaker, the posture data correction unit corrects the part posture data to the head posture data based on a table indicating a relationship between the part posture data and the head posture data; The table is classified into a plurality of patterns, the posture data correction unit accepts selection of any one of the plurality of patterns, and corrects the part posture data to the head posture data based on a table of the accepted pattern. Shoulder mounted speaker.

2. a data calculation unit that calculates at least one parameter of a user's movement amount per unit time or a number of movements per unit time from the part posture data acquired by the posture data detection unit, The plurality of patterns are each associated with the parameter, the posture data correction unit corrects the part posture data to the head posture data based on a table of patterns corresponding to the calculated parameters.

2. The shoulder-mounted speaker according to claim 1.

3. The posture data correction unit corrects the angle of the part in a horizontal direction around a vertical axis to an angle of the head.

3. The shoulder-mounted speaker according to claim 1 or 2.

4. the posture data detection unit detects the posture of the part from at least one of a three-axis angular velocity sensor or a three-axis acceleration sensor; 4. A shoulder-mounted speaker according to claim 1.

5. Detect the posture of the part of the body on which the shoulder-mounted speaker is placed, Acquire part posture data which digitizes the posture of the part; The acquired part posture data is corrected to head posture data; performing sound image localization processing on the sound signal using a head related transfer function corresponding to the corrected head posture data; A sound image localization method, comprising: correcting the part posture data to the head posture data based on a table showing a relationship between the part posture data and the head posture data; The table is classified into a plurality of patterns, Accepting a selection of one of the plurality of patterns; correcting the part posture data to the head posture data based on a table of the received pattern; Sound image localization method.

6. Calculating at least one parameter of a user's movement amount per unit time or a number of movements per unit time from the acquired part posture data; The plurality of patterns are each associated with the parameter, correcting the part posture data to the head posture data based on a table of patterns corresponding to the calculated parameters; The sound image localization method according to claim 5.

7. The angle of the part in the horizontal direction with the vertical direction as an axis is corrected to the angle of the head.

7. The sound image localization method according to claim 5 or 6.

8. Detecting the posture of the part using a three-axis acceleration sensor and a three-axis angular velocity sensor.

8. The sound image localization method according to claim 5.

9. A sound image localization program executed by a computer, Detect the posture of the part of the body on which the shoulder-mounted speaker is placed, Acquire part posture data which digitizes the posture of the part; The acquired part posture data is corrected to head posture data; performing sound image localization processing on the sound signal using a head related transfer function corresponding to the corrected head posture data; A sound image localization program, correcting the part posture data to the head posture data based on a table showing a relationship between the part posture data and the head posture data; The table is classified into a plurality of patterns, Accepting a selection of one of the plurality of patterns; correcting the part posture data to the head posture data based on a table of the received pattern; Sound image localization program.

Images