Voice processing device

Abstract

To make a correction for localizing sound at an appropriate position even when a portable terminal device is used.SOLUTION: In a receiver unit (20), a control unit (22) detects a position of a tablet terminal (10) having a display unit (11) on which information about content is displayed, and a correction unit (23) corrects sound related to the content output from a loudspeaker disposed in a predetermined space, on the basis of the detected position of the tablet terminal (10).SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an audio processing apparatus that performs predetermined processing on audio related to content output from a speaker arranged in a predetermined space.

Background Art

[0002] For example, in a vehicle, in order to localize sound such as music for a passenger sitting on a seat such as a driver's seat, a function of adjusting the delay etc. of each speaker installed in the vehicle is known as time alignment etc. (see Patent Document 1).

[0003] When performing such time alignment, it is desirable to detect the presence or absence of a passenger and localize the sound near the seat where the passenger is sitting. As a method for detecting a passenger at this time, it is known to detect by a camera (see Patent Documents 2 and 3).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the case of a method for detecting an occupant using a camera, complex processing such as image recognition is required. Also, the detection of the occupant may be inaccurate depending on the accuracy of the processing. In recent years, the use of portable terminal devices such as tablet terminals and smartphones to view content and the like has been increasing. When localizing sound for a user (viewer) of such a portable terminal device, since the portable terminal device can move freely inside the vehicle, simply detecting the occupant cannot distinguish the user of the terminal from other occupants and localize the sound to a desired location.

[0006] An example of the problem to be solved by the present invention is to perform correction such as localizing sound to an appropriate position even when a portable terminal device is being used.

Means for Solving the Problem

[0007] In order to solve the above problems, the invention according to claim 1 includes an orientation detection unit that detects the orientation of a display screen of a portable terminal device on which information regarding content is displayed, and a correction unit that corrects the audio regarding the content output from a plurality of speakers arranged in a predetermined space. The correction unit selects, from the plurality of speakers, a speaker that outputs the left audio and a speaker that outputs the right audio among the audio regarding the content based on the detected orientation of the display screen.

[0008] The invention according to claim 6 is an audio processing method executed by an audio processing device that performs predetermined processing on the audio regarding content output from a plurality of speakers arranged in a predetermined space. The method includes an orientation detection step of detecting the orientation of a display screen of a portable terminal device on which information regarding the content is displayed, and a correction step of correcting the audio regarding the content output from the speakers. The correction step selects, from the plurality of speakers, a speaker that outputs the left audio and a speaker that outputs the right audio among the audio regarding the content based on the detected orientation of the display screen.

[0009] The invention according to claim 7 is characterized in that a computer executes the voice processing method according to claim 6.

[0010] The invention according to claim 8 is characterized in that it stores the voice processing program according to claim 7.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0012] Hereinafter, a voice processing device according to an embodiment of the present invention will be described. The voice processing device according to an embodiment of the present invention detects the position of a portable terminal device having a display screen on which information related to content is displayed by a position detection unit, and a correction unit corrects the voice related to the content output from a speaker arranged in a predetermined space based on the detected position of the portable terminal device. By doing so, since the voice output from the speaker can be corrected based on the position of the portable terminal device, corrections such as localizing the sound at an appropriate position can be made even when the portable terminal device is being used.

[0013] Further, it may include an orientation detection unit that detects the orientation of the display screen, and the correction unit may perform correction based on the position of the mobile terminal device and the orientation of the display screen. By doing so, the orientation of the display screen can also be considered. Therefore, it becomes possible to estimate where the user is with respect to the mobile terminal device, and more appropriate correction can be performed.

[0014] Further, the correction unit may set a speaker that outputs at least the audio of the left channel and the right channel among the audio related to the content based on the orientation of the display screen. By doing so, for example, when the orientation of the display screen is reversed, the left and right audio can be swapped. Therefore, it becomes possible to view the content with audio without discomfort.

[0015] Further, it may include an inclination acquisition unit that acquires the inclination of the mobile terminal device with respect to the floor surface, and the correction unit may perform correction based on the position of the mobile terminal device, the orientation of the display screen, and the inclination with respect to the floor surface. By doing so, it is possible to determine whether the mobile terminal device is fixed to a mounting member or the like, or held in the hand, and perform correction such as determining the sound localization position.

[0016] Further, the orientation detection unit may respectively acquire detection results from a first geomagnetic sensor provided in the mobile terminal device and a second geomagnetic sensor provided separately from the first geomagnetic sensor, and detect the orientation of the display screen based on the detection results of the first geomagnetic sensor and the second geomagnetic sensor. By doing so, based on the second geomagnetic sensor, the orientation of the display screen of the mobile terminal device can be specified from the orientation of the first geomagnetic sensor. Therefore, even for a moving body such as a vehicle, the orientation of the display screen can be specified using the geomagnetic sensor.

[0017] Further, the speaker may be provided in the vehicle interior of the vehicle. By doing so, correction such as sound localization of the speaker provided in the vehicle interior can be performed.

[0018] Also, in a voice processing method according to an embodiment of the present invention, in a position detection step, the position of a mobile terminal device having a display screen on which information regarding content is displayed is detected, and in a correction step, based on the detected position of the mobile terminal device, the voice regarding the content output from a speaker arranged in a predetermined space is corrected. By doing so, since the voice output from the speaker can be corrected based on the position of the mobile terminal device, even when the mobile terminal device is being used, corrections such as localizing the sound at an appropriate position can be made.

[0019] Also, the above-described voice processing method is executed by a computer. By doing so, since the voice output from the speaker can be corrected based on the position of the mobile terminal device using a computer, even when the mobile terminal device is being used, corrections such as localizing the sound at an appropriate position can be made.

[0020] Also, the above-described voice processing program may be stored in a computer-readable storage medium. By doing so, in addition to incorporating the program into a device, it can also be distributed as a single unit, and version updates and the like can be easily performed.

Example

[0021] A voice processing device according to an embodiment of the present invention will be described with reference to FIGS. 1 to 7. FIG. 1 shows an external perspective view of a device provided with the voice processing device according to this embodiment. The device shown in FIG. 1 includes a tablet terminal 10 and a receiver unit 20.

[0022] The tablet terminal 10 is a well-known flat computer and is a mobile terminal device. The tablet terminal 10 is detachable from the receiver unit 20. In this embodiment, the tablet terminal 10 is described as the mobile terminal device, but other portable terminal devices such as smartphones may also be used.

[0023] By communicating with the receiver unit 20, the tablet terminal 10 can output the audio of the content played by itself, etc. from the speakers installed in a predetermined space such as inside the vehicle cabin. The audio of the content in this embodiment includes not only videos, music, etc., but also all sounds output by the tablet terminal 10, such as warning sounds emitted from the OS (Operating System), apps, etc.

[0024] The receiver unit 20 is installed, for example, inside a moving body such as a vehicle, and fixes the tablet terminal 10 when the tablet terminal 10 is mounted. The receiver unit 20 is installed, for example, on the instrument panel inside the vehicle cabin if it is a vehicle. The receiver unit 20 may be further configured to be able to charge the tablet terminal 10 by wire, wirelessly, or by an electrical contact with the terminal.

[0025] Fig. 2 shows the functional configuration of the tablet terminal 10. The tablet terminal 10 includes a display unit 11, a geomagnetic sensor 12, a gyro sensor 13, a control unit 14, a wireless communication unit 15, and a storage unit 16.

[0026] The display unit 11 is composed of, for example, a liquid crystal display, etc., and information related to content such as video content, icons indicating apps, or operation screens of apps is displayed. That is, the display unit 11 functions as a display screen on which information related to content is displayed. Further, a touch panel is overlaid on the liquid crystal display constituting the display unit 11, and the tablet terminal 10 is operated by a touch operation.

[0027] The geomagnetic sensor 12 is a well-known sensor that detects geomagnetism. The geomagnetic sensor 12 may use any method such as a Hall sensor, an MR (Magneto Resistance) sensor, an MI (Magneto Impedance) sensor, etc., and is not particularly limited.

[0028] The gyro sensor 13 is a well-known sensor that detects angular velocity. The gyro sensor 13 may use a well-known sensor such as a vibrating type or an optical type, and is not particularly limited.

[0029] The control unit 14 is composed of, for example, a CPU (Central Processing Unit) or the like, and is in charge of the overall control of the tablet terminal 10. The control unit 14 causes the display unit 11 to display, for example, the content stored in the storage unit 16 or the content acquired from the wireless communication unit 15, and executes processing corresponding to the operations made on the touch panel of the display unit 11. Further, the control unit 14 causes the wireless communication unit 15 to transmit the detection results of the geomagnetic sensor 12 and the gyro sensor 13 to the receiver unit 20.

[0030] The wireless communication unit 15 includes an antenna for wireless communication, a communication circuit, and the like. In this embodiment, the wireless communication unit 15 performs wireless communication with the receiver unit 20 via Bluetooth (registered trademark). The wireless communication unit 15 transmits the detection results of the geomagnetic sensor 12 and the gyro sensor 13 to the receiver unit 20. Further, the wireless communication unit 15 outputs a reference signal such as a predetermined packet in order to detect the distance and direction (angle) from the receiver unit 20 to itself. The measurement of the distance and direction by this reference signal is known as a direction detection function of Bluetooth (registered trademark) 5.1. Note that the wireless communication unit 15 may also be able to communicate with an external network (public line or the like) other than the receiver unit 20.

[0031] The storage unit 16 is composed of a storage device such as an SSD (Solid State Drive), and stores information such as the OS, applications, and content that operate on the tablet terminal 10.

[0032] Fig. 3 shows the functional configuration of the receiver unit 20. The receiver unit 20 includes a wireless communication unit 21, a control unit 22, a correction unit 23, an amplifier 24, and a geomagnetic sensor 25.

[0033] The wireless communication unit 21 includes an antenna for wireless communication, a communication circuit, and the like. In this embodiment, the wireless communication unit 21 performs wireless communication with the tablet terminal 10 via Bluetooth (registered trademark). The wireless communication unit 21 receives the detection results of the geomagnetic sensor 12 and the gyro sensor 13 from the receiver unit 20. Further, the wireless communication unit 21 receives the reference signal transmitted from the tablet terminal 10 and detects the distance and direction (angle) from the tablet terminal 10.

[0034] The control unit 22 is composed of, for example, a CPU or the like and is in charge of the overall control of the receiver unit 20. Further, the control unit 22 estimates the position of the tablet terminal 10 based on the distance and direction from the tablet terminal 10, and further, based on the estimated position, the detection results of the geomagnetic sensor 12, the gyro sensor 13, and the detection result of the geomagnetic sensor 25, determines the position for localization when outputting the audio related to the content being played back or the like on the tablet terminal 10 from a plurality of speakers in the vehicle.

[0035] The correction unit 23 is composed of, for example, a DSP (Digital Signal Processor) or the like, and corrects the delay time and the like of the audio signal supplied to each speaker so as to localize at the position determined by the control unit 22. That is, the correction unit 23 corrects the audio related to the content output from the speakers arranged in a predetermined space based on the detected position of the tablet terminal 10 (portable terminal device). As the correction method, well-known techniques such as time alignment described in the prior art may be used.

[0036] The amplifier 24 amplifies the audio signal output from the correction unit 23 and outputs it from the speaker 26 installed in the vehicle.

[0037] The magnetic sensor 25 is a well-known sensor that detects geomagnetism in the same manner as the geomagnetic sensor 12. The magnetic sensor 25 detects the azimuth that serves as a reference when detecting the orientation of the display unit 11 described above.

[0038] Note that in the configuration of FIG. 3, the correction unit 23 and the amplifier 24 are included in the receiver unit 20, but they may be configured separately.

[0039] Next, with reference to FIGS. 4 and 5, the operations (voice processing methods) of the tablet terminal 10 and the receiver unit 20 having the above-described configuration will be described. FIG. 4 is a flowchart of the operation of the tablet terminal 10. Note that by using the flowcharts shown in FIGS. 4 and 5 as programs executed by a computer, a voice processing program for executing a voice processing method can be obtained. Further, this voice processing program is not limited to being stored in a memory or the like included in the receiver unit 20 or the like, and may be stored in a storage medium such as a memory card or an optical disk.

[0040] First, the direction is detected by the geomagnetic sensor 12 (step S11). Then, the angular velocity is detected by the gyro sensor 13 (step S12).

[0041] Next, the wireless communication unit 15 generates a reference signal such as a predetermined packet in order to detect the distance and direction (angle) from the receiver unit 20 to itself (step S13).

[0042] Then, the direction, angular velocity, and reference signal acquired and generated in steps S11 to S13 are transmitted to the receiver unit 20 (step S14).

[0043] FIG. 5 is a flowchart of the operation of the receiver unit 20. First, the wireless communication unit 21 receives the direction, angular velocity, and reference signal transmitted from the tablet terminal 10 (step S21). In this step, based on the received direction, the control unit 22 detects the orientation of the display unit 11 by a method described later. Also, based on the received angular velocity, the inclination value of the tablet terminal 10 with respect to the floor surface (ground) is detected. Note that in this embodiment, the inclination value is detected by the tablet terminal 10, but it may be detected by the receiver unit 20 and transmitted.

[0044] Next, the control unit 22 detects the position of the tablet terminal 10 based on the received reference signal (step S22). The detection of the position of the tablet terminal 10 is performed based on the direction detection function of Bluetooth (registered trademark) as described above. Next, the control unit 22 acquires the received azimuth and angular velocity (step S23).

[0045] Next, the correction unit 23 estimates the position of the user of the tablet terminal 10 based on the position acquired and detected in steps S22 to S23, the orientation of the display unit 11, and the inclination of the tablet terminal 10, and performs sound field correction on the audio signal of the content so that the sound is localized at the estimated position (step S24). That is, the correction unit 23 performs correction based on the position of the tablet terminal 10 (portable terminal device), the orientation of the display unit 11, and the inclination with respect to the floor surface. Examples of the content of the sound field correction include the time alignment described above, the right channel / left channel setting, etc., but equalization for optimizing the frequency characteristics at the position may also be performed.

[0046] Here, a method for specifying the orientation of the display unit 11 of the tablet terminal 10 during the position estimation in step S24 will be described with reference to FIG. 6. FIG. 6(a) shows the case where the orientation of the receiver unit 20 and the display unit 11 of the tablet terminal 10 is in the same direction, and FIG. 6(b) shows the case where the orientation of the receiver unit 20 and the display unit 11 of the tablet terminal 10 is in the opposite direction. In FIG. 6, it is assumed that the azimuth detected by the geomagnetic sensor 25 of the receiver unit 20 indicates the direction of arrow A1 (set as the reference 0°). At this time, when the azimuth detected by the geomagnetic sensor 12 of the tablet terminal 10 indicates the direction of arrow A2 (reference 0°) (FIG. 6(a)), since the azimuths detected by the two geomagnetic sensors are the same, it is estimated that the user U of the tablet terminal 10 is at the position shown in FIG. 6(a).

[0047] On the other hand, when the orientation detected by the geomagnetic sensor 12 of the tablet terminal 10 indicates the direction of arrow A3 (from the reference 0° to 200°) (Fig. 6(b)), since the orientations detected by the two geomagnetic sensors are substantially opposite, the user U of the tablet terminal 10 is estimated to be at the position shown in Fig. 6(b). That is, it can be estimated that the display unit 11 is substantially opposite to that in Fig. 6(a).

[0048] In this embodiment, taking the detection orientation of the geomagnetic sensor 25 of the receiver unit 20 as the reference 0°, when the orientation detected by the tablet terminal 10 is -90° to +90° with respect to the reference 0°, it is determined to be the same direction (the state of Fig. 6(a)), and when it is +90° to +270°, it is determined to be the opposite direction (the state of Fig. 6(b)). That is, the control unit 22 (orientation detection unit) acquires the detection results from the geomagnetic sensor 12 (first geomagnetic sensor) provided in the tablet terminal 10 (portable terminal device) and the geomagnetic sensor 25 (second geomagnetic sensor) provided separately from the geomagnetic sensor 12 (first geomagnetic sensor), and detects the orientation of the display unit 11 based on the detection results of the geomagnetic sensor 12 (first geomagnetic sensor) and the geomagnetic sensor 25 (second geomagnetic sensor).

[0049] Returning to the description of Fig. 5. The audio signal corrected in the sound field in step S24 is digitally / analog-converted (DA conversion) by the correction unit 23 (step S25), amplified by the amplifier 24 (step S26), and output from the speaker 26 (step S27).

[0050] As is clear from the above description, step S22 functions as a position detection step, and step S24 functions as a correction step.

[0051] Here, an example of the position for localizing the audio of the content displayed on the tablet terminal 10 by the operations described with reference to FIGS. 4 and 5 will be described with reference to FIG. 7. FIG. 7 is a diagram schematically showing the passenger compartment of a vehicle. In FIG. 7, a driver's seat S1, a passenger seat S2, and rear seats S3 and S4 are provided in the passenger compartment. And the receiver unit 20 is installed on the instrument panel in front of the middle of the driver's seat S1 and the passenger seat S2. Also, front speakers 26a and 26b and rear speakers 26c and 26d are installed in the passenger compartment. Here, the front side and the rear side are described in association with the front and the rear of the vehicle for convenience.

[0052] FIG. 7(a) shows a state where the user U is seated in the driver's seat S1 and the tablet terminal 10 is attached to the receiver unit 20. In this case, the audio of the right channel is output from the speakers 26a and 26c, and the audio of the left channel is output from the speakers 26b and 26d. When the audio is in 4 channels, the audio corresponding to the rear audio channels is output from the speakers 26c and 26d. And the tablet terminal 10 is detected at substantially the same position as the receiver unit 20, and both the tablet terminal 10 and the receiver unit 20 are detected in the same orientation. Therefore, in this case, correction is made so that the audio image is localized at the driver's seat S1. Note that correction may be made so that the audio image is localized in the middle between the driver's seat S1 and the passenger seat S2 instead of the driver's seat S1. That is, based on the detected position, it may be localized at a predetermined position, and it is not necessary to localize it near the tablet terminal 10.

[0053] FIG. 7(b) shows a state where the user U is seated in the rear seat S4 and the tablet terminal 10 is fixed to an attachment member or the like provided on the seat back of the passenger seat S2. In this case, the position of the tablet terminal 10 is detected as the seat back of the passenger seat S2, and both the tablet terminal 10 and the receiver unit 20 are detected in the same orientation. Therefore, in this case, correction is made so that the audio image is localized at the rear seat S4.

[0054] FIG. 7(c) shows a state where the user U1 is seated in the rear seat S4, the user U2 is seated in the rear seat S3, and the tablet terminal 10 is fixed to a mounting member or the like provided on the ceiling or the like in front of the middle of the rear seats S3 and S4. In this case, the position of the tablet terminal 10 is detected to be in front of the middle of the rear seats S3 and S4, and both the tablet terminal 10 and the receiver unit 20 are detected to be in the same orientation. Therefore, in this case, correction is made so that the sound image is localized in the middle of the rear seats S3 and S4.

[0055] FIG. 7(d) shows a state where the position of the user U is the same as in FIG. 7(b), and the tablet terminal 10 is held by the user U. In this case, the position of the tablet terminal 10 is detected to be the passenger seat S2, and both the tablet terminal 10 and the receiver unit 20 are detected to be in the same orientation. Further, different from FIGS. 7(a) to 7(c), from the inclination of the tablet terminal 10 with respect to the vehicle floor surface detected by the gyro sensor 13, it can be seen that the tablet terminal 10 is in an inclined state, and it can be estimated that the user U is holding it. Therefore, fine adjustment is made so that the localization position is closer to the user U than the localization position in FIG. 7(b) according to this inclination. For example, the vertical direction (up and down direction) is made higher (or lower) according to the inclination.

[0056] FIG. 7(e) assumes, for example, a vehicle for overnight parking, a camper van, an autonomous vehicle with seats rotatable backward, etc. In FIG. 7(e), the user U lies horizontally at an intermediate position between the flattened seats S3 and S4, etc., and the tablet terminal 10 is arranged behind the vehicle, with its orientation being the arrow A5, that is, opposite to the orientations in FIGS. 7(a) to (d). In this case, the position of the tablet terminal 10 is detected as being behind the rear seats S3 and S4, but the orientation of the tablet terminal 10 is detected as being opposite to the orientation of the receiver unit 20. Therefore, in this case, correction is made so that the sound image is localized near the illustrated user U. Further, in FIG. 7(e), the left and right channels of the stereo audio are inverted. That is, the right channel is output from the speakers 26d and 26b, and the left channel is output from the speakers 26c and 26a. In the case of 4 channels, the front audio and the rear audio are also inverted. By doing so, even when the orientation of the display unit 11 is in the opposite direction, appropriate audio can be output accordingly.

[0057] Note that FIG. 7(e) is a case where the orientation of the display unit 11 is in the opposite direction. However, for example, even when it is arranged on the side (side surface) where the speakers 26a and 26c are provided, the present embodiment can also be applied. This is a case where the orientation of the display unit 11 changes by approximately 90° compared to FIGS. 7(a) etc. Even in this case, since at least the position of the tablet terminal 10 and the orientation of the display unit 11 are detected, the position of the user can be estimated based on the position and orientation, and the sound image can be localized. Also, for the audio channels, the speaker 26a is the left front audio channel, the speaker 26c is the right front audio channel, the speaker 26b is the left rear audio channel, and the speaker 26d is the right rear audio channel.

[0058] In the above-described embodiments, the direction of the display unit 11 is detected by the geomagnetic sensor 12 and the geomagnetic sensor 25, and the inclination of the tablet terminal 10 is detected by the gyro sensor 13. However, it may be configured to detect only the position. Alternatively, it may be only the position and the direction. In the case of detecting only the position, it is not possible to cope with the state of FIG. 7(e), but at least in a normal seating state, correction such as sound localization of audio-visual content can be performed. Also, even if it is only the position and the direction, the state of FIG. 7(d) cannot be discriminated. In this case, at least a minimum correction can be made by performing the same correction as in FIG. 7(b). Further, the tablet terminal 10 may detect the state of FIG. 7(a) by detecting a physical connection such as being electrically connected to the receiver unit 20. Furthermore, the state such as FIG. 7(b) may be detected by detecting a physical connection with a mounting member provided on the seat back or the like.

[0059] According to this embodiment, in the receiver unit 20, the control unit 22 detects the position of the tablet terminal 10 having the display unit 11 on which information regarding the content is displayed, and the correction unit 23 corrects the audio regarding the content output from the speaker arranged in a predetermined space based on the detected position of the tablet terminal 10. By doing so, since the audio output from the speaker 26 can be corrected based on the position of the tablet terminal 10, even when the tablet terminal 10 is being used, corrections such as localizing the sound at an appropriate position can be made.

[0060] Also, the control unit 22 detects the direction of the display unit 11, and the correction unit 23 performs correction based on the position of the tablet terminal 10 and the direction of the display unit 11. By doing so, the direction can also be taken into consideration for the display unit 11. Therefore, it is also possible to estimate where the user U is with respect to the tablet terminal 10, and more appropriate correction can be made.

[0061] Further, the correction unit 23 sets the speaker 26 that outputs at least the audio of the right channel and the left channel among the audio related to the content based on the orientation of the display unit 11. By doing so, for example, when the orientation of the display unit 11 is reversed front to back, the left and right audio can be swapped. Therefore, it becomes possible to view the content with audio without discomfort.

[0062] Also, the control unit 22 acquires the inclination of the tablet terminal 10, and the correction unit 23 performs correction based on the position of the tablet terminal 10, the orientation of the display unit 11, and the inclination of the tablet terminal 10. By doing so, it is possible to determine whether the tablet terminal 10 is fixed to a mounting member or the like or held in the hand, and perform correction such as determining the sound localization position.

[0063] Also, the detection results are respectively acquired from the geomagnetic sensor 12 and the geomagnetic sensor 25 provided in the tablet terminal 10, and the orientation of the display unit 11 is detected based on the detection results of the geomagnetic sensor 12 and the geomagnetic sensor 25. By doing so, the orientation of the display unit 11 of the tablet terminal 10 can be specified from the azimuth of the geomagnetic sensor 12 with reference to the geomagnetic sensor 25. Therefore, even in a moving body such as a vehicle, the orientation of the display unit 11 can be specified using the geomagnetic sensor.

[0064] Note that in the above-described embodiment, the receiver unit 20 functions as an audio processing device, but the tablet terminal 10 may function as an audio processing device. Since the Bluetooth (registered trademark) direction detection function can also be implemented on the terminal side, if the tablet terminal 10 acquires the detection information of the geomagnetic sensor 25, it is possible to estimate its own (tablet terminal 10) position and calculate the position for localization. However, in order to reflect the calculation result in the output from the speaker 26, it is necessary to transmit it to in-vehicle equipment (not limited to the receiver unit 20).

[0065] In addition, the position detection of the tablet terminal 10 is not limited to the direction detection function of Bluetooth (registered trademark). For example, if a camera is already installed in the vehicle interior, the tablet terminal 10 may be detected from the camera image by image recognition. Alternatively, GNSS (Global Navigation Satellite System) receivers may be provided in both the tablet terminal 10 and the receiver unit 20, and relative distances, angles, etc. may be detected from the positions (latitude and longitude) detected by both.

[0066] Also, in the above-described embodiment, the position of the portable terminal device such as the tablet terminal 10 is used to localize sound in a predetermined position inside the vehicle. However, the position may be used to, for example, enable better listening to the sound related to the content of the tablet terminal 10 in the rear seat. Techniques for playing different sources in the front seat and the rear seat in the vehicle and enabling good listening in each seat are known from, for example, JP-A-2014-165569. That is, when the position of the tablet terminal 10 is estimated to be in the front, the content being played, etc. on the tablet terminal 10 is used as the source on the front seat side, and when the position of the tablet terminal 10 is estimated to be in the rear, the content being played, etc. on the tablet terminal 10 is used as the source on the rear seat side, and the techniques of the above-mentioned document may be applied.

[0067] Also, in the above-described embodiment, it has been described in the vehicle interior of the vehicle, but it may also be in the interior of a house or the like. Further, processing may be performed so that sound from the vehicle speakers or the indoor speakers is localized with respect to the outdoor tablet terminal 10.

[0068] Also, in the above-described embodiment, the tablet terminal is assumed to play content information, but it is not limited thereto. For example, a configuration in which the receiver includes a TV / radio wave receiving unit and a playback unit for a CD or DVD, etc., and transmits content information by communication is also conceivable. When playback is performed by the receiver, if the content information is video, the video is transmitted to the tablet terminal and the audio is output from the amplifier.

[0069] Furthermore, the present invention is not limited to the above embodiments. That is, those skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the gist of the present invention. As long as the voice processing apparatus of the present invention is still provided even by such modifications, it is of course included in the scope of the present invention.

Explanation of Reference Numerals

[0070] 10 Tablet terminal (portable terminal device) 11 Display unit (display screen) 12 Geomagnetic sensor (first geomagnetic sensor) 20 Receiver unit 21 Wireless communication unit 22 Control unit (position detection unit, orientation detection unit, tilt acquisition unit) 23 Correction unit 24 Amplifier 25 Geomagnetic sensor (second geomagnetic sensor) 26 Speaker

Claims

1. an orientation detection unit that detects an orientation of a display screen of a mobile terminal device having a display screen on which information related to content is displayed; a correction unit that corrects audio related to the content output from a plurality of speakers arranged in a predetermined space, the correction unit selects, from the plurality of speakers, a speaker for outputting a left side sound and a speaker for outputting a right side sound, among sounds related to the content, based on the detected orientation of the display screen.

13. A voice processing device comprising:

2. a position detection unit that detects the position of the mobile terminal device; the correction unit selects, from the plurality of speakers, a speaker for outputting a left side sound and a speaker for outputting a right side sound, among the sounds related to the content, based on the detected orientation of the display screen and the position of the mobile terminal; 2. The audio processing device according to claim 1 .

3. a tilt acquisition unit that acquires a tilt of the mobile terminal device with respect to a floor surface, 3. The audio processing device according to claim 2, wherein the correction unit performs the correction based on a position of the mobile terminal device, a direction of the display screen, and an inclination of the mobile terminal device with respect to a floor surface.

4. The audio processing device described in any one of claims 1 to 3, characterized in that the orientation detection unit acquires detection results from a first geomagnetic sensor provided in the mobile terminal device and a second geomagnetic sensor provided separately from the first geomagnetic sensor, and detects the orientation of the display screen based on the detection results of the first geomagnetic sensor and the second geomagnetic sensor.

5. 5. The audio processing device according to claim 1, wherein the plurality of speakers are provided in a vehicle interior.

6. 1. A sound processing method executed by a sound processing device that performs a predetermined process on sound related to content output from a plurality of speakers arranged in a predetermined space, comprising: an orientation detection step of detecting an orientation of a display screen of a mobile terminal device having a display screen on which information related to the content is displayed; a correction step of correcting the sound related to the content output from the speaker, the correction step includes selecting, from the plurality of speakers, a speaker for outputting a left side sound and a speaker for outputting a right side sound, among sounds related to the content, based on the detected orientation of the display screen.

13. A method for processing audio comprising the steps of:

7. 7. A voice processing program for causing a computer to execute the voice processing method according to claim 6.

8. 8. A computer-readable storage medium storing the voice processing program according to claim 7.

Images