Sound processing device

Abstract

To make a correction for localizing sound at an appropriate position even when a portable terminal device is used.SOLUTION: In a receiver unit (20), a control unit (22) detects a position of a tablet terminal (10) having a display unit (11) on which information about content is displayed, and a correction unit (23) corrects sound related to the content output from a loudspeaker disposed in a predetermined space, on the basis of the detected position of the tablet terminal (10).SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an audio processing device that performs predetermined processing on audio related to content output from a speaker arranged in a predetermined space. [Background technology]

[0002] For example, in a vehicle, the function of adjusting the delay, etc. of each speaker installed in the vehicle in order to localize the sound of music, etc. to the occupants sitting in the driver's seat, etc., is known as time alignment, etc. (see Patent Document 1).

[0003] When performing such time alignment, it is desirable to detect the presence or absence of an occupant and localize the sound near the seat where the occupant is sitting. A known method for detecting an occupant in this case is to use a camera (see Patent Documents 2 and 3). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-54326 A [Patent Document 2] JP 2019-139582 A [Patent Document 3] JP 2018-164144 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the case of a method of detecting occupants using a camera, complex processing such as image recognition is required. Furthermore, detection of occupants may be inaccurate depending on the accuracy of the processing. Furthermore, in recent years, viewing of content using portable terminal devices such as tablet terminals and smartphones has become more common. When localizing sound to a user (viewer) of such a portable terminal device, since the portable terminal device is freely movable within the vehicle, simply detecting the occupant makes it impossible to distinguish between the user of the terminal and other occupants and to localize the sound to a desired location.

[0006] One example of a problem to be solved by the present invention is how to make corrections such as localizing sound at an appropriate position even when a mobile terminal device is being used. [Means for solving the problem]

[0007] In order to solve the above problem, the invention described in claim 1 comprises an orientation detection unit that detects the orientation of a display screen of a mobile terminal device having a display screen on which information related to content is displayed, and a correction unit that corrects audio related to the content output from a plurality of speakers arranged in a predetermined space, and is characterized in that the correction unit selects from the plurality of speakers a speaker that outputs left audio and a speaker that outputs right audio of the audio related to the content based on the detected orientation of the display screen.

[0008] The invention described in claim 6 is an audio processing method executed by an audio processing device that performs a predetermined processing on audio related to content output from a plurality of speakers arranged in a predetermined space, and includes an orientation detection process for detecting the orientation of a display screen of a portable terminal device having a display screen on which information related to the content is displayed, and a correction process for correcting the audio related to the content output from the speakers, wherein the correction process is characterized in that, based on the detected orientation of the display screen, a speaker that outputs left audio and a speaker that outputs right audio of the audio related to the content are selected from the plurality of speakers.

[0009] The invention as recited in claim 7 is characterized in that the audio processing method as recited in claim 6 is executed by a computer.

[0010] The invention as recited in claim 8 is characterized in that the voice processing program as recited in claim 7 is stored. [Brief description of the drawings]

[0011] [Figure 1] 1 is a perspective view of the appearance of a device including a voice processing device according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a block diagram of the tablet terminal shown in FIG. [Diagram 3] FIG. 2 is a block diagram of a receiver section shown in FIG. [Figure 4] 3 is a flowchart of the operation of the tablet terminal shown in FIG. 2. [Diagram 5] 4 is a flowchart of the operation of the receiver unit shown in FIG. 3. [Figure 6] 11 is an explanatory diagram of a method for identifying the orientation of a display unit of a tablet terminal. [Figure 7] 11 is an explanatory diagram of the position at which the sound of content being displayed on a tablet terminal is localized. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an audio processing device according to one embodiment of the present invention will be described. In the audio processing device according to one embodiment of the present invention, a position detection unit detects the position of a mobile terminal device having a display screen on which information related to content is displayed, and a correction unit corrects the audio related to the content output from a speaker arranged in a predetermined space based on the position of the mobile terminal device detected. In this way, the audio output from the speaker can be corrected based on the position of the mobile terminal device, so that correction such as localizing the sound at an appropriate position can be performed even when the mobile terminal device is being used.

[0013] The present invention may further include an orientation detection unit that detects the orientation of the display screen, and the correction unit may perform correction based on the position of the mobile terminal device and the orientation of the display screen. In this way, the orientation of the display screen can also be taken into consideration. Therefore, it is possible to estimate where the user is located relative to the mobile terminal device, and more appropriate correction can be performed.

[0014] The correction unit may also set speakers that output at least the left and right channel sounds of the sound related to the content based on the orientation of the display screen. In this way, for example, when the orientation of the display screen is reversed, the left and right sounds can be switched. Therefore, it becomes possible to watch the content with a natural sound.

[0015] The present invention may further include a tilt acquisition unit that acquires the tilt of the mobile terminal device relative to the floor surface, and the correction unit may perform correction based on the position of the mobile terminal device, the orientation of the display screen, and the tilt relative to the floor surface. In this way, it is possible to determine whether the mobile terminal device is fixed to a mounting member or is being held in the hand, and perform correction such as determining the localization position of the sound.

[0016] The orientation detection unit may obtain detection results from a first geomagnetic sensor provided in the mobile terminal device and a second geomagnetic sensor provided separately from the first geomagnetic sensor, and detect the orientation of the display screen based on the detection results of the first and second geomagnetic sensors. In this way, the orientation of the display screen of the mobile terminal device can be identified from the orientation of the first geomagnetic sensor with the second geomagnetic sensor as a reference. Therefore, even in a moving body such as a vehicle, the orientation of the display screen can be identified using the geomagnetic sensor.

[0017] The speaker may be provided inside the vehicle cabin, which makes it possible to correct the positioning of the sound image of the speaker provided inside the vehicle cabin.

[0018] In addition, in the audio processing method according to one embodiment of the present invention, a position detection step detects the position of a mobile terminal device having a display screen on which information related to content is displayed, and a correction step corrects the audio related to the content output from a speaker arranged in a predetermined space based on the detected position of the mobile terminal device. In this way, the audio output from the speaker can be corrected based on the position of the mobile terminal device, so that corrections such as localizing the sound at an appropriate position can be made even when the mobile terminal device is being used.

[0019] In addition, the above-mentioned audio processing method is executed by a computer. In this way, the audio output from the speaker can be corrected based on the position of the mobile terminal device using the computer, so that even when the mobile terminal device is being used, corrections such as localizing the sound at an appropriate position can be made.

[0020] The above-mentioned voice processing program may be stored in a computer-readable storage medium. In this way, the program can be distributed as a standalone program in addition to being incorporated into a device, and version upgrades can be easily performed. EXAMPLES

[0021] An audio processing device according to an embodiment of the present invention will be described with reference to Fig. 1 to Fig. 7. Fig. 1 shows an external perspective view of a device equipped with an audio processing device according to this embodiment. The device shown in Fig. 1 includes a tablet terminal 10 and a receiver unit 20.

[0022] The tablet terminal 10 is a well-known flat-plate-shaped computer and a mobile terminal device. The tablet terminal 10 is detachable from the receiver unit 20. In this embodiment, the tablet terminal 10 is described as the mobile terminal device, but it may be another mobile terminal device such as a smartphone.

[0023] The tablet terminal 10 can output the sound of the content that it has played back by itself from a speaker installed in a predetermined space such as the inside of a vehicle by communicating with the receiver unit 20. The sound of the content in this embodiment is not limited to video and music, but includes all sounds output by the tablet terminal 10, such as warning sounds issued by the OS (Operating System) and apps.

[0024] The receiver unit 20 is installed, for example, in the interior of a moving object such as a vehicle, and when the tablet terminal 10 is attached, the receiver unit 20 fixes the tablet terminal 10. For example, in the case of a vehicle, the receiver unit 20 is installed on an instrument panel or the like in the interior of the vehicle. The receiver unit 20 may further be configured to be capable of charging the tablet terminal 10 by wire, wirelessly, or through electrical contact with the terminal.

[0025] 2 shows a functional configuration of the tablet terminal 10. The tablet terminal 10 includes a display unit 11, a geomagnetic sensor 12, a gyro sensor 13, a control unit 14, a wireless communication unit 15, and a storage unit 16.

[0026] The display unit 11 is configured, for example, with a liquid crystal display, and displays information related to the content, such as video content, icons representing applications, or an application operation screen. That is, the display unit 11 functions as a display screen that displays information related to the content. In addition, a touch panel is overlaid on the liquid crystal display that configures the display unit 11, and the tablet terminal 10 is operated by touch operations.

[0027] The geomagnetic sensor 12 is a well-known sensor that detects geomagnetism. The geomagnetic sensor 12 may be any type of sensor, such as a Hall sensor, a Magneto Resistance (MR) sensor, or a Magneto Impedance (MI) sensor, and is not particularly limited.

[0028] The gyro sensor 13 is a well-known sensor that detects angular velocity, and is not particularly limited as long as a well-known type of sensor, such as a vibration type or an optical type, is used as the gyro sensor 13.

[0029] The control unit 14 is composed of, for example, a CPU (Central Processing Unit) and is responsible for the overall control of the tablet terminal 10. The control unit 14 displays, for example, content stored in the storage unit 16 and content acquired from the wireless communication unit 15 on the display unit 11, and executes processing corresponding to operations performed on the touch panel of the display unit 11. The control unit 14 also causes the wireless communication unit 15 to transmit the detection results of the geomagnetic sensor 12 and the gyro sensor 13 to the receiver unit 20.

[0030] The wireless communication unit 15 includes an antenna and a communication circuit for wireless communication. In this embodiment, the wireless communication unit 15 wirelessly communicates with the receiver unit 20 by Bluetooth (registered trademark). The wireless communication unit 15 transmits the detection results of the geomagnetic sensor 12 and the gyro sensor 13 to the receiver unit 20. The wireless communication unit 15 also outputs a reference signal such as a predetermined packet to detect the distance and direction (angle) from the receiver unit 20 to the wireless communication unit 15 itself. The measurement of the distance and direction using this reference signal is known as the direction detection function of Bluetooth (registered trademark) 5.1. The wireless communication unit 15 may also be capable of communicating with an external network (such as a public line) other than the receiver unit 20.

[0031] The storage unit 16 is configured with a storage device such as an SSD (Solid State Drive), and stores information about the OS, applications, and content that run on the tablet terminal 10.

[0032] 3 shows the functional configuration of the receiver unit 20. The receiver unit 20 includes a wireless communication unit 21, a control unit 22, a correction unit 23, an amplifier 24, and a geomagnetic sensor 25.

[0033] The wireless communication unit 21 includes an antenna and a communication circuit for wireless communication. In this embodiment, the wireless communication unit 21 performs wireless communication with the tablet terminal 10 via Bluetooth (registered trademark). The wireless communication unit 21 receives detection results of the geomagnetic sensor 12 and the gyro sensor 13 from the receiver unit 20. The wireless communication unit 21 also receives a reference signal transmitted from the tablet terminal 10 to detect the distance and direction (angle) to the tablet terminal 10.

[0034] The control unit 22 is composed of, for example, a CPU, and is responsible for the overall control of the receiver unit 20. The control unit 22 also estimates the position of the tablet terminal 10 based on the distance and direction from the tablet terminal 10, and further determines, based on the estimated position, the detection results of the geomagnetic sensor 12 and the gyro sensor 13, and the detection result of the geomagnetic sensor 25, the position at which the sound related to the content being played on the tablet terminal 10 is to be localized when being output from multiple speakers in the vehicle.

[0035] The correction unit 23 is composed of, for example, a DSP (Digital Signal Processor) and corrects delay times and the like of audio signals supplied to each speaker so that the audio signals are localized at the positions determined by the control unit 22. That is, the correction unit 23 corrects audio related to content output from speakers arranged in a predetermined space based on the detected position of the tablet terminal 10 (mobile terminal device). The correction method may use well-known techniques such as time alignment described in the prior art.

[0036] The amplifier 24 amplifies the audio signal output from the correction unit 23 and outputs the amplified signal from a speaker 26 installed inside the vehicle.

[0037] The magnetic sensor 25 is a well-known sensor that detects geomagnetism, similar to the geomagnetic sensor 12. The geomagnetic sensor 25 detects a direction that is a reference when detecting the orientation of the display unit 11 described above.

[0038] In the configuration of FIG. 3, the correction unit 23 and the amplifier 24 are included in the receiver unit 20, but they may be configured as separate units.

[0039] Next, the operation (audio processing method) of the tablet terminal 10 and the receiver unit 20 configured as described above will be described with reference to Figs. 4 and 5. Fig. 4 is a flowchart of the operation of the tablet terminal 10. Note that by making the flowcharts shown in Figs. 4 and 5 into a program executed by a computer, it is possible to make an audio processing program that executes the audio processing method. Furthermore, this audio processing program is not limited to being stored in a memory or the like possessed by the receiver unit 20 or the like, but may also be stored in a storage medium such as a memory card or an optical disk.

[0040] First, the geomagnetic sensor 12 detects the direction (step S11), and the gyro sensor 13 detects the angular velocity (step S12).

[0041] Next, wireless communication unit 15 generates a reference signal such as a predetermined packet in order to detect the distance and direction (angle) from receiver unit 20 to itself (step S13).

[0042] Then, the azimuth, angular velocity and reference signal acquired and generated in steps S11 to S13 are transmitted to the receiver unit 20 (step S14).

[0043] 5 is a flowchart of the operation of the receiver unit 20. First, the wireless communication unit 21 receives the direction, angular velocity, and reference signal transmitted from the tablet terminal 10 (step S21). In this step, the control unit 22 detects the orientation of the display unit 11 based on the received direction using a method described below. Also, the control unit 22 detects the inclination value of the tablet terminal 10 with respect to the floor surface (ground) based on the received angular velocity. Note that, although the inclination value is detected by the tablet terminal 10 in this embodiment, it may be detected and transmitted by the receiver unit 20.

[0044] Next, the control unit 22 detects the position of the tablet terminal 10 based on the received reference signal (step S22). The detection of the position of the tablet terminal 10 is performed based on the direction detection function of Bluetooth (registered trademark) as described above. Next, the control unit 22 acquires the received orientation and angular velocity (step S23).

[0045] Next, the correction unit 23 estimates the position of the user of the tablet terminal 10 based on the position acquired / detected in steps S22-S23, the orientation of the display unit 11, and the inclination of the tablet terminal 10, and performs sound field correction on the audio signal of the content so that the sound is localized at the estimated position (step S24). That is, the correction unit 23 performs correction based on the position of the tablet terminal 10 (mobile terminal device), the orientation of the display unit 11, and the inclination with respect to the floor surface. The contents of the sound field correction include the above-mentioned time alignment and right channel / left channel settings, but equalization for optimizing the frequency characteristics at the position may also be performed.

[0046] Here, a method for identifying the orientation of the display unit 11 of the tablet terminal 10 when estimating the position in step S24 will be described with reference to Fig. 6. Fig. 6(a) shows a case where the orientations of the receiver unit 20 and the display unit 11 of the tablet terminal 10 are the same, while Fig. 6(a) shows a case where the orientations of the receiver unit 20 and the display unit 11 of the tablet terminal 10 are opposite. In Fig. 6, it is assumed that the orientation detected by the geomagnetic sensor 25 of the receiver unit 20 indicates the direction of the arrow A1 (reference 0°). At this time, if the orientation detected by the geomagnetic sensor 12 of the tablet terminal 10 indicates the direction of the arrow A2 (reference 0°) (Fig. 6(a)), the orientations detected by the two geomagnetic sensors are the same, so it is estimated that the user U of the tablet terminal 10 is at the position shown in Fig. 6(a).

[0047] On the other hand, when the orientation detected by the geomagnetic sensor 12 of the tablet terminal 10 indicates the direction of the arrow A3 (reference 0° to 200°) (FIG. 6(b)), since the orientations detected by the two geomagnetic sensors are substantially opposite, it is estimated that the user U of the tablet terminal 10 is in the position shown in FIG. 6(b). In other words, it can be estimated that the display unit 11 in FIG. 6(b) is facing substantially the opposite direction to that in FIG. 6(a).

[0048] In this embodiment, the detected orientation of the geomagnetic sensor 25 of the receiver unit 20 is set as a reference 0°, and the orientation detected by the tablet terminal 10 may be determined as the same orientation (state of FIG. 6(a)) when it is −90° to +90° with respect to the reference 0°, and as the opposite orientation (state of FIG. 6(b)) when it is +90° to +270°. That is, the control unit 22 (orientation detection unit) acquires detection results from the geomagnetic sensor 12 (first geomagnetic sensor) provided in the tablet terminal 10 (mobile terminal device) and the geomagnetic sensor 25 (second geomagnetic sensor) provided separately from the geomagnetic sensor 12 (first geomagnetic sensor), and detects the orientation of the display unit 11 based on the detection results of the geomagnetic sensor 12 (first geomagnetic sensor) and the geomagnetic sensor 25 (second geomagnetic sensor).

[0049] Returning to the description of Fig. 5, the audio signal that has been sound field corrected in step S24 is digital-to-analog converted (DA converted) by the correction unit 23 (step S25), amplified by the amplifier 24 (step S26), and output from the speaker 26 (step S27).

[0050] As is clear from the above description, step S22 functions as a position detection step, and step S24 functions as a correction step.

[0051] Here, an example of a position where the sound of the content displayed on the tablet terminal 10 is localized by the operation described in FIG. 4 and FIG. 5 will be described with reference to FIG. 7. FIG. 7 is a diagram showing a typical interior of a vehicle. In FIG. 7, a driver's seat S1, a passenger seat S2, and rear seats S3 and S4 are provided in the interior of the vehicle. The receiver unit 20 is installed on the instrument panel in front of and between the driver's seat S1 and the passenger seat S2. Front speakers 26a, 26b and rear speakers 26c, 26d are also installed in the interior of the vehicle. For convenience, the front and rear are described in correspondence with the front and rear of the vehicle.

[0052] FIG. 7(a) shows a state in which a user U sits in the driver's seat S1 and the tablet terminal 10 is attached to the receiver unit 20. In this case, the right channel sound is output from the speakers 26a and 26c, and the left channel sound is output from the speakers 26b and 26d. If the sound is four-channel, the sound corresponding to the rear sound channel is output from the speakers 26c and 26d. The tablet terminal 10 is detected to be in substantially the same position as the receiver unit 20, and both the tablet terminal 10 and the receiver unit 20 are detected to be in the same direction. Therefore, in this case, the sound image is corrected so that it is localized at the driver's seat S1. The sound image may be corrected so that it is localized not at the driver's seat S1 but between the driver's seat S1 and the passenger seat S2. In other words, it is sufficient to localize the sound image at a predetermined position based on the detected position, and it is not necessary to localize the sound image near the tablet terminal 10.

[0053] 7(b) shows a state in which the user U is seated in the rear seat S4 and the tablet terminal 10 is fixed to a mounting member or the like provided on the seat back of the passenger seat S2. In this case, the position of the tablet terminal 10 is detected as the seat back of the passenger seat S2, and both the tablet terminal 10 and the receiver unit 20 are detected as having the same orientation. Therefore, in this case, the sound image is corrected so as to be localized in the rear seat S4.

[0054] 7(c) shows a state in which user U1 is seated in the rear seat S4, user U2 is seated in the rear seat S3, and the tablet terminal 10 is fixed to a mounting member or the like provided on the ceiling or the like in the middle and forward of the rear seats S3 and S4. In this case, the position of the tablet terminal 10 is detected as being in the middle and forward of the rear seats S3 and S4, and both the tablet terminal 10 and the receiver unit 20 are detected as having the same orientation. Therefore, in this case, the sound image is corrected so as to be localized in the middle of the rear seats S3 and S4.

[0055] In FIG. 7(d), the position of the user U is the same as in FIG. 7(b), and the tablet terminal 10 is held by the user U in his / her hand. In this case, the position of the tablet terminal 10 is detected as the passenger seat S2, and both the tablet terminal 10 and the receiver unit 20 are detected as having the same orientation. Furthermore, unlike in FIGS. 7(a) to (c), the inclination of the tablet terminal 10 with respect to the vehicle floor detected by the gyro sensor 13 shows that the tablet terminal 10 is in an inclined state, and it can be estimated that the user U is holding it in his / her hand. Therefore, the localization position is finely adjusted according to this inclination so that it is closer to the user U than the localization position in FIG. 7(b). For example, the vertical direction (top-bottom direction) is made higher (or lower) according to the inclination.

[0056] FIG. 7(e) is an example of a vehicle that is used for sleeping overnight, a camper, or an autonomous vehicle with a seat that can be rotated backward. In FIG. 7(e), the user U lies down in the middle of the flat seat between S3 and S4, and the tablet terminal 10 is placed at the rear of the vehicle, facing the arrow A5, that is, in the opposite direction to that of FIG. 7(a) to (d). In this case, the position of the tablet terminal 10 is detected as being behind the rear seats S3 and S4, but the orientation of the tablet terminal 10 is detected as being in the opposite direction to that of the receiver unit 20. Therefore, in this case, the sound image is corrected so that it is localized in the vicinity of the user U shown in the figure. Furthermore, in FIG. 7(e), the left and right channels of the stereo sound are inverted. That is, the right channel is output from the speakers 26d and 26b, and the left channel is output from the speakers 26c and 26a. In the case of a four-channel system, the front and rear sounds are also inverted. By doing so, even if the display unit 11 is turned in the opposite direction, appropriate sound can be output accordingly.

[0057] FIG. 7(e) shows a case where the display unit 11 faces in the opposite direction, but this embodiment can also accommodate a case where the display unit 11 is arranged on the side (side surface) where the speakers 26a and 26c are provided. This is a case where the orientation of the display unit 11 changes by about 90° from FIG. 7(a) and the like. Even in this case, since at least the position of the tablet terminal 10 and the orientation of the display unit 11 are detected, the position of the user can be estimated based on the position and orientation, and the sound image can be localized. In addition, the sound channels are as follows: speaker 26a is the left front sound channel, speaker 26c is the right front sound channel, speaker 26b is the left rear sound channel, and speaker 26d is the right rear sound channel.

[0058] In the above-mentioned embodiment, the orientation of the display unit 11 is detected by the geomagnetic sensor 12 and the geomagnetic sensor 25, and the inclination of the tablet terminal 10 is detected by the gyro sensor 13. However, only the position may be detected. Alternatively, only the position and the orientation may be detected. In the case of only the position, the state of FIG. 7(e) cannot be handled, but at least the localization of the sound image can be corrected in a normal seated state. In addition, the state of FIG. 7(d) cannot be determined even if only the position and the orientation are used, but in this case, a minimum correction can be made by making the same correction as in FIG. 7(b). In addition, the tablet terminal 10 may detect the state of FIG. 7(a) by detecting a physical connection, such as an electrical connection with the receiver unit 20. Furthermore, the state of FIG. 7(b) may be detected by detecting a physical connection with a mounting member provided on a seat back or the like.

[0059] According to this embodiment, in the receiver unit 20, the control unit 22 detects the position of the tablet terminal 10 having the display unit 11 on which information related to the content is displayed, and the correction unit 23 corrects the sound related to the content output from the speaker arranged in a predetermined space based on the detected position of the tablet terminal 10. In this way, the sound output from the speaker 26 can be corrected based on the position of the tablet terminal 10, so that corrections such as localizing the sound at an appropriate position can be made even when the tablet terminal 10 is being used.

[0060] Furthermore, the control unit 22 detects the orientation of the display unit 11, and the correction unit 23 performs correction based on the position of the tablet terminal 10 and the orientation of the display unit 11. In this manner, it is possible to take into account the orientation of the display unit 11. Therefore, it is also possible to estimate where the user U is located relative to the tablet terminal 10, and more appropriate correction can be performed.

[0061] Furthermore, the correction unit 23 sets the speaker 26 to output at least the right channel and the left channel of the sound related to the content based on the orientation of the display unit 11. By doing so, for example, when the orientation of the display unit 11 is reversed, it becomes possible to switch the left and right sounds. Therefore, it becomes possible to watch the content with a sound that does not feel unnatural.

[0062] Furthermore, the control unit 22 acquires the inclination of the tablet terminal 10, and the correction unit 23 performs correction based on the position of the tablet terminal 10, the orientation of the display unit 11, and the inclination of the tablet terminal 10. In this manner, it is possible to determine whether the tablet terminal 10 is fixed to a mounting member or the like, or is being held in the hand, and perform corrections such as determining the localization position of sound.

[0063] Furthermore, detection results are obtained from the geomagnetic sensor 12 and the geomagnetic sensor 25 provided in the tablet terminal 10, and the orientation of the display unit 11 is detected based on the detection results of the geomagnetic sensor 12 and the geomagnetic sensor 25. In this manner, the orientation of the display unit 11 of the tablet terminal 10 can be identified from the direction of the geomagnetic sensor 12 with the geomagnetic sensor 25 as a reference. Therefore, even in the case of a moving body such as a vehicle, the orientation of the display unit 11 can be identified using the geomagnetic sensor.

[0064] In the above-described embodiment, the receiver unit 20 functions as the audio processing device, but the tablet terminal 10 may function as the audio processing device. The direction detection function of Bluetooth (registered trademark) can also be implemented on the terminal side, so if the tablet terminal 10 acquires detection information from the geomagnetic sensor 25, it is possible to estimate the position of itself (the tablet terminal 10) and calculate the position to be localized. However, the calculation result needs to be transmitted to an in-vehicle device (not limited to the receiver unit 20) in order to be reflected in the output from the speaker 26.

[0065] Furthermore, the position detection of the tablet terminal 10 is not limited to the direction detection function of Bluetooth (registered trademark). For example, if a camera is already installed in the vehicle cabin, the tablet terminal 10 may be detected by image recognition from a camera image. Alternatively, a GNSS (Global Navigation Satellite System) receiver may be provided in both the tablet terminal 10 and the receiver unit 20, and the relative distance, angle, etc. may be detected from the positions (latitude and longitude) detected by both.

[0066] In the above-described embodiment, the position of a mobile terminal device such as the tablet terminal 10 is used to localize a sound image at a predetermined position in the vehicle, but the position may be used to enable sound related to the content of the tablet terminal 10 to be heard well in the rear seat, for example. A technology for reproducing different sources in the front and rear seats in a vehicle and allowing good listening in each seat is known from JP 2014-165569 A and the like. That is, when it is estimated that the position of the tablet terminal 10 is in the front, the content being reproduced, etc. on the tablet terminal 10 is treated as the source on the front seat side, and when it is estimated that the position of the tablet terminal 10 is in the rear, the content being reproduced, etc. on the tablet terminal 10 is treated as the source on the rear seat side, and the technology of the above-described document may be applied.

[0067] In addition, in the above-mentioned embodiment, the description is given in the cabin of a vehicle, but the interior of a house, etc. may be used. Furthermore, processing may be performed so that sounds from the vehicle's speakers or the interior speakers are localized for the tablet terminal 10 outdoors.

[0068] In the above embodiment, the tablet terminal plays the content information, but the present invention is not limited to this. For example, the receiver may have a television / radio wave receiving unit and a CD or DVD playback unit, and transmit the content information via communication. When playing the content information on the receiver, if the content information is video, the video is transmitted to the tablet terminal, and the audio is output from the amplifier.

[0069] Furthermore, the present invention is not limited to the above-mentioned embodiment. In other words, a person skilled in the art can implement various modifications according to the conventionally known knowledge without departing from the gist of the present invention. As long as the voice processing device of the present invention is still included in the scope of the present invention even after such modifications, it is of course included in the scope of the present invention. [Explanation of symbols]

[0070] 10 Tablet terminals (mobile terminal devices) 11 Display section (display screen) 12 Geomagnetic sensor (first geomagnetic sensor) 20 Receiver section 21 Wireless Communication Department 22 Control unit (position detection unit, orientation detection unit, tilt acquisition unit) 23 Correction section 24 Amplifier 25 Geomagnetic sensor (second geomagnetic sensor) 26 Speaker

Claims

1. an orientation detection unit that detects an orientation of a display screen of a mobile terminal device having a display screen on which information related to content is displayed; a correction unit that corrects audio related to the content output from a plurality of speakers arranged in a predetermined space, the correction unit selects, from the plurality of speakers, a speaker for outputting a left side sound and a speaker for outputting a right side sound, among sounds related to the content, based on the detected orientation of the display screen.

13. A voice processing device comprising:

2. a position detection unit that detects the position of the mobile terminal device; the correction unit selects, from the plurality of speakers, a speaker for outputting a left side sound and a speaker for outputting a right side sound, among the sounds related to the content, based on the detected orientation of the display screen and the position of the mobile terminal; 2. The audio processing device according to claim 1 .

3. a tilt acquisition unit that acquires a tilt of the mobile terminal device with respect to a floor surface, 3. The audio processing device according to claim 2, wherein the correction unit performs the correction based on a position of the mobile terminal device, a direction of the display screen, and an inclination of the mobile terminal device with respect to a floor surface.

4. The audio processing device described in any one of claims 1 to 3, characterized in that the orientation detection unit acquires detection results from a first geomagnetic sensor provided in the mobile terminal device and a second geomagnetic sensor provided separately from the first geomagnetic sensor, and detects the orientation of the display screen based on the detection results of the first geomagnetic sensor and the second geomagnetic sensor.

5. 5. The audio processing device according to claim 1, wherein the plurality of speakers are provided in a vehicle interior.

6. 1. A sound processing method executed by a sound processing device that performs a predetermined process on sound related to content output from a plurality of speakers arranged in a predetermined space, comprising: an orientation detection step of detecting an orientation of a display screen of a mobile terminal device having a display screen on which information related to the content is displayed; a correction step of correcting the sound related to the content output from the speaker, the correction step includes selecting, from the plurality of speakers, a speaker for outputting a left side sound and a speaker for outputting a right side sound, among sounds related to the content, based on the detected orientation of the display screen.

13. A method for processing audio comprising the steps of:

7. 7. A voice processing program for causing a computer to execute the voice processing method according to claim 6.

8. 8. A computer-readable storage medium storing the voice processing program according to claim 7.

Images