Acoustic processing apparatus, acoustic processing method, acoustic processing program, and acoustic processing system

Abstract

This acoustic processing device (100) is equipped with: an acquisition unit (131) for acquiring the recommended environment which is prescribed for each unit of content and includes the ideal arrangement of speakers in the space where the content is to be played back; a measurement unit (132) for measuring the position of the audience present in the space, the number and arrangement of the speakers, and the shape of the space; and a correction unit (133) which, on the basis of the information measured by the measurement unit, corrects the voice, which is observed from the audience position, of the content produced by the speaker present in the space so as to be a voice produced from a virtual speaker which is ideally positioned in the recommended environment.

Claims

1. An acquisition unit that acquires a recommended environment defined for each piece of content, including the ideal speaker placement in the space where the content is played, A measuring unit that measures the position of viewers located in the aforementioned space, the number and arrangement of speakers, and the shape of the space, Based on the information measured by the measurement unit, a correction unit corrects the audio of the content, which is observed at the viewer's position and emitted from a speaker located in that space, to audio emitted from a virtual speaker ideally positioned in the recommended environment. An acoustic processing device equipped with the following features.

2. The aforementioned measuring unit is The number and arrangement of speakers in the space are determined by measuring the relative positions of the sound processing device and the multiple speakers by using radio waves transmitted or received by the multiple speakers located in the space. The acoustic apparatus according to claim 1.

3. The aforementioned measuring unit is Using a depth sensor that detects objects located in the aforementioned space, the position of the viewer located in the space, the number and arrangement of speakers, and at least one of the spatial shape are measured. The acoustic apparatus according to claim 1.

4. The aforementioned measuring unit is The position of the viewer or speaker located in the space is measured by image recognition of the viewer or speaker using an image sensor provided by the sound processing device or external device. The acoustic apparatus according to claim 1.

5. The aforementioned measuring unit is The location of the viewer in the space is measured using radio waves transmitted or received by a terminal device carried by the viewer. The acoustic apparatus according to claim 1.

6. The aforementioned measuring unit is The spatial shape of the space is determined by measuring the distance to the ceiling of the space based on the reflected sound emitted from a sound irradiation unit provided by a speaker located in the space. The acoustic apparatus according to claim 1.

7. The aforementioned measuring unit is The positions of viewers located in the aforementioned space, the number and placement of speakers, and the shape of the space are continuously measured. The correction unit, Using the information continuously measured by the measurement unit, the audio of the content emitted from the speaker located in the space is corrected. The acoustic apparatus according to claim 1.

8. The acquisition unit is, From the metadata contained in the aforementioned content, the recommended environment specified in the content is obtained. The acoustic apparatus according to claim 1.

9. The acquisition unit is, The viewer's head transfer function is obtained, The correction unit, The sound from the speaker positioned near the viewer is corrected based on the viewer's head-related transfer function. The acoustic apparatus according to claim 1.

10. The aforementioned measuring unit is Based on an image captured by an image sensor or external device of the sound processing device, map information is generated, and based on the generated map information, at least one of the following is measured: the position of the sound processing device, the position of the viewer, the number and arrangement of speakers, and the spatial shape. The acoustic apparatus according to claim 1.

11. The correction unit, The information measured by the measurement unit is provided to a terminal device used by the viewer, and the audio of the content is corrected based on at least one of the viewer's position in the space, the number and arrangement of speakers, and the spatial shape, as corrected by the viewer on the terminal device. The acoustic apparatus according to claim 1.

12. The correction unit, The audio of the content, which has been corrected by the correction unit, is further corrected based on the correction performed by the viewer. The acoustic apparatus according to claim 1.

13. The correction unit, Based on the viewer's behavior pattern or the speaker placement pattern learned from the information measured by the measurement unit, the audio of the content is corrected. The acoustic apparatus according to claim 1.

14. Computers We obtain the recommended environment specified for each piece of content, including the ideal speaker placement in the space where the content is played. The positions of viewers located in the aforementioned space, the number and arrangement of speakers, and the shape of the space are measured. Based on the measured information, the audio of the content observed at the viewer's position, emitted from a speaker located in that space, is corrected to sound emitted from a virtual speaker ideally positioned in the recommended environment. A sound processing method that includes the following.

15. Computers, An acquisition unit that acquires a recommended environment defined for each piece of content, including the ideal speaker placement in the space where the content is played, A measuring unit that measures the position of viewers located in the aforementioned space, the number and arrangement of speakers, and the shape of the space, Based on the information measured by the measurement unit, a correction unit corrects the audio of the content, which is observed at the viewer's position and emitted from a speaker located in that space, to audio emitted from a virtual speaker ideally positioned in the recommended environment. An audio processing program designed to function as such.

16. An acoustic processing system including an acoustic processing device and a speaker, The aforementioned acoustic processing device is An acquisition unit that acquires a recommended environment defined for each piece of content, including the ideal speaker placement in the space where the content is played, A measuring unit that measures the position of viewers located in the space, the number and arrangement of the speakers, and the shape of the space, The system includes a correction unit that, based on the information measured by the measurement unit, corrects the audio of the content, which is observed at the viewer's position and emitted from a speaker located in that space, to audio emitted from a virtual speaker ideally positioned in the recommended environment. The aforementioned speaker is A sound irradiation unit that projects an audio signal toward a predetermined location in the space, The system includes an observation unit that observes the reflected sound of the audio signal irradiated by the aforementioned audio irradiation unit, The aforementioned measuring unit is The spatial shape is measured based on the time from when the sound signal is irradiated by the sound irradiation unit until the reflected sound is observed by the observation unit. Acoustic processing system.

Images