Masking device, masking method, and program

Abstract

Provided is masking technology that prevents a feeling of incongruity when a masking sound has changed by presenting an image corresponding with the masking sound when changing the masking sound. The present invention includes: an utterance volume evaluation unit that generates, from an uttered speech signal, an evaluation value (hereinafter referred to as the utterance volume evaluation value) with respect to the volume of uttered speech, which is speech of a speaking person, said utterance volume evaluation unit using a sound pickup signal output by a microphone installed for sound pickup of the uttered speech as the uttered speech signal; a masking sound signal generation unit that generates a signal (hereinafter referred to as the masking sound signal) for emitting, from a speaker, a masking sound, corresponding with the utterance volume evaluation value, that prevents the uttered speech from being audible to people in the vicinity other than the speaking person; and a masking image signal generation unit that generates a signal (hereinafter referred to as the masking image signal) for presenting, from an image presentation device, an image corresponding with the masking sound.

Description

[Technical field]

[0001] The present invention relates to an acoustic signal processing technique for preventing a speaker's voice from bothering people around the speaker. [Background technology]

[0002] An acoustic signal processing technology for preventing the voice of a speaker from bothering people in the vicinity is described in Patent Document 1. The technology described in Patent Document 1 uses an interference sound (hereinafter referred to as a masking sound) that masks the voice of a far-end talker reproduced from a speaker so that the people in the vicinity cannot hear the voice, thereby preventing the voice from leaking to the surroundings and preventing the masking sound from becoming excessive and bothering the people in the vicinity. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-267799 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology of Patent Document 1, only the volume of the masking sound is adjusted when controlling the reproduction of the masking sound, so that a change in the volume can sound unnatural.

[0005] Therefore, an object of the present invention is to provide a masking technique that suppresses the sense of discomfort felt when the masking sound is changed by presenting an image corresponding to the masking sound when the masking sound is changed. [Means for solving the problem]

[0006] One aspect of the present invention includes a speech volume evaluation unit that uses a picked-up signal output by a microphone installed to pick up speech, which is the voice of a speaker, as a speech voice signal and generates an evaluation value for the volume of the speech voice (hereinafter referred to as a speech volume evaluation value) from the speech voice signal, a masking sound signal generation unit that generates a signal (hereinafter referred to as a masking sound signal) for emitting a masking sound from a speaker that prevents the speech voice from being heard by people in the vicinity other than the speaker, according to the speech volume evaluation value, and a masking video signal generation unit that generates a signal (hereinafter referred to as a masking video signal) for presenting an image according to the masking sound from an image presentation device.

[0007] One aspect of the present invention includes a microphone array processing unit that generates an integrated picked-up signal from N picked-up signals output by a microphone array including N microphones (N is an integer equal to or greater than 2) installed to pick up speech, which is the voice of a speaker, and converts the integrated picked-up signal into a speech signal; a speech volume evaluation unit that generates an evaluation value for the volume of the speech from the speech signal (hereinafter referred to as a speech volume evaluation value); a masking sound signal generation unit that generates a signal (hereinafter referred to as a masking sound signal) for emitting a masking sound that prevents surrounding people other than the speaker from hearing the speech from a speaker array including M speakers (M is an integer equal to or greater than 2) in accordance with the speech volume evaluation value; a masking video signal generation unit that generates a signal (hereinafter referred to as a masking video signal) for presenting an image corresponding to the masking sound from an image presentation device; and a speaker array processing unit that generates M individual masking sound signals from the masking sound signal to be emitted from speakers included in the speaker array. Effect of the Invention

[0008] According to the present invention, by presenting an image corresponding to the masking sound when the masking sound is changed, it is possible to suppress a sense of discomfort when the masking sound is changed. [Brief description of the drawings]

[0009] [Figure 1]FIG. 1 is a block diagram showing a configuration of a masking device 100. [Diagram 2] 4 is a flowchart showing the operation of the masking device 100. [Diagram 3] FIG. 2 is a block diagram showing a configuration of a masking device 200. [Figure 4] 4 is a flowchart showing the operation of the masking device 200. [Diagram 5] FIG. 3 is a block diagram showing a configuration of a masking device 300. [Figure 6] 4 is a flowchart showing the operation of the masking device 300. [Figure 7] FIG. 4 is a block diagram showing a configuration of a masking device 400. [Figure 8] 13 is a flowchart showing the operation of the masking device 400. [Figure 9] FIG. 2 is a diagram illustrating an example of a functional configuration of a computer that realizes each device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail. Note that components having the same functions are given the same reference numbers and duplicated explanations will be omitted.

[0011] Before describing each embodiment, the notation used in this specification will be described.

[0012] ^ (caret) represents a superscript. For example, x y^z Yes z is a superscript to x, and x y^z Yes z is a subscript to x. Also, _ (underscore) represents a subscript. For example, x y_z Yes z is a superscript to x, and x y_z Yes z is a subscript on x.

[0013] The superscripts "^" and "~" such as ^x and ~x for a certain letter x should actually be written directly above the "x", but due to the constraints of the description in the specification, they are written as ^x and ~x.

[0014] First Embodiment Hereinafter, the masking device 100 will be described with reference to FIG. 1 and FIG. 2. FIG. 1 is a block diagram showing the configuration of the masking device 100. FIG. 2 is a flowchart showing the operation of the masking device 100. As shown in FIG. 1, the masking device 100 includes a speech volume evaluation unit 110, a masking sound signal generation unit 120, a masking video signal generation unit 130, and a recording unit 190. The recording unit 190 is a component that appropriately records information required for the processing of the masking device 100. In addition, the masking device 100 is connected to a microphone 910, a speaker 920, and an image presentation device 930. The microphone 910 is installed to collect the speech sound, which is the voice of the speaker. The speaker 920 is installed to emit a masking sound that prevents the speech sound from being heard by people around the speaker other than the speaker. The image presentation device 930 is installed to present an image corresponding to the masking sound emitted by the speaker 920, and may be, for example, a display or a projector.

[0015] The operation of the masking device 100 will be described with reference to FIG.

[0016] In S110, the speech volume evaluation unit 110 inputs the picked-up signal output by the microphone 910 as a speech signal, and generates and outputs an evaluation value for the volume of the speech (hereinafter referred to as a speech volume evaluation value) from the speech signal. The speech volume evaluation unit 110 generates the speech volume evaluation value, for example, by comparing the power of the speech signal with a predetermined threshold. Note that the speech volume evaluation unit 110 may detect a speech section or suppress noise when calculating the power of the speech signal. The speech volume evaluation value may be a value indicating a high speech volume or a value indicating a low speech volume.

[0017] In S120, the masking sound signal generation unit 120 receives the speech volume evaluation value generated in S110 as input, and generates and outputs a signal of a masking sound (hereinafter referred to as a masking sound signal) to be emitted from the speaker 920 according to the speech volume evaluation value. For example, when the speech volume evaluation value is a value indicating that the speech volume is low, the masking sound signal generation unit 120 may set the masking sound to a low volume sound (e.g., the sound of a forest), and when the speech volume evaluation value is a value indicating that the speech volume is high, the masking sound signal generation unit 120 may set the masking sound to a high volume sound (e.g., the sound of a waterfall).

[0018] In S130, the masking video signal generation unit 130 generates and outputs a signal of a video according to the masking sound corresponding to the masking sound signal generated in S120 (hereinafter referred to as a masking video signal). The masking video signal generation unit 130 receives, for example, meta information of the masking sound signal generated in S120, and selects a masking video signal using the meta information. For example, if the meta information indicates the sound of a forest, a signal of a video of the forest may be used as the masking video signal, and if the meta information indicates the sound of a waterfall, a signal of a video of the waterfall may be used as the masking video signal.

[0019] According to an embodiment of the present invention, by presenting an image corresponding to the masking sound when changing the masking sound, it is possible to suppress the sense of incongruity when the masking sound is changed. This makes it possible to suppress the sense of incongruity even in cases where a sense of incongruity occurs when the masking sound is switched by simply changing the volume or type of the masking sound. For example, even in cases where a sense of incongruity occurs when the sound of a forest changes to the sound of a waterfall because it is difficult to distinguish what sound it is, the sense of incongruity can be suppressed.

[0020] <Second embodiment> Hereinafter, the masking device 200 will be described with reference to FIG. 3 and FIG. 4. FIG. 3 is a block diagram showing the configuration of the masking device 200. FIG. 4 is a flowchart showing the operation of the masking device 200. As shown in FIG. 3, the masking device 200 includes a masking sound elimination unit 210, a speech volume evaluation unit 110, a masking sound signal generation unit 120, a masking video signal generation unit 130, and a recording unit 190. The recording unit 190 is a component that appropriately records information required for the processing of the masking device 200. In addition, the masking device 200 is connected to a microphone 910, a speaker 920, and an image presentation device 930. The masking device 200 differs from the masking device 100 in that the masking device 200 includes the masking sound elimination unit 210.

[0021] The operation of the masking device 200 will be described with reference to Fig. 4. Here, only the operation of the masking sound elimination unit 210 will be described.

[0022] In S210, the masking sound elimination unit 210 receives the collected signal output by the microphone 910 and the masking sound signal generated in S120 as input, generates a signal from which components attributable to the masking sound contained in the collected signal have been eliminated using the collected signal and the masking sound signal, and outputs the signal as a speech signal. For example, the masking sound elimination unit 210 subtracts a signal generated by convolving the masking sound signal with an estimated transfer characteristic from the speaker 920 to the microphone 910 from the collected signal, and filters the signal to generate a signal from which components attributable to the masking sound contained in the collected signal have been eliminated.

[0023] According to an embodiment of the present invention, by presenting an image corresponding to the masking sound when the masking sound is changed, it is possible to suppress the sense of incongruity felt when the masking sound is changed. By erasing the components caused by the masking sound contained in the collected signal, it is possible to prevent the masking sound from being mixed in and being transmitted to the other party as unnecessary noise when, for example, a speaker is talking using the microphone 910. In addition, it is possible to generate a speech volume evaluation value without being affected by the masking sound.

[0024] <Third embodiment> Hereinafter, the masking device 300 will be described with reference to FIG. 5 and FIG. 6. FIG. 5 is a block diagram showing the configuration of the masking device 300. FIG. 6 is a flowchart showing the operation of the masking device 300. As shown in FIG. 5, the masking device 300 includes a microphone array processing unit 310, a speech volume evaluation unit 110, a masking sound signal generation unit 120, a masking video signal generation unit 130, a speaker array processing unit 320, and a recording unit 190. The recording unit 190 is a component that appropriately records information required for the processing of the masking device 300. In addition, the masking device 300 is connected to a microphone array 911 including N microphones (N is an integer of 2 or more), a speaker array 921 including M speakers (M is an integer of 2 or more), and an image presentation device 930. The microphone array 911 is installed to collect the speech sound, which is the sound of a speaker. The speaker array 921 is installed to emit a masking sound that prevents the speech sound from being heard by people around the speaker. The image presentation device 930 is installed to present an image corresponding to the masking sound emitted by the speaker array 921. The masking device 300 differs from the masking device 100 in that it includes a microphone array processing unit 310 and a speaker array processing unit 320.

[0025] The operation of masking device 300 will be described with reference to Fig. 6. Here, only the operations of microphone array processing unit 310 and speaker array processing unit 320 will be described.

[0026] In S310, microphone array processing unit 310 receives N sound pickup signals output from N microphones included in microphone array 911, generates an integrated sound pickup signal from the N sound pickup signals, and outputs the integrated sound pickup signal as a speech signal. Microphone array processing unit 310 uses, for example, predetermined signal processing to form directivity in the direction of the speaker and blind spots in the directions of surrounding people other than the speaker and speakers included in speaker array 921, and generates the integrated sound pickup signal.

[0027] Furthermore, when position information of the speaker, surrounding people other than the speaker, microphones included in microphone array 911, and speakers included in speaker array 921 is obtained, microphone array processing unit 310 may adjust the gain of the microphones included in microphone array 911 that are located close to the speaker to be large, and adjust the gain of the microphones close to surrounding people other than the speaker and speakers included in speaker array 921 to be small. Note that the position information of the speaker, surrounding people other than the speaker, microphones included in microphone array 911, and speakers included in speaker array 921 may be obtained, for example, from a system (not shown) that estimates positions from video captured by a camera, or when position information is available in advance, that information may be used.

[0028] In S320, the speaker array processing unit 320 receives the masking sound signal generated in S120 as an input, generates M individual masking sound signals from the masking sound signal to be emitted from the speakers included in the speaker array 921, and outputs the signals. The speaker array processing unit 320 generates the M individual masking sound signals using, for example, predetermined signal processing, so as to form directivity in the direction of surrounding people other than the speaker, and blind spots in the direction of the speaker and the direction of the microphones included in the microphone array 911. The directions of the speaker, surrounding people other than the speaker, and microphones included in the microphone array 911 may be obtained using any method, and for example, the directions of the speaker and surrounding people other than the speaker can be obtained by sound source direction estimation by the microphone array processing unit 310.

[0029] Furthermore, when position information of the speaker, surrounding people other than the speaker, microphones included in microphone array 911, and speakers included in speaker array 921 is obtained, speaker array processing unit 320 may adjust the gain of speakers included in speaker array 921 that are located close to the speaker to be large, and adjust the gain of speakers close to surrounding people other than the speaker and microphones included in microphone array 911 to be small. Note that the position information of the speaker, surrounding people other than the speaker, microphones included in microphone array 911, and speakers included in speaker array 921 may be obtained, for example, from a system (not shown) that estimates positions from video captured by a camera, or when position information is available in advance, that information may be used.

[0030] Of the M individual masking sound signals, the individual masking sound signal directed toward the speaker and the individual masking sound signal directed toward surrounding people other than the speaker may be signals such that the larger the speech volume evaluation value, the louder the sound produced by the emitted signal.

[0031] According to an embodiment of the present invention, by presenting an image corresponding to the masking sound when the masking sound is changed, it is possible to suppress a sense of discomfort when the masking sound is changed.

[0032] Directivity control by microphone array processing unit 310 and speaker array processing unit 320 can prevent masking sounds from becoming louder near the speaker, and the Lombard effect can prevent the speaker from speaking at a louder volume.

[0033] <Fourth embodiment> Hereinafter, the masking device 400 will be described with reference to FIG. 7 and FIG. 8. FIG. 7 is a block diagram showing the configuration of the masking device 400. FIG. 8 is a flowchart showing the operation of the masking device 400. As shown in FIG. 7, the masking device 400 includes a microphone array processing unit 310, a masking sound elimination unit 210, a speech volume evaluation unit 110, a masking sound signal generation unit 120, a masking video signal generation unit 130, a speaker array processing unit 320, and a recording unit 190. The recording unit 190 is a component that appropriately records information required for the processing of the masking device 400. In addition, the masking device 400 is connected to a microphone array 911 including N microphones (N is an integer of 2 or more), a speaker array 921 including M speakers (M is an integer of 2 or more), and an image presentation device 930. The masking device 400 differs from the masking device 300 in that the masking device 400 includes the masking sound elimination unit 210.

[0034] The operation of the masking device 400 will be described with reference to Fig. 8. Here, only the operation of the masking sound elimination unit 210 will be described.

[0035] In S210, the masking sound elimination unit 210 receives as input the integrated sound pickup signal generated in S310 and the masking sound signal generated in S120, generates a signal by using the integrated sound pickup signal and the masking sound signal to eliminate components caused by the masking sound contained in the integrated sound pickup signal, and outputs the signal as a speech sound signal.

[0036] According to an embodiment of the present invention, by presenting an image corresponding to the masking sound when the masking sound is changed, it is possible to suppress the sense of incongruity when the masking sound is changed. By erasing the components caused by the masking sound contained in the integrated sound pickup signal, it is possible to prevent the masking sound from being mixed in and being transmitted to the other party as unnecessary noise when, for example, a speaker is talking using a microphone. In addition, it is possible to generate a speech volume evaluation value without being affected by the masking sound.

[0037] <Additional Notes> 9 is a diagram showing an example of a functional configuration of a computer 2000 that realizes each of the above-mentioned devices. The processing in each of the above-mentioned devices can be implemented by having a recording unit 2020 load a program for causing the computer 2000 to function as each of the above-mentioned devices, and having the control unit 2010, the input unit 2030, the output unit 2040, and the like operate.

[0038] The device of the present invention has, as a single hardware entity, an input section to which a keyboard or the like can be connected, an output section to which a liquid crystal display or the like can be connected, a communication section to which a communication device (e.g., a communication cable) capable of communicating with the outside of the hardware entity can be connected, a CPU (which may also have a central processing unit, cache memory, registers, etc.), memories such as RAM and ROM, an external storage device such as a hard disk, and buses connecting the input section, output section, communication section, CPU, RAM, ROM, and external storage device so that data can be exchanged between them. If necessary, the hardware entity may also be provided with a device (drive) capable of reading and writing a recording medium such as a CD-ROM. A physical entity equipped with such hardware resources is, for example, a general-purpose computer.

[0039] The external storage device of the hardware entity stores the programs required to realize the above-mentioned functions and the data required in the processing of these programs (not limited to the external storage device, but for example the programs may be stored in a ROM, which is a read-only storage device). Data obtained by the processing of these programs is stored appropriately in the RAM, the external storage device, etc.

[0040] In the hardware entity, each program stored in an external storage device (or ROM, etc.) and the data required for processing each program are loaded into memory as necessary, and interpreted, executed, and processed by the CPU as appropriate, so that the CPU realizes a predetermined function (each component represented as the above, "unit," "means," etc.).

[0041] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention. Furthermore, the processes described in the above-described embodiment are not limited to being executed in chronological order according to the order described, but may be executed in parallel or individually depending on the processing capacity of the device that executes the processes or as necessary.

[0042] As described above, when the processing functions of the hardware entities (the devices of the present invention) described in the above embodiments are realized by a computer, the processing contents of the functions that the hardware entities should have are described by a program. Then, by executing this program on a computer, the processing functions of the hardware entities are realized on the computer.

[0043] The program describing the processing contents can be recorded on a computer-readable recording medium. The computer-readable recording medium may be, for example, a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, or any other suitable recording medium. Specifically, for example, a hard disk drive, a flexible disk, a magnetic tape, or the like can be used as the magnetic recording device, a DVD (Digital Versatile Disc), a DVD-RAM (Random Access Memory), a CD-ROM (Compact Disc Read Only Memory), a CD-R (Recordable) / RW (ReWritable), or the like can be used as the optical disk, an MO (Magneto-Optical disc), or the like can be used as the magneto-optical recording medium, and an EEP-ROM (Electronically Erasable and Programmable-Read Only Memory) or the like can be used as the semiconductor memory.

[0044] The program may be distributed, for example, by selling, transferring, lending, etc. portable recording media such as DVDs and CD-ROMs on which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of a server computer and transferring the program from the server computer to other computers via a network.

[0045] A computer that executes such a program, for example, first stores the program recorded on a portable recording medium or the program transferred from a server computer in its own storage device. Then, when executing a process, the computer reads the program stored in its own storage device and executes a process according to the read program. As another execution form of the program, the computer may directly read the program from the portable recording medium and execute a process according to the program, or may execute a process according to the received program each time a program is transferred from the server computer to the computer. The server computer may not transfer the program to the computer, but may execute the above-mentioned process by a so-called ASP (Application Service Provider) type service that realizes the processing function only by issuing an execution instruction and obtaining the result. Note that the program in this embodiment includes information used for processing by an electronic computer that is equivalent to a program (data that is not a direct instruction to the computer but has a nature that specifies the processing of the computer, etc.).

[0046] In addition, in this embodiment, a hardware entity is configured by executing a specific program on a computer, but at least a part of the processing contents may be realized by hardware.

[0047] The foregoing description of the embodiments of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Modifications and variations are possible in light of the above teachings. The embodiments have been chosen and depicted to provide a best illustration of the principles of the invention and to enable those skilled in the art to utilize the invention in various embodiments and with various modifications as may be suitable for the practical use contemplated. All such modifications and variations are within the scope of the invention as defined by the appended claims interpreted in accordance with the breadth to which they are fairly, legally, and equitably entitled.

Claims

1. a speech volume evaluation unit that generates an evaluation value for the volume of the speech voice (hereinafter referred to as a speech volume evaluation value) from a speech voice signal, the speech voice signal being a pickup signal output from a microphone installed to pick up a speech voice that is the voice of a speaker; a masking sound signal generating unit that generates a signal (hereinafter, referred to as a masking sound signal) for emitting a masking sound from a speaker, the masking sound preventing the speech from being heard by people around the speaker, according to the speech volume evaluation value; a masking video signal generating unit that generates a signal (hereinafter, referred to as a masking video signal) for displaying an image corresponding to the masking sound from an image display device; A masking device comprising: A masking sound elimination unit that uses the collected sound signal and the masking sound signal to generate a signal from which a component caused by the masking sound contained in the collected sound signal has been eliminated, and converts the generated signal into a speech sound signal. Masking device.

2. A masking device as claimed in claim 1, The masking sound elimination unit subtracts a signal generated by convolving the masking sound signal with an estimated transfer characteristic from the speaker to the microphone from the collected sound signal and filters the signal to generate a signal from which a component caused by the masking sound contained in the collected sound signal has been eliminated. A masking device comprising:

3. A microphone array processing unit that generates an integrated picked-up signal from N picked-up signals output from a microphone array including N microphones (N is an integer equal to or greater than 2) installed to pick up a speech voice that is the voice of a speaker, and converts the integrated picked-up signal into a speech voice signal; a speech volume evaluation unit that generates an evaluation value for the volume of the speech (hereinafter referred to as a speech volume evaluation value) from the speech voice signal; a masking sound signal generating unit that generates a signal (hereinafter, referred to as a masking sound signal) for emitting a masking sound that prevents the speech voice from being heard by people around the speaker from a speaker array including M speakers (M is an integer of 2 or more), according to the speech volume evaluation value; a masking video signal generating unit that generates a signal (hereinafter, referred to as a masking video signal) for displaying an image corresponding to the masking sound from an image display device; a speaker array processing unit that generates, from the masking sound signal, M individual masking sound signals to be emitted from speakers included in the speaker array; A masking device comprising: A masking sound elimination unit that uses the integrated sound pickup signal and the masking sound signal to generate a signal in which a component caused by the masking sound contained in the integrated sound pickup signal is eliminated, and converts the generated signal into a speech sound signal. Masking device.

4. A masking device as claimed in claim 3, The masking sound elimination unit subtracts a signal generated by convolving the masking sound signal with an estimated transfer characteristic from the speaker array to the microphone array from the integrated sound pickup signal and filters the signal to generate a signal from which a component caused by the masking sound contained in the integrated sound pickup signal has been eliminated. A masking device comprising:

5. a speech volume evaluation step in which the masking device generates an evaluation value for the volume of the speech voice (hereinafter referred to as a speech volume evaluation value) from a speech voice signal, the speech voice signal being a pickup signal output from a microphone installed to pick up a speech voice that is the voice of a speaker; a masking sound signal generating step of generating a signal (hereinafter referred to as a masking sound signal) for emitting from a speaker a masking sound that prevents a speech voice from being heard by people around the speaker other than the speaker, according to the speech volume evaluation value by the masking device; a masking video signal generating step of generating a signal (hereinafter referred to as a masking video signal) for displaying an image corresponding to the masking sound from an image display device by the masking device; A masking method comprising: A masking sound elimination step is included in which a signal is generated by using the collected sound signal and the masking sound signal and eliminating a component caused by the masking sound contained in the collected sound signal, and the generated signal is used as a speech sound signal. Masking methods.

6. A microphone array processing step in which the masking device generates an integrated picked-up signal from N picked-up signals output from a microphone array including N microphones (N is an integer equal to or greater than 2) installed to pick up a speech sound that is the voice of a speaker, and treats the integrated picked-up signal as a speech sound signal; a speech volume evaluation step of generating an evaluation value for the volume of a speech voice (hereinafter referred to as a speech volume evaluation value) from the speech voice signal by the masking device; a masking sound signal generating step of generating a signal (hereinafter referred to as a masking sound signal) for emitting a masking sound that prevents a speech voice from being heard by people around the speaker other than the speaker from a speaker array including M speakers (M is an integer of 2 or more) according to the speech volume evaluation value by the masking device; a masking video signal generating step of generating a signal (hereinafter referred to as a masking video signal) for displaying an image corresponding to the masking sound from an image display device by the masking device; a speaker array processing step in which the masking device generates, from the masking sound signal, M individual masking sound signals to be emitted from speakers included in the speaker array; A masking method comprising: A masking sound elimination step is included in which a signal is generated by using the integrated sound pickup signal and the masking sound signal, and a component caused by the masking sound contained in the integrated sound pickup signal is eliminated, and the signal is used as a speech sound signal. Masking methods.

7. A program for causing a computer to function as the masking device according to any one of claims 1 to 4.

Images