Sound reproduction method, computer program, and sound reproduction device

By deciding and performing noise suppression processing in the audio reproduction technology, the problem of insufficient sense of presence caused by noise in the sound signal in the prior art is solved, and a more sense of presence sound output and processing load reduction is achieved.

CN118947142APending Publication Date: 2024-11-12PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202380029851.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-02-02
Filing Date
2023-03-28
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing audio reproduction technology is difficult to output sufficient on-site sound when noise is included in the sound signal, causing the listener to feel awkward.

Method used

By obtaining the sound signal and processing information, it is determined whether to perform noise suppression processing, and perform suppression processing based on the processing content in the suppression processing step, and finally output the suppression processing sound signal to generate a more sense of occasional reverberation signal.

Benefits of technology

It is realized that even when noise is included in the sound signal, a more sense of presence can be output, which reduces the processing load of the audio reproduction method and improves the auditory experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118947142A_ABST
    Figure CN118947142A_ABST
Patent Text Reader

Abstract

A sound reproduction method includes: an acquisition step of acquiring a sound signal indicating sound arriving at a listener in a sound reproduction space, and information indicating whether or not processing is possible, the information indicating whether or not processing of noise included in the sound is performed on the sound signal; a processing determination step for determining the processing content of the suppression processing when the acquired processing capability information indicates that the suppression processing is performed; a suppression processing step for performing suppression processing on the basis of the determined processing content; and an output step of outputting the sound signal after the suppression processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a sound reproduction method and the like. Background Art

[0002] Patent Document 1 discloses a sound reproduction device that can output realistic sound by acquiring a sound signal and generating reverberation with respect to the sound signal.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: International Publication No. 2006 / 92995 Summary of the invention

[0006] Problems to be solved by the invention

[0007] Request to output sound with a more immersive feel.

[0008] Therefore, an object of the present disclosure is to provide a sound reproduction method and the like capable of outputting sound with a higher sense of immersion.

[0009] Means used to solve problems

[0010] A sound reproduction method according to a technical solution of the present disclosure includes: an acquisition step of acquiring a sound signal and processing capability information, wherein the sound signal represents the sound reaching a listener in a sound reproduction space, and the processing capability information represents whether to suppress the noise contained in the sound; a processing decision step of determining the processing content of the suppression processing when the acquired processing capability information represents the suppression processing; a suppression processing step of performing the suppression processing based on the determined processing content; and an output step of outputting the sound signal after the suppression processing.

[0011] A program according to one technical aspect of the present disclosure causes a computer to execute the above-mentioned sound reproduction method.

[0012] A sound reproduction device according to a technical solution disclosed herein comprises: an acquisition unit, which acquires a sound signal and processing capability information, wherein the sound signal represents the sound reaching a listener in a sound reproduction space, and the processing capability information indicates whether to perform noise suppression processing on the sound signal; a processing decision unit, which determines the processing content of the suppression processing when the acquired processing capability information indicates that the suppression processing is to be performed; a suppression processing unit, which performs the suppression processing based on the determined processing content; and an output unit, which outputs the sound signal after the suppression processing.

[0013] In addition, these inclusive or specific technical solutions can also be implemented by systems, devices, methods, integrated circuits, computer programs, or non-temporary recording media such as computer-readable CD-ROMs, or by any combination of systems, devices, methods, integrated circuits, computer programs, and recording media.

[0014] Effects of the Invention

[0015] According to a sound reproduction method according to a technical solution of the present disclosure, it is possible to output sound with a more immersive feeling. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a block diagram showing the functional structure of the sound reproduction device related to Embodiment 1.

[0017] Figure 2 This is a flowchart of operation example 1 of the sound reproduction device according to embodiment 1.

[0018] Figure 3 This is a diagram showing the relationship between time and amplitude of a sound signal after the suppression process according to the first embodiment has been performed.

[0019] Figure 4 Yes means Figure 3 A graph of the power spectrum of the sound signal shown.

[0020] Figure 5 This is a diagram showing the relationship between time and amplitude of a synthetic sound signal according to the first embodiment.

[0021] Figure 6 Yes means Figure 5 The power spectrum of the synthetic sound signal is shown.

[0022] Figure 7 This is a flowchart of operation example 2 of the sound reproduction device according to embodiment 1.

[0023] Figure 8 This is a diagram showing two sound reproduction spaces and the positions of two sound sources according to the first embodiment.

[0024] Fig. 9 This is another diagram showing the positions of two sound reproduction spaces and two sound sources according to the first embodiment.

[0025] Fig.10 This is a block diagram showing the functional structure of the sound reproduction device related to the second embodiment.

[0026] Fig.11 This is a flowchart of operation example 3 of the sound reproduction device according to embodiment 2.

[0027] Fig.12This is a diagram showing a threshold value and a noise floor level according to the second embodiment. DETAILED DESCRIPTION

[0028] (Understanding that is the basis of the present disclosure)

[0029] Conventionally, there is known a sound reproduction method for outputting sound with a sense of presence.

[0030] For example, Patent Document 1 discloses a sound reproduction device as an example of a sound reproduction technology capable of outputting a realistic sound by acquiring a sound signal and generating a reverberation with respect to the sound signal.

[0031] In addition, the sound represented by the sound signal obtained by the sound reproduction device disclosed in Patent Document 1 may include a target sound for the listener to hear and noise other than the target sound. In this case, the sound reproduction device disclosed in Reference Document 1 generates a reverberation signal representing reverberation based on the sound signal representing the sound including noise, and outputs a sound signal (synthesized sound signal) synthesized from the sound signal and the generated reverberation signal to the listener. The synthesized sound signal is a signal representing a sound synthesized from the sound including noise and the reverberation, and the listener hears the sound synthesized from the sound including noise and the reverberation.

[0032] As described above, the reverberation signal is generated based on the sound signal represented by the sound containing noise. More specifically, the reverberation represented by the reverberation signal is generated based on the sound containing noise. Therefore, if the listener hears such reverberation, the listener will feel uncomfortable and the listener will not be able to hear the sound with sufficient sense of presence. That is, the sound reproduction technology disclosed in Patent Document 1 is difficult to output a sound with sufficient sense of presence when the sound represented by the acquired sound signal contains noise. Therefore, a sound reproduction method capable of outputting a sound with a greater sense of presence is required.

[0033] Therefore, the sound reproduction method of the first technical solution of the present disclosure includes: an acquisition step, acquiring a sound signal and processing capability information, the sound signal representing the sound reaching the listener in the sound reproduction space, and the processing capability information indicating whether the sound signal is to be subjected to noise suppression processing contained in the sound; a processing decision step, determining the processing content of the suppression processing when the acquired processing capability information indicates that the suppression processing is to be performed; a suppression processing step, performing the suppression processing based on the determined processing content; and an output step, outputting the sound signal after the suppression processing.

[0034] Thus, since the processing capability information is obtained in the acquisition step, the noise contained in the sound represented by the sound signal is suppressed in the suppression processing step according to whether the noise suppression processing can be performed indicated by the processing capability information. For example, there is a case where a reverberation signal representing reverberation is generated based on the sound signal after such processing, and a synthesized sound signal (synthesized sound signal) synthesized from the sound signal and the reverberation signal is output to the listener. In this case, the reverberation heard by the listener is a sound based on the sound after noise suppression. Even if the listener hears such a reverberation, it is not easy for the listener to feel awkward and can hear a sound with a sense of presence. That is, in such a case, a sound reproduction method can be realized that can output a sound with a sense of presence even if noise is contained in the sound represented by the acquired sound signal.

[0035] In addition, for example, in the sound reproduction method of the second technical scheme related to the present disclosure, in the first technical scheme, in the above-mentioned acquisition step, spatial information representing the shape and acoustic characteristics of the above-mentioned sound reproduction space and positional information representing the position of the above-mentioned listener in the above-mentioned sound reproduction space are acquired; in the above-mentioned suppression processing step, based on the acquired spatial information and the acquired positional information, it is decided whether to perform the above-mentioned suppression processing.

[0036] In this way, whether or not to perform suppression processing is determined according to the shape and acoustic characteristics of the sound reproduction space where the listener is located. For example, when suppression processing is not performed, the processing load of the sound reproduction method can be reduced.

[0037] Furthermore, for example, in the sound reproduction method according to the third technical aspect of the present disclosure, in the second technical aspect, in the suppression processing step, when the position of the listener is included in the sound reproduction space where no reverberation is generated, it is decided not to perform the suppression processing.

[0038] Thus, when the position of the listener is included in the sound reproduction space where no reverberation occurs, the suppression process is not performed, so that the processing load of the sound reproduction method can be reduced.

[0039] In addition, for example, in the sound reproduction method of the fourth technical scheme related to the present disclosure, in any one of the first to third technical schemes, in the above-mentioned acquisition step, processing content information representing the above-mentioned processing content is acquired; and in the above-mentioned suppression processing step, the above-mentioned processing content represented by the acquired above-mentioned processing content information is performed.

[0040] This makes it possible to perform suppression processing in accordance with the processing content indicated by the processing content information.

[0041] In addition, for example, the sound reproduction method related to the 5th technical solution of the present disclosure includes a reverberation generation step in the 2nd or 3rd technical solution, in which a reverberation signal representing reverberation is generated based on the above-mentioned sound signal after the above-mentioned suppression processing and the above-mentioned spatial information obtained; in the output step, a synthetic sound signal obtained by synthesizing the above-mentioned sound signal after the above-mentioned suppression processing and the generated reverberation signal is output.

[0042] Thus, a reverberation signal representing reverberation is generated based on a sound signal represented by the sound after noise suppression. Therefore, the reverberation heard by the listener is a sound based on the sound after noise suppression. Even if the listener hears such a reverberation, it is not easy to feel awkward and can hear a sound with a sense of presence. That is, a sound reproduction method can be realized that can output a sound with a sense of presence even if the sound represented by the acquired sound signal contains noise.

[0043] In addition, for example, in the sound reproduction method of the sixth technical solution of the present disclosure, in the fifth technical solution, in the above-mentioned acquisition step, threshold data representing the threshold is acquired; the above-mentioned sound reproduction method includes a comparison step, in which the noise floor level of a specified frequency range in the power spectrum representing the above-mentioned synthetic sound signal is compared with the above-mentioned threshold represented by the acquired threshold data; in the above-mentioned processing decision step, based on the comparison result in the above-mentioned comparison step, the above-mentioned processing content of the above-mentioned suppression processing is updated.

[0044] Thus, the processing content of the suppression process is updated based on the comparison result between the threshold value and the noise floor level, so the sound reproduction method can output a more realistic sound.

[0045] In addition, for example, in the sound reproduction method of the seventh technical solution of the present disclosure, in the sixth technical solution, the threshold value is the target value of the noise floor level; in the processing decision step, when the noise floor level is higher than the threshold value, the processing content is updated to make it the suppression processing that suppresses the noise more strongly.

[0046] Thus, when the noise floor level is higher than the threshold, the noise can be suppressed more strongly, so the sound reproduction method can output a more realistic sound.

[0047] Furthermore, a computer program according to an eighth aspect of the present disclosure causes a computer to execute the sound reproduction method according to any one of the first to seventh aspects.

[0048] Thereby, the computer can execute the above-mentioned sound reproduction method according to the program.

[0049] In addition, the sound reproduction device related to the 9th technical solution of the present disclosure comprises: an acquisition unit, which acquires a sound signal and processing capability information, the sound signal represents the sound reaching the listener in the sound reproduction space, and the processing capability information indicates whether the sound signal is to be subjected to noise suppression processing contained in the sound; a processing decision unit, which determines the processing content of the suppression processing when the acquired processing capability information indicates that the suppression processing is to be performed; a suppression processing unit, which performs the suppression processing based on the determined processing content; and an output unit, which outputs the sound signal after the suppression processing.

[0050] Thus, since the processing capability information is acquired in the acquisition unit, the noise contained in the sound represented by the sound signal is suppressed in the suppression processing unit according to whether the noise suppression processing can be performed indicated by the processing capability information. For example, there is a case where a reverberation signal representing reverberation is generated based on the sound signal after such processing, and a synthesized sound signal (synthesized sound signal) synthesized from the sound signal and the reverberation signal is output to the listener. In this case, the reverberation heard by the listener is a sound based on the sound after noise suppression. Even if the listener hears such a reverberation, it is not easy for the listener to feel awkward and can hear a sound with a sense of presence. That is, in such a case, it is possible to realize an audio reproduction device that can output a sound with a sense of presence even if noise is contained in the sound represented by the acquired sound signal.

[0051] Furthermore, these inclusive or specific technical solutions may also be implemented by systems, devices, methods, integrated circuits, computer programs, or non-temporary recording media such as computer-readable CD-ROMs, or by any combination of systems, devices, methods, integrated circuits, computer programs, and recording media.

[0052] Hereinafter, the embodiments will be described in detail with reference to the drawings.

[0053] In addition, the embodiments described below are all inclusive or specific examples. The numerical values, shapes, materials, components, configuration positions and connection forms of components, steps, and the order of steps shown in the following embodiments are examples and are not intended to limit the present disclosure.

[0054] In addition, in the following description, elements are sometimes given ordinals such as 1st and 2nd. These ordinals are given to elements for the purpose of identifying the elements and do not necessarily correspond to a meaningful order. These ordinals may be replaced as appropriate, may be newly given, or may be removed.

[0055] In addition, each figure is a schematic diagram and does not necessarily illustrate the exact figure. Therefore, the scales and the like in each figure are not necessarily the same. In each figure, the same reference numerals are given to substantially the same structure, and repeated descriptions are omitted or simplified.

[0056] In the present specification, the numerical range is not an expression showing a strict meaning, but an expression showing that the range is substantially equivalent and includes a difference of about several percentage points, for example.

[0057] (Implementation Method 1)

[0058] [structure]

[0059] First, the configuration of sound reproduction device 100 according to Embodiment 1 will be described. Figure 1 1 is a block diagram showing the functional structure of sound reproduction device 100 according to the present embodiment.

[0060] The sound reproduction device 100 related to the present embodiment is a device for allowing a listener to hear the sound by processing a sound signal representing the sound reaching the listener in the sound reproduction space and outputting it to the headphones 200 worn by the listener. More specifically, the sound reproduction device 100 is a stereo sound reproduction device for allowing the listener to hear stereo sound. As an example, the sound reproduction device 100 related to the present embodiment is a device applied to various applications such as virtual reality or augmented reality (VR / AR). In addition, in the present embodiment, the sound reproduction space refers to a virtual reality space or an augmented reality space used in various applications such as virtual reality or augmented reality.

[0061] Next, the earphone 200 will be described.

[0062] like Figure 1 As shown, the earphone 200 is a sound output device including a head sensor unit 201 and a second output unit 202 .

[0063] The head sensor unit 201 senses the direction in which the head of the listener is facing and the position of the listener determined by the coordinates of the horizontal plane and the height in the vertical direction, and outputs detection information indicating the direction in which the head of the listener is facing and the position of the listener determined by the coordinates of the horizontal plane and the height in the vertical direction to the sound reproduction device 100. The direction in which the head of the listener is facing is also the direction in which the face of the listener is facing.

[0064] The head sensor unit 201 can sense the 6DoF (Degrees of Freedom) information of the listener's head. For example, the head sensor unit 201 can be an inertial measurement unit (IMU), an accelerometer, a gyroscope, a magnetic sensor, or a combination thereof. In addition, the detection information also includes the rotation amount or displacement amount sensed by the head sensor unit 201.

[0065] In addition, for simplicity, the direction in which the head of the listener is facing may be described as the direction of the listener.

[0066] Second output unit 202 is a device that reproduces the sound reaching the listener in the sound reproduction space. More specifically, second output unit 202 reproduces the sound based on the sound signal representing the sound processed by sound reproduction device 100 and output from sound reproduction device 100.

[0067] Next, Figure 1 The audio reproduction device 100 shown will be described.

[0068] like Figure 1 As shown, the sound reproduction device 100 includes an extraction unit 110 , an acquisition unit 120 , a process determination unit 130 , a suppression processing unit 140 , a reverberation generation unit 150 , a first output unit 160 , and a storage unit 170 .

[0069] Extraction unit 110 acquires audio content information and extracts predetermined information and signals included in the acquired audio content information. Extraction unit 110 acquires audio content information from, for example, a storage device (not shown) outside sound reproduction device 100. Alternatively, extraction unit 110 may acquire audio content information stored in storage unit 170 included in sound reproduction device 100.

[0070] The extraction unit 110 extracts the sound signal, processability information, space information, position information, and processing content information from the acquired audio content information.

[0071] The sound signal is a signal representing the sound reaching the listener in the sound reproduction space. The sound reaching the listener includes the target sound for the listener to hear and the noise other than the target sound, and more specifically, it is composed of the target sound and the noise. The target sound is, for example, the sound emitted by a person and music, and the noise is, for example, the noise accidentally mixed in when collecting the target sound or the reverberation caused by the sound receiving environment. The sound signal is a signal representing the sound reaching the listener, and is digital data represented in the form of WAVE, MP3 or WMA.

[0072] The processing ability information is information indicating whether the above-mentioned sound signal is subjected to noise suppression processing contained in the sound reaching the listener. The processing ability information indicates whether the suppression processing is performed or not. For example, when the processing ability information indicates that the suppression processing is performed, the flag indicates "1", and when the processing ability information indicates that the suppression processing is not performed, the flag indicates "0".

[0073] Spatial information is information indicating the shape and acoustic characteristics of a sound reproduction space. In applications such as virtual reality or augmented reality, the sound reproduction space indicated by the spatial information can be either a space where a listener is located or a space without a listener. Spatial information is information indicating the shape of a sound reproduction space, and more specifically, information indicating the location and shape of objects (walls, doors, floors, ceilings, appliances, etc.) in the sound reproduction space. In addition, spatial information is information indicating acoustic characteristics, which indicates which frequency is reflected or absorbed to what extent when the object reflects or absorbs sound. In addition, spatial information indicates the position of a sound source set in the sound reproduction space. The sound source is a sound source that emits sound that reaches the listener in the sound reproduction space.

[0074] The position information is information indicating the position of the listener in the sound reproduction space. More specifically, when there are multiple sound reproduction spaces, the position information is information indicating the sound reproduction space where the listener is located among the multiple sound reproduction spaces and indicating the position of the listener in the sound reproduction space where the listener is located.

[0075] The processing content information is information indicating the processing content of the noise suppression process included in the sound reaching the listener when the acquired processing capability information indicates that the suppression process is to be performed. In the noise suppression process, for example, a sound emphasis method can be used, but it is not limited to this, and a known method can also be used. The processing content information indicates that the method used in the noise suppression process is the sound emphasis method, and the information required for using the sound emphasis method. In addition, the processing content information may also include information indicating which method is used among multiple noise suppression process methods.

[0076] As described above, in this embodiment, the audio content information includes a sound signal, processability information, space information, position information, and processing content information.

[0077] In addition, the audio content information may be subjected to encoding processing such as MPEG-H 3D Audio (ISO / IEC 23008-3) (hereinafter referred to as MPEG-H 3D Audio). That is, the extraction unit 110 obtains the audio content information as an encoded bit stream. The extraction unit 110 obtains the audio content information and decodes it. The extraction unit 110 performs decoding processing based on the above-mentioned MPEG-H 3DAudio, etc. That is, for example, the extraction unit 110 functions as a decoder. The extraction unit 110 decodes the encoded audio content information and provides the decoded sound signal, processability information, spatial information, position information, and processing content information to the acquisition unit 120.

[0078] The acquisition unit 120 acquires the sound signal extracted by the extraction unit 110, the processability information, the spatial information, the position information, and the process content information. The acquisition unit 120 provides the acquired information to the process determination unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160, respectively. Here, the acquisition unit 120 may provide the information required by the corresponding processing unit to each processing unit instead of providing the information to the processing determination unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160, respectively. In addition, in the present embodiment, the extraction unit 110 extracts the sound signal from the audio content information, and the acquisition unit 120 acquires the extracted sound signal, the processability information, the spatial information, the position information, and the process content information, but the present invention is not limited thereto. For example, the acquisition unit 120 may acquire the sound signal, the processability information, the spatial information, the position information, and the process content information from a storage device (not shown) or the storage unit 170 outside the sound reproduction device 100. In addition, the acquisition unit 120 also acquires detection information including the rotation amount or displacement amount detected by the earphone 200 (more specifically, the head sensor unit 201) and the position and orientation of the listener. The acquisition unit 120 determines the position and orientation of the listener in the sound reproduction space based on the acquired detection information. That is, here the acquisition unit 120 determines that the position and orientation of the listener represented by the acquired detection information are the position and orientation of the listener in the sound reproduction space. That is, here the acquisition unit 120 determines that the position and orientation of the listener represented by the acquired detection information are the position and orientation of the listener in the sound reproduction space. The position of the listener can also be represented by the coordinates of the horizontal plane and the height in the vertical direction. Next, the acquisition unit 120 updates the position information based on the determined position and orientation of the listener. Therefore, the position information provided by the acquisition unit 120 to each processing unit is information containing the updated position information.

[0079] The processing decision unit 130 determines the processing content of the suppression processing when the processing availability information acquired by the acquisition unit 120 indicates that the suppression processing is to be performed. More specifically, when the processing availability information indicates that the suppression processing is to be performed, the processing decision unit 130 determines the processing content indicated by the processing content information acquired by the acquisition unit 120 as the processing content of the suppression processing.

[0080] The suppression processing unit 140 performs a noise suppression process on the sound signal representing the sound reaching the listener based on the processing content determined by the processing decision unit 130. The sound signal after the suppression process is a signal representing the sound after the noise is suppressed. In addition, when the processing availability information obtained by the acquisition unit 120 indicates that the suppression process is not to be performed, the processing decision unit 130 does not determine the processing content of the suppression process, and the suppression processing unit 140 does not perform the suppression process.

[0081] The reverberation generation unit 150 generates a reverberation signal representing reverberation based on the sound signal subjected to the suppression processing by the suppression processing unit 140 and the spatial information acquired by the acquisition unit 120. The reverberation generation unit 150 may generate reverberation by applying a known reverberation generation method to the sound signal. As an example, the known reverberation generation method is the Schroeder method, but is not limited thereto. In addition, the reverberation generation unit 150 uses the shape and acoustic characteristics of the sound reproduction space represented by the spatial information when applying the known reverberation generation processing. Thus, the reverberation generation unit 150 can generate a reverberation signal representing reverberation. In addition, in the present embodiment, the reverberation signal generated by the reverberation generation unit 150 is a signal representing reverberation based on the sound after the noise is suppressed, that is, the reverberation heard by the listener is a sound based on the sound after the noise is suppressed. In addition, the reverberation described here is a late reverberation, but the reverberation may also include an initial reflection and a late reverberation. Furthermore, the reverberation generation unit 150 may also generate a virtual acoustic effect other than the late reverberation by performing acoustic processing on the sound signal using the spatial information. For example, it is possible to add acoustic effects such as diffraction sound generation, distance attenuation effect, localization, sound image localization processing, or Doppler effect. In addition, the acquisition unit 120 may acquire information for switching on / off all or part of the acoustic effects together with the spatial information.

[0082] The first output unit 160 is an example of an output unit, and outputs the sound signal subjected to the suppression processing by the suppression processing unit 140. More specifically, the first output unit 160 outputs a synthesized sound signal synthesized by the sound signal subjected to the suppression processing by the suppression processing unit 140 and the reverberation signal generated by the reverberation generating unit 150 to the earphone 200. The synthesized sound signal indicates a synthesized sound, and the synthesized sound is a sound including a sound subjected to noise suppression and a reverberation based on the sound subjected to noise suppression. Here, the first output unit 160 includes a volume control unit 161 and a direction control unit 162.

[0083] The volume control unit 161 determines the volume of the noise-suppressed sound represented by the sound signal subjected to the suppression processing by the suppression processing unit 140 and the volume of the reverberation represented by the reverberation signal generated by the reverberation generating unit 150. The volume control unit 161 can determine the volume of the noise-suppressed sound and the volume of the reverberation based on the volume information. The volume information is information indicating the ratio of the volume of the noise-suppressed sound represented by the sound signal subjected to the suppression processing and the volume of the reverberation represented by the reverberation signal. The volume control unit 161 determines the volume of the noise-suppressed sound and the volume of the reverberation so that the ratio of the volumes of the noise-suppressed sound and the reverberation output from the first output unit 160 becomes the ratio indicated by the volume information.

[0084] In addition, the volume information may be extracted from the audio content information by the extraction unit 110 and acquired by the acquisition unit 120 . The volume control unit 161 acquires the volume information acquired by the acquisition unit 120 .

[0085] The direction control unit 162 performs convolution processing on the audio signal after the suppression processing and the generated reverberation signal based on the space information, position information, and detection information acquired by the acquisition unit 120 .

[0086] As described above, the spatial information indicates the shape and acoustic characteristics of the sound reproduction space and the position of the sound source in the sound reproduction space, the position information indicates the reproduction space where the listener is located and the position of the listener in the reproduction space, and the detection information indicates the direction of the listener and the position of the listener represented by the coordinates of the horizontal plane and the value of the height in the vertical direction. The direction control unit 162 processes the sound signal and the reverberation signal with reference to the head-related transfer function stored in the storage unit 170.

[0087] More specifically, the direction control unit 162 performs a process of convolving the sound signal with the head-related transfer function so that the sound represented by the sound signal reaches the position of the listener represented by the position information from the position of the sound source represented by the spatial information. At this time, the direction control unit 162 may determine the head-related transfer function in consideration of the orientation of the listener represented by the detection information, and perform a process of convolving the sound signal with the head-related transfer function. In addition, the direction control unit 162 performs a process of convolving the reverberation signal with the head-related transfer function so that the reverberation represented by the reverberation signal in the reproduction space reaches the position of the listener facing the direction represented by the detection information.

[0088] The direction control unit 162 generates a synthesized sound signal synthesized by synthesizing the sound signal and the reverberation signal respectively subjected to the convolution head correlation transfer function processing, and outputs the generated synthesized sound signal to the headphone 200. When the direction control unit 162 generates the synthesized sound signal, it processes the sound represented by the sound signal and the reverberation represented by the reverberation signal so that the volume of the sound and the volume of the reverberation are respectively determined by the volume control unit 161.

[0089] Furthermore, the second output unit 202 of the headphone 200 reproduces the volume and reverberation of the noise-suppressed sound represented by the synthesized sound signal based on the synthesized sound signal output by the first output unit 160 .

[0090] In this way, the acquisition unit 120, the processing decision unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160 output a synthesized sound signal that can be reproduced by the headphone 200 based on the information and signal extracted by the extraction unit 110. That is, the acquisition unit 120, the processing decision unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160 function as a renderer, for example.

[0091] In the present embodiment, sound reproduction device 100 includes reverberation generation unit 150 , but in another example, sound reproduction device 100 may not include reverberation generation unit 150 . In this case, first output unit 160 outputs the sound signal subjected to the suppression processing by suppression processing unit 140 .

[0092] The storage unit 170 is a storage device that stores information necessary for information processing performed by the extraction unit 110, the acquisition unit 120, the processing determination unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160. The information stored in the storage unit 170 includes computer programs executed by the extraction unit 110, the acquisition unit 120, the processing determination unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160.

[0093] [Action Example 1]

[0094] Hereinafter, operation example 1 of the sound reproduction method executed by the sound reproduction device 100 will be described. Figure 2 This is a flowchart of operation example 1 of sound reproduction device 100 according to the present embodiment.

[0095] First, the extraction unit 110 acquires audio content information ( S10 ).

[0096] The extraction unit 110 extracts the sound signal, the processability information, the space information, the position information, the process content information, and the volume information from the acquired audio content information ( S20 ).

[0097] The acquisition unit 120 acquires the audio signal extracted by the extraction unit 110, the processability information, the space information, the position information, the process content information, the volume information, and the detection information output by the headphone 200 (S30). This step S30 corresponds to an acquisition step.

[0098] The processing decision unit 130 determines whether the processing availability information acquired by the acquisition unit 120 indicates that the suppression processing is to be performed (S40). For example, when the processing availability information indicates "1" as a flag, the processing decision unit 130 determines that the processing availability information indicates that the suppression processing is to be performed. In addition, for example, when the processing availability information indicates "0" as a flag, the processing decision unit 130 determines that the processing availability information indicates that the suppression processing is not to be performed.

[0099] Here, when the processing decision unit 130 determines that the processing information indicates that the suppression processing is to be performed ("Yes" in S40), the processing decision unit 130 determines the processing content of the suppression processing (S50). More specifically, the processing decision unit 130 determines the processing content indicated by the processing content information acquired by the acquisition unit 120 as the processing content of the suppression processing. This step S50 corresponds to a processing decision step.

[0100] Next, the suppression processing unit 140 performs suppression processing on the sound signal acquired by the acquisition unit 120 based on the processing content determined by the processing determination unit 130 (step S60). The sound signal after the suppression processing is a signal representing the sound after noise is suppressed. This step S60 corresponds to the suppression processing step.

[0101] The reverberation generation unit 150 generates a reverberation signal (S70) indicating reverberation based on the sound signal subjected to the suppression processing by the suppression processing unit 140 in step S60 and the space information acquired by the acquisition unit 120. The reverberation signal generated by the reverberation generation unit 150 is a signal indicating reverberation based on the sound after noise suppression. This step S70 corresponds to a reverberation generation step.

[0102] The first output unit 160 outputs a synthesized sound signal (S80) synthesized by synthesizing the sound signal subjected to the suppression processing by the suppression processing unit 140 in step S60 and the reverberation signal generated by the reverberation generating unit 150 to the headphone 200. This step S80 corresponds to an output step. More specifically, the volume control unit 161 and the direction control unit 162 included in the first output unit 160 generate a synthesized sound signal based on the volume information, space information, position information, and detection information acquired by the acquisition unit 120, and output the synthesized sound signal to the headphone 200.

[0103] Here, use Figure 3 to Figure 6 , the sound signal and the synthesized sound signal after suppression processing are explained.

[0104] Figure 3 It is a diagram showing the relationship between time and amplitude of a sound signal after the suppression process according to the present embodiment is performed. Figure 4 Yes means Figure 3 A graph of the power spectrum of the sound signal shown. Figure 5 : This is a diagram showing the relationship between time and amplitude of a synthetic sound signal according to the present embodiment. Figure 6 Yes means Figure 5 The power spectrum of the synthetic sound signal is shown.

[0105] Figure 4 The power spectrum shown is for Figure 3 The spectrum of the sound signal shown is processed by fast Fourier transform. Figure 6 The power spectrum shown is for Figure 5 The spectrum of the synthetic audio signal shown is obtained by performing fast Fourier transform processing.

[0106] Figure 5 and Figure 6 The synthesized tone signal shown is Figure 3 and Figure 4 The signal synthesized from the sound signal shown in FIG. 1 and the reverberation signal generated based on the sound signal. Figure 5 The synthesized tone signal shown is subtracted Figure 3 The signal following the sound signal shown corresponds to the reverberation signal.

[0107] Here, compare Figure 4 and Figure 6 .like Figure 4 and Figure 6 As shown in the areas surrounded by the single-dot dashed rectangles, the noise floor level in the area below 700 Hz is Figure 6 That is, in the synthetic sound signal including the reverberation signal, the noise floor level in this area is higher.

[0108] Here, the noise floor level is briefly described. The noise floor level indicates the level of noise contained in the sound signal. The noise floor level is determined by observing the level of unevenness. Figure 4 The noise floor level may be simply calculated, for example, based on the average value of the level of the concave part in a predetermined frequency interval.

[0109] In step S80 , such a synthesized audio signal is output to the headphone 200 , and the second output unit 202 of the headphone 200 reproduces the noise-suppressed sound and reverberation represented by the synthesized audio signal based on the synthesized audio signal output by the first output unit 160 .

[0110] If the sound reproduction device 100 does not include the reverberation generation unit 150 , step S70 is not performed, and the first output unit 160 outputs the sound signal subjected to the suppression processing by the suppression processing unit 140 .

[0111] When the process determination unit 130 determines that the process availability information indicates that the suppression process is not to be performed (No in S40), the process determination unit 130 does not determine the process content of the suppression process, and the suppression process unit 140 does not perform the suppression process (S90).

[0112] The first output unit 160 outputs the audio signal that has not been subjected to the suppression processing by the suppression processing unit 140 to the headphone 200 ( S100 ).

[0113] Thus, in operation example 1, the sound reproduction method includes an acquisition step, a processing decision step, a suppression processing step, and an output step. In the acquisition step, a sound signal and processing availability information are acquired, the sound signal represents the sound reaching the listener in the sound reproduction space, and the processing availability information indicates whether to suppress the noise contained in the sound signal. In the processing decision step, when the acquired processing availability information indicates that suppression processing is to be performed, the processing content of the suppression processing is determined. In the suppression processing step, suppression processing is performed based on the determined processing content. In the output step, the sound signal after the suppression processing is output.

[0114] Thus, since the processing capability information is obtained in the acquisition step, the noise contained in the sound represented by the sound signal is suppressed in the suppression processing step according to whether the noise suppression processing can be performed indicated by the processing capability information. In action example 1, there is the following situation: a reverberation signal representing reverberation is generated based on the sound signal after such processing (step S70), and a synthetic sound signal (synthesized sound signal) synthesized from the sound signal and the reverberation signal is output to the listener. In this case, the reverberation heard by the listener is a sound based on the sound after noise suppression. Even if the listener hears such a reverberation, it is not easy for the listener to feel awkward, and the sound with a sense of presence can be heard. That is, in such a case, a sound reproduction method can be realized that can output a sound with a sense of presence even if noise is contained in the sound represented by the acquired sound signal.

[0115] In the operation example 1, in the acquisition step, the processing content information indicating the processing content is acquired. In the suppression process step, the processing content indicated by the acquired processing content information is performed.

[0116] This makes it possible to perform suppression processing in accordance with the processing content indicated by the processing content information.

[0117] In operation example 1, the extraction unit 110 extracts the processability information for the sound signal from the audio content information, but the processability information may be set by analyzing the input time series sound signal. As the analysis of the time series sound signal, there is a method of estimating the size of noise by observing the time transition of the autocorrelation value or the frequency component, etc., and the processability information may be set by judging the estimated noise size using a predetermined threshold.

[0118] Furthermore, the input time series sound signal may be a sound signal collected by an input device such as a microphone instead of the sound signal extracted by the extraction unit 110 and input in association with the audio content information. In this case, the audio content information associated with the sound signal may be information set based on the environment in which the sound is collected. In this way, the noise of the sound collection environment contained in the sound signal can be suppressed and a predetermined virtual space can be reproduced.

[0119] In operation example 1, the sound reproduction method includes a reverberation generation step of generating a reverberation signal representing reverberation based on the sound signal subjected to the suppression processing and the acquired space information, and an output step of outputting a synthesized sound signal synthesized by the sound signal subjected to the suppression processing and the generated reverberation signal.

[0120] Thus, a reverberation signal representing reverberation is generated based on a sound signal representing a sound after noise suppression. Therefore, the reverberation heard by the listener is a sound based on the sound after noise suppression. Even if the listener hears such a reverberation, it is not easy to feel awkward and can hear a sound with a sense of presence. That is, a sound reproduction method can be realized that can output a sound with a sense of presence even if the sound represented by the acquired sound signal contains noise.

[0121] Furthermore, in the present embodiment, the computer program causes a computer to execute the above-mentioned sound reproduction method.

[0122] Thereby, the computer can execute the above-mentioned sound reproduction method according to the program.

[0123] [Action Example 2]

[0124] In the second operation example, an example is described in which two sound reproduction spaces are provided and sound sources are provided in each of the two sound reproduction spaces. Figure 7 This is a flowchart related to Operation Example 2 of sound reproduction device 100 according to the present embodiment. Figure 8 and Fig. 9 These are diagrams showing the positions of two sound reproduction spaces A and B and two sound sources A1 and B1 according to the present embodiment.

[0125] The two sound reproduction spaces A and B are examples of the above-mentioned sound reproduction spaces, respectively, and the sounds output from the two sound sources A1 and B1 are examples of the sounds reaching the above-mentioned listener L, respectively. In addition, for the purpose of identification, the sound output from the sound source A1 is set as the first sound below, and the first sound includes the target sound for the listener to hear and noise other than the target sound. The first sound signal representing the first sound is an example of the above-mentioned sound signal. The first processability information indicating whether the first sound signal is to be suppressed is an example of the above-mentioned processability information. The first space information related to the sound reproduction space A is an example of the above-mentioned space information, which indicates the shape and acoustic characteristics of the sound reproduction space A, etc. In addition, the sound output from the sound source B1 is set as the second sound, and the second sound includes the target sound for the listener to hear and noise other than the target sound. The second sound signal representing the second sound is an example of the above-mentioned sound signal. The second processability information indicating whether the second sound signal is to be suppressed is an example of the above-mentioned processability information. The second spatial information regarding the sound reproduction space B is an example of the above-mentioned spatial information, and indicates the shape and acoustic characteristics of the sound reproduction space B, and the like.

[0126] Sound reproduction space A and sound reproduction space B are adjacent spaces. Sound reproduction space A is a space where reverberation occurs. Therefore, the first space information indicating the shape and acoustic characteristics of sound reproduction space A indicates that sound reproduction space A is a space where reverberation occurs.

[0127] The sound reproduction space B is a space where no reverberation occurs. Therefore, the second space information indicating the shape and acoustic characteristics of the sound reproduction space B indicates that the sound reproduction space B is a space where no reverberation occurs.

[0128] First, for Figure 8 Operation Example 2 will be described in which the position of the listener L is in the sound reproduction space A. In this Operation Example 2, the position information indicates that the listener is in the sound reproduction space A and the position of the listener L in the sound reproduction space A.

[0129] like Figure 7 As shown, first, the extraction unit 110 obtains audio content information ( S10 ).

[0130] The extraction unit 110 extracts a sound signal, processing capability information, spatial information, position information, processing content information, and volume information from the acquired audio content information (S21). More specifically, the extraction unit 110 extracts a first sound signal, a second sound signal, first processing capability information, second processing capability information, first spatial information, second spatial information, position information, processing content information, and volume information from the audio content information.

[0131] The acquisition unit 120 acquires the sound signal extracted by the extraction unit 110, the processing capability information, the spatial information, the position information, the processing content information, and the volume information, and the detection information output by the earphone 200 (S31). More specifically, the acquisition unit 120 acquires the first sound signal, the second sound signal, the first processing capability information, the second processing capability information, the first spatial information, the second spatial information, the position information, the processing content information, the volume information, and the detection information.

[0132] The process determination unit 130 determines whether the process availability information acquired by the acquisition unit 120 indicates that the suppression process is to be performed (S41). In the following process including step S41, the process for the first sound and the process for the second sound are performed separately.

[0133] First, the processing for the first sound will be described.

[0134] In step S41, the process determination unit 130 determines whether the first processability information acquired by the acquisition unit 120 indicates that a suppression process is to be performed. Here, the first processability information indicates that a suppression process is to be performed.

[0135] Therefore, the processing decision unit 130 determines that the first processing availability information indicates that the suppression processing is to be performed ("Yes" in S41), and the processing decision unit 130 determines the processing content of the suppression processing (S51). More specifically, the processing decision unit 130 determines the processing content indicated by the processing content information acquired by the acquisition unit 120 as the processing content of the suppression processing.

[0136] Furthermore, the suppression processing unit 140 determines whether the position of the listener L is included in the sound reproduction space where reverberation occurs based on the spatial information (first spatial information) obtained by the acquisition unit 120 and the position information obtained by the acquisition unit 120 (S52). Here, the position information indicates that the listener is in the sound reproduction space A. In addition, the first spatial information indicates that the sound reproduction space A is a space where reverberation occurs. Therefore, the suppression processing unit 140 determines that the position of the listener L is included in the sound reproduction space A where reverberation occurs ("Yes" in step S52).

[0137] In this case, the suppression processing unit 140 performs suppression processing on the sound signal (first sound signal) acquired by the acquisition unit 120 (step S61) based on the processing content determined by the processing determination unit 130. The suppression-processed first sound signal is a signal representing the first sound after noise is suppressed.

[0138] The reverberation generation unit 150 generates a reverberation signal (S71) indicating reverberation based on the sound signal (first sound signal) subjected to the suppression processing by the suppression processing unit 140 in step S61 and the space information (first space information) acquired by the acquisition unit 120. The reverberation signal generated by the reverberation generation unit 150 in step S71 is a signal indicating reverberation based on the first sound after noise suppression.

[0139] The first output unit 160 outputs a synthesized sound signal (S81) synthesized by synthesizing the sound signal (first sound signal) subjected to the suppression processing by the suppression processing unit 140 in step S61 and the reverberation signal generated by the reverberation generating unit 150 to the headphone 200. More specifically, the volume control unit 161 and the direction control unit 162 included in the first output unit 160 generate the synthesized sound signal based on the volume information, the first space information, the position information, and the detection information acquired by the acquiring unit 120, and output the synthesized sound signal to the headphone 200.

[0140] Here, returning to step S41, the processing for the second sound will be described.

[0141] In step S41, the process determination unit 130 determines whether the second process availability information acquired by the acquisition unit 120 indicates that the suppression process is to be performed. Here, the second process availability information indicates that the suppression process is not to be performed.

[0142] Therefore, the process determination unit 130 determines that the second processability information indicates that the suppression process is not to be performed (No in S41 ), and the process determination unit 130 does not determine the process content of the suppression process, and the suppression process unit 140 does not perform the suppression process ( S91 ).

[0143] The first output unit 160 outputs the audio signal (second audio signal) that has not been subjected to the suppression processing by the suppression processing unit 140 to the earphone 200 ( S101 ).

[0144] Through the above, in action example 2 Figure 8 In the example shown, the second output unit 202 of the headphone 200 performs the following processing. That is, the second output unit 202 reproduces the first sound and reverberation after noise suppression represented by the synthesized sound signal output by the first output unit 160, and reproduces the second sound represented by the second sound signal output by the first output unit 160.

[0145] Furthermore, the following is for the case in action example 2 Fig. 9 The following describes a case where the position of the listener L is in the sound reproduction space B. In this operation example 2, the position information indicates that the listener is in the sound reproduction space B and the position of the listener L in the sound reproduction space B.

[0146] As described above, steps S10 to S31 are performed.

[0147] Next, the processing decision unit 130 determines whether the processing availability information acquired by the acquisition unit 120 indicates that the suppression processing is to be performed (S41). Even when the position of the listener L is within the sound reproduction space B, in the following processing including step S41, the processing for the first sound and the processing for the second sound are performed separately.

[0148] First, the processing for the first sound will be described.

[0149] In step S41, the process determination unit 130 determines whether the first processability information acquired by the acquisition unit 120 indicates that a suppression process is to be performed. Here, the first processability information indicates that a suppression process is to be performed.

[0150] Therefore, the processing decision unit 130 determines that the first processing availability information indicates that the suppression processing is to be performed ("Yes" in S41), and the processing decision unit 130 determines the processing content of the suppression processing (S51). More specifically, the processing decision unit 130 determines the processing content indicated by the processing content information acquired by the acquisition unit 120 as the processing content of the suppression processing.

[0151] Furthermore, the suppression processing unit 140 determines whether the position of the listener L is included in the sound reproduction space where reverberation occurs based on the spatial information (second spatial information) obtained by the acquisition unit 120 and the position information obtained by the acquisition unit 120 (S52). Here, the position information indicates that the listener is in the sound reproduction space B. In addition, the second spatial information indicates that the sound reproduction space B is a space where reverberation does not occur. Therefore, the suppression processing unit 140 determines that the position of the listener L is included in the sound reproduction space B where reverberation does not occur ("No" in step S52).

[0152] In this case, the process decision unit 130 does not determine the process content of the suppression process, and the suppression process unit 140 does not perform the suppression process (S91). Step S91 is described in more detail below. Fig. 9 In the example shown, since the listener L is in the sound reproduction space B where no reverberation is generated, the reverberation generation unit 150 does not generate a reverberation signal based on the sound signal (first sound signal) represented by the sound containing noise (first sound). Therefore, even if the suppression processing unit 140 does not perform the suppression processing, the listener does not hear the reverberation based on the sound containing noise. That is, to be more precise, the suppression processing unit 140 does not perform the suppression processing because it is not necessary. As a result, since the suppression processing is not performed, the processing load of the sound reproduction method can be reduced.

[0153] Furthermore, the first output unit 160 outputs the audio signal (first audio signal) that has not been suppressed by the suppression processing unit 140 to the earphone 200 ( S101 ).

[0154] Here, returning to step S41, the processing for the second sound will be described.

[0155] In step S41, the process determination unit 130 determines whether the second process availability information acquired by the acquisition unit 120 indicates that the suppression process is to be performed. Here, the second process availability information indicates that the suppression process is not to be performed.

[0156] Therefore, the process determination unit 130 determines that the second processability information indicates that the suppression process is not to be performed (No in S41 ), and the process determination unit 130 does not determine the process content of the suppression process, and the suppression process unit 140 does not perform the suppression process ( S91 ).

[0157] The first output unit 160 outputs the audio signal (second audio signal) that has not been subjected to the suppression processing by the suppression processing unit 140 to the earphone 200 ( S101 ).

[0158] Therefore, in action example 2, the second output unit 202 of the earphone 200 reproduces the first sound after noise suppression and reverberation represented by the synthesized sound signal output by the first output unit 160, and reproduces the second sound represented by the second sound signal output by the first output unit 160.

[0159] Based on the above, in Action Example 2 Fig. 9 In the example shown, the second output unit 202 of the headphone 200 performs the following processing. That is, the second output unit 202 reproduces the first sound represented by the first sound signal output by the first output unit 160 without the suppression processing, and reproduces the second sound represented by the second sound signal output by the first output unit 160 without the suppression processing.

[0160] As described above, in Operation Example 2, in the suppression processing step, when the position of the listener L is included in the sound reproduction space where no reverberation occurs (for example, in the sound reproduction space B), it is determined not to perform the suppression processing.

[0161] Thus, when the position of the listener L is included in the sound reproduction space where reverberation does not occur (for example, in the sound reproduction space B), the suppression process is not performed, so the processing load of the sound reproduction method can be reduced.

[0162] Furthermore, in the operation example 2, in the acquisition step, processing content information indicating the processing content is acquired, and in the suppression process step, the processing content indicated by the acquired processing content information is performed.

[0163] This makes it possible to perform suppression processing in accordance with the processing content indicated by the processing content information.

[0164] (Implementation Method 2)

[0165] In the second embodiment, an example in which the comparison unit 180 is provided will be described.

[0166] [structure]

[0167] The structure of the sound reproduction device 100a according to the second embodiment will be described.

[0168] Fig.10 1 is a block diagram showing the functional structure of the sound reproduction device 100a according to the present embodiment.

[0169] The sound reproduction device 100 a according to the present embodiment has the same configuration as the sound reproduction device 100 except that a comparison unit 180 is mainly included.

[0170] Specifically, the sound reproduction device 100 a includes an extraction unit 110 , an acquisition unit 120 , a process determination unit 130 , a suppression processing unit 140 , a reverberation generation unit 150 , a first output unit 160 , a storage unit 170 , and a comparison unit 180 .

[0171] In this embodiment, the acquisition unit 120 acquires threshold data indicating a threshold. The threshold indicated by the threshold data is a value used by the comparison unit 180, and the details will be described later.

[0172] For example, the threshold data is stored in the storage unit 170, and the acquisition unit 120 acquires the threshold data stored in the storage unit 170. Alternatively, for example, the threshold data may be data extracted from the audio content information by the extraction unit 110, and the acquisition unit 120 may acquire the threshold data extracted by the extraction unit 110.

[0173] Next, the processing performed by the comparison unit 180 is described. Figure 2 After the processing of steps S10 , S20 , S30 , S40 , S50 , S60 , and S70 in operation example 1 of the illustrated embodiment 1, the comparison unit 180 generates a synthetic audio signal.

[0174] Comparison unit 180 generates a synthesized sound signal by performing the same process as first output unit 160 described in Embodiment 1. In other words, comparison unit 180 can generate a synthesized sound signal by performing the same process as that performed by volume control unit 161 and direction control unit 162 included in first output unit 160 .

[0175] The comparison unit 180 compares the noise floor level in a predetermined frequency range in the power spectrum representing the generated synthetic sound signal with the threshold value represented by the acquired threshold value data. Figure 6The noise floor level in a predetermined frequency range in the power spectrum shown in FIG. 1 is compared with the threshold value indicated by the threshold value data, and the comparison result is output to the processing decision unit 130.

[0176] The processing decision unit 130 updates (re-determines) the processing content of the suppression processing based on the comparison result output from the comparison unit 180. More specifically, the processing decision unit 130 updates (re-determines) the processing content of the suppression processing based on the processing content indicated by the processing content information acquired by the acquisition unit 120 and the output comparison result.

[0177] Thus, in the present embodiment, in step S50, the processing decision unit 130 once decides the processing content, and then further, the comparison unit 180 outputs the comparison result, and the processing decision unit 130 again decides the processing content of the suppression processing based on the comparison result. That is, the processing content once decided in step S50 is updated to the processing content decided based on the comparison result. Compared with the processing content once decided in step S50, the processing content decided based on the comparison result is, for example, a processing content such as a suppression processing that suppresses noise more strongly.

[0178] In addition, the threshold value represented by the threshold data may be the target value of the noise floor level described above. The threshold value may be 1 value. In the present embodiment, the threshold value is a value that is greater than the lower limit value and less than the upper limit value (ie, a value having a predetermined width).

[0179] When the noise floor level is higher than the threshold, the processing decision unit 130 updates the processing content so that the noise is suppressed more strongly. When the noise floor level is higher than the threshold, the noise cannot be suppressed sufficiently. If reverberation is generated based on sound whose noise is not suppressed sufficiently, the listener L will feel uncomfortable when hearing such reverberation, and the listener L will not be able to hear sound with sufficient sense of presence.

[0180] When the noise floor level is higher than the threshold, the process determining unit 130 updates the processing content so as to suppress the noise more strongly, so that the reverberation signal generated by the reverberation generating unit 150 can be a signal indicating reverberation based on the sound after the noise is suppressed more strongly. Furthermore, the first output unit 160 outputs a synthesized sound signal synthesized by the sound signal subjected to the suppression process for suppressing the noise more strongly and the reverberation signal to the headphone 200.

[0181] Thus, the reverberation heard by the listener L is a sound based on the sound after the noise is more strongly suppressed. The listener L does not easily feel uncomfortable even if he hears such a reverberation, and can listen to the sound with a sense of presence. That is, in this case, a sound reproduction method can be realized that can output a sound with a sense of presence even if the sound represented by the acquired sound signal contains noise.

[0182] [Action Example 3]

[0183] Next, operation example 3 of the sound reproduction method executed by the sound reproduction device 100a will be described. Fig.11 This is a flowchart related to Operation Example 3 of the sound reproduction device 100a according to the present embodiment.

[0184] In Operation Example 3, the processing of steps S10 to S40 shown in Operation Example 1 of Embodiment 1 is also performed. In Operation Example 3, in step S10, the acquisition unit 120 acquires threshold data. In Operation Example 3, an example of the case where the answer is "yes" in step S40 is described.

[0185] If the answer is "yes" in step S40, the process determination unit 130 determines the process content once in step S50. Then, the processes of steps S60 and S70 are performed.

[0186] Next, the comparison unit 180 generates a synthetic sound signal based on the volume information, space information, position information, and detection information acquired by the acquisition unit 120 (S110). The comparison unit 180 generates a synthetic sound signal by the same processing as the first output unit 160 described in the first embodiment.

[0187] Furthermore, the comparison unit 180 compares the noise floor level in a predetermined frequency range in the power spectrum of the generated synthetic sound signal with the threshold value indicated by the threshold value data ( S120 ).

[0188] Here, use Fig.12 The threshold and noise floor levels are explained.

[0189] Fig.12 It is a diagram showing the threshold value and the noise floor level according to the present embodiment. Fig.12 (a) is a diagram showing a power spectrum and a threshold value representing a target synthetic sound signal. Fig.12 (b) is a diagram showing a power spectrum of a synthetic sound signal generated by the comparison unit 180 and a noise floor level in a predetermined frequency range in the power spectrum. Fig.12 The noise floor level shown in (a) is recorded as the noise floor level related to the target value, and sometimes Fig.12 The noise floor level shown in (b) is recorded as the noise floor level of the synthetic sound signal.

[0190] Fig.12 The power spectrum shown in (a) is a target power spectrum representing the power spectrum of the synthetic sound signal generated by the comparison unit 180. The threshold is a target value of the noise floor level as described above. As an example, the threshold is a value including Fig.12The value of the noise floor level (noise floor level related to the target value) in the specified frequency range in the power spectrum shown in (a) of FIG. Fig.12 The upper limit of the threshold value shown in (a) is UL, assuming Fig.12 The lower limit of the threshold value shown in (a) is LL, assuming Fig.12 When the noise floor level about the target value shown in (a) is NLV, UL satisfies equation 1 and LL satisfies equation 2.

[0191] UL = NLV × 1.1 (Formula 1)

[0192] LL = NLV × 0.9 (Equation 2)

[0193] That is, the upper limit value (UL) of the threshold and the lower limit value (LL) of the threshold are ±10% of the noise floor level (NLV) of the target value, but are not limited to this, and can also be ±5%, ±20% or ±30% of the noise floor level (NLV) of the target value.

[0194] in addition, Fig.12 The power spectrum shown in (a) is within the specified frequency range and Fig.12 The prescribed frequency range in the power spectrum shown in (b) is the same range, for example, 100 Hz or more and 700 Hz or less. Fig.12 (a) and Fig.12 The predetermined frequency range in the power spectrum shown in each of (b) is not limited to 100 Hz to 700 Hz, and may be other frequencies.

[0195] In step S120 , the comparison unit 180 compares the noise floor level of the synthetic audio signal with a threshold value.

[0196] If the noise floor level of the synthetic sound signal is greater than or equal to the lower limit value of the threshold and less than or equal to the upper limit value of the threshold, the comparison unit 180 determines that the noise floor level of the synthetic sound signal is equal to the threshold.

[0197] If the noise floor level of the synthetic audio signal is lower than the lower limit value of the threshold, the comparison unit 180 determines that the noise floor level of the synthetic audio signal is lower than the threshold.

[0198] If the noise floor level of the synthetic sound signal is higher than the upper limit of the threshold, the comparison unit 180 determines that the noise floor level of the synthetic sound signal is higher than the threshold.

[0199] When the noise floor level of the synthetic audio signal is higher or lower than the threshold, the comparison unit 180 outputs the comparison result to the process determination unit 130. In this case, the process of step S50 is performed again, that is, the process determination unit 130 updates (redetermines) the content of the suppression process.

[0200] For example, when the noise floor level of the synthetic sound signal is higher than the threshold, the processing content is re-determined so that it becomes a suppression process that suppresses the noise more strongly. Also, when the noise floor level of the synthetic sound signal is lower than the threshold, the processing content is re-determined so that it becomes a suppression process that suppresses the noise more weakly.

[0201] Next, the process of step S60 is performed again, that is, the suppression processing unit 140 performs suppression processing on the sound signal acquired by the acquisition unit 120 based on the processing content determined again by the processing determination unit 130. This suppression processing is a suppression processing for suppressing noise more weakly.

[0202] Then, the process of step S70 is performed again, that is, the reverberation generation unit 150 generates a reverberation signal indicating reverberation based on the sound signal suppressed by the suppression processing unit 140 in step S60 and the space information acquired by the acquisition unit 120. The reverberation signal is a signal indicating reverberation based on the sound after the noise is more strongly suppressed.

[0203] Then, the processes of steps S110 and S120 are performed again.

[0204] In this way, when the noise floor level of the synthetic audio signal is higher or lower than the threshold, the processing of steps S50 to S70, S110 and S120 is performed again.

[0205] Furthermore, when the noise floor levels of the synthetic audio signals are the same, the comparison unit 180 outputs the comparison result to the first output unit 160. In this case, the process of step S80 is performed.

[0206] In step S80, for example, the first output unit 160 outputs a synthesized sound signal synthesized by synthesizing a sound signal that has been subjected to a suppression process for suppressing noise more strongly and a reverberation signal representing a reverberation based on the sound after suppressing noise more strongly, to the earphone 200. As a result, the reverberation heard by the listener L is a sound based on the sound after suppressing noise more strongly. Even if the listener L hears such a reverberation, it is not easy to feel awkward, and the listener L can hear a sound with a sense of presence. That is, in such a case, a sound reproduction method that can output a sound with a sense of presence even if the sound represented by the acquired sound signal contains noise can be realized.

[0207] Thus, in operation example 3, in the acquisition step, threshold data indicating a threshold is acquired. The sound reproduction method includes a comparison step of comparing a noise floor level in a predetermined frequency range in a power spectrum indicating a synthetic sound signal with a threshold indicated by the acquired threshold data. In the process determination step, based on the comparison result in the comparison step, the processing content of the suppression process is updated.

[0208] Thus, the content of the suppression process is updated based on the comparison result of the threshold value and the noise floor level, so the sound reproduction method can output a more realistic sound.

[0209] In the operation example 3, the threshold is a target value of the noise floor level. In the process determination step, when the noise floor level is higher than the threshold, the process content is updated so that it becomes a suppression process that suppresses noise more strongly.

[0210] Thus, when the noise floor level is higher than the threshold, the noise can be suppressed more strongly, so the sound reproduction method can output a more realistic sound.

[0211] (Other Embodiments)

[0212] The above is a description of the sound reproduction method and the sound reproduction device of the technical solution of the present disclosure based on the implementation mode, but the present disclosure is not limited to the implementation mode. For example, other implementation modes that are realized by arbitrarily combining the constituent elements described in this specification or removing some of the constituent elements may be used as implementation modes of the present disclosure. In addition, modifications of the above-mentioned implementation modes that are obtained by implementing various modifications that can be conceived by those skilled in the art within the scope of the meaning of the sentences described in the claims without departing from the main purpose of the present disclosure are also included in the present disclosure.

[0213] In addition, the following aspects may also be included in the scope of one or more technical aspects of the present disclosure.

[0214] (1) A part of the components constituting the above-mentioned sound reproduction device may be a computer system composed of a microprocessor, ROM, RAM, hard disk unit, display unit, keyboard, mouse, etc. A computer program is stored in the above-mentioned RAM or hard disk unit. The above-mentioned microprocessor operates according to the above-mentioned computer program to achieve its function. Here, the computer program is composed of a plurality of command codes representing instructions to the computer in order to achieve a predetermined function.

[0215] (2) A part of the components constituting the above-mentioned sound reproduction device and sound reproduction method may be constituted by a system LSI (Large Scale Integration). The system LSI is a super-multifunctional LSI manufactured by integrating multiple components into a single chip, and specifically, is a computer system composed of a microprocessor, ROM, RAM, etc. A computer program is stored in the above-mentioned RAM. The system LSI achieves its function by the above-mentioned microprocessor operating according to the above-mentioned computer program.

[0216] (3) A part of the components constituting the above-mentioned sound reproduction device may be constituted by an IC card or a single module that is detachable from each device. The above-mentioned IC card or the above-mentioned module is a computer system composed of a microprocessor, ROM, RAM, etc. The above-mentioned IC card or the above-mentioned module may also include the above-mentioned super-multifunctional LSI. The above-mentioned IC card or the above-mentioned module achieves its function by the microprocessor operating according to the computer program. The IC card or the module may also have tamper-resistance.

[0217] (4) In addition, a part of the components constituting the above-mentioned sound reproduction device may be a product in which the above-mentioned computer program or the above-mentioned digital signal is recorded on a recording medium that can be read by a computer, such as a floppy disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. In addition, it may be a digital signal recorded on these recording media.

[0218] Furthermore, part of the components constituting the sound reproduction device may be obtained by transmitting the computer program or the digital signal via an electric communication line, a wireless or wired communication line, a network represented by the Internet, data broadcasting, or the like.

[0219] (5) The present disclosure may be the methods described above. In addition, the present disclosure may be a computer program that implements the methods using a computer, or a digital signal composed of the computer program.

[0220] (6) Furthermore, the present disclosure may be a computer system including a microprocessor and a memory, wherein the memory stores the computer program and the microprocessor operates according to the computer program.

[0221] (7) In addition, the above-mentioned program or the above-mentioned digital signal may be recorded in the above-mentioned recording medium and transferred, or the above-mentioned program or the above-mentioned digital signal may be transferred via the above-mentioned network, etc., so that it can be implemented by another independent computer system.

[0222] (8) The above-described embodiments and modifications may be combined.

[0223] In addition, a video linked to the sound output from the headphones 200 may be presented to the listener L. In this case, although Figure 1 Although not shown in the figure, for example, a display device such as a liquid crystal panel or an organic EL (ElectroLuminescence) panel may be provided around the listener L, and the image may be presented on the display device. In addition, the image may be presented by the listener L wearing a head mounted display or the like.

[0224] In addition, the audio content information in the present disclosure can be said to be a bit stream containing a sound signal (sound information) and metadata. Regarding the audio content information in the present disclosure, it can be said that the processing capability information, spatial information, position information, and processing content information are all information constituting the metadata in the bit stream. The audio content information can also be obtained by the sound reproduction device 100 as a bit stream encoded in a format specified by, for example, MPEG-H 3D Audio (ISO / IEC 23008-3). As an example, the encoded sound signal includes information about the target sound reproduced by the sound reproduction device 100. The target sound mentioned here is a sound or natural environment sound emitted by a sound source object existing in the sound reproduction space, and can include, for example, mechanical sound or the sound of animals including humans. In addition, when there are multiple sound source objects in the sound reproduction space, the sound reproduction device 100 obtains multiple sound signals corresponding to the multiple sound source objects.

[0225] Metadata is, for example, information used in the sound reproduction device 100 to control the sound processing of sound information. Metadata may also be information used to describe a scene represented by a virtual space (sound reproduction space). The scene mentioned here is a term that refers to a collection of all elements of three-dimensional images and sound events in the virtual space modeled by the sound reproduction device 100 using metadata. That is, the metadata mentioned here includes not only information for controlling sound processing, but also information for controlling image processing. Of course, metadata may include information for controlling only one of sound processing and image processing, or information used for controlling both.

[0226] The sound reproduction device 100 may also generate a virtual sound effect by performing sound processing on the sound information using metadata included in the bitstream and additional interactive position information of the listener L. In the present embodiment, the generation of late reverberation sound in the sound effect is described, but other sound processing may be performed using metadata. For example, sound effects such as additional diffraction sound generation, distance attenuation effect, localization, sound image localization processing, or Doppler effect may be considered. In addition, information for switching on or off all or part of the sound effects may be added as metadata.

[0227] In addition, all or part of the metadata may be obtained from outside the bitstream of the audio information. For example, metadata for controlling the audio or metadata for controlling the video may be obtained from outside the bitstream, or both metadata may be obtained from outside the bitstream.

[0228] Furthermore, when the bit stream obtained by the sound reproduction device 100 includes metadata for controlling an image, the sound reproduction device 100 may have a function of outputting the metadata that can be used to control the image to a display device that displays an image or a stereoscopic image reproduction device that reproduces a stereoscopic image.

[0229] In addition, as an example, the encoded metadata includes: information related to a sound reproduction space including a sound source object that emits sound and an obstacle object, and information related to the positioning position when the sound image of the sound is positioned at a specified position in the sound reproduction space (that is, so that it is perceived as a sound arriving from a specified direction), that is, information related to the specified direction. Here, an obstacle object is an object that may affect the sound perceived by the listener L, such as blocking or reflecting the sound, during the period from the sound emitted by the sound source object to the sound reaching the listener L. In addition to stationary objects, obstacle objects may also include animals such as humans or moving objects such as machinery. In addition, when there are multiple sound source objects in the sound reproduction space, for any sound source object, other sound source objects may become obstacle objects. In addition, non-sound source objects such as building materials or inanimate objects and sound source objects that emit sound may also become obstacle objects.

[0230] The spatial information constituting the metadata may include not only the shape of the sound reproduction space, but also information indicating the shape and position of obstacle objects existing in the sound reproduction space and the shape and position of sound source objects existing in the sound reproduction space. The sound reproduction space may be either a closed space or an open space, and the metadata includes information on the reflectivity of structures such as floors, walls, or ceilings that can reflect sound in the sound reproduction space and the reflectivity of obstacle objects existing in the sound reproduction space. Here, the reflectivity is the energy ratio of reflected sound to incident sound, and is set for each frequency band of sound. Of course, the reflectivity may also be set uniformly regardless of the frequency band of the sound. In the case where the sound reproduction space is an open space, for example, uniformly set parameters such as attenuation rate, diffracted sound, or initial reflected sound may also be used.

[0231] In the above description, reflectivity is listed as a parameter related to an obstacle object or a sound source object included in metadata, but metadata may include information other than reflectivity. For example, metadata related to both a sound source object and a non-sound source object may include information related to the material of the object. Specifically, metadata may include parameters such as diffusivity, transmittance, or sound absorption.

[0232] As information related to the sound source object, it is also possible to include volume, radiation characteristics (directivity), reproduction conditions, the number and type of sound sources emitted from an object, or information specifying the sound source area in the object. For example, the reproduction conditions can also be set to be a sound that flows continuously or a sound triggered by an event. The sound source area in the object can be set by the relative relationship between the position of the listener L and the position of the object, or it can be set based on the object. In the case of setting based on the relative relationship between the position of the listener L and the position of the object, the listener L can perceive that sound X is emitted from the right side of the object and sound Y is emitted from the left side when the listener L looks at it. In the case of setting based on the object, which sound is emitted from which area of ​​the object regardless of the direction the listener L looks at. For example, the listener L can perceive that when looking at the object from the front, high sound flows from the right side and low sound flows from the left side. In this case, when the listener L goes around to the back of the object, the listener L can perceive that the bass flows from the right side and the high sound flows from the left side when looking from the back.

[0233] Metadata related to the space may include the time until the initial reflected sound, the reverberation time, the ratio of direct sound to diffuse sound, etc. When the ratio of direct sound to diffuse sound is zero, the listener L can perceive only the direct sound.

[0234] In addition, it is assumed that the information indicating the position and orientation of the listener L is included in the bitstream as metadata, but the information indicating the position and orientation of the listener L that changes interactively may not be included in the bitstream. In this case, the information indicating the position and orientation of the listener L is obtained from information outside the bitstream. For example, if it is the position information of the listener L in the VR space, it can be obtained from the application that provides VR content. If it is the position information of the listener L used to prompt the sound as AR, the position information obtained by self-position estimation using GPS, camera or LiDAR (Laser Imaging Detection and Ranging) in a portable terminal is used. In addition, the sound information and metadata can be stored in one bitstream or in multiple bitstreams respectively. Similarly, the sound information and metadata can be stored in one file or in multiple files respectively.

[0235] In the case where the sound information and metadata are stored in multiple bitstreams, respectively, information indicating other associated bitstreams may be included in one or a part of the bitstreams storing the sound information and metadata. In addition, information indicating other associated bitstreams may be included in metadata or control information of each bitstream of the multiple bitstreams storing the sound information and metadata. In the case where the sound information and metadata are stored in multiple files, information indicating other associated bitstreams or files may be included in one or a part of the files storing the sound information and metadata. In addition, information indicating other associated bitstreams or files may be included in metadata or control information of each bitstream of the multiple bitstreams storing the sound information and metadata.

[0236] Here, the associated bitstreams or files are, for example, bitstreams or files that may be used simultaneously during audio processing. In addition, information indicating other associated bitstreams may be recorded together in the metadata or control information of one bitstream among multiple bitstreams storing sound information and metadata, or may be recorded separately in the metadata or control information of two or more bitstreams among multiple bitstreams storing sound information and metadata. Similarly, information indicating other associated bitstreams or files may be recorded together in the metadata or control information of one file among multiple files storing sound information and metadata, or may be recorded separately in the metadata or control information of two or more files among multiple files storing sound information and metadata. In addition, a control file that records information indicating other associated bitstreams or files may be generated separately from multiple files storing sound information and metadata. In this case, the control file may not store sound information and metadata.

[0237] Here, the information indicating the other associated bitstreams or files is, for example, an identifier indicating the other bitstream, a file name indicating the other file, a URL (Uniform Resource Locator) or a URI (Uniform Resource Identifier), etc. In this case, the acquisition unit 120 determines or acquires the bitstream or file based on the information indicating the other associated bitstream or file. In addition, the information indicating the other associated bitstream may be included in the metadata or control information of at least a part of the bitstreams among the multiple bitstreams storing the sound information and metadata, and the information indicating the other associated files may be included in the metadata or control information of at least a part of the files among the multiple files storing the sound information and metadata. Here, the file containing the information indicating the associated bitstream or file is, for example, a control file such as a manifest file for distributing content.

[0238] The extraction unit 110 decodes the encoded metadata and supplies the decoded metadata to the acquisition unit 120. The acquisition unit 120 supplies the acquired metadata to the processing decision unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160. Here, the acquisition unit 120 may not supply the same metadata to the processing decision unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160, but may supply metadata required by each processing unit.

[0239] In addition, the acquisition unit 120 also acquires detection information including the rotation amount or displacement amount detected by the head sensor unit 201 and the position and orientation of the listener L. The acquisition unit 120 determines the position and orientation of the listener L in the sound reproduction space based on the acquired detection information. More specifically, the acquisition unit 120 determines that the position and orientation of the listener L indicated by the acquired detection information are the position and orientation of the listener L in the sound reproduction space. And, the acquisition unit 120 updates the position information included in the metadata based on the determined position and orientation of the listener L. Therefore, the metadata provided by the acquisition unit 120 to each processing unit is metadata including the updated position information.

[0240] In the present embodiment, the sound reproduction device 100 has a function as a renderer that generates a sound signal with an added sound effect, but the server may assume all or part of the function of the renderer. That is, all or part of the extraction unit 110, the acquisition unit 120, the processing determination unit 130, the suppression processing unit 140, the reverberation generation unit 150, and the first output unit 160 may exist in a server (not shown). In this case, the sound signal generated in the server or the synthesized sound signal is received by the sound reproduction device 100 via a communication module (not shown) and reproduced by the headphones 200.

[0241] Industrial Applicability

[0242] The present disclosure can be utilized in a sound reproduction method and a sound reproduction device, and can be particularly applied to a stereo sound reproduction system and the like.

[0243] Description of symbols

[0244] 100, 100a Sound reproduction device

[0245] 110 Extraction Department

[0246] 120 Acquisition Department

[0247] 130 Processing Decision Department

[0248] 140 Suppression Processing Unit

[0249] 150 Reverberation Generation Unit

[0250] 160 1st output unit

[0251] 161 Volume Control

[0252] 162 Direction Control Unit

[0253] 170 Storage

[0254] 180 Comparative Department

[0255] 200 Headphones

[0256] 201 Head sensor unit

[0257] 202 Second output unit

[0258] A, B Sound reproduction space

[0259] A1, B1 audio source

[0260] L Listener

Claims

1. A sound reproduction method, in, include: An acquisition step of acquiring a sound signal and processing capability information, wherein the sound signal represents the sound reaching the listener in the sound reproduction space, and the processing capability information represents whether to perform noise suppression processing on the sound signal; a processing determination step of determining the processing content of the above-mentioned suppression processing when the acquired processing availability information indicates that the above-mentioned suppression processing is to be performed; a suppression processing step of performing the suppression processing based on the determined processing content; and The output step is to output the above-mentioned sound signal after the above-mentioned suppression processing.

2. The sound reproduction method according to claim 1, in, In the acquisition step, spatial information indicating the shape and acoustic characteristics of the sound reproduction space and positional information indicating the position of the listener in the sound reproduction space are acquired. In the suppression processing step, whether or not to perform the suppression processing is determined based on the acquired spatial information and the acquired position information.

3. The sound reproduction method according to claim 2, in, In the suppression processing step, when the position of the listener is included in the sound reproduction space where no reverberation occurs, it is determined not to perform the suppression processing.

4. The sound reproduction method according to claim 1, in, In the acquisition step, the processing content information indicating the processing content is acquired. In the suppression processing step, the processing content indicated by the acquired processing content information is performed.

5. The sound reproduction method according to claim 2, in, The method comprises a reverberation generation step, in which a reverberation signal representing reverberation is generated based on the sound signal after the suppression process and the acquired space information, In the output step, a synthesized sound signal is outputted, which is a synthesis of the sound signal subjected to the suppression process and the generated reverberation signal.

6. The sound reproduction method according to claim 5, in, In the above-mentioned acquisition step, threshold data indicating a threshold value is acquired, The sound reproduction method includes a comparison step of comparing a noise floor level in a predetermined frequency range in a power spectrum representing the synthetic sound signal with the threshold value represented by the acquired threshold value data, In the process determination step, the process content of the suppression process is updated based on the comparison result in the comparison step.

7. The sound reproduction method according to claim 6, in, The above threshold is the target value of the above noise floor level, In the process determination step, when the noise floor level is higher than the threshold value, the process content is updated so as to become the suppression process for more strongly suppressing the noise. 8 . A computer program for causing a computer to execute the sound reproduction method according to claim 1 .

9. A sound reproduction device, in, have: an acquisition unit that acquires a sound signal and processability information, wherein the sound signal represents the sound reaching a listener in a sound reproduction space, and the processability information represents whether to perform a noise suppression process on the sound signal; a processing decision unit that determines the processing content of the above-mentioned suppression processing when the acquired processing availability information indicates that the above-mentioned suppression processing is to be performed; a suppression processing unit that performs the suppression processing based on the determined processing content; as well as The output unit outputs the audio signal after the suppression process.

Citation Information

Patent Citations

  • Acoustic reproduction device

    WO2006092995A1