Target sound processing device
Patent Information
- Application Number
- JP2021106462
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-06-28
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2041-06-28
AI Technical Summary
【0006】 本発明によれば、対象音を収音した場所において、対象音に遮音や響き方などの音環境に関する予測計算結果を加味した試聴音を忠実に再現して試聴できる。
Smart Images

Figure 0007577033000002 
Figure 0007577033000003 
Figure 0007577033000004
Abstract
Description
[Technical field]
[0001] The present invention relates to an object sound processing device. [Background technology]
[0002] The reverberation and the degree of sound insulation are usually indicated by numerical values, and it is difficult for ordinary people who are not familiar with such numerical values to imagine how the sound is heard. For this reason, for example, the reverberation and sound insulation performance are calculated from the design specifications of a building, and a trial sound is generated by adding the predicted calculation results to the target sound such as noise. For example, Patent Document 1 discloses a method of predicting the attenuation of environmental noise (target sound) for each propagation path into a sound receiving room, such as a direct transmission path through a partition wall, a roundabout propagation path from an opening, and a solid propagation path through a side wall, and convoluting the impulse response waveform obtained from the predicted attenuation with the sound source waveform of the environmental noise to generate an evaluation sound (trial sound) (Claim 1, etc.). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2003-156388 A [Patent Document 2] Patent No. 4307622 [Patent Document 3] Patent No. 4234257 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the technology described in Patent Document 1 above, the picked-up target sound was brought back to the location where the processing device was located before the preview sound was generated, so the picked-up target sound could not be processed at the location where it was picked up, and the preview sound could not be heard on the spot. [Means for solving the problem]
[0005] In order to solve the above problems, the target sound processing device according to the present invention comprises: A target sound collected by a sound collection unit at a predetermined location; A collection condition of the target sound; A processed target sound obtained by processing the target sound using a first processing correction value for processing the target sound acquired based on the first characteristic of the sound collection unit; and A test sound that reproduces an absolute sound that is actually heard when the target sound is heard in a predetermined environment at the predetermined location; and a processed sample sound obtained by processing the sample sound using a second processing correction value for processing the sample sound obtained based on a second characteristic of an output unit for outputting the sample sound; and The device is provided with a storage unit that stores at least one or more of the above in association with each other. Effect of the Invention
[0006] According to the present invention, it is possible to faithfully reproduce and listen to a sample sound in a location where a target sound is collected, the sample sound being listened to takes into account the results of predicted calculations regarding the sound environment, such as sound insulation and reverberation, of the target sound. [Brief description of the drawings]
[0007] [Figure 1A] 1 is a diagram for explaining an overview of a target sound processing system according to a first embodiment of the present invention. FIG. [Figure 1B] 1 is a sequence diagram for explaining an overview of the operation of a target sound processing system according to a first embodiment of the present invention. FIG. [Diagram 2] 1 is a block diagram for explaining a configuration of a target sound processing system according to a first embodiment of the present invention. [Figure 3A] 2 is a diagram showing an example of a microphone correction value table included in a target sound processing device of the target sound processing system according to the first embodiment of the present invention. FIG. [Figure 3B] 2 is a diagram showing an example of a speaker correction value table included in a target sound processing device of the target sound processing system according to the first embodiment of the present invention. FIG. [Figure 4]1 is a diagram for explaining a hardware configuration of a target sound processing device of a target sound processing system according to a first embodiment of the present invention. FIG. [Figure 5A] 4 is a flowchart for explaining a processing procedure of a target sound processing device of the target sound processing system according to the first embodiment of the present invention. [Figure 5B] 5 is a flowchart for explaining a processing procedure of a mobile terminal of the target sound processing system according to the first embodiment of the present invention. [Figure 6A] FIG. 11 is a sequence diagram for explaining an outline of the operation of the target sound processing system according to the second embodiment of the present invention. [Figure 6B] FIG. 11 is a block diagram for explaining the configuration of a target sound processing system according to a second embodiment of the present invention. [Figure 7A] 10 is a flowchart for explaining a processing procedure of a target sound processing device of a target sound processing system according to a second embodiment of the present invention. [Figure 7B] 13 is a flowchart for explaining a processing procedure of a mobile terminal of a target sound processing system according to a second embodiment of the present invention. [Figure 8] FIG. 11 is a block diagram for illustrating the configuration of a target sound processing device according to a third embodiment of the present invention. [Figure 9] FIG. 13 is a block diagram for explaining the configuration of a target sound adding device according to a fourth embodiment of the present invention. [Figure 10] FIG. 13 is a diagram showing an example of a sample sound database included in a target sound adding device according to the fourth embodiment of the present invention. [Figure 11] FIG. 13 is a diagram for explaining a hardware configuration of a target sound adding device according to a fourth embodiment of the present invention. [Figure 12] 13 is a flowchart illustrating a processing procedure of a target sound adding device according to a fourth embodiment of the present invention. [Figure 13] 13 is a flowchart for explaining a processing procedure of a sound collection device of a target sound processing system according to a fifth embodiment of the present invention. [Figure 14] 13 is a flowchart for explaining a processing procedure of a mobile terminal of a target sound processing system according to a fifth embodiment of the present invention. [Figure 15] 13 is a flowchart for explaining a processing procedure of a target sound processing device of a target sound processing system according to a fifth embodiment of the present invention. [Figure 16] 1 is a graph showing frequency characteristics of collected sound data. [Figure 17] 1 is a graph showing the pickup level and linearity of a microphone. [Figure 18] 1 is a graph showing frequency characteristics of sound reproduced through headphones. [Figure 19] 1 is a graph showing the reproducible level and linearity of headphones. [Figure 20] FIG. 1 is a diagram showing an outline of the experimental conditions of the present invention. [Figure 21] 1 is a graph showing the sound pressure level difference between rooms. [Figure 22] 1 is a graph showing a sound pressure waveform on the conference room (sound source room) side. [Figure 23] 13 is a graph showing octave band levels on the conference room (sound source room) side. [Figure 24] 13 is a graph showing a sound pressure waveform on the office (sound receiving room) side. [Diagram 25] This is a graph showing the octave band levels on the office (receiving room) side. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations, numerical values, process flows, functional elements, etc. described in the following embodiments are merely examples, and are free to be modified or changed, and are not intended to limit the technical scope of the present invention to the following description.
[0009] [First embodiment] A target sound processing system 100 according to a first embodiment of the present invention will be described with reference to Figs. 1A to 5B. The target sound processing system 100 is used, for example, to generate an evaluation sound for evaluating how a target sound collected at a predetermined location sounds after passing through performance determined by architectural specifications, etc. Fig. 1A is a diagram for explaining an overview of the target sound processing system according to this embodiment.
[0010] The target sound processing system 100 includes a target sound processing device 110 and a mobile terminal 120. A sound collection unit 130 (microphone) and an output unit 140 (speaker) are connected to the mobile terminal 120 by wired connection using a cable from the outside of the mobile terminal 120. The sound collection unit 130 and the output unit 140 may be wirelessly connected to the mobile terminal 120 using a wireless communication standard, and the sound collection unit 130 and the output unit 140 may be built into the mobile terminal 120.
[0011] For example, a worker or user who owns the mobile terminal 120 collects a target sound at a predetermined location using the sound collection unit 130 (microphone) connected to the mobile terminal 120. Here, the target sound includes, but is not limited to, indoor sounds, outdoor sounds, etc. In addition, the predetermined location is, for example, a construction site for a detached house or an apartment building, a construction site for a commercial facility or an office building, a road, a railway facility, an airport, a power plant, a factory, etc., an existing building, etc., and is a location where a person related to the predetermined location or a person who wants to purchase the predetermined location wants to know the sound environment of the predetermined location.
[0012] First, a person collecting target sound 131 at a predetermined location collects the target sound at the predetermined location using the sound collection unit 130, and stores the collected target sound 131 in the mobile terminal 120. Then, the sound collection person (or the owner of the mobile terminal 120, etc.) transmits the target sound data stored in the mobile terminal 120 to the target sound processing device 110. Note that the mobile terminal 120 and the target sound processing device 110 are connected by wireless connection. Also, the target sound processing device 110 may be a cloud server installed on a cloud, etc.
[0013] Then, the target sound processing device 110 processes the target sound 131 picked up at a predetermined location based on the received target sound data to generate an evaluation sound (processed sample sound 141). When transmitting the target sound data to the target sound processing device 110, the mobile terminal 120 preferably also transmits data on the characteristics of the sound collection unit 130 (microphone) and output unit 140 (speaker) connected to the mobile terminal 120, but may transmit the data in response to a request from the target sound processing device 110.
[0014] This is because some frequency components of the picked-up target sound 131 are cut due to the sound pickup characteristics of the sound pickup unit 130, and because the output characteristics of the output unit 140 result in the output of a preview sound having different frequency components from the sound that is actually heard. For this reason, the target sound processing system 100 processes the target sound 131 while also taking into account the characteristics of the microphone and speaker to generate a preview sound (processed preview sound 141).
[0015] For example, built-in microphones and speakers built into mobile terminal 120 are smaller than external microphones and speakers, and may have limited performance or reduced functionality, in order to keep the price of mobile terminal 120 down or to accommodate space issues within the housing of mobile terminal 120. Even external microphones and speakers may be limited to certain functions or have limited performance, or may have enhanced performance, depending on the purpose of use and price. For this reason, there are microphones and speakers with a variety of functions and capabilities.
[0016] In this way, if a microphone dedicated to picking up the target sound or a speaker dedicated to outputting the test sound is used, there is no need to adjust the variation between microphones and speakers. However, if a dedicated microphone or speaker must be used, the dedicated microphone must be transported to a designated location each time the target sound is picked up, and when the test sound is to be listened to, the dedicated speaker must be located, making it difficult to respond flexibly and quickly.
[0017] Therefore, in the target sound processing system 100, in order to eliminate errors that depend on the characteristics of each device, at each stage of processing the picked-up target sound, absolute sounds (processed target sound, trial sound, processed trial sound) are generated in which errors due to the device have been eliminated, and these absolute sounds are processed to reproduce sounds that are no different from real sounds, allowing the listener to experience them.
[0018] Therefore, in the target sound processing system 100, the characteristics of the sound collection unit 130 (microphone) and the characteristics of the output unit 140 (speaker) are transmitted to the target sound processing device 110 together with the target sound data of the collected target sound. Alternatively, the characteristics of the sound collection unit 130 and the output unit 140 may be transmitted to the target sound processing device 110 separately from the target sound, for example, before or after the transmission of the target sound. The target sound processing device 110 processes the received target sound data using a correction value according to the characteristics of the sound collection unit 130 that collected the sound, to generate a processed target sound. Next, the target sound processing device 110 generates a trial sound from the generated processed target sound, which reproduces the sound that is actually heard when the target sound is heard in a predetermined place under a predetermined environment.
[0019] Here, the predetermined environment includes, for example, buildings such as apartment buildings and detached houses to be constructed at the predetermined location where the target sound was collected, and includes the interior of these buildings and the exterior of balconies, etc. Furthermore, the predetermined environment may include various factors that realize the living environment of the building, such as the position and area of the walls of the building, sound insulation performance (sound transmission loss), the position, area, and sound insulation performance (sound transmission loss) of windows installed in the building, the area and number of air intakes, sound insulation performance (standardized sound transmission loss), the surface area of the room, and sound absorption performance (sound absorption power).
[0020] Then, the target sound processing device 110 reproduces, for example, a predetermined environment (such as a building) in a virtual space, and generates a trial sound by predicting the acoustic effect in the predetermined environment using the data of the collected target sound. The target sound processing device 110 processes the generated trial sound using a correction value according to the characteristics of the output unit 140 to generate a processed trial sound. In this way, by processing the trial sound using a correction value based on the characteristics of the output unit 140, it is possible to reliably reproduce the sound that is actually heard in the output unit 140 without using a dedicated speaker. Note that the trial sound may be regenerated based on the result of listening to the processed trial sound. In this way, by regenerating the trial sound, trial sounds in various environments can be reproduced, so that trial sounds in various environments can be simulated by changing, for example, the area of a window or the grade of sound insulation performance.
[0021] 1B, an overview of the operation of the target sound processing system will be described. In step S101, the target sound is collected by the sound collection unit 130. In step S103, the collected target sound is transmitted from the sound collection unit 130 to the mobile terminal 120. The collected target sound is, for example, analog data.
[0022] Then, in step S105, the mobile terminal 120 transmits target sound data obtained by digitally converting the received target sound to the target sound processing device 110. In step S107, the target sound processing device 110 processes the received target sound data in accordance with predetermined conditions to generate a processed sample sound. In step S109, the target sound processing device 110 transmits the generated processed sample sound to the mobile terminal 120 (output unit 140). In step S111, the output unit 140 outputs the received processed sample sound. Note that the sound collection unit 130 and the output unit 140 may be built into the mobile terminal 120. Also, the digital conversion of the target sound may be performed in the target sound processing device 110.
[0023] The configuration of the target sound processing system 100 will be described with reference to Fig. 2. The target sound processing system 100 includes a target sound processing device 110 and a mobile terminal 120. The target sound processing device 110 includes a first receiving unit 211, a sound collection condition acquiring unit 212, a processed target sound generating unit 213, a preview sound generating unit 214, a processed preview sound generating unit 215, and a second transmitting unit 216.
[0024] The first receiving unit 211 acquires the target sound collected by the sound collecting unit 130 at a predetermined location. The acquired data related to the target sound is, for example, analog data, and the target sound processing device 110 converts the received analog data of the target sound into digital data and stores it as target sound data (digital data). If the sound collecting unit 130 has an AD converter, the digital conversion may be performed in the sound collecting unit 130.
[0025] The sound collection conditions acquired by the sound collection condition acquisition unit 212 are various conditions when the target sound is collected, and include, for example, mechanical characteristics such as the frequency characteristics of the sound collection unit 130 (microphone), characteristics of the software built into the sound collection unit 130, and environmental characteristics such as temperature, humidity, wind direction, and wind volume at a specified location, but are not limited to these.
[0026] The processed target sound generating unit 213 acquires a first processing correction value for processing the target sound based on the acquired sound collection conditions. The processed target sound generating unit 213 acquires the first processing correction value from, for example, an internal storage or an external storage, but the method of acquiring the first processing correction value is not limited thereto.
[0027] Then, the processed target sound generation unit 213 processes the target sound (target sound data) using the acquired first processing correction value to generate the processed target sound. The processed target sound generation unit 213 processes the target sound data, for example, by canceling a specific frequency component, to generate the processed target sound.
[0028] The trial sound generating unit 214 processes the generated processed target sound to generate a trial sound that reproduces the sound that is actually heard when the target sound is heard in a predetermined environment at a predetermined place where the target sound is collected. Here, the predetermined environment is, for example, a building such as an apartment building or a detached house to be constructed at the predetermined place where the target sound is collected, and includes the indoors and outdoors such as balconies of these buildings, and further, the predetermined environment may include various factors that realize the living environment of the building, such as the position and area of the walls of the building, the sound insulation performance (sound transmission loss), the position, area, and sound insulation performance (sound transmission loss) of windows attached to the building, the area and number of air intakes, and sound insulation performance (standardized sound transmission loss), the surface area of the room, the sound absorption performance (sound absorption power), and the reflection of sound from surrounding buildings.
[0029] The sample sounds that are generated include, for example, (1) indoor noise caused by external noise, (2) inter-room sound insulation performance (noise propagating from adjacent rooms), (3) noise propagating from inside and outside the building to the site boundary, (4) indoor quieting performance caused by air conditioning equipment, (5) floor impact sound insulation performance (floor impact sound), and (6) indoor reverberation time (sound reverberation).
[0030] Specifically, (1) refers to how noise from an external noise source such as a train sounds in a room. (2) refers to how a room with a TV or conference sound sounds in an adjacent room. (3) refers to how noise sources such as equipment and machinery and work noises on the building site (inside or outside the building) sound to the site boundary or neighbors. (4) refers to how the quietness of the room changes or how the sound of the air conditioning equipment sounds in the room when the noise source is an air conditioner or total heat exchanger. (5) refers to how the sound of jumping or running around from the room on the upper floor sounds in the room on the lower floor. (6) refers to how the sound of talking or audio equipment resonates and sounds in the room during a meeting or lecture.
[0031] The processed preview sound generation unit 215 acquires a second processing correction value for processing the preview sound based on the output conditions of the output unit 140 (speaker) for outputting the generated preview sound, and processes the preview sound using the acquired second processing correction value to generate a processed preview sound.
[0032] Since the reproducibility of the sample sound when output from the output unit 140 depends on the characteristics of the output unit 140, even if the same sample sound data is reproduced, when it is output from a plurality of output units 140 with different characteristics, the listener may hear the sound differently. When such a situation occurs, additional construction may be required after the building or the like is actually constructed. Therefore, in order to reproduce the sound that will actually be heard in advance, the generated sample sound is processed according to the output characteristics of the output unit 140. A processing correction value (second processing correction value) is used to process the sample sound.
[0033] The second processing correction value is determined after outputting a reference experimental sound from each of the output units 140 (speakers) and checking the output characteristics, such as the frequency characteristics, of each of the output units 140. Then, the processed sample sound generating unit 215 processes the sample sound using the second processing correction value determined as described above, and generates a processed sample sound by processing the generated sample sound according to the characteristics of the output unit 140.
[0034] The second transmission unit 216 transmits the processed sample sound generated in the processed sample sound generation unit 215 to the mobile terminal 120. Note that the second transmission unit 216 may transmit the generated processed sample sound directly to the output unit 140.
[0035] Next, the mobile terminal 120 includes an acquisition unit 221, a first transmission unit 222, a second reception unit 223, and an output control unit 224. Furthermore, the mobile terminal 120 is connected to a sound collection unit 130 and an output unit 140. Note that the sound collection unit 130 and the output unit 140 may be built into the mobile terminal 120.
[0036] The acquisition unit 221 acquires a target sound collected by the sound collection unit 130 (microphone) at a predetermined location. Here, the target sound includes at least one of indoor sound and outdoor sound. The acquired data of the target sound is analog data, but if the sound collection unit 130 has an AD converter, for example, the analog data of the collected target sound may be converted into digital data in the sound collection unit 130. If the sound collection unit 130 does not have an AD converter, the analog data may be converted into digital data using an AD converter included in the mobile terminal 120. If neither the sound collection unit 130 nor the mobile terminal 120 has an AD converter, the analog data of the collected target sound may be converted into digital data in an AD converter included in the target sound processing device 110, as described above.
[0037] The first transmission unit 222 transmits the acquired data of the target sound to the target sound processing device 110. The data of the target sound transmitted to the target sound processing device 110 may be analog data or digital data.
[0038] The second receiving unit 223 receives the processed sample sound 141 transmitted from the target sound processing device 110. The data of the received processed sample sound 141 is digital data.
[0039] The output control unit 224 controls the received processed sample sound 141 to output it from the output unit 140. The output control unit 224 converts the digital data of the received processed sample sound 141 into analog data, sends it to the output unit 140, and controls the output unit 140 to play back the analog data of the processed sample sound 141.
[0040] Next, an example of a microphone correction value table 301 and a speaker correction value table 302 held by the target sound processing device 110 of the target sound processing system 100 will be described with reference to Fig. 3A and Fig. 3B. The microphone correction value table 301 stores characteristics 312 and correction values 313 in association with a microphone ID (Identifier) 311. The microphone ID 311 is an identifier for identifying a microphone capable of collecting a target sound. The characteristics 312 indicate characteristics of the microphone, and include a frequency characteristic and a possible sound collection level. The correction values 313 include a frequency correction value and a level correction value. The processed target sound generation unit 213 of the target sound processing device 110 then refers to the microphone correction value table 301, extracts a correction value according to the characteristics of the microphone (sound collection unit 130), and processes the received target sound.
[0041] The speaker correction value table 302 stores characteristics 322 and correction values 323 in association with speaker IDs 321. The speaker IDs 321 are identifiers for identifying speakers capable of outputting the processed sample sound transmitted from the target sound processing device 110. The characteristics 321 indicate speaker characteristics, including frequency characteristics and possible output levels. The correction values 323 include frequency correction values and level correction values. The processed sample sound generation unit 215 of the target sound processing device 110 then refers to the speaker correction value table 302, extracts correction values according to the characteristics of the speaker (output unit 140), and processes the generated sample sound.
[0042] With reference to FIG. 4, the hardware configuration of the target sound processing device 110 of the target sound processing system 100 will be described. The CPU (Central Processing Unit) 410 is a processor for arithmetic control, and executes a program to realize each functional configuration of the target sound processing device 110 of FIG. 2. The CPU 410 may have multiple processors and execute different programs, modules, tasks, threads, etc. in parallel. The ROM (Read Only Memory) 420 stores fixed data such as initial data and programs, and other programs. The network interface 430 communicates with other devices, etc. via a network. The CPU 410 is not limited to one, and may be multiple CPUs or may include a GPU (Graphics Processing Unit) for image processing. The network interface 430 preferably has a CPU independent of the CPU 410 and writes or reads transmission and reception data in an area of the RAM (Random Access Memory) 440. It is also preferable to provide a DMAC (Direct Memory Access Controller) for transferring data between the RAM 440 and the storage 450 (not shown). Furthermore, the CPU 410 processes the data upon recognizing that the data has been received or transferred to the RAM 440. The CPU 410 also prepares the processing results in the RAM 440, and leaves the subsequent transmission or transfer up to the network interface 430 or DMAC.
[0043] The RAM 440 is a random access memory used by the CPU 410 as a temporary storage work area. A storage area for storing data necessary for implementing the present embodiment is secured in the RAM 440. The target sound data 441 is data of a target sound collected by the sound collection unit 130 at a predetermined location, and is digitally converted data.
[0044] The microphone correction value 442 is used to calibrate the microphone sensitivity (difference between the actual sound and the picked up sound) that depends on the sound pickup unit 130 (microphone) used to pick up the target sound. The speaker correction value 443 is used to cancel the speaker-specific acoustic characteristics (difference between the generated sample sound and the reproduced sample sound) that depends on the output unit 140 (speaker) that reproduces the generated processed sample sound.
[0045] The processed target sound data 444 is data of the target sound obtained by processing the collected target sound using the first processing correction value. The trial sound data 445 is data of the trial sound obtained by processing the processed target sound, and reproduces the sound that is actually heard when the target sound is listened to at a predetermined place under a predetermined environment. The processed trial sound data 446 is a trial sound that has been processed using the second processing correction value based on the output conditions of the output unit 140 for outputting the generated trial sound.
[0046] The transmitted / received data 447 is data that is transmitted and received via the network interface 430. The RAM 440 also has an application execution area 448 for executing various application modules.
[0047] The storage 450 stores a database, various parameters, or the following data or programs required to realize this embodiment. The storage 450 stores a microphone correction value table 301 and a speaker correction value table 302. The microphone correction value table 301 is a table that manages the relationship between the microphone ID 311 and the correction value 313, etc., shown in Fig. 3A, and the speaker correction value table 302 is a table that manages the relationship between the speaker ID 321 and the correction value 323, etc., shown in Fig. 3B.
[0048] The storage 450 further stores a first receiving module 451, a sound collection condition acquisition module 452, a processed target sound generation module 453, a preview sound generation module 454, a processed preview sound generation module 455, and a second transmitting module 456. The first receiving module 451 is a module that receives the collected target sound from the mobile terminal 120. The sound collection condition acquisition module 452 is a module that acquires the sound collection conditions of the received target sound. The processed target sound generation module 453 is a module that acquires a first processing correction value based on the acquired sound collection conditions, processes the target sound using the acquired first processing correction value, and generates the processed target sound. The preview sound generation module 454 is a module that processes the processed target sound to generate a preview sound, which is a sound that is actually heard when the target sound is listened to in a predetermined place under a predetermined environment. The processed sample sound generation module 455 is a module that processes the sample sound using a second processing correction value according to the output condition of the output section 140 for outputting the generated sample sound, thereby generating a processed sample sound. The second transmission module 456 is a module that transmits the generated processed sample sound to the mobile terminal 120. These modules 451 to 456 are read by the CPU 410 into the application execution area 448 of the RAM 440 and executed. The control program 457 is a program for controlling the entire target sound processing device 110.
[0049] The input / output interface 460 interfaces input / output data with input / output devices. A display unit 461 and an operation unit 462 are connected to the input / output interface 460. A storage medium 464 may be further connected to the input / output interface 460. A speaker 463 serving as an audio output unit, a microphone (not shown) serving as an audio input unit, or a GPS position determination unit may be further connected. Note that the RAM 440 and the storage 450 shown in FIG. 4 do not show programs and data relating to the general-purpose functions of the target sound processing device 110 or other feasible functions.
[0050] Next, a processing procedure of the object sound processing device 110 will be described with reference to the flowchart shown in Fig. 5A. This flowchart is executed by the CPU 410 in Fig. 4 using the RAM 440, and realizes each functional configuration of the object sound processing device 110 in Fig. 2.
[0051] In step S501, the target sound processing device 110 receives a target sound collected at a predetermined location from the mobile terminal 120. In step S503, the target sound processing device 110 acquires the collection conditions of the acquired target sound. In step S505, the target sound processing device 110 acquires a first processing correction value for processing the target sound based on the acquired collection conditions. In step S507, the target sound processing device 110 processes the target sound using the acquired first processing correction value to generate a processed target sound.
[0052] In step S509, the target sound processing device 110 processes the generated processed target sound to generate a trial sound, which is a sound that is actually heard when the target sound is listened to in a predetermined place under a predetermined environment. In step S511, the target sound processing device 110 acquires a second processing correction value for processing the trial sound based on the output condition of the output unit 140 that outputs the generated trial sound. In step S513, the target sound processing device 110 processes the generated trial sound using the acquired second processing correction value to generate a processed trial sound. The target sound processing device 110 transmits the generated processed trial sound to the mobile terminal 120.
[0053] 5B, a processing procedure of mobile terminal 120 will be described. This flowchart is executed by a CPU (not shown) using a RAM, and realizes each functional configuration of mobile terminal 120 in FIG.
[0054] In step S531, the mobile terminal 120 acquires the target sound collected by the sound collection unit 130 from the sound collection unit 130. Here, the mobile terminal 120 may digitally convert the acquired target sound. In step S533, the mobile terminal 120 transmits data of the acquired target sound to the target sound processing device 110. In step S535, the mobile terminal 120 receives the processed sample sound from the target sound processing device 110, and outputs the received processed sample sound from the output unit 140.
[0055] According to this embodiment, the trial sound is generated based on the target sound processed according to the characteristics of the sound collection unit, so the trial sound can be generated without depending on the sound collection device (without using a dedicated sound collection device). Furthermore, the generated trial sound is processed according to the characteristics of the output unit, so the trial sound can be listened to without depending on the output device (without using a dedicated output device). Furthermore, since there is no need to use a dedicated device, it is possible to quickly and accurately generate and listen to a trial sound on the spot for a target sound in any location.
[0056] [Second embodiment] Next, a target sound processing system 600 according to a second embodiment of the present invention will be described with reference to Figs. 6A to 7B. Fig. 6A is a sequence diagram for explaining a processing procedure of the target sound processing system 600 according to this embodiment. The target sound processing system 600 according to this embodiment differs from the first embodiment in that a target sound processing device 610 generates a new sample sound based on the result of listening to the sample sound. Other configurations and operations are similar to those of the first embodiment, so the same configurations and operations are denoted by the same reference numerals and detailed description thereof will be omitted.
[0057] With reference to Fig. 6A, the generation of a new processed sample sound based on the result of listening to the processed sample sound will be described. In step S601, the mobile terminal 620 transmits, for example, the reproduced processed sample sound, for example, the result of the user listening to the reproduced processed sample sound, to the target sound processing device 610. Then, in step S603, the target sound processing device 610 generates the processed sample sound again by changing the generating conditions of the sample sound, such as the area of the window and the sound insulation performance (sound transmission loss), based on the listening result (determination result). In step S605, the target sound processing device 610 transmits the generated processed sample sound to the mobile terminal 620 (output unit 140). In step S607, the output unit 140 reproduces the regenerated processed sample sound. As described above, in the target sound processing system 100, the processed trial sound may be re-generated depending on the results of listening to the processed trial sound, thereby making it possible to listen to trial sounds in multiple environments for a certain target sound.
[0058] 6B, the target sound processing system 600 includes a target sound processing device 610 and a mobile terminal 620. The target sound processing device 610 has a result receiving unit 611. In addition, the mobile terminal 620 has a result input receiving unit 621.
[0059] The result input receiving unit 621 receives an input of the results of a person who has listened to the processed sample sound output from the output unit 140. Here, the results of listening to the processed sample sound include, for example, an evaluation of the output processed sample sound, an instruction to change a predetermined environment, etc.
[0060] Then, the result receiving unit 611 receives the preview result of the processed preview sound from the mobile terminal 620. The preview sound generating unit 214 of the target sound processing device 610 generates a preview sound in a new environment different from the previously generated preview sound from the collected target sound based on the received preview result. Here, the new environment different from the previously generated preview sound refers to, for example, an environment in which the area of a window has been increased or decreased, or the sound insulation performance has been changed, or the sound insulation performance of a wall has been changed, but is not limited to these.
[0061] The preview sound generating unit 214 changes the generation conditions of the preview sound based on the received preview result (determination result) and generates a preview sound according to the preview result (determination result). The preview sound generating unit 214 generates the preview sound under all generation conditions that can be set as the preview sound generation conditions, for example.
[0062] In this way, the extraction unit 612 extracts a trial sound that satisfies the user's request from among the trial sounds generated under all settable generation conditions based on the judgment result made by the user. Note that the extraction unit 612 may extract all of the trial sounds generated under all settable generation conditions.
[0063] The assigning unit 613 assigns a score to the sample sound extracted by the extracting unit 612, taking into consideration the cost and construction time required to build a predetermined environment. The assigning unit 613 may assign a high score to a sample sound that allows the construction of a predetermined environment at low cost and in a short construction time, for example. Note that the method of assigning the score is not limited to the method shown here.
[0064] Then, the second transmission unit 216 transmits the newly generated processed sample sound to the mobile terminal 620. The output unit 140 outputs the received processed sample sound, and the result input receiving unit 621 receives again the sample listening result from the person who listened to the processed sample sound, and transmits the received sample listening result to the target sound processing device 610. In the target sound processing system 600, by repeating the above-mentioned procedure, it becomes possible to test sample sounds in various environments.
[0065] Next, the processing procedure of the target sound processing device 610 and the mobile terminal 620 will be described with reference to Fig. 7A and Fig. 7B. First, with reference to Fig. 7A, in step S701, the target sound processing device 610 judges whether or not there is a request to regenerate a trial sound. If there is a request to regenerate a trial sound (YES in step S701), the target sound processing device 610 returns to step S509 and repeats the procedure of regenerating a trial sound that satisfies the target level (noise level, inter-room sound insulation performance (Dr-50), etc.). For example, the trial sound may be generated under all generation conditions that can be set at that time, and then the trial sound that satisfies the user's request may be extracted from the generated trial sounds, thereby regenerating the trial sound.
[0066] 7B, in step S731, the mobile terminal 620 determines whether the preview result accepted by the result input accepting unit 621 is a result requesting regeneration of the processed preview sound (preview sound). If there is no regeneration request (NO in step S731), the mobile terminal 620 ends the process. If there is a regeneration request (YES in step S731), the mobile terminal 620 proceeds to the next step. In step S733, the mobile terminal 620 sends a retransmission request for the preview sound to the target sound processing device 610.
[0067] In step S735, the mobile terminal 620 receives the regenerated processed sample sound from the target sound processing device 610 and outputs it from the output unit 140. In step S737, the mobile terminal 620 judges whether the preview result of the regenerated processed sample sound is a result that requires regeneration. If there is a regeneration request (YES in step S737), the mobile terminal 620 returns to step S733. If there is no regeneration request (NO in step S737), the mobile terminal 620 ends the process.
[0068] According to this embodiment, since the input of the trial sound listening result is accepted, the trial sound can be listened to under various environments.
[0069] [Third embodiment] Next, a target sound processing device according to a third embodiment of the present invention will be described with reference to Fig. 8 to Fig. 11. Fig. 8 is a block diagram for explaining the configuration of a target sound processing device 800 according to this embodiment. The target sound processing device 800 according to this embodiment differs from the target sound processing systems of the first and second embodiments in that the target sound processing device 800 collects, processes and outputs a target sound.
[0070] The target sound processing device 800 has a sound collection unit 801, a first characteristic acquisition unit 802, a processed target sound generation unit 803, a preview sound generation unit 804, a second characteristic acquisition unit 805, a processed preview sound generation unit 806, an output control unit 807, an output unit 808 and a storage unit 809.
[0071] The sound collection unit 801 collects the target sound 131 at a predetermined location. The sound collection unit 801 is a device such as a microphone, and may be either an external type or a built-in type.
[0072] The first characteristic acquisition unit 802 acquires the first characteristic of the sound collection unit 801. The first characteristic is, for example, the frequency characteristic of the sound collected by the sound collection unit 801 and the sound collection level of the sound collection unit 801. The first characteristic acquisition unit 802 acquires the first characteristic from the microphone correction value table 301 stored in the storage unit 809.
[0073] The processed target sound generating unit 803 acquires a first processing correction value for processing the collected target sound based on the acquired first characteristic, and processes the target sound using the acquired first processing correction value to generate the processed target sound. That is, the processed target sound generating unit 803 acquires the first processing correction value stored in association with the acquired first characteristic from the microphone correction value table 301. Then, the processed target sound generating unit 803 processes the target sound 131 using the acquired first processing correction value to generate the processed target sound.
[0074] Here, the reason why the collected target sound 131 is processed using the first processing correction value is to eliminate the variation (device dependency) that depends on the device characteristics because there are various types of sound collection devices such as microphones, each of which has various characteristics. For example, one microphone is configured to cut sounds in the treble range (high frequency region). Another microphone is configured to cut sounds in the bass range (low frequency region).
[0075] In this way, each microphone has various characteristics depending on, for example, its use, price, etc., and the sound (sound data) picked up by each microphone contains features (device dependency) according to the characteristics. Therefore, in order to eliminate the features of this sound (sound data), the processed target sound generating unit 803 uses the first processing correction value to remove the features of the sound (sound data) and eliminate the difference in the device characteristics of the sound collecting unit 801 (microphone).
[0076] The trial sound generating unit 804 generates a trial sound that reproduces the sound that is actually heard when the target sound 131 is listened to under a predetermined environment at the place where the target sound 131 is collected. Here, the predetermined environment is, for example, a building such as an apartment building or a detached house to be constructed at the predetermined place where the target sound 131 is collected, and includes the indoors and outdoors such as balconies of these buildings, and the predetermined environment may include various factors that realize the living environment of the building, such as the position and area of the walls of the building, the sound insulation performance (sound transmission loss), the position, area, and sound insulation performance (sound transmission loss) of windows attached to the building, the area and number of air intakes, the sound insulation performance (standardized sound transmission loss), the surface area of the room, and the sound absorption performance (sound absorption power).
[0077] The sample sounds that are generated include, for example, (1) indoor noise caused by external noise, (2) inter-room sound insulation performance (noise propagating from adjacent rooms), (3) noise propagating from inside and outside the building to the site boundary, (4) indoor quieting performance caused by air conditioning equipment, (5) floor impact sound insulation performance (floor impact sound), and (6) indoor reverberation time (sound reverberation).
[0078] The second characteristic acquisition unit 805 acquires the second characteristic of the output unit 808 for outputting the generated trial sound. The second characteristic is, for example, the frequency characteristic of the sound output from the output unit 808 and the possible output level of the output unit 808. The second characteristic acquisition unit 805 acquires the second characteristic from the speaker correction value table 302 stored in the storage unit 809.
[0079] The processed sample sound generation unit 806 acquires a second processing correction value for processing the generated sample sound based on the acquired second characteristic, and processes the sample sound using the acquired second processing correction value to generate processed sample sound 141. That is, the processed sample sound generation unit 806 acquires a second processing correction value that is stored in association with the acquired second characteristic from the speaker correction value table 302. Then, the processed sample sound generation unit 806 processes the sample sound using the acquired second processing correction value to generate processed sample sound 141.
[0080] Here, the reason why the generated sample sound is processed using the second processing correction value is to eliminate the variation (device dependency) that depends on the device characteristics because there are various devices for output devices such as speakers, and each speaker has various characteristics, just like the above-mentioned microphone (sound pickup unit 801). For example, a certain speaker may have excellent reproducibility in the high range but poor reproducibility in the low range, or conversely, may have poor reproducibility in the high range but excellent reproducibility in the low range.
[0081] In this way, each speaker has various characteristics depending on, for example, its use, price, etc., and the sound output from each speaker is output as a sound according to its characteristics. Therefore, in order to eliminate the device-dependent characteristics of the output sound, the processed sample sound generating unit 806 uses the second processing correction value to remove the device-dependent characteristics and cancel the device characteristics of the output unit 808 (speaker), making it possible to reproduce the sound that is actually heard.
[0082] The output control unit 807 controls the generated processed sample sound and outputs it from the output unit 808. The output control unit 807 converts the processed sample sound from digital data to analog data and sends the converted analog data to the output unit 808, for example.
[0083] The output unit 808 outputs the processed sample sound. The output unit 808 is a device such as a speaker or a headphone for outputting the processed sample sound. The output unit 808 may be built in the target sound processing device 800 or may be attached externally to the target sound processing device 800.
[0084] The storage unit 809 stores a microphone correction value table 301 and a speaker correction value table 302. The microphone correction value table 301 is a table that manages the relationship between the microphone ID 311 and the correction value 313, etc., and the speaker correction value table 302 is a table that manages the relationship between the speaker ID 321 and the correction value 323, etc. Then, the processed target sound generation unit 803 acquires the first processing correction value from the microphone correction value table 301, and the processed sample sound generation unit 806 acquires the second processing correction value from the speaker correction value table 302.
[0085] In this way, in the target sound processing device 800, the first processing correction value and the second processing correction value are stored in advance in the storage unit 809 as the microphone correction value table 301 and the speaker correction value table 302, and are read out as needed.
[0086] According to the present embodiment, since the target sound processing device has a table storing processing correction values, the processed preview sound can be generated quickly and reliably. In addition, even if the sound collection location and the installation location of the target sound processing device are different, the processed preview sound can be easily generated and previewed.
[0087] [Fourth embodiment] Next, a target sound processing device 900 according to a fourth embodiment of the present invention will be described with reference to Fig. 9 to Fig. 12. Fig. 9 is a block diagram for explaining the configuration of the target sound processing device 900 according to this embodiment. The target sound processing device 900 according to this embodiment differs from the target sound processing systems and target sound processing devices according to the first to third embodiments in that a database generated in advance is used.
[0088] The target sound processing device 900 includes a storage unit 901 , a reception unit 902 , a search unit 903 , an acquisition unit 904 , and an output control unit 905 .
[0089] The storage unit 901 stores a target sound (target sound data) collected by the sound collection unit 130 at a predetermined location and the collection conditions of the collected target sound. The storage unit 901 further stores a processed target sound (processed target sound data) obtained by processing the acquired target sound using a first processing correction value for processing the target sound acquired based on the first characteristic of the sound collection unit 130, and a trial sound (trial sound data) that reproduces the sound that is actually heard when the target sound is heard at a predetermined location under a predetermined environment.
[0090] The storage unit 901 also stores a processed preview sound (processed preview sound data) obtained by processing the preview sound using a second processing correction value for processing the preview sound obtained based on the second characteristic of the output unit 140 for outputting the preview sound.
[0091] The storage unit 901 associates the target sound data, sound collection conditions, processed target sound data, trial sound data, and processed trial sound data with each other and stores them as trial sound database 911. In the target sound processing device 900, each time the target sound is collected and a processed trial sound is generated, this data is stored in the storage unit 901 and stocked in the trial sound database 911. In this way, since the various data generated when the target sound is collected is stocked in the database, it becomes possible to listen to the desired processed trial sound more quickly as the amount of data stored in the database increases.
[0092] The receiving unit 902 receives the characteristics of the target sound for which the processed sample sound is to be listened to. Here, the characteristics of the target sound include, for example, a location with a nearby factory, a location with a nearby highway or main road, a location near the coast, a location in a mountainous area, a location near a park, height [m] from the ground, time of day or night, weather, temperature [°C], air pressure [atm], humidity [%], wind speed [m / s], wind direction, etc., but are not limited to these. In addition, the frequency characteristics and waveform (change in sound pressure on the time axis) of the target sound may also be used.
[0093] The search unit 903 searches the storage unit 901 for a target sound corresponding to the received feature. That is, the collected target sound is stored as target sound data to which the above-mentioned feature is added as metadata. Therefore, the search unit 903 searches for target sound data corresponding to the received feature by relying on this metadata. Note that the search unit 903 searches for target sound data that perfectly matches the received feature, but if there is no perfectly matching target sound data, it may search for target sound data that matches some of the received features in order of highest matching rate.
[0094] The acquisition unit 904 acquires a processed sample sound (processed sample sound data) associated with the searched target sound (target sound data). In this case, a plurality of processed sample sounds are associated with one target sound. That is, there are a plurality of different types of output units 140, and a plurality of processed sample sounds exist corresponding to each of these output units 140. Therefore, the acquisition unit 904 acquires a processed sample sound that matches the characteristics of the output unit 140 that outputs the searched target sound.
[0095] The output control section 905 controls the acquired processed sample sound and outputs it from the output section 140. The processed sample sound output from the output section 140 is a sample sound that matches the characteristics of the output section 140.
[0096] Next, the structure of the sample sound database 911 will be described with reference to Fig. 10. The sample sound database 911 stores target sound data 1002, sound collection conditions 1003, processed target sound data 1004, sample sound data 1005, output conditions 1006, and processed sample sound data 1007 in association with a target sound ID 1001.
[0097] The target sound ID 1001 is an identifier for identifying the collected target sound. The target sound data 1002 is data of the collected target sound, and includes analog data of the target sound collected by the sound collection unit 130 and digital data obtained by digitally converting the analog data. The target sound data 1002 may be only analog data, or may be digitally converted as necessary to obtain digital data.
[0098] The sound collection conditions 1003 are various conditions when the target sound is collected. The sound collection conditions 1003 include microphone characteristics, sound collection environment, etc. The microphone characteristics are the frequency characteristics and the possible sound collection level of the sound collection unit 130 (microphone), and the sound collection environment is the weather, temperature, air pressure, etc.
[0099] The processed target sound data 1004 is data obtained by processing the collected sound data in accordance with the characteristics of the sound collection unit 130 (microphone). The trial sound data 1005 is data of trial sound that reproduces the sound that is actually heard when the target sound is listened to in a specified location under a specified environment. The output conditions 1006 are conditions related to output such as the frequency characteristics and possible output level of the output unit 140 (speaker). The processed trial sound data 1007 is data of trial sound that has been processed in accordance with the output characteristics of the output unit 140 (speaker).
[0100] Then, the search unit 903 searches the sample sound database 911 stored in the storage unit 901 for a target sound that matches the characteristics received by the reception unit 902, and the acquisition unit 904 acquires processed sample sound data that matches the characteristics of the output unit 140.
[0101] The hardware configuration of the target sound processing device 900 will be described with reference to FIG. 11. The RAM 1140 is a random access memory used by the CPU 410 as a work area for temporary storage. A storage area for storing data necessary for realizing this embodiment is secured in the RAM 1140. The target sound characteristic data 1141 is data relating to the characteristics of a target sound for which the processed sample sound is to be sampled. The processed sample sound data 1142 is data relating to a processed sample sound stored in association with a target sound obtained by searching the sample sound database 911 based on the characteristics of the target sound for which the processed sample sound is to be sampled. The transmission / reception data 1143 is data transmitted / received via the network interface 430. The RAM 1140 also has an application execution area 1144 for executing various application modules.
[0102] The storage 1150 stores databases, various parameters, or the following data or programs required to realize this embodiment. The storage 1150 stores a sample sound database 911. The sample sound database 911 is a database that stores the target sound ID 1001 and the processed sample sound data 1007 shown in FIG. 10 in association with each other.
[0103] The storage 1150 further stores a reception module 1151, a search module 1152, an acquisition module 1153, and an output control module 1154. The reception module 1151 is a module that receives the characteristics of a target sound for which a processed sample sound is to be sampled. The search module 1152 searches the sample sound database 911 stored in the storage unit 901 for a target sound corresponding to the received characteristics. The acquisition module 1153 is a module that acquires a processed sample sound associated with the searched target sound from the sample sound database 911. The output control module 1154 is a module that controls the acquired processed sample sound and outputs it from the output unit 140. These modules 1151 to 1154 are read by the CPU 410 into the application execution area 1144 of the RAM 440 and executed. The control program 1155 is a program for controlling the entire target sound processing device 900.
[0104] Next, a processing procedure of the object sound processing device 900 will be described with reference to the flowchart shown in Fig. 12. This flowchart is executed by the CPU 410 in Fig. 11 using the RAM 1140, and realizes each functional configuration of the object sound processing device 900 in Fig. 9.
[0105] In step S1201, the receiving unit 902 of the target sound processing device 900 receives features of a target sound for which the processed sample sound is to be sampled. In step S1203, the searching unit 903 searches the sample sound database 911 for a target sound corresponding to the received features. In step S1205, the acquiring unit 904 acquires, from the sample sound database 911, a processed sample sound associated with the searched target sound. In step S1207, the output control unit 905 controls the acquired processed sample sound to output it from the output unit 140.
[0106] In the above explanation, an example was given in which the target sound, sound collection conditions, processed target sound, trial sound, and processed trial sound are associated with each other and stored in the database, but the combinations of data stored in the database are not limited to these.
[0107] For example, if the target sound is stored in a database, it is possible to use the desired target sound among previously collected target sounds without having to take the trouble of collecting the target sound. In this way, by using previously collected target sounds, it is possible to reduce the time required for sound collection.
[0108] Also, for example, if the target sound is stored in a database in association with the sound collection conditions and the processed target sound generated from the target sound, and if the desired target sound exists in the database, processing to generate the processed target sound from the desired target sound becomes unnecessary. In other words, by using data on the processed target sound registered in advance in the database, it is possible to reduce the time, etc., until the final processed sample sound is obtained.
[0109] Furthermore, if the sample sound is stored in the database in association with the target sound, the sound collection conditions, and the processed target sound, and if the desired target sound exists in the database, no processing is required to generate the sample sound. Therefore, as described above, it is possible to significantly reduce the time required to obtain the final processed sample sound.
[0110] According to this embodiment, when the target sound is collected, various data generated are stored in a database, so that as the amount of data stored in the database increases, it becomes possible to listen to the desired processed sample sound more quickly.
[0111] [Fifth embodiment] Next, a target sound processing system according to a fifth embodiment of the present invention will be described with reference to Figs. 13 to 15. The target sound processing system according to this embodiment includes a sound collection device, a mobile terminal, and a target sound processing device. The mobile terminal and the target sound processing device are connected via a network. The sound collection device and the mobile terminal are connected by wire or wirelessly. Figs. 13 to 15 are flowcharts for explaining the processing procedures of the sound collection device, the mobile terminal, and the target sound processing device included in the target sound processing system according to this embodiment. In the following description, an example in which the sound collection device and the mobile terminal are configured separately will be described, but the sound collection device may be built into the mobile terminal.
[0112] First, the processing procedure of the sound collection device will be described with reference to Fig. 13. In step S1301, the first worker operates the sound collection device such as a microphone to collect a target sound in a predetermined location. In step S1303, the first worker operates the sound collection device to transmit the collected target sound to the mobile terminal.
[0113] Next, a processing procedure of the mobile terminal will be described with reference to FIG. 14. In step S1401, the first operator operates a mobile terminal such as a tablet terminal or a smartphone to AD convert the received target sound into digital data. In step S1403, the first operator operates the mobile terminal to transmit the target sound (target sound data) to the target sound processing device. In step S1405, the first operator operates the mobile terminal to output, from the output unit, a processed sample sound generated by the target sound processing device, which will be described later. In step S1407, the first operator operates the mobile terminal to transmit a listening result of the output processed sample sound to the target sound processing device. In step S1409, the first operator operates the mobile terminal to output, from the output unit, a new processed sample sound received from the target sound processing device.
[0114] The processing procedure of the target sound processing device will be described with reference to Fig. 15. In step S1501, the second operator operates the target sound processing device to acquire a first processing correction value based on the sound collection conditions of the sound collection device. In step S1503, the second operator operates the target sound processing device to process the collected target sound using the acquired first processing correction value to generate a processed target sound. In step S1505, the second operator operates the target sound processing device to generate a trial sound from the generated processed target sound, which reproduces the sound that is actually heard when the target sound is heard at a predetermined location under a predetermined environment.
[0115] In step S1507, the second operator operates the target sound processing device to acquire a second processing correction value for processing the generated sample sound based on the output condition of the output unit of the mobile terminal for outputting the generated sample sound. In step S1509, the second operator operates the target sound processing device to process the generated sample sound using the acquired second processing correction value to generate a processed sample sound. Note that the output unit may be built into the mobile terminal or may be externally attached to the mobile terminal. In step S1511, the second operator operates the target sound processing device to transmit the generated processed sample sound to the mobile terminal.
[0116] In step S1513, the second operator operates the target sound processing device to generate a new processed sample sound based on the result of the preview of the generated processed sample sound received from the mobile terminal. The new processed sample sound is a sample sound generated under different environmental conditions than the previously generated processed sample sound. In step S1515, the second operator operates the target sound processing device to transmit the generated new processed sample sound to the mobile terminal. The output processed sample sound may be previewed and evaluated by at least one of the first operator and the second operator. For example, when the second operator previews the processed sample sound, the second operator himself evaluates the processed sample sound generated by the second operator. Alternatively, the output processed sample sound may be previewed and evaluated by a third operator different from the first operator and the second operator.
[0117] According to this embodiment, even if the sound collection location and the location where the target sound processing device is installed are different, a processed sample sound can be easily generated and the sample sound can be easily listened to.
[0118] [Example] Next, examples of the present invention will be described with reference to Figures 16 to 25. It should be noted that the scope of the present invention is not limited to the following examples.
[0119] In the target sound processing systems 100, 600 and the target sound processing devices 800, 900, the sample sounds generated are the six items ((a) to (f)) shown in Table 1. That is, the six items are: (a) indoor noise caused by external noise, (b) inter-room sound insulation performance (noise propagating from adjacent rooms), (c) noise propagating from inside and outside the building to the site boundary, (d) indoor noise caused by air conditioning equipment, (e) floor impact sound insulation performance (floor impact sound), and (f) indoor reverberation time (sound reverberation).
[0120] [Table 1]
[0121] Specific examples of each of the six items are, for example, (a) traffic noise (road traffic noise, railway noise, etc.), (b) airborne noise such as conversations in conference rooms and hotel television sounds, (c) outdoor equipment and machinery, indoor equipment and machinery, (d) indoor air conditioning equipment, (e) floor impact sounds (heavy floor impact sounds and light floor impact sounds), (f) conversations in conference rooms, voices in classrooms, etc. For each calculation, the techniques described in Patent Documents 1 to 3, for example, are used.
[0122] The target frequencies for each of the six items are: (a) 50Hz to 5,000Hz band, (b) 100Hz to 5,000Hz band, (c and (d) 50Hz to 5,000Hz band, (e) heavy floor impact sound: 50Hz to 630Hz band, light floor impact sound: 50Hz to 5,000Hz band, and (f) 100Hz to 5,000 band.
[0123] As for generating the sample sound, in (a) to (d), a sound-reduction filter is generated, and the sample sound is generated by filtering the sound source data (the picked-up target sound data).
[0124] In (e), the floor impact sound level is calculated from the impact force of the standard impact source (tire, ball, tapping) according to the JIS standard, and sound source data close to the calculated conditions is extracted from the floor impact sound from the standard impact source recorded for each condition such as slab thickness, floor finishing structure, finishing ceiling, etc., and a filter is generated with the difference between the floor impact sound level and the calculated value as the reduction level to generate a trial sound. Note that the heavy floor impact sound is evaluated in the 50Hz to 630Hz band, so frequencies outside the target are not filtered and are not played.
[0125] In (f), a test sound is generated by convolving a dry source sound, such as a reading sound recorded in an anechoic room, with an impulse response predicted by acoustic simulation or the like, or an actual measured value of the impulse response.
[0126] Next, the microphone (sound pickup unit 130 or sound pickup device) and headphones (output unit 140 or speaker) used each have their own unique acoustic characteristics. Therefore, in order to faithfully reproduce the generated preview sound, it is necessary to correct these acoustic characteristics, and the picked-up sound source (target sound) and the generated preview sound are corrected based on a correction value obtained in advance. The correction value for the acoustic characteristics of the equipment used is obtained by the following method.
[0127] <How to correct the acoustic characteristics of a microphone> <Microphone frequency characteristics> A method for correcting the acoustic characteristics of a microphone (sound collection unit 130) will be described using an example in which a tablet terminal is used as the mobile terminal 120. First, it is experimentally confirmed that the microphone can collect the sound of the frequency to be evaluated. In an anechoic chamber, pink noise (noise) is generated from a speaker (sound source), and a precision sound level meter is placed 1 m away to collect the sound. FIG. 16 shows the 1 / 3 octave band levels of the collected sound data.
[0128] The tablet device's external microphone and the precision sound level meter are roughly consistent in the target frequency range of 50Hz to 5,000Hz. On the other hand, the tablet device's built-in microphone shows level differences at low frequencies below the 80Hz band. When capturing problematic low-frequency sounds such as heavy floor impact sounds and equipment sounds, it is preferable to use an external microphone.
[0129] <Microphone pickup level and linearity> When listening to the test sound, the sound pressure level to be picked up is assumed to be 30dB to 80dB, taking into consideration the hearing impairment of the user and the level of noise that requires noise control measures when using the system. In addition, the frequency characteristics of the microphone to be used change linearly according to the sound pressure level to be picked up. Therefore, the linearity of the pickup level and frequency characteristics of the microphone to be used is experimentally confirmed.
[0130] The volume of pink noise was set to 30dB to 80dB, and the sound was collected using the tablet's built-in microphone and a precision sound level meter. The collected sound was analyzed in 1 / 3 octave bands to examine the correspondence between the tablet's built-in microphone and the precision sound level meter. Figure 17 shows the results for the 1,000Hz band as a representative example.
[0131] If the value of the precision sound level meter is taken as the true value, when using the built-in microphone of a tablet device, the change is roughly linear from 30 dB to 80 dB. Since the change is linear within the sound pressure level range assumed for system use, correction can be performed with a fixed correction value for each frequency band.
[0132] After confirming that the target microphone can be used with the target sound processing system 100, the 1 / 3 octave band level difference between the precision sound level meter and the target microphone is used as a correction value (first processing correction value) to ensure accurate sound collection.
[0133] <How to correct the acoustic characteristics of headphones> <Headphone frequency response> Many headphones are tuned according to purpose and preference, and in order to faithfully reproduce the generated listening sound, the frequency characteristics of each headphone must be cancelled. For this reason, headphones were attached to a dummy head in an anechoic chamber, and pink noise (sound source) was played via a tablet device. Figure 18 shows the 1 / 3 octave band levels of pink noise and the sound reproduced by the headphones. Compared to pink noise, which has a flat frequency response, the sound reproduced by the headphones used varies by frequency, with sounds in the 400Hz to 1,000Hz band being particularly emphasized.
[0134] <Headphone playback level and linearity> Pink noise is played through headphones at different levels to examine the reproducible level and linearity of the headphones. Figure 19 shows the 1 / 3 octave band level of the 1,000 Hz band as a typical example.
[0135] The range of 20dB to 80dB can be reproduced by headphones, and changes linearly with the 5dB pitch change in pink noise level. Similar results were obtained for other frequency bands. Since reproduction up to 20dB is possible, for example, when considering sound insulation between rooms, the effect of spatial sound insulation performance up to Dr-55 can be expressed as a listening sound for a sound source generated at 75dB in the sound source room. Here, Dr is the level of sound pressure level difference between rooms, and the higher the Dr value, the higher the sound insulation performance between rooms and the less airborne sound is transmitted.
[0136] After confirming that the target headphones can be used with the target sound processing system 100, the 1 / 3 octave band level difference between the pink noise (sound source) and the sound reproduced by the headphones is used as a correction value (second processing correction value) to cancel the acoustic characteristics specific to the headphones so that the generated trial sound can be faithfully reproduced.
[0137] <Verification example of system accuracy in an actual building> <Verification Overview> Using the office room, we verified the accuracy of predicted calculations, trial sounds, and processed trial sounds generated by the target sound processing devices 110, 610 and the target sound processing devices 800, 900 with respect to spatial sound insulation performance. The outline of the measurement room is shown in Figure 20.
[0138] The partition between the conference room and the office is a dry double wall (sound insulation performance: TL D -40). The corridor doors between the conference room and the office are ordinary steel double doors that are not airtight. The conference room was used as the sound source room, and the target sound (pink noise or a man reading aloud) was played from the speaker. The played target sound was picked up by the target sound processing device 110 (using the built-in microphone of a tablet terminal), and the picked up target sound was used as sound source data. In order to verify the sound pickup accuracy, sound was also picked up by a precision sound level meter (NA-28 manufactured by RION). A dummy head was installed in the sound receiving room to pick up the sound propagating from the conference room. The difference in sound pressure level between the rooms was also measured according to JIS A1418:2000 "Method of measurement for the airborne sound insulation performance of buildings".
[0139] <Prediction calculation accuracy> In order to confirm the accuracy of prediction calculation by the target sound processing system 100, the predicted values of the spatial sound pressure level difference were compared with the actual measured values. Figure 21 shows the comparison results of the octave band levels. The predicted values roughly correspond to the actual measured values in the 125 Hz to 4,000 Hz bands, and the sound pressure level difference between the rooms can be predicted with good accuracy.
[0140] <Sound pickup accuracy> Because the accuracy of sound collection affects the accuracy of generating the trial sound, we compared the data collected by the target sound processing system 100 (microphone built into the tablet) with the data collected by a precision sound level meter. The sound pressure waveform of the precision sound level meter and the sound pressure waveform (processed target sound) collected by the target sound processing system 100 (microphone built into the tablet) are shown in Fig. 22, and the octave band levels of each sound pressure waveform are shown in Fig. 23.
[0141] The shape and amplitude of the sound pressure waveform picked up by the target sound processing system 100 (tablet built-in microphone) are the same as those picked up by a precision sound level meter for both pink noise and a male reading aloud. At the octave band level, the error is a maximum of about 1 dB, and the sound is picked up with the same accuracy as a normal sound level meter.
[0142] <Preview sound accuracy> A correction process was performed to cancel the acoustic characteristics specific to headphones on the sound pressure waveform of the sample sound, which was generated by adding the predicted calculation results to the collected sound data of the target sound processing systems 100, 600 and the target sound processing devices 800, 900, to generate a processed sample sound.
[0143] The sound pressure waveforms of the test sound, the processed test sound (sound played back through headphones), and the sound pressure waveforms (actual measurements) collected using a dummy head in the sound receiving room office are shown in Figure 24, and their respective octave band levels are shown in Figure 25. Note that while the background noise of the sound receiving room is shown in Figure 25, when playing back the male reading, it is excluded from the evaluation because it is affected by the background noise of the sound receiving room in the 1,000 Hz band and above.
[0144] The processed test sound (sound played back through headphones) has almost the same shape and amplitude as the test sound and the actual measured sound pressure waveform, and the octave band levels are also approximately the same.
[0145] The sample sound generated by the system's target sound processing device can be played back correctly through headphones, and the processed sample sound reproduces the actual sound.
[0146] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-described embodiments and can be modified as appropriate. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, systems or devices that combine separate features included in each embodiment in any way are also included in the technical scope of the present invention.
[0147] The present invention may be applied to a system consisting of multiple devices, or to a single device. Furthermore, the present invention may be applied to a case where an information processing program for implementing the functions of the embodiment is supplied to a system or device and executed by a built-in processor. Therefore, the technical scope of the present invention includes a program installed on a computer to implement the functions of the present invention with a computer, a medium storing the program, a WWW (World Wide Web) server that downloads the program, and a processor that executes the program. In particular, at least a non-transitory computer readable medium storing a program that causes a computer to execute the processing steps included in the above-mentioned embodiment is included in the technical scope of the present invention.
Claims
1. A target sound collected by a sound collection unit at a predetermined location; A collection condition of the target sound; A processed target sound obtained by processing the target sound using a first processing correction value for processing the target sound acquired based on the first characteristic of the sound collection unit; and A test sound that reproduces an absolute sound that is actually heard when the target sound is heard in a predetermined environment at the predetermined location; and a processed sample sound obtained by processing the sample sound using a second processing correction value for processing the sample sound acquired based on a second characteristic of an output unit for outputting the sample sound; and a storage unit that stores the target sound and the sound collection conditions in association with at least one sound other than the target sound, A reception unit that receives characteristics of a target sound for which the processed sample sound is to be listened to; a search unit that searches the storage unit for a target sound corresponding to the received feature; an acquisition unit that acquires a processed sample sound associated with the searched target sound or a sound other than the target sound from the storage unit; Controlling the acquired processed sample sound, or extracting the processed sample sound from a sound other than the target sound. an output control unit that generates the information and outputs it from the output unit; The target sound processing device further comprises:
2. The first characteristic includes at least one of a frequency characteristic of the sound pickup unit and a sound pickup level, The target sound processing device according to claim 1 , wherein the second characteristic includes at least one of a frequency characteristic and an available output level of the output section.
3. The target sound processing device of claim 1 or 2, wherein the processed sample sound includes at least one of indoor noise caused by external noise, sound insulation performance between rooms, noise propagating from inside and outside the building to the site boundary, indoor noise caused by air conditioning equipment, floor impact sound insulation performance, and indoor reverberation time.
4. 4. The target sound processing device according to claim 1, wherein the target sound includes at least one of an indoor sound and an outdoor sound.
Citation Information
Patent Citations
Actual sound data generating device for sound shield performance evaluation, sound shield performance evaluating device, and information storage medium
JP1999167384A
Sensing method for noise environment, trial listening apparatus and information storage medium
JP2003156388A
Sound characteristic correction system
JP2008268258A
Portable terminal device, and server
JP2010226332A
Equalizer
JP2013251802A
