Method for generating multiple derived sound sources from original sound source, program and sound source generation system

Abstract

To provide a method capable of easily acquiring an appropriate sound source for hearing experiment, a program and a sound source generation system.SOLUTION: A sound source generation system 1 generates setting information including information about a plurality of filters to be used to generate a plurality of derived sound sources from one original sound source on the basis of one sound source kind of sound source kind information corresponding to an instruction when the instruction to set a sound source kind of one sound source is inputted. When the instruction to generate a derived sound source about one original sound source is inputted, the sound source generation system 1 acquires filter configuration information of the plurality of filters to be used to generate a derived sound source on the basis of setting information of the one original sound source, and performs processing for converting acoustic data of the one original sound source into acoustic data of a plurality of derived sound sources by the plurality of filters configured on the basis of a plurality of pieces of filter configuration information that are acquired.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a method, a program, and a sound source generation system for generating a plurality of derived sound sources from an original sound source. [Background technology]

[0002] Auditory experiments that investigate a person's subjective auditory sensation for sound are conducted for various purposes, such as improving product quality and evaluating acoustic environments. The following patent document describes a system for conducting auditory experiments. In this system, a sound source is uploaded from a terminal to a server, a screen that allows the user to select one of multiple auditory experiments is displayed on the terminal, the selected auditory experiment is conducted on the terminal, the subjective amount obtained from the auditory experiment is stored in the memory unit of the server, and the subjective amount obtained from the auditory experiment is displayed on the terminal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6667607 Summary of the Invention [Problem to be solved by the invention]

[0004] In general auditory experiments, a wide variety of sound sources are used. However, preparing such sound sources requires a great deal of time and effort. Furthermore, in order to ensure the reliability of the experimental results, a deep understanding of the sound sources used in the experiment is required, so preparing appropriate sound sources is not easy.

[0005] The present invention has been made in view of the above circumstances, and its object is to provide a method, a program, and a sound source generation system that can easily obtain an appropriate sound source for auditory experiments. [Means for solving the problem]

[0006] A first aspect of the present invention is a method for a sound source generation system to generate a plurality of derived sound sources from an original sound source, the method comprising: a step of generating, upon input of an instruction to set the sound source type of one original sound source, setting information including information on the plurality of filters used to generate a plurality of derived sound sources from the one original sound source, based on the sound source type information of the one sound source type corresponding to the instruction; and a step of acquiring, upon input of an instruction to generate a derived sound source for one original sound source, filter configuration information of the plurality of filters used to generate the derived sound sources, based on the setting information of the one original sound source, and converting the acoustic data of the one original sound source into acoustic data of the plurality of derived sound sources using the plurality of filters configured based on the acquired plurality of filter configuration information.

[0007] A second aspect of the present invention is a program including an instruction for causing a sound source generation system to perform a process of generating a plurality of derived sound sources from an original sound source, the sound source generation system being accessible to a storage device, the storage device storing a plurality of pieces of filter configuration information and a plurality of pieces of sound source type information, each piece of filter configuration information including information on the configuration of a filter that converts acoustic data of the original sound source into acoustic data of a derived sound source, the type of the original sound source being called a sound source type, and each piece of sound source type information including information on a plurality of filters used to generate a plurality of derived sound sources from an original sound source of one sound source type, the process performed by the sound source generation system in accordance with the instruction The program has the steps of: when an instruction to set a sound source type of a source is input, generating setting information including information on a plurality of filters used to generate a plurality of derived sound sources from the one original sound source based on sound source type information of one sound source type corresponding to the instruction; and when an instruction to generate a derived sound source for one original sound source is input, acquiring filter configuration information of the plurality of filters used to generate the derived sound source based on the setting information of the one original sound source, and converting acoustic data of the one original sound source into acoustic data of a plurality of derived sound sources using a plurality of filters configured based on the acquired plurality of filter configuration information.

[0008] A third aspect of the present invention is a sound source generation system for generating a plurality of derived sound sources from an original sound source, the system comprising: a processing unit; and a storage unit storing instructions to be executed by the processing unit. The processing unit is accessible to a storage device, and the storage device stores a plurality of pieces of filter configuration information and a plurality of pieces of sound source type information. One piece of filter configuration information includes information on the configuration of one filter that converts acoustic data of the original sound source into acoustic data of the derived sound source. The type of the original sound source is called a sound source type. One piece of sound source type information includes information on a plurality of filters used to generate a plurality of derived sound sources from an original sound source of one sound source type. The processing performed by the processing unit in accordance with the instructions is The sound source generation system has a process of generating, when an instruction to set a sound source type of a source is input, setting information including information on a plurality of filters used to generate a plurality of derived sound sources from the one original sound source, based on sound source type information of one sound source type corresponding to the instruction; and, when an instruction to generate a derived sound source for one original sound source is input, acquiring filter configuration information of the plurality of filters used to generate the derived sound source, based on the setting information of the one original sound source, and converting acoustic data of the one original sound source into acoustic data of a plurality of derived sound sources using a plurality of filters configured based on the acquired plurality of filter configuration information.

[0009] A fourth aspect of the present invention is a sound source generation system that generates a plurality of derived sound sources from an original sound source, the sound source generation system having access to a storage device, the storage device storing a plurality of filter configuration information and a plurality of sound source type information, each piece of filter configuration information including information regarding the configuration of a filter that converts acoustic data of the original sound source into acoustic data of a derived sound source, the type of the original sound source being referred to as a sound source type, and each piece of sound source type information including information regarding a plurality of filters used to generate a plurality of derived sound sources from an original sound source of one sound source type, the sound source generation system having: a means for generating, when an instruction to set the sound source type of one original sound source is input, setting information including information regarding the plurality of filters used to generate a plurality of derived sound sources from the one original sound source, based on the sound source type information of the one sound source type corresponding to the instruction; and a means for acquiring, when an instruction to generate a derived sound source for one original sound source is input, filter configuration information of the plurality of filters used to generate the derived sound source, based on the setting information of the one original sound source, and performing processing to convert the acoustic data of the one original sound source into acoustic data of the plurality of derived sound sources using a plurality of filters configured based on the acquired plurality of filter configuration information. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a method, a program, and a sound source generation system that can easily obtain an appropriate sound source for an auditory experiment. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a system according to this embodiment. [Figure 2] Fig. 2A is a diagram showing an example of filter configuration information, and Fig. 2B is a diagram showing an example of sound source type information. [Figure 3] 3A to 3G are diagrams showing examples of frequency characteristics of filters. [Figure 4] FIG. 4 is a diagram illustrating an example of the setting information. [Figure 5]FIG. 5 is a flowchart illustrating an example of a process for generating a derived sound source from an original sound source in the sound source generation system. [Figure 6] FIG. 6 is a flowchart illustrating an example of a process for adjusting a derived sound source in the sound source generation system. [Figure 7] FIG. 7 is a diagram showing an example of a screen including a derived sound source list. [Figure 8] FIG. 8 is a flowchart for explaining a modified example of the process of generating a derived sound source from an original sound source in the sound source generation system. [Figure 9] FIG. 9 is a flowchart for explaining a modified example of the process of generating a derived sound source from an original sound source in the sound source generation system. [Figure 10] FIG. 10 is a diagram showing an example of a filter selection screen. [Figure 11] FIG. 11 is a flowchart for explaining a modified example of the process of generating a derived sound source from an original sound source in the sound source generation system. [Figure 12] FIG. 12 is a first flowchart for explaining a modified example of the process of adjusting a derived sound source in the sound source generation system. [Figure 13] FIG. 13 is a second flowchart for explaining a modified example of the process of adjusting a derived sound source in the sound source generation system. [Figure 14] FIG. 14 shows a modified example of a screen including a list of derived sound sources. [Figure 15] FIG. 15 shows a modified example of a screen including a list of derived sound sources. DETAILED DESCRIPTION OF THE INVENTION

[0012] FIG. 1 is a diagram showing an example of a system according to this embodiment. The system according to this embodiment performs processing to generate multiple derived sound sources from one original sound source. Multiple derived sound sources (hereinafter sometimes referred to as a "derived sound source set") generated from one original sound source are used, for example, in auditory experiments. The system shown in FIG. 1 has a sound source generation system 1 and a terminal device 3 that can communicate with each other via a communication network 9 such as the Internet. In the example of FIG. 1, there is one terminal device 3 that accesses the sound source generation system 1, but multiple terminal devices 3 may also access the sound source generation system 1.

[0013] [Sound Source Generation System 1] The sound source generation system 1 is a device (such as a cloud server) that performs processing to generate multiple derived sound sources from one original sound source provided from a terminal device 3. In the example of FIG. 1, the sound source generation system 1 includes a communication unit 11, a storage unit 15, and a processing unit 16.

[0014] The communication unit 11 communicates with other devices (such as the terminal device 3) via the communication network 9. The communication unit 11 includes a communication device (such as a network interface card) that communicates in accordance with a predetermined communication standard (such as wireless LAN or Ethernet (registered trademark)).

[0015] The storage unit 15 stores one or more programs 151 including instructions executable by the processing unit 16, data temporarily saved during processing by the processing unit 16, data used in processing by the processing unit 16, data obtained as a result of processing by the processing unit 16, etc. The storage unit 15 may include, for example, a main storage device (ROM, RAM, etc.) and an auxiliary storage device (flash memory, SSD, hard disk, optical disk, etc.). The storage unit 15 may be composed of one storage device or multiple storage devices. When the storage unit 15 is composed of multiple storage devices, each storage device is connected to the processing unit 16 via a computer bus or any other data communication means.

[0016] The processing unit 16 controls the overall operation of the sound source generation system 1 and executes predetermined information processing. The processing unit 16 includes, for example, one or more processors (such as a central processing unit (CPU), a micro-processing unit (MPU), or a digital signal processor (DSP)) that execute processing in accordance with instructions in a program 151 stored in the storage unit 15. The processing unit 16 operates as a computer by the one or more processors executing instructions in the one or more programs 151 stored in the storage unit 15. The sound source generation system 1 may include multiple such computers, and these computers may execute processing in cooperation by communicating via any communication network.

[0017] The processing unit 16 may include one or more dedicated hardware (such as an application specific integrated circuit (ASIC) or a field-programmable gate array (FPGA)) configured to realize a specific function. In this case, the processing unit 16 may execute all of the processes described in this embodiment on a computer, or may execute at least some of the processes on dedicated hardware.

[0018] The program 151 may be recorded, for example, on a computer-readable recording medium (such as an optical disk, a memory card, a USB memory, or other non-transitory tangible medium). The processing unit 16 may read at least a part of one or more programs 151 recorded on such a recording medium using a recording medium reading device (such as an optical disk device) or an interface device (such as a USB interface), not shown, and write the part to the storage unit 15.

[0019] Alternatively, the processing unit 16 may receive at least a part of one or more programs 151 via the communication unit 11 from another device connected to the communication network 9, and write the programs 151 to the storage unit 15. The programs 151 may include instructions that cause the processing unit 16 to perform at least a part of the processing according to this embodiment, which will be described later.

[0020] 1, the one or more programs 151 include at least one signal processing module 152. The signal processing module 152 is a program including instructions for causing a processor to perform predetermined acoustic signal processing (such as converting an original sound source into a derived sound source).

[0021] [Storage device 2] The storage device 2 stores various information used in the processing of the sound source generation system 1. The sound source generation system 1 and the storage device 2 can communicate with each other via any communication path (LAN, dedicated line network, Internet, etc.). For example, the storage device 2 may be included in a file server, database server, cloud server, etc. that accepts access from multiple computers, or may be a dedicated storage device that is accessible only to the sound source generation system 1. In the example of FIG. 1, the storage device 2 stores a filter configuration information database 21, an acoustic type information database 22, and one or more data groups 23. In the following description, database may be abbreviated to "DB."

[0022] <Filter configuration information DB21> The filter configuration information DB 21 includes a plurality of pieces of filter configuration information, each of which relates to the configuration of one filter. One piece of filter configuration information includes information on the configuration of one filter that converts acoustic data of an original sound source into acoustic data of a derived sound source.

[0023] 2A is a diagram showing an example of filter configuration information. In the filter configuration information DB 21, each piece of filter configuration information is associated with one filter configuration ID as identification information.

[0024] One piece of filter configuration information includes module information and parameter information, as shown in FIG. 2A, for example. The module information is information that specifies the signal processing module 152 used in acoustic signal processing as a filter that converts an original sound source into a derived sound source. The parameter information is information relating to parameters related to the characteristics of the filter, and includes, for example, information on arguments referenced in the acoustic signal processing of the signal processing module 152 specified by the module information.

[0025] 3A to 3G are diagrams showing examples of frequency characteristics of filters configured based on the filter configuration information. FIG. 3A shows the frequency characteristics of a low-pass filter that attenuates signals in the high-frequency band. FIG. 3B shows the frequency characteristics of a high-pass filter that attenuates signals in the low frequency band. FIG. 3C shows the frequency characteristics of a bandpass filter that attenuates signals that are not included in a specific frequency band. FIG. 3D shows the frequency characteristics of a band elimination filter that attenuates signals included in a specific frequency band. FIG. 3E shows the frequency characteristics of a low shelving filter that uniformly increases or decreases the gain of signals with frequencies lower than a specific frequency. FIG. 3F shows the frequency characteristics of a high shelving filter that uniformly increases or decreases the gain of signals with frequencies higher than a specific frequency. FIG. 3G shows the frequency characteristics of a peaking filter that increases the gain of a signal having a specific frequency.

[0026] A filter configured by the filter configuration information may have time-varying characteristics in addition to the frequency characteristics shown in Figs. 3A to 3G described above. The time-varying characteristics of the filter add frequency changes and amplitude changes to a specific time range of the sound source. By using a filter with time-varying characteristics, it becomes possible to generate a wider variety of derived sound sources.

[0027] Examples of filters with time-varying characteristics include the following:

[0028] Envelope filter (fade in / fade out) An envelope filter controls the change in amplitude of a sound. It can create smooth transitions by gradually fading in at the beginning of a sound or fading out at the end. For example, a gradual increase in volume at the beginning of a sound can be used to simulate a realistic beginning, or a gradual fade-out can be used to simulate a natural ending to a sound.

[0029] -Filters with time-varying frequency characteristics By changing the frequency characteristics of a sound over time, it is possible to change the impression and texture of the sound source. For example, by decreasing the high frequency components over time, it is possible to recreate the effect of a sound receding into the distance or an old recording. Conversely, by increasing the high frequency components over time, it is possible to create the effect of a sound approaching or becoming more vivid.

[0030] Pitch change filter A pitch change filter changes the pitch of a sound source over time. For example, by gradually raising or lowering the pitch of a sound source, it is possible to achieve a unique sound effect in a piece of music.

[0031] Echo filter An echo filter adds an echo effect to a sound source. Echo is an acoustic effect that occurs when the original sound reverberates after a certain delay, giving the sound a sense of space and resonance. With an echo filter, you can, for example, adjust the echo reverberation time and intensity.

[0032] Reverb filter A reverb filter adds a reverb effect to a sound source. Reverb is an acoustic effect that occurs when sound reflects off reflective surfaces such as walls and floors and mixes together, giving the sound a sense of spaciousness and spaciousness. For example, a reverb filter can simulate different sound fields or adjust the sound effect.

[0033] Both echo and reverb give sound a sense of space, but they each have different characteristics: Echoes occur when sound bounces off obstacles in mountainous areas or vast spaces, resulting in a delayed sound. Because echoes are clearly reflected sounds, there is a clear time interval between the original sound and the reflected sound. Reverb is created by the synthesis of multiple reflected sounds that bounce off reflective surfaces such as walls, floors, and ceilings. For example, in an enclosed space such as a hall or church, sound is reflected by reflective surfaces on all four sides, and multiple reflected sounds are heard blending together at short time intervals. Reverb reproduces the natural reflections that occur in an enclosed space. With reverb, multiple reflected sounds are heard blending together, so there is no clear time interval between the original sound and the reflected sounds. In other words, the difference is that echo emphasizes the reflected sound that is heard after a delay from the original sound, while reverb reproduces the natural reverberation of a space by synthesizing multiple reflected sounds.

[0034] Furthermore, the filters configured by the filter configuration information may have the above-described frequency characteristics and time-varying characteristics, and may also have volume settings. That is, volume settings may be set for each filter. Since volume settings have a significant effect on how sounds are heard, setting volume settings for each filter can enrich the variety of derived sound sources.

[0035] Differences in volume have a wide range of effects. For example, increasing the volume increases the clarity and presence of the sound, making it more assertive. Examples of sound sources that should be increased in volume include sound effects used in product demos and presentations, and sounds emphasized in music. On the other hand, decreasing the volume increases the impression of distance from the sound source and the delicate sound. Examples of sound sources that should be decreased in volume include environmental sounds, natural sounds, and background sounds from movies and games.

[0036] <Audio type information DB22> The sound type information DB 22 includes a plurality of pieces of sound source type information each corresponding to a type of original sound source (hereinafter, sometimes referred to as "sound source type"). One piece of sound source type information includes information on a plurality of filters (hereinafter, sometimes referred to as "filter set") used to generate a plurality of derived sound sources (derived sound source set) from an original sound source belonging to one sound source type.

[0037] Examples of sound source types (types of original sound sources) include the following:

[0038] -Sounds generated by machines, etc. The sounds produced by machines include the sound of a rotating motor, the hum of electronic devices, the sound of a computer fan, etc. In addition to the sounds produced when a machine is in a normal state, there are also sounds (abnormal noises) that are produced when a machine is in an abnormal state.

[0039] ·Environmental sounds Environmental sounds are sounds that can be heard in a particular place or environment, such as urban noise, traffic noise (cars, airplanes, trains, etc.), background noise in a restaurant, and factory noise.

[0040] ·music Music includes musical compositions of various genres, sounds of various instruments, and sounds created electronically using synthesizers.

[0041] Human voice Human voices include those produced in a variety of situations, such as speaking, singing, shouting, laughing, crying, coughing, and yawning.

[0042] ·Nature sounds Natural sounds are sounds that occur in the natural world, such as the sound of wind, waves, rain, thunder, and mountain streams.

[0043] Sound effects Sound effects are sounds used in movies, games, plays, etc., and include explosions, gunshots, door opening and closing sounds, stepping sounds, etc.

[0044] Artificial sounds Artificial sounds are sounds that are artificially created for a specific purpose, such as alert sounds, melody sounds, phone ringtones, message notification sounds, and app operation sounds.

[0045] Animal sounds Animal sounds include the sounds of pets and wild animals such as dogs, cats, and birds.

[0046] There is a close relationship between the derived sound source set used in auditory experiments and the sound source type. Therefore, the filter set used when generating the derived sound source set from the original sound source needs to be selected appropriately according to the sound source type. In other words, the frequency characteristics and time change characteristics of each filter in the filter set need to be appropriately set after understanding the characteristics of the sound source according to the sound source type.

[0047] For example, noises (abnormal noises) generated by machinery and environmental sounds often have characteristics in a specific frequency range or tone. To emphasize these sound sources, it is necessary to use a filter (such as a band-pass filter or peaking filter) that matches the characteristics of the sound source, and to set the frequency of the filter to match the characteristics of the sound source. Furthermore, music (the sounds of musical instruments) often have characteristics across a wide frequency range. To bring out the characteristics of these sound sources, it is necessary to use filters that adjust the overall sound (for example, low shelving filters and high shelving filters) and set the frequency of the filter according to the characteristics and purpose of the sound source.

[0048] The number of derived sound sources used in the auditory experiment is determined according to the purpose of the auditory experiment, and it is preferable to take into consideration the characteristics of the sound source according to the type of sound source when determining the number of derived sound sources.

[0049] The number of derived sound sources for each sound source type may be determined as follows, for example.

[0050] ·music Since music (sounds of musical instruments) has a rich frequency spectrum, it is preferable to have a relatively large number of derived sound sources. For example, by limiting the number of derived sound sources to around 10 to 20, it becomes easier to capture the differences in the timbre of musical instruments, etc.

[0051] Human voice While the human voice is concentrated in a relatively narrow frequency range, subtle changes in sound quality are important. Therefore, it is estimated that there are about 10 to 15 derived sound sources for the human voice.

[0052] Environmental and natural sounds Because environmental sounds (such as urban noise) and natural sounds have diverse characteristics, it is expected that a large number of derived sound sources (approximately 10 to 20) will be required. However, if you are focusing on a specific sound (such as the sound of wind), the number of derived sound sources may be as small as 5 to 10.

[0053] -Sounds generated by machines, etc. The sounds (abnormal sounds) emitted by machines often have peaks at specific frequencies. Therefore, it is expected that even if the number of derived sound sources is around 5 to 10, it will be possible to cover important characteristics.

[0054] In this way, it is desirable to set the number of derived sound sources in a derived sound source set (the number of filters in a filter set) and the characteristics of each filter in a filter set in accordance with the characteristics of the sound source according to the sound source type (type of original sound source). Therefore, in this embodiment, the configuration of the filter set (the configuration of each filter included in the filter set) is determined for each sound source type based on the sound source type information registered in the sound type information DB 22.

[0055] 2B is a diagram showing an example of sound source type information. In the sound type information DB 22, each piece of sound source type information is associated with one sound source type ID as identification information.

[0056] 2B, one piece of sound source type information includes the name of the sound source type, the number of derived sound sources, and multiple filter configuration IDs. Each filter configuration ID included in the sound source type information indicates filter configuration information for configuring each filter in the filter set.

[0057] The sound source type information also includes an evaluation term assigned to each of a plurality of filters used to generate a derived sound source, as shown in Fig. 2B. In the example of Fig. 2B, one evaluation term is assigned to each of a plurality of filter configuration IDs. The evaluation term assigned to one filter is a term that expresses the impression of the sound that is expected to be emphasized by that one filter.

[0058] The evaluation word may be one of a pair of antonyms (evaluation word pair), such as "strong / weak" or "heavy / light," or it may be a word that does not have a specific antonym (such as "rough," "metallic," or "faint").

[0059] The evaluation words may also include adjectives that indicate the degree of strength of the impression (e.g., "slightly powerful," "very powerful"), or numerical values ​​that indicate the degree of strength of the impression (e.g., "powerful (1)," "powerful (2)").

[0060] The evaluation words may also be a combination of multiple words each expressing an impression of a sound (such as "powerful and profound" or "powerful and light").

[0061] <Data Set 23> 1, the data group 23 includes acoustic data of one original sound source, acoustic data of multiple derived sound sources generated from the one original sound source, and setting information. The setting information includes information about multiple filters (filter sets) used to generate multiple derived sound sources (derived sound source sets) from the one original sound source.

[0062] FIG. 4 is a diagram showing an example of setting information. The setting information shown in the example of FIG. 4 includes an original sound source ID indicating one original sound source and multiple pieces of derived sound source information. One piece of derived sound source information is information about one derived sound source, and includes a derived sound source ID indicating the one derived sound source, filter configuration information about the configuration of one filter used to generate the one derived sound source, and an evaluative word assigned to the one filter. The evaluative word assigned to one filter is a word that expresses the impression of a sound that is expected to be emphasized by the one filter. Note that, since an evaluative word is not essential for generating a derived sound source, at least a part of the derived sound source information included in the setting information may not include an evaluative word. As will be described later, the setting information of one original sound source is generated according to the sound source type of the one original sound source.

[0063] [Terminal device 3] The terminal device 3 is a device equipped with an information communication function, such as a personal computer, tablet, or smartphone, and is operated by a user who has acoustic data of the original sound source. In the example of Fig. 1, the terminal device 3 includes a communication unit 31, an input unit 32, a display unit 33, a sound output unit 34, a storage unit 35, and a processing unit 36. The terminal device 3 having the display unit 33 is an example of the display device of the present invention. The terminal device 3 having the sound output unit 34 is an example of the sound reproducing device of the present invention.

[0064] The communication unit 31 communicates with other devices (such as the sound source generation system 1) via the communication network 9. The communication unit 31 includes, for example, a communication device that communicates in accordance with a predetermined communication standard.

[0065] The input unit 32 inputs instructions and other information according to user operations to the processing unit 36. For example, the input unit 32 includes at least one device having an input function, such as a button, a keyboard, a mouse, a touchpad, a touch panel, a microphone, or a camera.

[0066] The display unit 33 is a device that displays an image corresponding to the image signal generated by the processing unit 36, and includes display devices such as a liquid crystal display, an organic EL display, and a projector.

[0067] The sound output unit 34 is a device that outputs sound corresponding to the acoustic signal generated in the processing unit 36, and includes, for example, a speaker.

[0068] The storage unit 35 stores one or more programs 351 including instructions executable by the processing unit 36, data temporarily saved during processing by the processing unit 36, data used in processing by the processing unit 36, data obtained as a result of processing by the processing unit 36, etc. The storage unit 35 may include, for example, a main storage device (ROM, RAM, etc.) and an auxiliary storage device (flash memory, SSD, hard disk, optical disk, etc.). The storage unit 35 may be composed of one storage device or multiple storage devices. When the storage unit 35 is composed of multiple storage devices, each storage device is connected to the processing unit 36 ​​via a computer bus or any other data communication means.

[0069] The processing unit 36 ​​controls the overall operation of the terminal device 3 and executes predetermined information processing. The processing unit 36 ​​includes, for example, one or more processors (CPU, MPU, DSP, etc.) that execute processing in accordance with instructions in a program 351 stored in the storage unit 35. The processing unit 36 ​​operates as a computer by the one or more processors executing instructions in one or more programs 151 stored in the storage unit 15. Note that the processing unit 36 ​​may include one or more dedicated hardware (ASIC, FPGA, etc.) configured to realize a specific function, and at least a part of the processing described in this embodiment may be executed by the dedicated hardware.

[0070] The program 351 may be recorded, for example, on a computer-readable recording medium (such as an optical disk, a memory card, a USB memory, or other non-transitory tangible medium). The processing unit 36 ​​may read at least a part of one or more programs 351 recorded on such a recording medium using a recording medium reader (such as an optical disk device) or an interface device (such as a USB interface), not shown, and write the part to the storage unit 35.

[0071] Alternatively, the processing unit 36 ​​may receive at least a part of one or more programs 351 via the communication unit 31 from another device connected to the communication network 9 and write the received programs to the storage unit 35. For example, if the sound source generation system 1 is a server that provides a web application and the screens (FIGS. 7, 10, etc.) described below are screens on a web browser provided by the sound source generation system 1, at least a part of the programs 351 may include code for the web browser provided by the sound source generation system 1 (code such as HTML, CSS, JavaScript (registered trademark), etc.).

[0072] Here, a description will be given of the operation of the system having the above-mentioned configuration shown in Fig. 1. Fig. 5 is a flowchart for explaining an example of a process for generating a derived sound source from an original sound source in the sound source generation system 1.

[0073] ST100: The terminal device 3 accesses the sound source generation system 1 in accordance with a user's input operation and uploads the acoustic data of the original sound source to the sound source generation system 1. The sound source generation system 1 inputs the acoustic data of the original sound source uploaded from the terminal device 3 and stores it in the storage device 2. The sound source generation system 1 issues one original sound source ID for one input original sound source. For example, the sound source generation system 1 may issue an original sound source ID corresponding to the file name of the sound source data of the original sound source stored in the storage device 2.

[0074] ST120: In accordance with a user's input operation, the terminal device 3 inputs an instruction (e.g., a sound source type ID) to set the sound source type of the uploaded original sound source to the sound source generation system 1. When an instruction to set the sound source type of one original sound source is input from the terminal device 3, the sound source generation system 1 generates setting information (FIG. 4) including information on a plurality of filters (filter sets) used to generate a plurality of derived sound sources (derived sound source sets) from the one original sound source, based on sound source type information (FIG. 2B) of one sound source type corresponding to the instruction.

[0075] For example, the sound source generation system 1 issues derived sound source IDs equal to the number of derived sound sources included in the sound source type information. Also, the sound source generation system 1 acquires a plurality of filter configuration information corresponding to a plurality of filter configuration IDs included in the sound source type information from the filter configuration information DB 21. Then, the sound source generation system 1 generates a plurality of pieces of derived sound source information (FIG. 4) in the setting information based on the issued plurality of derived sound source IDs, the plurality of filter configuration information acquired from the filter configuration information DB 21, and a plurality of evaluation words included in the sound source type information. The evaluation words included together with the filter configuration information in each piece of derived sound source information are evaluation words assigned to the filter configuration ID of the filter configuration information in the sound source type information.

[0076] ST130: The terminal device 3 inputs an instruction to generate a derived sound source set from the uploaded original sound source to the sound source generation system 1 in accordance with an input operation by the user. When an instruction to generate a derived sound source set for one original sound source is input, the sound source generation system 1 acquires filter configuration information of multiple filters used to generate the derived sound source set based on the setting information of the one original sound source (FIG. 4). The sound source generation system 1 performs a process of converting the acoustic data of the one original sound source into acoustic data of multiple derived sound sources using multiple filters configured based on the acquired multiple filter configuration information.

[0077] For example, the sound source generation system 1 identifies a signal processing module 152 based on module information ( FIG. 2A ) included in one piece of filter configuration information in the setting information, and executes the identified signal processing module 152 so as to perform acoustic signal processing to generate a derived sound source from an original sound source. When executing the signal processing module 152, the sound source generation system 1 obtains arguments for the signal processing module 152 from parameter information ( FIG. 2A ) included in the one piece of filter configuration information, and passes these arguments to the signal processing module 152. As a result, the sound source generation system 1 executes acoustic signal processing so as to have the filter characteristics (frequency characteristics, time change characteristics, etc.) set based on the arguments of the parameter information.

[0078] When the sound source generation system 1 stores the acoustic data of a derived sound source generated from an original sound source in the storage device 2, the sound source generation system 1 may store the data with a file name corresponding to the derived sound source ID.

[0079] Here, examples of filters and derived sound sources according to the sound source type are shown.

[0080] When the sound source type is "abnormal noise from a motor," for example, a derived sound source may be generated using the following seven filters (1-1) to (1-7).

[0081] (1-1) A low-pass filter with a cutoff frequency of 500 Hz The low-pass filter emphasizes low-frequency noises, allowing only signals below a specific frequency to pass, emphasizing low-frequency vibration noises and motor startup sounds.

[0082] (1-2) High-pass filter with a cutoff frequency of 2000Hz The high-pass filter emphasizes high-frequency abnormal noises, such as those caused by friction or foreign objects, making it easier to detect mechanical problems inside the motor.

[0083] (1-3) Bandpass filter with a passband around 1000Hz A bandpass filter emphasizes noises in a specific frequency range, which can enhance noises concentrated in a specific mid-range.

[0084] (1-4) Band elimination filter with a stop band around 50 Hz A band elimination filter eliminates noise within a specific frequency range, making it easier to identify true abnormal noise by eliminating hum noise at power supply frequencies.

[0085] (1-5) Peaking filter with a gain peak around 3000Hz A peaking filter increases the gain of a specific frequency range, which can emphasize specific mid- to high-frequency noises.

[0086] (1-6) Low shelving filter that increases / decreases the gain below 500Hz A low shelving filter increases or decreases the gain of all frequencies below a certain frequency, thereby changing the sound quality in the low frequency range and making the effect easier to evaluate.

[0087] (1-7) High shelving filter that increases / decreases the gain above 2000Hz A high shelving filter increases or decreases the gain of specific frequency anomalies all at once, thereby changing the sound quality of the high frequencies and making it easier to evaluate their impact.

[0088] When the sound source type is a "notification melody" (such as a melody that notifies that the bath is ready), a derived sound source may be generated using, for example, the following six filters (2-1) to (2-6).

[0089] (2-1) A low-pass filter with a cutoff frequency of 4000 Hz This allows you to create melodies that emphasize bass by attenuating high frequency components above 4000Hz.

[0090] (2-2) High-pass filter with a cutoff frequency of 500 Hz This allows you to create melodies that emphasize high notes by attenuating low-frequency components below 500Hz.

[0091] (2-3) Bandpass filter with a passband of 1000Hz ± 200Hz This allows you to create melodies that emphasize specific tones by emphasizing the 800Hz to 1200Hz range and suppressing other ranges.

[0092] (2-4) Peaking filter with a gain peak around 2000Hz The Q value (quality factor of the filter) of the peaking filter is set to, for example, 2.0, which emphasizes the frequency band around 2000 Hz, allowing you to create a melody that emphasizes a specific tone.

[0093] (2-5) Low shelving filter that increases / decreases the gain below 500Hz This allows you to amplify or attenuate all low-frequency components below 500 Hz, adjusting the bass part of the entire melody.

[0094] (2-6) High shelving filter that increases / decreases the gain above 4000Hz This allows you to amplify or attenuate all high-frequency components above 4000 Hz, adjusting the high-pitched parts of the entire melody.

[0095] As described above, according to this embodiment, a plurality of derived sound sources (a derived sound source set) are generated from one original sound source, so that the time and effort spent on collecting sound sources can be significantly reduced.

[0096] According to the present embodiment, sound source type information including information on a filter set used to generate a derived sound source set is generated in advance for each type (sound source type) of original sound source. When an instruction to set the sound source type of one original sound source is input, setting information including information on a filter set used to generate a derived sound source set from the one original sound source is generated based on the sound source type information of one sound source type corresponding to the instruction. Then, when an instruction to generate a derived sound source set for one original sound source is input, filter configuration information of multiple filters used to generate a derived sound source set is acquired based on the setting information of the one original sound source. The acoustic data of the one original sound source is converted into acoustic data of multiple derived sound sources by multiple filters configured based on the acquired filter configuration information. This allows a user to obtain a derived sound source set suitable for the original sound source simply by setting the sound source type of the original sound source. Therefore, an appropriate sound source for an auditory experiment can be easily obtained.

[0097] Next, the processing of the sound source generation system 1 for adjusting the generated derived sound source will be described with reference to the flowchart of FIG.

[0098] ST200~ST210: The terminal device 3 accesses the sound source generation system 1 in accordance with a user's input operation, and requests a derived sound source list relating to a plurality of derived sound sources generated for one original sound source from the sound source generation system 1. When the derived sound source list for one original sound source is requested from the terminal device 3, the sound source generation system 1 displays, on the terminal device 3, a derived sound source list including information indicating a plurality of derived sound sources generated from the one original sound source and evaluation words assigned to each of the plurality of derived sound sources, based on the setting information of the one original sound source (FIG. 4) (ST200). For example, the sound source generation system 1 generates data (codes such as HTML, CSS, JavaScript (registered trademark), image data, sound data, etc.) for displaying a web page including the derived sound source list on the web browser of the terminal device 3, and provides the data to the terminal device 3.

[0099] 7 is a diagram showing an example of a screen including a derived sound source list. Screen A includes an area A1 where information about an original sound source is displayed, and an area A2 where information about a plurality of derived sound sources (derived sound source list) is displayed.

[0100] The name of the original sound source and the type of the original sound source (sound source type) are displayed above the area A1. In the center of area A1, a horizontally long control element 70 is arranged, which contains elements for controlling the playback of the original sound source. The control element 70 includes a button 71 for starting and stopping the playback of the original sound source, a seek bar 72 that indicates the playback status (the ratio of the played time to the remaining playback time) while the original sound source is being played, and a slider 73 for adjusting the volume during playback of the original sound source. The right end of the seek bar 72 displays the total playback time of the original sound source and the time that has been played.

[0101] In area A2, the names of multiple derived sound sources ("Derived Sound Source 1," "Derived Sound Source 2," ...) are displayed in a vertical row. To the right of each derived sound source name, an evaluation word ("Very powerful," "Somewhat powerful," "Deep," ...) that expresses the impression of the sound emphasized in that derived sound source is displayed. Below the name of each derived sound source, a horizontally long control element 74 similar to the control element 70 described above is arranged. The control element 74 includes a button 75 for controlling the start and stop of playback of the derived sound source, a seek bar 76 that indicates the playback status (the ratio of played time to remaining playback time) while the derived sound source is being played, and a slider 77 for adjusting the volume when the derived sound source is being played. The right end of the seek bar 76 displays the total playback time of the derived sound source and the time that has been played.

[0102] A check box 78 for selecting a derived sound source is placed at the left end of each control element 74 of the derived sound source. Further to the right of the evaluation word of each derived sound source, a button 79 is placed to be pressed when adjusting the sound of the derived sound source.

[0103] At the top right corner of the area A2, there are arranged a button 710 to be pressed when adding a derived sound source, and a button 711 to be pressed when deleting a derived sound source.

[0104] The layout of screen A shown in FIG. 7 is an example, and the configuration and arrangement of each element (70 to 711) may be arbitrary.

[0105] In accordance with a user's input operation, the terminal device 3 inputs to the sound source generation system 1 an instruction to play one of the sound sources (original sound source, derived sound source) shown on screen A (FIG. 7). For example, when button 71 or button 75 is pressed on screen A shown in FIG. 7, the terminal device 3 inputs to the sound source generation system 1 an instruction to play the sound source (original sound source, derived sound source) corresponding to the pressed button. When an instruction to play a sound source is input from the terminal device 3 (Yes in ST205), the sound source generation system 1 reads out the acoustic data of the specified sound source from the storage device 2, transfers the read acoustic data to the terminal device 3 by streaming, and causes the terminal device 3 to play the acoustic data (ST210). Note that if the communication speed between the terminal device 3 and the sound source generation system 1 is sufficiently fast, or conversely, if the communication speed is so slow that playback is interrupted by streaming, the sound source generation system 1 may transfer the entire acoustic data to the terminal device 3 and then play the acoustic data on the terminal device 3. Alternatively, the sound source generation system 1 may switch the sound data reproduction method (streaming method, method of reproducing after transferring all sound data) according to the communication speed with the terminal device 3.

[0106] If an instruction to play back sound data is not input from the terminal device 3 (No in ST205), the sound source generation system 1 proceeds to step ST215.

[0107] ST215~ST225: The terminal device 3 inputs, in accordance with a user's input operation, an instruction to the sound source generation system 1 to request that the sound of one of the derived sound sources (original sound source, derived sound source) shown on screen A (FIG. 7) be adjusted. For example, when button 79 is pressed on screen A shown in FIG. 7, the terminal device 3 inputs, to the sound source generation system 1, an instruction to request that the sound of the derived sound source corresponding to the pressed button be adjusted. When an instruction to adjust the sound of the derived sound source is input from the terminal device 3 (Yes in ST215), the sound source generation system 1 adjusts the parameters of the filter used to generate this derived sound source (ST220).

[0108] When an instruction to adjust the sound of one derived sound source generated from one original sound source is input, the sound source generation system 1 acquires filter configuration information of one filter used to obtain the one derived sound source based on the setting information of the one original sound source (FIG. 4). Based on the acquired filter configuration information, the sound source generation system 1 adjusts parameters related to the characteristics of the one filter so that the characteristics of the one filter change in response to an instruction from the terminal device 3.

[0109] For example, the sound source generation system 1 displays a parameter adjustment window on the terminal device 3. The parameter adjustment window displays, for example, parameters of a filter before adjustment, and the user can input adjusted parameters while referring to the parameters before adjustment. The sound source generation system 1 acquires the adjusted parameters input in the parameter adjustment window from the terminal device 3. In this case, the sound source generation system 1 may acquire the adjusted parameters input in the parameter adjustment window directly as information equivalent to the parameter information of the filter configuration information (FIG. 2A). Alternatively, the sound source generation system 1 may generate information equivalent to the parameter information from the adjusted parameters input in the parameter adjustment window in accordance with a predetermined conversion rule.

[0110] When the sound source generation system 1 adjusts the parameters of a filter used to generate a derived sound source from an original sound source, the sound source generation system 1 updates the setting information (FIG. 4) of the original sound source so as to include information on the filter to which the adjusted parameters are reflected (ST225). For example, the sound source generation system 1 updates the filter configuration information (parameter information) of the derived sound source in the setting information (FIG. 4) of the original sound source in accordance with an instruction input from the terminal device 3 (such as the adjusted parameters input in the parameter adjustment window).

[0111] Furthermore, when the sound source generation system 1 adjusts the parameters of one filter used to generate one derived sound source from one original sound source, the sound source generation system 1 reconverts the acoustic data of the one original sound source into acoustic data of the one derived sound source using the one filter configured based on filter configuration information in which the adjusted parameters are reflected in the setting information of the one original sound source (FIG. 4). The sound source generation system 1 stores the acoustic data of the derived sound source generated by reconversion from the original sound source in the storage device 2.

[0112] When the sound source generation system 1 reconverts the original sound source into a derived sound source, it can reproduce this reconverted derived sound source on the terminal device 3 when returning to step ST205 through the steps described below. That is, when an instruction to reproduce the reconverted derived sound source in the derived sound source list is input from the terminal device 3 in step ST205, the sound source generation system 1 reproduces the acoustic data of this reconverted derived sound source on the terminal device 3.

[0113] If an instruction to adjust the sound of the derived sound source is not input from the terminal device 3 (No in ST215), the sound source generation system 1 proceeds to step ST240.

[0114] ST240~ST260: The terminal device 3 inputs, in accordance with a user's input operation, an instruction to add filter configuration information of one filter used to generate one derived sound source from one original sound source to the sound source generation system 1. For example, when button 710 is pressed on screen A shown in Fig. 7, the terminal device 3 inputs an instruction to add filter configuration information to the sound source generation system 1. When an instruction to add filter configuration information for one original sound source is input from the terminal device 3 (Yes in ST240), the sound source generation system 1 adds the filter configuration information to the setting information of the one original sound source in accordance with the instruction input from the terminal device 3 (ST245).

[0115] For example, when button 710 is pressed on screen A shown in Fig. 7, the sound source generation system 1 displays a window for adding filter configuration information on the terminal device 3. The sound source generation system 1 acquires information input in the window for adding filter configuration information from the terminal device 3, and adds the filter configuration information to the setting information based on the acquired information.

[0116] In this case, the window for adding filter configuration information may allow, for example, module information and parameter information to be directly input, or may allow any information required to identify the module information and parameter information to be input. In the latter case, the sound source generation system 1 may generate the module information and parameter information from the information input in the window for adding filter configuration information in accordance with a predetermined conversion rule.

[0117] When adding filter configuration information to the setting information, the sound source generation system 1 also adds, to the setting information, evaluation words assigned to the filters of this filter configuration information. That is, the sound source generation system 1 adds, to the setting information, evaluation words assigned to the filters of the newly added filter configuration information in response to an instruction from the terminal device 3. For example, the sound source generation system 1 may input evaluation words in the above-mentioned window for adding filter configuration information and add them to the setting information.

[0118] When adding filter configuration information and evaluation words to the setting information, the sound source generation system 1 issues a new derived sound source ID and adds it to the setting information. That is, the sound source generation system 1 generates new derived sound source information (FIG. 4) by associating the newly issued derived sound source ID with the newly acquired filter configuration information and evaluation words, and adds it to the setting information.

[0119] When the sound source generation system 1 adds filter configuration information of one filter used to generate one derived sound source from one original sound source to the setting information, the sound source generation system 1 converts the acoustic data of the one original sound source into acoustic data of the one derived sound source by the one filter configured based on the added filter configuration information (ST250). The sound source generation system 1 stores the acoustic data of the derived sound source generated using the newly added filter configuration information in the storage device 2.

[0120] When the sound source generation system 1 generates a new derived sound source based on newly added filter configuration information, the sound source generation system 1 updates the derived sound source list (FIG. 7) so as to include information indicating the derived sound source (ST260). In this case, the sound source generation system 1 updates the derived sound source list so as to include the evaluation word added together with the filter configuration information.

[0121] If an instruction to add filter configuration information is not input from the terminal device 3 (No in ST240), the sound source generation system 1 proceeds to step ST265.

[0122] ST265~ST280: The terminal device 3 inputs an instruction to the sound source generation system 1 to request that one or more derived sound sources generated from one original sound source be deleted in accordance with a user's input operation. For example, when the button 711 is pressed with one or more derived sound sources selected using the check box 78 on the screen A shown in Fig. 7, the terminal device 3 inputs an instruction to the sound source generation system 1 to request that the one or more derived sound sources be deleted. When an instruction to delete one or more derived sound sources generated from one original sound source is input (Yes in ST265), the sound source generation system 1 deletes information about one or more filters used to obtain the one or more derived sound sources from the setting information of the one original sound source (ST270). For example, the sound source generation system 1 deletes derived sound source information including filter configuration information to be deleted from the setting information.

[0123] When information (derived sound source information) relating to one or more filters is deleted from the setting information, the sound source generation system 1 deletes the acoustic data of the derived sound source generated by the one or more filters from the storage device 2 (ST275). In this case, the sound source generation system 1 also deletes the information relating to the deleted derived sound source from the derived sound source list (FIG. 7) (ST280).

[0124] If the instruction to delete the derived sound source is not input from the terminal device 3 (No in ST265), the sound source generation system 1 proceeds to step ST285.

[0125] When the process proceeds to step ST285, the sound source generation system 1 returns to step ST205 and repeats the above-described processing unless an end instruction is input from the terminal device 3. When an end instruction is input from the terminal device 3, the sound source generation system 1 ends the series of processing.

[0126] As described above, according to the present embodiment, it is possible to customize a filter set configured based on initial setting information by adjusting filter parameters, adding filters, deleting derived sound sources, etc. Therefore, it is possible to flexibly generate an appropriate derived sound source set that meets the purpose of an auditory experiment.

[0127] In addition, according to this embodiment, it is possible to customize the filter set (adjust parameters, etc.) while referring to the evaluation words of each derived sound source in the derived sound source list and checking the sound of the derived sound source, so that an appropriate derived sound source set can be generated efficiently.

[0128] Next, some modifications of the above-described embodiment will be described.

[0129] (Variation 1) Fig. 8 is a flowchart for explaining a modified example of the process of generating a derived sound source from an original sound source in a sound source generation system. The flowchart shown in Fig. 8 is obtained by adding steps ST105 and ST110 to the flowchart shown in Fig. 5, and the other steps are the same as those in the flowchart shown in Fig. 5.

[0130] In this modification, when acoustic data of a new original sound source is input (ST100), the sound source generation system 1 determines whether to reuse setting information of another original sound source that has already been generated as setting information for this new original sound source (ST105). If an instruction to apply existing setting information generated for another original sound source to the new original sound source is input from the terminal device 3 (Yes in ST105), the sound source generation system 1 saves the existing setting information in the storage device 2 as setting information for the new original sound source (ST110), and proceeds to step ST130. If the instruction is not input from the terminal device 3 (No in ST105), the sound source generation system 1 performs the processes from step ST120 onwards, similar to the flowchart shown in FIG.

[0131] According to this modification, existing setting information generated for one original sound source can be applied to another original sound source, so that it is possible to efficiently generate an appropriate derived sound source set by utilizing the existing setting information. For example, if setting information has already been generated for another original sound source that belongs to the same sound source type as a new original sound source, applying this existing setting information to the new original sound source can reduce the effort required to customize the filter set (adjust parameters, etc.).

[0132] (Variation 2) Fig. 9 is a flowchart for explaining a modified example of the process of generating a derived sound source from an original sound source in a sound source generation system. In the flowchart shown in Fig. 9, step ST120 in the flowchart shown in Fig. 5 is replaced with steps ST115 and ST125, and the other steps are the same as those in the flowchart shown in Fig. 5.

[0133] In this modification, when an instruction to set one sound source type for a new original sound source (ST100) uploaded from the terminal device 3 is input from the terminal device 3, the sound source generation system 1 causes the terminal device 3 to display information (filter selection information) on a plurality of filters that can be selected to generate a plurality of derived sound sources from the new original sound source, based on the sound source type information (FIG. 2B) of the one sound source type (ST115). The filter selection information includes evaluation words assigned to each filter.

[0134] Fig. 10 is a diagram showing an example of a screen for filter selection. Screen B shown in Fig. 10 includes an area B1 in which information about an original sound source is displayed, and an area B2 in which information about a plurality of selectable derived sound sources (filter selection information) is displayed.

[0135] Above the area B1, the name of the original sound source and the type of the original sound source (sound source type) are displayed. In the center of area B1, a horizontally elongated control element 80 is arranged, which includes elements for controlling playback of the original sound source. The control element 80 includes a button 81, a seek bar 82, and a slider 83, which are similar to the button 71, the seek bar 72, and the slider 73 in the control element 70 (FIG. 7) already described.

[0136] In area B2, the names of multiple derived sound sources generated by multiple selectable filters ("Derived Sound Source 1", "Derived Sound Source 2", ...) are displayed vertically. To the right of each derived sound source name, an evaluation word ("Very powerful", "Somewhat powerful", "Heavy", ...) that expresses the impression of the sound emphasized in the derived sound source is displayed. To the left of each derived sound source name, a check box 84 for selecting a derived sound source is arranged.

[0137] To the right of the name of each derived sound source is a listening button 85 that is pressed when listening to the derived sound source. When the listening button 85 for one derived sound source is pressed, the terminal device 3 requests sound data for listening to that one derived sound source from the sound source generation system 1. Upon receiving this request, the sound source generation system 1 generates sound data for listening from the sound data of the original sound source using a filter corresponding to that one derived sound source, and plays it back on the terminal device 3.

[0138] At the top right corner of the area B2, a button 86 is arranged which is pressed to confirm the selected derived sound source.

[0139] The layout of screen B shown in FIG. 10 is an example, and the configuration and arrangement of each element (80 to 86) may be arbitrary.

[0140] Return to Figure 9. The terminal device 3 inputs, in accordance with a user's input operation, an instruction to select two or more filters from a plurality of filters included in the filter selection information to the sound source generation system 1. For example, when the button 86 is pressed with two or more filters for derived sound sources selected using the check boxes 84 on the screen B shown in Fig. 10, the terminal device 3 inputs an instruction to select the selected two or more filters to the sound source generation system 1. When the instruction to select two or more filters is input from the terminal device 3, the sound source generation system 1 generates setting information including information on the selected two or more filters based on the sound source type information (ST125).

[0141] According to this modification, setting information is generated from information about a plurality of filters included in the sound source type information so as to include information about a filter selected by a user. This makes it possible to generate setting information by appropriately selecting information about a necessary filter from sound source type information that has been created in advance so as to include information about a large number of filters, and makes it easy to customize a filter set. Therefore, it is possible to efficiently generate a derived sound source set appropriate for the purpose of an auditory experiment.

[0142] (Variation 3) Fig. 11 is a flowchart for explaining a modified example of the process of generating a derived sound source from an original sound source in a sound source generation system. The flowchart shown in Fig. 11 is obtained by adding step ST140 to the flowchart shown in Fig. 5, and the other steps are the same as those in the flowchart shown in Fig. 5.

[0143] When multiple derived sound sources are generated from one original sound source in step ST130, the sound source generation system 1 acquires an acoustic waveform representing a time change in sound level for each of the acoustic data of the multiple derived sound sources converted from the acoustic data of the one original sound source (ST140). The sound source generation system 1 also acquires an acoustic waveform for the original sound source input in step ST100.

[0144] Figures 12 and 13 are flowcharts for explaining a modified example of the process of adjusting a derived sound source in a sound source generation system. The flowcharts shown in Figures 12 and 13 are obtained by replacing step ST200 in the flowchart shown in Figure 6 with step ST200A and adding steps ST230, ST235, and ST255, but the other steps are the same as those in the flowchart shown in Figure 6. Below, we will explain the processes (ST200A, ST230 to ST235, ST255) that are different from the flowchart shown in Figure 6.

[0145] ST200A: When a derived sound source list of one original sound source is requested from the terminal device 3, the sound source generation system 1 displays, on the terminal device 3 (ST200A), a derived sound source list including information indicating multiple derived sound sources generated from the one original sound source, evaluation words assigned to each of the multiple derived sound sources, and acoustic waveforms acquired for each of the multiple derived sound sources, based on setting information of the one original sound source (FIG. 4) and acoustic waveforms acquired for each of the multiple derived sound sources (ST140). In this case, the sound source generation system 1 also displays, on the terminal device 3, the acoustic waveforms acquired for the original sound source.

[0146] Fig. 14 is a diagram showing a modified example of a screen including a derived sound source list. Screen A is obtained by adding acoustic waveforms (721, 722) for each sound source of screen A shown in Fig. 7. In the example of Fig. 14, acoustic waveform 721 of the original sound source is arranged above control element 70 in area A1, and acoustic waveform 722 of the derived sound source is arranged above control element 74 of each derived sound source in area A2.

[0147] ST230~ST235: When the sound source generation system 1 reconverts the acoustic data of one original sound source into the acoustic data of one derived sound source in accordance with the adjustment of the filter parameters in step ST220 (ST225), it reacquires the acoustic waveform of the acoustic data of the one derived sound source obtained by the reconversion (ST230). In this case, the sound source generation system 1 updates the acoustic waveform of the one derived sound source in the derived sound source list to the acoustic waveform reacquired in step ST230 (ST235).

[0148] ST255: The sound source generation system 1 adds filter configuration information to the setting information in response to an instruction input from the terminal device 3 (ST245), and when a derived sound source is generated using a filter based on the added filter configuration information (ST250), acquires an acoustic waveform for the generated derived sound source (ST255). When updating the derived sound source list in step ST270, the sound source generation system 1 makes the acoustic waveform acquired in step ST255 be included in the derived sound source list.

[0149] In the above-described modified example, the acoustic waveform of each derived sound source is acquired and displayed in the derived sound source list. However, instead of the acoustic waveform, a spectrogram of the sound of each derived sound source may be acquired and displayed in the derived sound source list. A spectrogram is a graph that represents a temporal change in the frequency spectrum of a signal. FIG. 15 is a diagram showing a modified example of a screen including a derived sound source list, in which the acoustic waveforms (721, 722) of screen A shown in FIG. 14 are replaced with spectrograms (731, 732). In the example of FIG. 15, the spectrogram is colorless, but it may be a colored spectrogram in which the intensity of the frequency spectrum is represented by color.

[0150] According to this modification, the acoustic waveform and spectrogram of each derived sound source are displayed in the derived sound source list, so that it is possible to grasp the sound characteristics of each derived sound source by comparing these graphs, making it easier to generate an appropriate derived sound source set.

[0151] The present invention is not limited to the above-described embodiments. Any addition, deletion, or design modification of components by a person skilled in the art to the above-described embodiments or their application examples, or any combination of features of the embodiments, is also included within the scope of the present invention as long as it includes the gist of the present invention.

[0152] For example, part of the processing performed by the processing unit 16 of the above-described sound source generation system 1 may be performed by the processing unit 36 ​​of the terminal device 3. In this case, it can be said that the processing of the sound source generation system according to this embodiment is executed by a plurality of computers including the processing unit 16 of the sound source generation system 1 and the processing unit 36 ​​of the terminal device 3. [Explanation of symbols]

[0153] 1...sound source generation system, 11...communication unit, 15...storage unit, 151...program, 152...signal processing module, 16...processing unit, 2...storage device, 21...filter configuration information DB, 22...acoustic type information DB, 23...data group, 3...terminal device, 31...communication unit, 32...input unit, 33...display unit, 34...sound output unit, 35...storage unit, 351...program, 36...processing unit, 9...communication network

Claims

1. A method for a sound source generation system to generate a plurality of derived sound sources from an original sound source, comprising: the sound source generation system has access to a storage device; The storage device a plurality of filter configuration information; Multiple sound source type information and I remember the one of the filter configuration information includes information on the configuration of one filter that converts acoustic data of the original sound source into acoustic data of the derived sound source, The type of the original sound source is called a sound source type, one of the sound source type information includes information on a plurality of the filters used to generate a plurality of the derived sound sources from the original sound source of one of the sound source types, generating, when an instruction to set the sound source type of one of the original sound sources is input, setting information including information on the plurality of filters used to generate the plurality of derived sound sources from the one original sound source, based on the sound source type information of the one of the sound source types corresponding to the instruction; a step of, when an instruction to generate the derived sound source for one of the original sound sources is input, acquiring filter configuration information of the plurality of filters used to generate the derived sound source based on the setting information of the one original sound source, and converting acoustic data of the one original sound source into acoustic data of the plurality of derived sound sources using a plurality of filters configured based on the acquired plurality of filter configuration information; A method having the following.

2. a step of, when an instruction to adjust the sound of one of the derived sound sources generated from one of the original sound sources is input, acquiring filter configuration information of one of the filters used to obtain the one derived sound source based on the setting information of the one original sound source, and adjusting parameters related to characteristics of the one filter based on the acquired filter configuration information so that the characteristics of the one filter change in response to the instruction; When the parameters of one of the filters used to generate one of the derived sound sources from one of the original sound sources are adjusted, updating the setting information of the one of the original sound sources to include information about the one of the filters reflecting the adjusted parameters; when the parameters of one of the filters used to generate one of the derived sound sources from one of the original sound sources are adjusted, reconverting the acoustic data of the one original sound source into acoustic data of the one derived sound source by the one filter configured based on the filter configuration information in which the adjusted parameters are reflected in the setting information of the one original sound source. The method of claim 1.

3. and when an instruction to delete one of the derived sound sources generated from one of the original sound sources is input, deleting information about one of the filters used to obtain the one derived sound source from the setting information of the one original sound source. The method of claim 2.

4. a step of, when an instruction to add filter configuration information of one of the filters used to generate one of the derived sound sources from one of the original sound sources is input, adding the filter configuration information in accordance with the instruction to the setting information of the one original sound source, and converting acoustic data of the one original sound source into acoustic data of the one derived sound source by the one filter configured based on the filter configuration information in accordance with the instruction. The method of claim 2.

5. and when an instruction to apply one of the setting information generated for one of the original sound sources to another of the original sound sources is input, storing the one of the setting information in the storage device as the setting information of the other of the original sound sources. The method of claim 2.

6. the sound source type information includes one or more evaluation terms assigned to each of the plurality of filters used to generate the derived sound source; the evaluation words assigned to one of the filters are words that express an impression of a sound that is expected to be emphasized by the one filter; the step of generating the setting information for one of the original sound sources includes generating the setting information including the evaluation words of the plurality of filters used to generate the plurality of derived sound sources from the one original sound source, based on the sound source type information of the sound source type set as the type of the one original sound source; A step of displaying, on a display device, a derived sound source list including information indicating a plurality of derived sound sources generated from one original sound source based on the setting information of the one original sound source and the evaluation words assigned to each of the plurality of derived sound sources; and when an instruction to reproduce one of the derived sound sources from the derived sound source list is input, reproducing, in an audio reproduction device, the sound data of the one derived sound source converted from the sound data of the original sound source by the filter. The method of claim 1.

7. The step of generating the setting information for one of the original sound sources includes: When an instruction to set the sound source type of the one original sound source is input, filter selection information related to a plurality of filters that can be selected to generate a plurality of derived sound sources from the one original sound source is displayed on a display device based on the sound source type information of the one sound source type corresponding to the instruction, the filter selection information including the evaluation words assigned to each of the filters; generating the setting information including information on the selected two or more filters when an instruction to select two or more filters from the plurality of filters included in the filter selection information is input; The method of claim 6.

8. a step of, when an instruction to adjust the sound of one of the derived sound sources generated from one of the original sound sources is input, acquiring filter configuration information of one of the filters used to obtain the one derived sound source based on the setting information of the one original sound source, and adjusting parameters related to characteristics of the one filter based on the acquired filter configuration information so that the characteristics of the one filter change in response to the instruction; When the parameters of one of the filters used to generate one of the derived sound sources from one of the original sound sources are adjusted, updating the setting information of the one of the original sound sources to include information about the one of the filters reflecting the adjusted parameters; when the parameters of one of the filters used to generate one of the derived sound sources from one of the original sound sources are adjusted, reconverting the acoustic data of the one original sound source into acoustic data of the one derived sound source by the one filter configured based on the filter configuration information in which the adjusted parameters are reflected in the setting information of the one original sound source, the step of reproducing the acoustic data of the derived sound source includes, when an instruction to reproduce one of the re-converted derived sound sources from the derived sound source list is input, reproducing, in the acoustic reproduction device, the acoustic data of the one derived sound source re-converted by the filter from the acoustic data of the original sound source. The method of claim 6.

9. a step of, when an instruction to add the filter configuration information of one of the filters used to generate one of the derived sound sources from one of the original sound sources and one or more of the evaluation words assigned to the one filter is input, adding the filter configuration information according to the instruction and the evaluation words according to the instruction to the setting information of the one original sound source, and converting acoustic data of the one original sound source into acoustic data of the one derived sound source by the one filter configured based on the filter configuration information according to the instruction; The method of claim 6.

10. acquiring at least one of an acoustic waveform representing a time change in sound level and a sound spectrogram for each of the plurality of derived sound source acoustic data converted from the acoustic data of one of the original sound sources; a step of displaying, on a display device, a derived sound source list including information indicating the derived sound sources generated from one original sound source and the acoustic waveform and / or the spectrogram obtained for each of the plurality of derived sound sources based on the setting information of one original sound source and the acoustic waveform and / or the spectrogram obtained for each of the plurality of derived sound sources generated from the one original sound source; and when an instruction to reproduce one of the derived sound sources from the derived sound source list is input, reproducing, in an audio reproduction device, the sound data of the one derived sound source converted from the sound data of the original sound source by the filter. The method of claim 1.

11. a step of, when an instruction to adjust the sound of one of the derived sound sources generated from one of the original sound sources is input, acquiring filter configuration information of one of the filters used to obtain the one derived sound source based on the setting information of the one original sound source, and adjusting parameters related to characteristics of the one filter based on the acquired filter configuration information so that the characteristics of the one filter change in response to the instruction; When the parameters of one of the filters used to generate one of the derived sound sources from one of the original sound sources are adjusted, updating the setting information of the one of the original sound sources to include information about the one of the filters reflecting the adjusted parameters; a step of, when adjusting the parameters of one of the filters used to generate one of the derived sound sources from one of the original sound sources, reconverting acoustic data of the one original sound source into acoustic data of the one derived sound source by the one filter configured based on the filter configuration information in which the adjusted parameters are reflected in the setting information of the one original sound source; When the acoustic data of one of the original sound sources is reconverted into the acoustic data of one of the derived sound sources, reacquiring the acoustic waveform and / or the spectrogram for the acoustic data of the one derived sound source obtained by the reconversion. The method of claim 10.

12. A program including instructions for causing a sound source generation system to perform a process of generating a plurality of derived sound sources from an original sound source, the sound source generation system has access to a storage device; The storage device a plurality of filter configuration information; Multiple sound source type information and I remember the one of the filter configuration information includes information on the configuration of one filter that converts acoustic data of the original sound source into acoustic data of the derived sound source, The type of the original sound source is called a sound source type, one of the sound source type information includes information on a plurality of the filters used to generate a plurality of the derived sound sources from the original sound source of one of the sound source types, The processing performed by the sound source generation system in accordance with the instructions includes each step of the method according to any one of claims 1 to 11. program.

13. A sound source generation system that generates a plurality of derived sound sources from an original sound source, a processing unit; a storage unit that stores instructions to be executed by the processing unit; the processing unit is capable of accessing a storage device; The storage device a plurality of filter configuration information; Multiple sound source type information and I remember the one of the filter configuration information includes information on the configuration of one filter that converts acoustic data of the original sound source into acoustic data of the derived sound source, The type of the original sound source is called a sound source type, one of the sound source type information includes information on a plurality of the filters used to generate a plurality of the derived sound sources from the original sound source of one of the sound source types, The processing performed by the processing unit in accordance with the instructions includes each step of the method described in any one of claims 1 to 11. Sound generation system.

14. A sound source generation system that generates a plurality of derived sound sources from an original sound source, The storage device is accessible; The storage device a plurality of filter configuration information; Multiple sound source type information and I remember the one of the filter configuration information includes information on the configuration of one filter that converts acoustic data of the original sound source into acoustic data of the derived sound source, The type of the original sound source is called a sound source type, one of the sound source type information includes information on a plurality of the filters used to generate a plurality of the derived sound sources from the original sound source of one of the sound source types, A device for carrying out each step of the method according to any one of claims 1 to 11 is provided. Sound generation system.

Images