Sound processing program, sound processing method, and sound processing device

Abstract

To make a second sound easier for a user to hear in comparison to a case where the sound pressure of any sound is not adjusted when both a first sound and the second sound are played simultaneously from an output unit.SOLUTION: A sound processing program causes a computer to execute processing that: acquires first sound pressure data which indicates a secular change in the sound pressure of the first sound, and second sound pressure data which indicates a secular change in the sound pressure of the second sound when the first sound and the second sound are played simultaneously from an output unit, and increases the sound pressure of the second sound during a period in which the sound pressure of the first sound is a first threshold or larger on the basis of the acquired first sound pressure data and second sound pressure data.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a sound processing program, a sound processing method, and a sound processing device. [Background technology]

[0002] Patent Document 1 describes a technology for providing sounds that do not cause a user to feel uncomfortable when content is provided. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-220798 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, when a game is executed as the above content, various sounds are reproduced from a speaker as an output unit, such as music, background music (BGM), sound effects, and voice. When a plurality of sounds are reproduced from a speaker in an overlapping manner, the sound pressure of the overlapping sounds may need to be adjusted based on a predetermined priority. For example, when a character's voice (e.g., lines) and background music are reproduced from a speaker in an overlapping manner, it may be possible to make the lines easier for the user to hear.

[0005] For example, when ducking is performed to reduce the volume of the BGM in a scene where a character is speaking softly, the volume of the BGM needs to be adjusted to match the low volume of the dialogue in order to make the dialogue in that scene easier to hear. In this case, the volume of the BGM may become too low, disrupting the balance between the BGM and the dialogue, which may damage the user's immersion in the game.

[0006] The present disclosure aims to provide a sound processing program, a sound processing method, and a sound processing device that, when a first sound and a second sound are played back overlappingly from an output unit, can make the second sound easier for a user to hear than when the sound pressure of either sound is not adjusted. [Means for solving the problem]

[0007] A first aspect of the sound processing program causes a computer to execute a process in which, when a first sound and a second sound are played back overlappingly from an output unit, first sound pressure data indicating a change in the sound pressure of the first sound over time and second sound pressure data indicating a change in the sound pressure of the second sound over time, and, based on the acquired first sound pressure data and second sound pressure data, increases the sound pressure of the second sound during a period in which the sound pressure of the first sound is equal to or greater than a first threshold value.

[0008] The sound processing program of the second aspect is the sound processing program of the first aspect, and causes a computer to execute a process of increasing the sound pressure of the second sound during the relevant period during which the sound pressure of the first sound is equal to or greater than the first threshold and the sound pressure of the second sound is equal to or less than a second threshold that is smaller than the first threshold, based on the acquired first sound pressure data and second sound pressure data.

[0009] The sound processing program of the third aspect is the sound processing program of the second aspect, and causes a computer to execute at least one of a process of decreasing the amount by which the sound pressure of the second sound is increased the smaller the difference between the sound pressure of the second sound in the relevant period and the second threshold value, and a process of increasing the amount by which the sound pressure of the second sound is increased the larger the difference between the sound pressure of the second sound in the relevant period and the second threshold value.

[0010] A sound processing program of a fourth aspect is a sound processing program of any one of the first to third aspects, and causes a computer to execute a process of reducing the sound pressure of the first sound during the relevant period when the sound pressure of the second sound during the relevant period is equal to or greater than a third threshold and the sound pressure of the first sound during the relevant period is equal to or greater than a fourth threshold that is greater than the third threshold.

[0011] A sound processing program of a fifth aspect is a sound processing program of the fourth aspect, which causes a computer to execute at least one of a process of decreasing the amount by which the sound pressure of the first sound is reduced the smaller the difference between the sound pressure of the first sound in the relevant period and the fourth threshold value, and a process of increasing the amount by which the sound pressure of the first sound is reduced the larger the difference between the sound pressure of the first sound in the relevant period and the fourth threshold value.

[0012] A sound processing program of a sixth aspect is a sound processing program of any one of the first to fifth aspects, wherein the first sound includes a plurality of sounds having different sound sources, and the plurality of sounds included in the first sound are synthesized to generate the first sound pressure data, the sound processing program causing a computer to execute a process.

[0013] A seventh aspect of the sound processing program is a sound processing program of any one of the first to sixth aspects, wherein the first sound pressure data and the second sound pressure data are managed by the same bus, and an upward compressor, which is an effector for increasing sound pressure, is applied to the bus to cause a computer to execute processing to increase the sound pressure of the second sound during the relevant period.

[0014] A sound processing program of an eighth aspect is the sound processing program of the fourth or fifth aspect, wherein the first sound pressure data and the second sound pressure data are managed by the same bus, and the computer is caused to execute processing to apply an upward compressor, which is an effector for increasing sound pressure, to the bus to increase the sound pressure of the second sound during the relevant period, and to apply a downward compressor, which is an effector for decreasing sound pressure, to the bus to decrease the sound pressure of the first sound during the relevant period.

[0015] In a ninth aspect of the sound processing method, when a first sound and a second sound are played back overlappingly from an output unit, a computer executes a process to acquire first sound pressure data indicating a change in the sound pressure of the first sound over time and second sound pressure data indicating a change in the sound pressure of the second sound over time, and increase the sound pressure of the second sound during a period in which the sound pressure of the first sound is equal to or greater than a first threshold value based on the acquired first sound pressure data and second sound pressure data.

[0016] A sound processing device of a tenth aspect includes a sound processing unit that, when a first sound and a second sound are played back overlappingly from an output unit, acquires first sound pressure data indicating a change in the sound pressure of the first sound over time and second sound pressure data indicating a change in the sound pressure of the second sound over time, and increases the sound pressure of the second sound during a period in which the sound pressure of the first sound is equal to or greater than a first threshold value based on the acquired first sound pressure data and second sound pressure data. Effect of the Invention

[0017] In the sound processing program, sound processing method, and sound processing device disclosed herein, when a first sound and a second sound are played back overlappingly from an output unit, the second sound can be made easier for a user to hear than when the sound pressure of either sound is not adjusted. [Brief description of the drawings]

[0018] [Figure 1] FIG. 2 is a block diagram showing a hardware configuration of the information processing device. [Diagram 2] 1 is a block diagram showing an example of a functional configuration of an information processing device. [Diagram 3] 1 shows sound data of a predetermined sound in the form of a waveform. [Figure 4] The waveform of the sound data of the target sound is added to Fig. 3. [Diagram 5] 5 shows a state after the sound pressure of the target sound is increased in a partial period of the sound pressure data W2 shown in FIG. [Figure 6] 1 is a first flowchart showing the flow of sound processing. [Figure 7] FIG. 1 is a first signal flow diagram. [Figure 8] FIG. 2 is an explanatory diagram for explaining the operation of an upward compressor. [Figure 9] 6 shows a state after the sound pressure of the predetermined sound is reduced during a partial period of the sound pressure data W1 shown in FIG. 5. [Figure 10] 11 is a second flowchart showing the flow of sound processing. [Figure 11] FIG. 2 is a second signal flow diagram. [Figure 12] FIG. 2 is an explanatory diagram for explaining the operation of a downward compressor. [Figure 13] 13 is a third flowchart showing the flow of sound processing. [Figure 14] FIG. 3 is a third signal flow diagram. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] The information processing device 10 according to this embodiment will be described below. (First embodiment) First, a first embodiment of the information processing device 10 according to the present embodiment will be described.

[0020] 1 is a block diagram showing a hardware configuration of an information processing device 10. The information processing device 10 is, for example, a home game machine, a portable game machine, an arcade game machine, a smartphone, a tablet terminal, a personal computer, etc. In the first embodiment, the information processing device 10 is, as an example, a "home game machine." The information processing device 10 is an example of a "computer" and a "sound processing device."

[0021] 1, the information processing device 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage 14, a display 15, a speaker 16, an external I / F (Interface) 17, a communication I / F 18, and an input I / F 19. Each component is connected to each other via a bus 20 so as to be able to communicate with each other.

[0022] The CPU 11 is a central processing unit that executes various programs and controls each section.

[0023] The ROM 12 stores various programs and various data. The RAM 13 serves as a working area for temporarily storing programs or data.

[0024] The storage 14 is configured with a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory, and stores various programs and various data. The storage 14 stores, as various data, sound data related to various sounds to be reproduced from the speaker 16 while the game is being executed. "Various sounds" include music, background music, sound effects, voice, and the like.

[0025] The display 15 is, for example, a liquid crystal display, and displays various information. In the first embodiment, the display 15 is integrated with the information processing device 10. However, this is not limited to this, and the display 15 may be separate from the information processing device 10. Also, in the first embodiment, the display 15 does not have a touch panel. However, this is not limited to this, and the display 15 may have an integrated touch panel. The speaker 16 plays sounds indicated by sound data stored in the storage 14 during execution of the game. The speaker 16 is an example of an "output unit."

[0026] The external I / F 17 is an interface for connecting an external device to the information processing device 10. The external device is, for example, a recording medium 30.

[0027] The recording medium 30 may be a compact disk read only memory (CD-ROM), a digital versatile disk read only memory (DVD-ROM), a universal serial bus (USB) memory, or an SD memory card. A game processing program 30A and a sound processing program 30B are stored in the recording medium 30. The CPU 11 reads the game processing program 30A and the sound processing program 30B from the recording medium 30 via the external I / F 17, and executes the game processing program 30A and the sound processing program 30B using the RAM 13 as a working area. The game processing program 30A and the sound processing program 30B are not limited to being stored in the recording medium 30, and may be stored in advance in the storage 14 of the information processing device 10, or may be downloadable to the information processing device 10 via a network. The sound processing program 30B is an example of a "sound processing program."

[0028] The communication I / F 18 is an interface for connecting the information processing device 10 to a network. For example, the communication I / F 18 uses a wired communication standard such as Ethernet (registered trademark) or FDDI, or a wireless communication standard such as 4G, 5G, or Wi-Fi (registered trademark).

[0029] The input I / F 19 is an interface for connecting to the input device 40. The input device 40 is a controller having operation buttons and directional keys, a mouse, a keyboard, etc., and is used for various inputs. A user operates the game using the input device 40. Operation information indicating the contents of the input operation performed by the user using the input device 40 is stored in the RAM 13. In the first embodiment, the input device 40 is separate from the information processing device 10. However, this is not limited to this, and the input device 40 may be integrated with the information processing device 10. In addition, the input device 40 may be detachable from the information processing device 10. In addition, the number of input devices 40 may be one or more.

[0030] Next, a description will be given of the functional configuration of the information processing device 10. FIG 2 is a block diagram showing an example of the functional configuration of the information processing device 10.

[0031] 2, the CPU 11 of the information processing device 10 has, as functional components, a reception unit 11A, a game execution unit 11B, a sound processing unit 11C, and a sound playback unit 11D. Each functional component is realized by the CPU 11 reading and executing at least one of a game processing program 30A and a sound processing program 30B stored in the recording medium 30.

[0032] The reception unit 11A receives an input operation for a game performed using the input device 40 from a user.

[0033] The game execution section 11B executes a game processing program 30A stored in the recording medium 30 to execute a predetermined game.

[0034] The sound processing unit 11C acquires from the storage 14 various kinds of sound data to be reproduced from the speaker 16 in accordance with the progress of the game executed by the game execution unit 11B. The sound processing unit 11C then sends the acquired sound data to a specified bus, and performs sound processing within the bus, including mixing processing using effectors such as an equalizer and a compressor. This will be described in detail later. Here, a bus is a device for combining multiple pieces of sound data into one. In the first embodiment, the bus is reproduced by software. The bus may be used, for example, as a sound source for an Internet search.<URL: https: / / sio-dtm.com / 2019 / 10 / 05 / bus-tips / > and<URL: https: / / masatsumu-dtm.com / word_65-bus / > Since this is publicly known as disclosed in, for example, US Pat. No. 6,399,343, detailed description thereof will be omitted.

[0035] In the first embodiment, two kinds of sounds are provided as the various sounds described above: a predetermined sound and a sound of interest. The sound of interest is a sound that is desired to draw the user's attention. In the first embodiment, as an example, the sound of a character (hereinafter, "character sound") is the sound of interest. The predetermined sound is a sound different from the sound of interest. For example, in the first embodiment, sound effects and background music are the predetermined sounds. Here, the predetermined sound and the sound of interest can be distinguished by the presence or absence of a tag for the sound data. In the first embodiment, a predetermined tag is applied to sound data of a sound that is desired to draw the user's attention (e.g., character sound), and the sound indicated by the tagged sound data is the sound of interest. The predetermined sound is an example of a "first sound", and the sound of interest is an example of a "second sound".

[0036] The sound playback unit 11D plays back from the speaker 16 sounds based on the sound data stored in the storage 14, such as sounds represented by the sound data stored in the storage 14 and sounds represented by the sound data processed by the sound processing unit 11C.

[0037] Next, an overview of the sound processing performed by the sound processing unit 11C will be described with reference to FIGS.

[0038] FIG. 3 shows sound data of a predetermined sound in the form of a waveform. The waveform is a composite wave obtained by combining the waveform of the sound effect sound data and the waveform of the BGM sound data during a period T1 during which the sound effect sound and the BGM, which are the predetermined sound, are played back from the speaker 16 in an overlapping manner. The period T1 starts at point P1 and ends at point P2. Hereinafter, the waveform showing the change in the sound pressure of the predetermined sound over time may be referred to as "sound pressure data W1." The sound pressure data W1 is an example of "first sound pressure data." The horizontal axis of FIG. 3 is time (sec), and indicates that time passes toward the right in the figure. The vertical axis of FIG. 3 is sound pressure (dB), and indicates that the sound pressure increases toward the top of the figure and decreases toward the bottom of the figure.

[0039] Fig. 4 is an example of Fig. 3 with the addition of a waveform of sound data of a sound of interest reproduced from the speaker 16 in overlap with the predetermined sound. Hereinafter, the waveform showing the change over time in the sound pressure of the sound of interest may be referred to as "sound pressure data W2." The sound pressure data W2 is an example of "second sound pressure data."

[0040] 4, the target sound is reproduced from the speaker 16 during a period T2 that starts at point P3 and ends at point P4. At this time, since period T2 is included in period T1, during period T2, the predetermined sound and the target sound overlap and are reproduced from the speaker 16. In this case, the sound processing unit 11C performs a threshold determination, which will be described later, and performs sound processing to increase the sound pressure of the target sound according to the determination result.

[0041] Fig. 5 shows a state after the sound pressure of the target sound is increased in a certain period of the sound pressure data W2 shown in Fig. 4. Fig. 5 shows threshold value V1 and threshold value V2, which are threshold values ​​used in the above threshold determination, by dashed dotted lines. Threshold value V1 is an example of a "first threshold value," and threshold value V2 is an example of a "second threshold value."

[0042] The sound processing unit 11C increases the sound pressure of the target sound in a period in which the sound pressure of the predetermined sound is equal to or greater than the threshold V1 and the sound pressure of the target sound is equal to or less than the threshold V2, based on the sound pressure data W1 and W2. In the case of Fig. 5, the period T3 is the above-mentioned period in question, and the sound pressure of the target sound in period T3 increases from sound pressure S1 indicated by the solid line to sound pressure S2 indicated by the dashed line.

[0043] Next, the flow of the above sound processing will be described with reference to Fig. 6. Fig. 6 is a first flowchart showing the flow of the sound processing. The CPU 11 reads out the sound processing program 30B from the recording medium 30, expands it in the RAM 13, and executes it, thereby performing the sound processing. As an example, the sound processing is performed when a predetermined sound and a target sound are reproduced from the speaker 16 in an overlapping manner.

[0044] In step S10 shown in Fig. 6, the CPU 11 acquires sound pressure data W1 and sound pressure data W2. As an example, the CPU 11 acquires a composite wave obtained by combining a waveform of sound data of a sound effect sent to a specific bus with a waveform of sound data of background music as the sound pressure data W1. The CPU 11 also acquires a waveform of sound data of a sound of interest sent to a specific bus as the sound pressure data W2. Then, the CPU 11 proceeds to step S11.

[0045] In step S11, the CPU 11 judges whether or not the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S10 is equal to or greater than a threshold value V1 (see FIG. 5). If the CPU 11 judges that the sound pressure of the predetermined sound is equal to or greater than the threshold value V1 (step S11: YES), the CPU 11 proceeds to step S12. On the other hand, if the CPU 11 judges that the sound pressure of the predetermined sound is not equal to or greater than the threshold value V1 (step S11: NO), the CPU 11 proceeds to step S14. As an example, the CPU 11 proceeds to step S12 if there is a period during which the sound pressure of the predetermined sound is equal to or greater than the threshold value V1 within a period T1 (see FIG. 5) during which the predetermined sound is reproduced from the speaker 16. On the other hand, the CPU 11 proceeds to step S14 if there is no period during which the sound pressure of the predetermined sound is equal to or greater than the threshold value V1 within the period T1.

[0046] In step S12, the CPU 11 judges whether the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S10 is equal to or less than a threshold value V2 (see FIG. 5). If the CPU 11 judges that the sound pressure of the target sound is equal to or less than the threshold value V2 (step S12: YES), the process proceeds to step S13. On the other hand, if the CPU 11 judges that the sound pressure of the target sound is not equal to or less than the threshold value V2 (step S12: NO), the process proceeds to step S14. As an example, the CPU 11 proceeds to step S13 if there is a period in which the sound pressure of the target sound is equal to or less than the threshold value V2 within a period in which the sound pressure of the predetermined sound is equal to or greater than the threshold value V1. On the other hand, the CPU 11 proceeds to step S14 if there is no period in which the sound pressure of the target sound is equal to or less than the threshold value V2 within a period in which the sound pressure of the predetermined sound is equal to or greater than the threshold value V1.

[0047] In step S13, the CPU 11 increases the sound pressure of the target sound in a period (e.g., period T3 shown in FIG. 5) in which the sound pressure of the predetermined sound is equal to or higher than the threshold V1 and the sound pressure of the target sound is equal to or lower than the threshold V2. Then, the CPU 11 proceeds to step S14.

[0048] In step S14, the CPU 11 synthesizes the waveforms of the sound data of the sound effects and background music that are the predetermined sounds with the waveform of the sound data of the character voice that is the target sound. For example, when the CPU 11 advances from step S13 to step S14, it generates a composite wave that synthesizes the waveform of the sound data of the sound effects, the waveform of the background music, and the waveform of the sound data of the character voice with increased sound pressure during the relevant period. Then, the CPU 11 ends the sound processing.

[0049] Next, the flow of the process until the sound represented by the processed sound data is reproduced from the speaker 16 will be described with reference to Fig. 7. Fig. 7 is a signal flow diagram showing the flow. In the signal flow diagram, the explanation will be simplified or omitted for the parts that overlap with the above flowchart. In the following, the above-mentioned predetermined bus to which the sound data of the character voice, which is the target sound, and the sound data of the sound effect and BGM, which are the predetermined sounds, are sent, will be referred to as "bus B1".

[0050] 7, the CPU 11 generates a composite wave by combining the waveform of the sound effect sound data and the waveform of the BGM sound data.Then, the CPU 11 proceeds to step S21.

[0051] In step S21, the CPU 11 obtains a composite wave of the waveform of the sound data of the sound effect generated in step S20 and the waveform of the sound data of the BGM as sound pressure data W1. Then, the CPU 11 proceeds to step S22.

[0052] In step S22, the CPU 11 acquires the waveform of the sound data of the target sound as sound pressure data W2. Then, the CPU 11 proceeds to step S23.

[0053] In step S23, the CPU 11 performs a threshold judgment to determine whether or not there is a period during which the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S21 is equal to or greater than the threshold V1 and the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S22 is equal to or less than the threshold V2. Note that here, assuming that the CPU 11 has judged by the threshold judgment that there is a period, the process proceeds to step S24.

[0054] In step S24, the CPU 11 performs sound pressure adjustment to increase the sound pressure of the target sound in the corresponding period. Then, the CPU 11 proceeds to step S25. In the first embodiment, the sound pressure data W1 and the sound pressure data W2 are managed by the same bus, bus B1. Then, the CPU 11 applies an upward compressor, which is an effector for increasing sound pressure, to bus B1 to increase the sound pressure of the target sound in the corresponding period. The upward compressor is set to increase the sound pressure of the target sound by a predetermined amount in the corresponding period in which the sound pressure of the predetermined sound is equal to or greater than a threshold V1 and the sound pressure of the target sound is equal to or less than a threshold V2. In the first embodiment, the upward compressor is reproduced by software.

[0055] In step S25, the CPU 11 generates a composite wave by combining the waveform of the character voice sound data with increased sound pressure during the relevant period, the waveform of the sound effect sound data, and the waveform of the BGM sound data. Hereinafter, the composite wave generated in step S25 is referred to as sound data 1. Then, the CPU 11 proceeds to step S26.

[0056] In step S26, the CPU 11 reproduces the sound represented by the sound data 1 generated in step S25 from the speaker 16. Then, the CPU 11 ends the process. Note that the CPU 11 may appropriately perform known sound processing before supplying the sound data 1 to the speaker 16, such as supplying the sound data 1 to the speaker 16 via an amplifier (not shown).

[0057] Here, FIG. 8 is an explanatory diagram for explaining the operation of the upward compressor. The horizontal axis of FIG. 8 is the sound pressure (dB) of the target sound before the upward compressor is applied to the bus B1. The horizontal axis indicates that the sound pressure increases toward the right in the figure and decreases toward the left in the figure. The vertical axis of FIG. 8 is the sound pressure (dB) of the target sound after the upward compressor is applied to the bus B1. The vertical axis indicates that the sound pressure increases toward the top in the figure and decreases toward the bottom in the figure. As shown in FIG. 8, when the upward compressor is applied to the bus B1, the sound pressure during the period in which the sound pressure of the target sound is equal to or lower than the threshold value V2 increases from the sound pressure S1 indicated by the solid line to the sound pressure S2 indicated by the dashed line.

[0058] As described above, in the information processing device 10, when the predetermined sound and the attention sound are reproduced from the speaker 16 in an overlapping manner, the CPU 11 acquires sound pressure data W1 indicating the change in the sound pressure of the predetermined sound over time and sound pressure data W2 indicating the change in the sound pressure of the attention sound over time. Then, based on the acquired sound pressure data W1 and sound pressure data W2, the CPU 11 increases the sound pressure of the attention sound in the corresponding period in which the sound pressure of the predetermined sound is equal to or greater than the threshold value V1. As a result, in the information processing device 10, the sound pressure of the attention sound is increased without decreasing the sound pressure of the predetermined sound in the corresponding period, so that the sound pressure of the predetermined sound is not too low, which reduces the clarity of the predetermined sound and the attention sound. Furthermore, according to the information processing device 10, when the predetermined sound and the attention sound are reproduced from the speaker 16 in an overlapping manner, the sound pressure of the attention sound is increased in the corresponding period in which the sound pressure of the predetermined sound is equal to or greater than the threshold value V1, making it easier for the user to hear the attention sound compared to the case in which the sound pressure of either sound is not adjusted.

[0059] Furthermore, in the information processing device 10, the CPU 11 increases the sound pressure of the target sound during a period in which the sound pressure of the predetermined sound is equal to or greater than the threshold value V1 and the sound pressure of the target sound is equal to or less than the threshold value V2, based on the acquired sound pressure data W1 and sound pressure data W2. In this way, the information processing device 10 can select opportunities to increase the sound pressure of the target sound.

[0060] Moreover, in the information processing device 10, the CPU 11 decreases the amount by which the sound pressure of the target sound is increased as the difference between the sound pressure of the target sound in the corresponding period and the threshold value V2 becomes smaller, and increases the amount by which the sound pressure of the target sound is increased as the difference between the sound pressure of the target sound in the corresponding period and the threshold value V2 becomes larger. For example, as shown in FIG. 5, the CPU 11 decreases the amount by which the sound pressure of the end part of the arc represented by the sound pressure S1, which has a small difference from the threshold value V2, to be increased more than the amount by which the sound pressure of the center part of the arc, which has a large difference from the threshold value V2, is increased. Moreover, the CPU 11 increases the amount by which the sound pressure of the center part of the arc is increased more than the amount by which the sound pressure of the end part of the arc is increased. As a result, the curvature of the arc represented by the sound pressure S2 in the period T3 is smaller than the curvature of the arc represented by the sound pressure S1. With the above configuration, according to the information processing device 10, the user can easily hear the part of the target sound with low sound pressure, compared to when the amount by which the sound pressure of the target sound is increased is constant.

[0061] In the first embodiment, the predetermined sound includes a plurality of sounds having different sound data as sound sources stored in the storage 14. In the information processing device 10, the CPU 11 synthesizes the plurality of sounds included in the predetermined sound to generate sound pressure data W1. As a result, in the information processing device 10, compared to when the predetermined sound is a single sound, the opportunities for the sound pressure of the predetermined sound to be equal to or greater than the threshold value V1 can be increased. Therefore, according to the information processing device 10 of the first embodiment in which the predetermined sound includes a plurality of sounds, the opportunities for increasing the sound pressure of the target sound in the corresponding period can be increased compared to when the predetermined sound is a single sound.

[0062] Second embodiment Next, a second embodiment of the information processing device 10 according to the present invention will be described while omitting or simplifying parts that overlap with the above embodiment.

[0063] In the second embodiment, in addition to the sound processing of the above embodiments, when the sound pressure of the attention sound in the corresponding period is equal to or greater than a threshold V3 and the sound pressure of the predetermined sound in the corresponding period is equal to or greater than a threshold V4 that is greater than the threshold V3, the CPU 11 performs sound processing to reduce the sound pressure of the predetermined sound in the corresponding period. The threshold V3 is an example of the "third threshold", and the threshold V4 is an example of the "fourth threshold".

[0064] First, an overview of the sound processing performed in the second embodiment will be described with reference to FIG. Fig. 9 shows a state after the sound pressure of a predetermined sound is reduced in a certain period of the sound pressure data W1 shown in Fig. 5. In Fig. 9, the sound pressure of the target sound in period T3, specifically, the sound pressure S2 after sound pressure adjustment, is shown by a solid line. Fig. 9 also shows the above thresholds V3 and V4 by a dashed dotted line. As an example, in the second embodiment, the magnitude relationship of each threshold is threshold V3<threshold V2<threshold V1<threshold V4, as shown in the following formula (1). However, the magnitude relationship of each threshold is not limited to the above, and the order may be changed as appropriate.

[0065] (Number 1) Threshold V3<threshold V2<threshold V1<threshold V4 (1)

[0066] In the case of Fig. 9, the sound pressure of the target sound in period T3, which is the relevant period, is equal to or greater than threshold value V3, and the sound pressure of the predetermined sound in period T3 is equal to or greater than threshold value V4. Therefore, as shown in Fig. 9, the CPU 11 reduces the sound pressure of the predetermined sound in period T3 from sound pressure S3 indicated by the solid line to sound pressure S4 indicated by the dashed line.

[0067] Next, the flow of the above sound processing will be described with reference to Fig. 10. Fig. 10 is a second flowchart showing the flow of the sound processing.

[0068] 10, the CPU 11 acquires the sound pressure data W1 and the sound pressure data W2. Then, the CPU 11 proceeds to step S31.

[0069] In step S31, the CPU 11 determines whether the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S30 is equal to or greater than a threshold value V1 (see FIG. 5). If the CPU 11 determines that the sound pressure of the predetermined sound is equal to or greater than the threshold value V1 (step S31: YES), the CPU 11 proceeds to step S32. On the other hand, if the CPU 11 determines that the sound pressure of the predetermined sound is not equal to or greater than the threshold value V1 (step S31: NO), the CPU 11 proceeds to step S38.

[0070] In step S32, the CPU 11 determines whether the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S30 is equal to or lower than a threshold value V2 (see FIG. 5). If the CPU 11 determines that the sound pressure of the target sound is equal to or lower than the threshold value V2 (step S32: YES), the CPU 11 proceeds to step S33. On the other hand, if the CPU 11 determines that the sound pressure of the target sound is not equal to or lower than the threshold value V2 (step S32: NO), the CPU 11 proceeds to step S38.

[0071] In step S33, the CPU 11 increases the sound pressure of the target sound in a period (e.g., period T3 shown in FIG. 5) in which the sound pressure of the predetermined sound is equal to or higher than the threshold V1 and the sound pressure of the target sound is equal to or lower than the threshold V2. Then, the CPU 11 proceeds to step S34.

[0072] In step S34, the CPU 11 obtains sound pressure data W2 (see FIG. 9) indicating the change over time in the sound pressure of the target sound after the sound pressure is increased in step S33. Then, the CPU 11 proceeds to step S35.

[0073] In step S35, the CPU 11 determines whether the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S34 is equal to or greater than a threshold value V3 (see FIG. 9) during the relevant period. If the CPU 11 determines that the sound pressure of the target sound is equal to or greater than the threshold value V3 during the relevant period (step S35: YES), the CPU 11 proceeds to step S36. On the other hand, if the CPU 11 determines that the sound pressure of the target sound is not equal to or greater than the threshold value V3 during the relevant period (step S35: NO), the CPU 11 proceeds to step S38.

[0074] In step S36, the CPU 11 determines whether the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S30 is equal to or greater than a threshold value V4 (see FIG. 9) during the relevant period. If the CPU 11 determines that the sound pressure of the predetermined sound is equal to or greater than the threshold value V4 during the relevant period (step S36: YES), the CPU 11 proceeds to step S37. On the other hand, if the CPU 11 determines that the sound pressure of the predetermined sound is not equal to or greater than the threshold value V4 during the relevant period (step S36: NO), the CPU 11 proceeds to step S38.

[0075] In step S37, the CPU 11 reduces the sound pressure of the predetermined sound during the relevant period (for example, the period T3 shown in FIG. 9).Then, the CPU 11 proceeds to step S38.

[0076] In step S38, the CPU 11 synthesizes the waveforms of the sound data of the sound effects and background music that are the predetermined sounds with the waveform of the sound data of the character voice that is the target sound. For example, when the CPU 11 advances from step S37 to step S38, it generates a combined wave that synthesizes the waveform of the sound data of the sound effects with a reduced sound pressure during the relevant period, the waveform of the sound data of the background music with a reduced sound pressure during the relevant period, and the waveform of the sound data of the character voice with a increased sound pressure during the relevant period. Then, the CPU 11 ends the sound processing.

[0077] Next, a flow of a process in which a sound represented by processed sound data is reproduced from the speaker 16 will be described with reference to Fig. 11. Fig. 11 is a signal flow diagram showing the process. In the signal flow diagram, as in the above embodiment, a predetermined bus to which sound data of a character voice, which is a sound of interest, and sound data of sound effects and BGM, which are predetermined sounds, are sent is called "bus B1".

[0078] 11, the CPU 11 generates a composite wave by combining the waveform of the sound effect sound data and the waveform of the BGM sound data.Then, the CPU 11 proceeds to step S41.

[0079] In step S41, the CPU 11 obtains a composite wave of the waveform of the sound data of the sound effect generated in step S40 and the waveform of the sound data of the BGM as sound pressure data W1. Then, the CPU 11 proceeds to step S42.

[0080] In step S42, the CPU 11 acquires the waveform of the sound data of the target sound as sound pressure data W2. Then, the CPU 11 proceeds to step S43.

[0081] In step S43, the CPU 11 performs a threshold judgment to determine whether or not there is a period during which the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S41 is equal to or greater than the threshold V1 and the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S42 is equal to or less than the threshold V2. Note that here, assuming that the CPU 11 has judged by the threshold judgment that there is a period, the process proceeds to step S44.

[0082] In step S44, the CPU 11 applies an upward compressor to the bus B1 to perform sound pressure adjustment to increase the sound pressure of the target sound in the corresponding period, and then the CPU 11 proceeds to step S45.

[0083] In step S45, the CPU 11 obtains sound pressure data W2 (see FIG. 9) indicating the change over time in the sound pressure of the target sound after the sound pressure is increased in step S44. Then, the CPU 11 proceeds to step S46.

[0084] In step S46, the CPU 11 performs a threshold judgment as to whether or not the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S41 is equal to or greater than the threshold V4 during the relevant period, and the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S45 is equal to or greater than the threshold V3 during the relevant period. Note that here, assuming that the CPU 11 has determined in the threshold judgment that the sound pressure of the predetermined sound is equal to or greater than the threshold V4 during the relevant period, and the sound pressure of the target sound is equal to or greater than the threshold V3 during the relevant period, the CPU 11 proceeds to step S47.

[0085] In step S47, the CPU 11 performs sound pressure adjustment to reduce the sound pressure of the predetermined sound in the corresponding period. Then, the CPU 11 proceeds to step S48. In the second embodiment, the CPU 11 applies a downward compressor, which is an effector for reducing sound pressure, to the bus B1 to reduce the sound pressure of the predetermined sound in the corresponding period. The downward compressor is set to reduce the sound pressure of the predetermined sound by a predetermined amount in the corresponding period in which the sound pressure of the predetermined sound is equal to or greater than the threshold V4 and the sound pressure of the target sound is equal to or greater than the threshold V3. In the second embodiment, the downward compressor is reproduced by software.

[0086] In step S48, the CPU 11 generates a composite wave by combining the waveform of the character voice sound data with increased sound pressure for the corresponding period, the waveform of the sound effect sound data with decreased sound pressure for the corresponding period, and the waveform of the BGM sound data with decreased sound pressure for the corresponding period. Hereinafter, the composite wave generated in step S48 is referred to as sound data 2. Then, the CPU 11 proceeds to step S49.

[0087] In step S49, the CPU 11 reproduces the sound represented by the sound data 2 generated in step S48 from the speaker 16. Then, the CPU 11 ends the process.

[0088] Here, FIG. 12 is an explanatory diagram for explaining the operation of the downward compressor. The horizontal axis of FIG. 12 is the sound pressure (dB) of the predetermined sound before the downward compressor is applied to the bass B1. The horizontal axis indicates that the sound pressure increases toward the right in the figure and decreases toward the left in the figure. The vertical axis of FIG. 12 is the sound pressure (dB) of the predetermined sound after the downward compressor is applied to the bass B1. The vertical axis indicates that the sound pressure increases toward the top in the figure and decreases toward the bottom in the figure. As shown in FIG. 12, when the downward compressor is applied to the bass B1, the sound pressure during the period in which the sound pressure of the predetermined sound is equal to or greater than the threshold value V4 decreases from the sound pressure S3 indicated by the solid line to the sound pressure S4 indicated by the dashed line.

[0089] As described above, in the information processing device 10, when the sound pressure of the target sound in the relevant period is equal to or greater than the threshold V3 and the sound pressure of the predetermined sound in the relevant period is equal to or greater than the threshold V4, the CPU 11 reduces the sound pressure of the predetermined sound in the relevant period. This makes it easier for the user to hear the target sound in the relevant period by reducing the sound pressure of the predetermined sound whose sound pressure is equal to or greater than the threshold V4 in the relevant period.

[0090] In addition, in the information processing device 10, the CPU 11 decreases the amount by which the sound pressure of the predetermined sound is reduced as the difference between the sound pressure of the predetermined sound in the corresponding period and the threshold value V4 becomes smaller, and increases the amount by which the sound pressure of the predetermined sound is reduced as the difference between the sound pressure of the predetermined sound in the corresponding period and the threshold value V4 becomes larger. For example, as shown in FIG. 9, the CPU 11 decreases the amount by which the sound pressure of the end portion of the arc represented by the sound pressure S3, which has a small difference from the threshold value V4, more than the amount by which the sound pressure of the center portion of the arc, which has a large difference from the threshold value V4, is reduced. In addition, the CPU 11 increases the amount by which the sound pressure of the center portion of the arc is reduced more than the amount by which the sound pressure of the end portion of the arc is reduced. As a result, the curvature of the arc represented by the sound pressure S4 in the period T3 is smaller than the curvature of the arc represented by the sound pressure S3. With the above configuration, the information processing device 10 can suppress the user from feeling that the parts of the predetermined sound with high sound pressure are noisy, compared to the case where the amount by which the sound pressure of the predetermined sound is reduced is constant.

[0091] In the second embodiment, the sound pressure data W1 and the sound pressure data W2 are managed by the same bus, specifically, the bus B1 (see FIG. 11). The CPU 11 applies an upward compressor to the bus B1 to increase the sound pressure of the target sound in the corresponding period, and applies a downward compressor to the bus B1 to decrease the sound pressure of the predetermined sound in the corresponding period. This allows the information processing device 10 to perform sound processing to increase the sound pressure of the target sound and sound processing to decrease the sound pressure of the predetermined sound in the same bus, so as to make the target sound easier for the user to hear.

[0092] (Third embodiment) Next, a third embodiment of the information processing device 10 according to the present invention will be described while omitting or simplifying parts that overlap with the above-described embodiments.

[0093] The third embodiment differs from the second embodiment in the order of sound processing in that the sound pressure of the target sound is increased after the sound pressure of the predetermined sound is decreased.

[0094] FIG. 13 is a third flowchart showing the flow of sound processing. 13, the CPU 11 acquires the sound pressure data W1 and the sound pressure data W2. Then, the CPU 11 proceeds to step S51.

[0095] In step S51, the CPU 11 judges whether or not the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S50 is equal to or greater than the threshold V3 (see FIG. 9). If the CPU 11 judges that the sound pressure of the target sound is equal to or greater than the threshold V3 (step S51: YES), the process proceeds to step S52. On the other hand, if the CPU 11 judges that the sound pressure of the target sound is not equal to or greater than the threshold V3 (step S51: NO), the process proceeds to step S55. As an example, the CPU 11 proceeds to step S52 if there is a period during which the sound pressure of the target sound is equal to or greater than the threshold V3 within the period T2 (see FIG. 9) during which the target sound is reproduced from the speaker 16. On the other hand, the CPU 11 proceeds to step S55 if there is no period during which the sound pressure of the target sound is equal to or greater than the threshold V3 within the period T2.

[0096] In step S52, the CPU 11 judges whether the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S50 is equal to or greater than a threshold V4 (see FIG. 9). If the CPU 11 judges that the sound pressure of the predetermined sound is equal to or greater than the threshold V4 (step S52: YES), the CPU 11 proceeds to step S53. On the other hand, if the CPU 11 judges that the sound pressure of the predetermined sound is not equal to or greater than the threshold V4 (step S52: NO), the CPU 11 proceeds to step S55. As an example, the CPU 11 proceeds to step S53 if there is a period in which the sound pressure of the predetermined sound is equal to or greater than the threshold V4 within a period in which the sound pressure of the target sound is equal to or greater than the threshold V3. On the other hand, the CPU 11 proceeds to step S55 if there is no period in which the sound pressure of the predetermined sound is equal to or greater than the threshold V4 within a period in which the sound pressure of the target sound is equal to or greater than the threshold V3.

[0097] In step S53, the CPU 11 reduces the sound pressure of the predetermined sound in a period in which the sound pressure of the predetermined sound is equal to or higher than the threshold V4 and the sound pressure of the target sound is equal to or higher than the threshold V3 (for example, the period T3 shown in FIG. 9). Then, the CPU 11 proceeds to step S54.

[0098] In step S54, the CPU 11 obtains sound pressure data W1 (see FIG. 9) indicating the change over time in the sound pressure of the predetermined sound after the sound pressure has been reduced in step S53. Then, the CPU 11 proceeds to step S55.

[0099] In step S55, the CPU 11 determines whether the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S50 or step S54 is equal to or greater than a threshold value V1 (see FIG. 5). If the CPU 11 determines that the sound pressure of the predetermined sound is equal to or greater than the threshold value V1 (step S55: YES), the CPU 11 proceeds to step S56. On the other hand, if the CPU 11 determines that the sound pressure of the predetermined sound is not equal to or greater than the threshold value V1 (step S55: NO), the CPU 11 proceeds to step S58.

[0100] In step S56, the CPU 11 determines whether the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S50 is equal to or lower than a threshold value V2 (see FIG. 5). If the CPU 11 determines that the sound pressure of the target sound is equal to or lower than the threshold value V2 (step S56: YES), the CPU 11 proceeds to step S57. On the other hand, if the CPU 11 determines that the sound pressure of the target sound is not equal to or lower than the threshold value V2 (step S56: NO), the CPU 11 proceeds to step S58.

[0101] In step S57, the CPU 11 increases the sound pressure of the target sound in a period (e.g., period T3 shown in FIG. 5) in which the sound pressure of the predetermined sound is equal to or greater than the threshold V1 and the sound pressure of the target sound is equal to or less than the threshold V2. Then, the CPU 11 proceeds to step S58.

[0102] In step S58, the CPU 11 synthesizes the waveforms of the sound data of the sound effects and BGM that are the predetermined sounds with the waveform of the sound data of the character's voice that is the target sound, and then ends the sound processing.

[0103] Next, a flow of a process in which a sound represented by processed sound data is reproduced from the speaker 16 will be described with reference to Fig. 14. Fig. 14 is a signal flow diagram showing the process. In the signal flow diagram, as in the above embodiment, a predetermined bus to which sound data of a character voice, which is a sound of interest, and sound data of sound effects and BGM, which are predetermined sounds, are sent is called "bus B1".

[0104] 14, the CPU 11 generates a composite wave by combining the waveform of the sound effect sound data and the waveform of the BGM sound data.Then, the CPU 11 proceeds to step S61.

[0105] In step S61, the CPU 11 obtains a composite wave of the waveform of the sound data of the sound effect generated in step S60 and the waveform of the sound data of the BGM as sound pressure data W1. Then, the CPU 11 proceeds to step S62.

[0106] In step S62, the CPU 11 acquires the waveform of the sound data of the target sound as sound pressure data W2. Then, the CPU 11 proceeds to step S63.

[0107] In step S63, the CPU 11 performs a threshold judgment to determine whether or not there is a period during which the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S61 is equal to or greater than a threshold V4 and the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S62 is equal to or greater than a threshold V3. Note that here, assuming that the CPU 11 has judged by the threshold judgment that such a period exists, the process proceeds to step S64.

[0108] In step S64, the CPU 11 applies a downward compressor to the bus B1 to adjust the sound pressure so as to reduce the sound pressure of the predetermined sound during the above-mentioned period, and then the CPU 11 proceeds to step S65.

[0109] In step S65, a combined wave is generated by combining the waveform of the sound data of the sound effect and the waveform of the sound data of the BGM after the sound pressures have been reduced in step S64.Then, the CPU 11 proceeds to step S66.

[0110] In step S66, the CPU 11 acquires a composite wave of the waveform of the sound data of the sound effect generated in step S65 and the waveform of the sound data of the BGM as the sound pressure data W1 after the sound pressure adjustment (see FIG. 9).Then, the CPU 11 proceeds to step S67.

[0111] In step S67, the CPU 11 performs a threshold judgment to determine whether or not there is a period during which the sound pressure of the predetermined sound indicated in the sound pressure data W1 acquired in step S66 is equal to or greater than the threshold V1 and the sound pressure of the target sound indicated in the sound pressure data W2 acquired in step S62 is equal to or less than the threshold V2. Note that here, assuming that the CPU 11 has judged by the threshold judgment that there is a period, the process proceeds to step S68.

[0112] In step S68, the CPU 11 applies an upward compressor to the bus B1 to perform sound pressure adjustment to increase the sound pressure of the target sound in the corresponding period, and then the CPU 11 proceeds to step S69.

[0113] In step S69, the CPU 11 generates a composite wave by combining the waveform of the character voice sound data with increased sound pressure for the corresponding period, the waveform of the sound effect sound data with decreased sound pressure for the corresponding period, and the waveform of the BGM sound data with decreased sound pressure for the corresponding period. Hereinafter, the composite wave generated in step S69 is referred to as sound data 3. Then, the CPU 11 proceeds to step S70.

[0114] In step S70, the CPU 11 reproduces the sound represented by the sound data 3 generated in step S69 from the speaker 16. Then, the CPU 11 ends the process.

[0115] (others) In the above embodiment, the target sound is the character voice, but the target sound is not limited to this. For example, the target sound may be a sound effect or background music.

[0116] In the above embodiment, a case where the attention sound is played while the predetermined sound is being played is exemplified as a case where the predetermined sound and the attention sound are played in an overlapping manner from the speaker 16. However, the present invention is not limited to this, and a case where the predetermined sound and the attention sound are played in an overlapping manner from the speaker 16 may be a case where the predetermined sound is played while the attention sound is being played, or a case where the predetermined sound and the attention sound start playing at the same time.

[0117] In the above embodiment, the predetermined sound includes a plurality of sounds having different sound data, specifically, two kinds of sounds. However, the present invention is not limited to this, and the predetermined sound may include three or more kinds of sounds having different sound data. Furthermore, the predetermined sound may be a single sound.

[0118] In the above embodiment, the predetermined sound is exemplified by sound effects and background music, but is not limited thereto. For example, the predetermined sound may be music with lyrics. Furthermore, the predetermined sound may be a sound without voice or may be a sound with voice.

[0119] In the above embodiment, the CPU 11 increases the sound pressure of the attention sound in the period in which the sound pressure of the predetermined sound is equal to or greater than the threshold V1 and the sound pressure of the attention sound is equal to or less than the threshold V2. However, without being limited thereto, the CPU 11 may increase the sound pressure of the attention sound in the period in which the sound pressure of the predetermined sound is equal to or greater than the threshold V1.

[0120] In the above embodiment, the CPU 11 executes both a process of decreasing the amount by which the sound pressure of the target sound is increased as the difference between the sound pressure of the target sound in the corresponding period and the threshold value V2 becomes smaller, and a process of increasing the amount by which the sound pressure of the target sound is increased as the difference between the sound pressure of the target sound in the corresponding period and the threshold value V2 becomes larger. However, without being limited to this, the CPU 11 may execute only one of the above two processes.

[0121] In the above embodiment, the CPU 11 executes both a process of decreasing the amount by which the sound pressure of the predetermined sound is reduced as the difference between the sound pressure of the predetermined sound in the corresponding period and the threshold value V4 becomes smaller, and a process of increasing the amount by which the sound pressure of the predetermined sound is reduced as the difference between the sound pressure of the predetermined sound in the corresponding period and the threshold value V4 becomes larger. However, without being limited to this, the CPU 11 may execute only one of the above two processes.

[0122] In the above embodiment, the sound processing executed by the CPU 11 by reading the software (program) may be executed by various processors other than the CPU. In this case, examples of the processor include a PLD (Programmable Logic Device) such as an FPGA (Field-Programmable Gate Array) whose circuit configuration can be changed after manufacture, and a dedicated electric circuit such as an ASIC (Application Specific Integrated Circuit) which is a processor having a circuit configuration designed exclusively for executing a specific process. The sound processing may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same or different types (for example, a plurality of FPGAs, and a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements. [Explanation of symbols]

[0123] 10 Information processing device (example of computer and sound processing device) 11C Sound Processing Unit 16 Speaker (an example of an output section) 30B Sound processing program (an example of a sound processing program)

Claims

1. When a first sound and a second sound are reproduced from an output unit in an overlapping manner, first sound pressure data indicating a change in sound pressure of the first sound over time and second sound pressure data indicating a change in sound pressure of the second sound over time are obtained; increasing the sound pressure of the second sound during a period in which the sound pressure of the first sound is equal to or greater than a first threshold, based on the acquired first sound pressure data and the acquired second sound pressure data; A sound processing program that causes a computer to carry out the processing.

2. increasing the sound pressure of the second sound during the period in which the sound pressure of the first sound is equal to or greater than the first threshold and the sound pressure of the second sound is equal to or less than a second threshold that is smaller than the first threshold, based on the acquired first sound pressure data and the acquired second sound pressure data; 2. The sound processing program according to claim 1, for causing a computer to execute processing.

3. 3. The sound processing program according to claim 2, for causing a computer to execute at least one of a process of decreasing an amount by which the sound pressure of the second sound is increased as the difference between the sound pressure of the second sound in the relevant period and the second threshold value becomes smaller, and a process of increasing an amount by which the sound pressure of the second sound is increased as the difference between the sound pressure of the second sound in the relevant period and the second threshold value becomes larger.

4. When the sound pressure of the second sound in the relevant period is equal to or greater than a third threshold and the sound pressure of the first sound in the relevant period is equal to or greater than a fourth threshold that is greater than the third threshold, the sound pressure of the first sound in the relevant period is reduced.

2. The sound processing program according to claim 1, for causing a computer to execute processing.

5. 5. The sound processing program according to claim 4, for causing a computer to execute at least one of a process of decreasing an amount by which the sound pressure of the first sound is reduced the smaller the difference between the sound pressure of the first sound in the relevant period and the fourth threshold value, and a process of increasing an amount by which the sound pressure of the first sound is reduced the larger the difference between the sound pressure of the first sound in the relevant period and the fourth threshold value.

6. The first sound includes a plurality of sounds having different sound sources; synthesizing the plurality of sounds included in the first sound to generate the first sound pressure data; 2. The sound processing program according to claim 1, for causing a computer to execute processing.

7. the first sound pressure data and the second sound pressure data are managed by the same bus; applying an upward compressor, which is an effector for increasing sound pressure, to the bus to increase the sound pressure of the second sound during the corresponding period; 2. The sound processing program according to claim 1, for causing a computer to execute processing.

8. the first sound pressure data and the second sound pressure data are managed by the same bus; applying an upward compressor, which is an effector for increasing sound pressure, to the bus to increase the sound pressure of the second sound during the relevant period, and applying a downward compressor, which is an effector for decreasing sound pressure, to the bus to decrease the sound pressure of the first sound during the relevant period; 5. The sound processing program according to claim 4, for causing a computer to execute the process.

9. When a first sound and a second sound are reproduced from an output unit in an overlapping manner, first sound pressure data indicating a change in sound pressure of the first sound over time and second sound pressure data indicating a change in sound pressure of the second sound over time are obtained; increasing the sound pressure of the second sound during a period in which the sound pressure of the first sound is equal to or greater than a first threshold, based on the acquired first sound pressure data and the acquired second sound pressure data; A sound processing method in which the processing is performed by a computer.

10. a first sound and a second sound are played back overlappingly from an output unit, the first sound data indicating a change in the sound pressure of the first sound over time and the second sound data indicating a change in the sound pressure of the second sound over time are acquired, and the sound processing unit increases the sound pressure of the second sound during a period in which the sound pressure of the first sound is equal to or greater than a first threshold value based on the acquired first sound pressure data and second sound pressure data.

Images