Sound effect control method, electronic equipment and storage medium
By determining the activation and waiting of the filter group in the sound module, and using the intermediate transition filter group step by step to solve the problem of non -smooth and uncontrollable switching time of sound effects, realize the smoothness and controllability of sound transition Essence
Patent Information
- Application Number
- CN202411441678.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-15
- Publication Date
- 2025-01-28
AI Technical Summary
In the prior art, when users switch scenes, the sound effect switching is not smooth and the switching time is uncontrollable.
By determine the activation filter group and the living filter group to be determined in the sound module, at least one intermediate transition filter group is determined based on these groups, and the filter group is activated to the activation of the filter through the group to achieve the smoothness of the transitional transition. And controllability.
It improves the smoothness of sound effects when changing environmental changes, and controls the transition time of sound effects.
Smart Images

Figure CN119376678A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of audio technology, and in particular to a sound effect control method, an electronic device and a storage medium. Background Art
[0002] With the development of technology, in order to improve the user experience, there are smart devices that can automatically adapt the audio effects of audio playback according to the surrounding environment. Related technologies In the process of smart devices automatically adapting audio according to the surrounding environment, environmental scene recognition and fusion are mainly learned from the collected sensor data sets through machine learning, deep learning and other traditional methods. When the device is placed in different scenes, it can automatically identify the type of environmental scene, and then adapt different sound effect parameters according to different scene types.
[0003] However, when the user switches scenes, the related technology has technical problems that the sound effect switching is not smooth and the switching time is uncontrollable. Summary of the invention
[0004] The purpose of the embodiments of the present invention is to provide a sound effect control method, an electronic device and a storage medium, thereby improving the smoothness of the sound effect transition when the environment changes, and the controllability of the sound effect transition time.
[0005] To solve the above technical problems, an embodiment of the present invention provides a sound effect control method, comprising: determining an activation filter group and a filter group to be activated in a sound effect module; determining at least one intermediate transition filter group based on the activation filter group and the filter group to be activated; in the sound effect module, transitioning the activation filter group to the filter group to be activated step by step through at least one intermediate transition filter group.
[0006] An embodiment of the present invention also provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the above-mentioned sound effect control method.
[0007] An embodiment of the present invention further provides a computer-readable storage medium storing a computer program, wherein the computer program implements the above-mentioned sound effect control method when executed by a processor.
[0008] In some embodiments, determining at least one intermediate transition filter group based on the activated filter group and the filter group to be activated includes: obtaining first parameter information of each filter of the same type contained in the activated filter group and second parameter information of each filter of the same type contained in the filter group to be activated; all filters of the same type contained in the filter group to be activated correspond one-to-one to all filters of the same type contained in the activated filter group; determining third parameter information of the corresponding filters in the intermediate transition filter group according to the corresponding first parameter information and second parameter information; determining each filter in the intermediate transition filter group in the sound effect module according to the third parameter information; in the sound effect module, transitioning the activated filter group to the filter group to be activated step by step through at least one intermediate transition filter group includes: transitioning each filter of the activated filter group to the corresponding filter in the filter group to be activated step by step through at least one filter corresponding to the intermediate transition filter group.
[0009] In some embodiments, the sound effect module includes M types of filters, where M is an integer greater than 0; the activated filter group includes at least one type of filter among the M types; the filter group to be activated includes at least one type of filter among the M types; before obtaining the first parameter information of each filter included in the activated filter group and the second parameter information of each filter included in the filter group to be activated, it also includes: for one of the filter types, if the number of filters included in the activated filter group is less than the number of filters included in the filter group to be activated, then a first virtual filter of the same type is added to the activated filter group; if the number of filters included in the activated filter group is greater than the number of filters included in the filter group to be activated, then a second virtual filter of the same type is added to the filter group to be activated, so that all filters included in the filter group to be activated correspond one-to-one to all filters included in the activated filter group.
[0010] In some embodiments, the first parameter information includes the first parameter value of each filter included in the activated filter group, and the second parameter information includes the second parameter value of each filter included in the filter group to be activated; the third parameter information includes the third parameter value of each filter included in the intermediate transition filter group; the first parameter value, the second parameter value, and the third parameter value are all one of the cutoff frequency, gain, Q value, and filter order; determining the third parameter information of the corresponding filter in the intermediate transition filter group according to the corresponding first parameter information and the second parameter information includes: when the first parameter value, the second parameter value, and the third parameter value are all the cutoff frequency or gain or Q value, for the filters corresponding to the activated filter group and the filter group to be activated, according to the number of the intermediate transition filter groups, linear operation or exponential operation is performed on the first parameter value and the second parameter value to obtain the third parameter value of the corresponding filter in each intermediate transition filter group.
[0011] In some embodiments, the first parameter information of each filter included in the activated filter group includes multiple different first parameter values, the second parameter information of each filter included in the filter group to be activated includes multiple different second parameter values, and the third parameter information of each filter included in the intermediate transition filter group includes multiple different third parameter values.
[0012] In some embodiments, the determining of the third parameter information of the corresponding filter in the intermediate transition filter group according to the corresponding first parameter information and the second parameter information also includes: when the first parameter value, the second parameter value, and the third parameter value are all filter orders, for the filters corresponding to the activated filter group and the filter group to be activated, determining the number of steps required for transition according to the first order and the second order; and evenly dividing the corresponding filters in the multiple intermediate transition filter groups into each step in order of order or in reverse order according to the number of steps, so as to determine the filter order of the corresponding filter in each intermediate transition filter group.
[0013] In some embodiments, in the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one intermediate transition filter group, including: in the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one intermediate transition filter group; wherein, in each transition process, the filter group before the transition and the filter group after the transition are faded in and out according to a preset number of processing frames.
[0014] In some embodiments, during each transition stage, the filter group before the transition and the filter group after the transition perform fade-in and fade-out transition according to a preset number of processing frames, including: during each transition stage, determining the attenuation coefficient of the filter group before the transition and the enhancement coefficient of the filter group after the transition for each processing frame in the preset number of processing frames; wherein the attenuation coefficient gradually decreases and the enhancement coefficient gradually increases; filtering the input processing frame by the filter group before the transition to obtain a first filter frame, and filtering the input processing frame by the filter group after the transition to obtain a second filter frame; attenuating the first filter frame according to the attenuation coefficient, and enhancing the second filter frame according to the enhancement coefficient; superimposing the attenuated first filter frame and the enhanced second filter frame according to sample points to obtain a filter frame corresponding to the processing frame.
[0015] The technical solution provided by the embodiment of the present invention has at least the following advantages:
[0016] After determining the activated filter group and the filter group to be activated, this embodiment determines at least one intermediate transition filter group according to the activated filter group and the filter group to be activated, and gradually transitions the activated filter group to the filter group to be activated through the at least one intermediate transition filter group, thereby making the transition process from the activated filter group to the filter group to be activated smoother, thereby improving the smoothness of the sound effect transition when the environment changes; at the same time, during the transition process from the activated filter group to the filter group to be activated, it is only necessary to control the switching time of the intermediate transition filter group, and the time of the sound effect transition is controllable. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.
[0018] Figure 1 is a flow chart of a sound effect control method according to an embodiment of the present invention;
[0019] Figure 2 is a flow chart of a sound effect control method according to an embodiment of the present invention;
[0020] Figure 3 is a flow chart of a sound effect control method according to an embodiment of the present invention;
[0021] Figure 4 is a flow chart of a sound effect control method according to an embodiment of the present invention;
[0022] Figure 5is a flow chart of a sound effect control method according to an embodiment of the present invention;
[0023] Figure 6 It is a schematic diagram of the filter order transitioning from 2nd order through 20 levels to 6th order;
[0024] Figure 7 is a flow chart of a sound effect control method according to an embodiment of the present invention;
[0025] Figure 8 It is a process diagram of the activated filter group transitioning to the filter group to be activated through multiple intermediate transition filter groups;
[0026] Fig. 9 is a flowchart of the sub-steps of step 603 according to an embodiment of the present invention;
[0027] Fig.10 It is a schematic diagram of the mechanism of fading in and out the processed frames by two sets of filters during a transition process;
[0028] Fig.11 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0029] In order to make the purpose, technical scheme and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. However, it can be understood by those skilled in the art that in the embodiments of the present invention, many technical details are proposed in order to enable the reader to better understand the present invention. However, even without these technical details and various changes and modifications based on the following embodiments, the technical scheme claimed in the present invention can also be implemented. The division of the following embodiments is for the convenience of description and should not constitute any limitation on the specific implementation of the present invention. The various embodiments can be combined and referenced with each other under the premise of no contradiction.
[0030] An embodiment of the present invention relates to a sound effect control method, and a specific flow chart is shown as follows: Figure 1 As shown, the sound effect control method includes the following steps:
[0031] Step 101: determine an activated filter group and a filter group to be activated in a sound effect module.
[0032] Specifically, the sound effect module is the most important module for basic sound effects, among which the equalizer is one of the most commonly used sound effect modules, and the equalizer has two implementation modes: time domain and frequency domain. In consumer electronic products, due to the limitation of the computing power of digital signal processing technology (DSP), the equalizer generally uses an infinite impulse response (IIR) filter group in the time domain to perform sound effect equalization. Therefore, in order to reduce the computing power of DSP, the sound effect module used in this embodiment is an equalizer, and the equalizer uses an IIR filter. However, in other embodiments, the sound effect module may also be an equalizer using a finite impulse response (FIR) filter in the frequency domain, or may be other sound effect modules other than the equalizer, such as a dynamic range control (Dynamic Range Control) module.
[0033] In this embodiment, the sound effect module is an equalizer composed of IIR filters for illustration. An equalizer composed of IIR filters is composed of 5 types of filters, including: low-pass filter (LPF), high-pass filter (HPF), peak filter (Peak Filter) or notch filter (NotchFilter), low-frequency shelf filter (Low Shelf Filter), and high-frequency shelf filter (High Shelf Filter); the parameters of an IIR filter can be defined as: type (the 5 basic filter types defined above), cutoff frequency fc, gain, Q value (quality factor), order, and enable switch, wherein the cutoff frequency, gain, Q value, and order of the filter are all adjustable, and the enable switch indicates whether the filter implements filtering. The filter that implements filtering is in an enabled state, and the filter that does not implement filtering is in a disabled state.
[0034] Among them, the number of each type of filter in the equalizer can be multiple or empty. The types and numbers of filters that need to be enabled in different environments are different. The sound effect control method in this embodiment refers to switching from a group of activated filters (multiple different types of IIR filters used in the current scene) to another group of unactivated filters (multiple different types of IIR filters needed to be used in the changed scene) when the scene changes. Among them, the former group of filters and the latter group of filters can be completely different, that is, the number of filters, types, filter parameters, etc. are different.
[0035] In practical applications, according to the five types of filters defined above, all filters in the activated filter group and the filter group to be activated are traversed respectively, and the activated filter group is divided into 5 groups according to the filter type, and the filter group to be activated is divided into 5 groups according to the filter type. Among them, the activated filter group and the filter group to be activated may contain all filter types or only some filter types. If a filter type is not included in the filter group, the corresponding group is empty.
[0036] The following example illustrates the statistics of the number of filters of various types contained in the activated filter group and the filter group to be activated. For example, the activated filter group includes 1 low-pass filter, 2 high-pass filters, 10 Peak / Notch filters, 0 low-frequency shelf filters, and 1 high-frequency shelf filter, and the filter group to be activated includes 0 low-pass filters, 1 high-pass filter, 15 Peak / Notch filters, 1 low-frequency shelf filter, and 0 high-frequency shelf filters.
[0037] Specifically, the activated filter group of the present embodiment is determined based on the environmental parameters before the change, and the filter group to be activated is determined based on the environmental parameters after the change; specifically, the present embodiment detects in real time whether the environmental parameters around the electronic product have changed, and when the environmental parameters around the electronic product have changed, obtains the environmental parameters after the change, and determines the filter group to be activated that needs to be used in the sound effect module based on the environmental parameters after the change, while the sound effect module currently has an activated filter group determined based on the environmental parameters before the change, and the activated filter group is in an enabled state. After determining the activated filter group and the filter group to be activated in the sound effect module, the transition from the activated filter group to the filter group to be activated is completed in the sound effect module.
[0038] Step 102: Determine at least one intermediate transition filter group according to the activated filter group and the filter group to be activated.
[0039] Specifically, after determining the activated filter group and the filter group to be activated in the sound effect module, the present embodiment determines at least one intermediate transition filter group required to transition the activated filter group to the filter group to be activated according to the activated filter group and the filter group to be activated. The number of intermediate transition filter groups may be one or more, and the number of intermediate transition filter groups is determined according to the actual smoothness of the sound effect transition, wherein the more the number of intermediate transition filter groups, the higher the smoothness of the sound effect transition, and the fewer the number of intermediate transition filter groups, the lower the smoothness of the sound effect transition. The number of intermediate transition filter groups can be set in advance, and after determining the number of intermediate transition filter groups, the transition from the activated filter group to the filter group to be activated is completed in the sound effect module according to the intermediate transition filter groups.
[0040] Step 103: In the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one intermediate transition filter group.
[0041] Specifically, after the sound effect module determines the intermediate transition filter group, the activated filter is first transitioned to the first intermediate transition filter group, and then from the first intermediate transition filter group to the second intermediate transition filter group, and so on, until the last intermediate transition filter group transitions to the filter group to be activated, thereby completing the entire process of step-by-step transition from the activated filter group to the filter group to be activated.
[0042] Specifically, it is not possible to switch directly from the activated filter group to the pending filter group. Direct switching will result in the sound effect not being smooth enough and creating a sense of abruptness. Therefore, it is necessary to change each filter parameter in the activated filter group in a step-by-step manner to gradually transition. By performing a multi-level switching transition from the activated filter group to the pending filter group, the sound can sound gradually changing and avoid a sense of frustration.
[0043] In the related art, when the user switches scenes and the environment around the electronic product changes, the related art has technical problems such as non-smooth switching and uncontrollable switching time. In order to solve this problem, after determining the activated filter group and the filter group to be activated, this embodiment determines at least one intermediate transition filter group according to the activated filter group and the filter group to be activated, and gradually transitions the activated filter group to the filter group to be activated through the at least one intermediate transition filter group, so that the transition process from the activated filter group to the filter group to be activated is smoother, thereby improving the smoothness of the sound effect transition when the environment changes; at the same time, in the transition process from the activated filter group to the filter group to be activated, it is only necessary to control the switching time of the intermediate transition filter group, and the time of the sound effect transition is controllable.
[0044] Another embodiment of the present invention relates to a sound effect control method, the specific flow chart is as follows Figure 2 As shown, the sound effect control method includes the following steps:
[0045] Step 201: determine an activated filter group and a filter group to be activated in a sound effect module.
[0046] Step 201 is substantially the same as step 101 and will not be described again to avoid repetition.
[0047] The following steps 201, 203, and 204 are sub-steps of step 102, i.e., determining at least one intermediate transition filter group according to the activated filter group and the filter group to be activated. Steps 201, 203, and 204 are as follows:
[0048] Step 202: Acquire first parameter information of each filter of the same type included in the activated filter group and second parameter information of each filter of the same type included in the filter group to be activated.
[0049] Among them, all filters of the same type included in the filter group to be activated correspond one-to-one to all filters of the same type included in the activated filter group.
[0050] Specifically, in order to enable a better transition from the activated filter group to the filter group to be activated, it is necessary to make a one-to-one correspondence between all filters of the same type contained in the filter group to be activated and all filters of the same type contained in the activated filter group, that is, all filters contained in the activated filter group and all filters contained in the filter group to be activated correspond one-to-one in quantity, and a filter in the activated filter group is of the same type as the corresponding filter in the filter group to be activated.
[0051] In order to obtain the intermediate transition filter group, it is necessary to obtain relevant information of each filter in the intermediate transition filter group. Therefore, this embodiment first obtains the first parameter information of each filter in the activated filter group and the second parameter information of each filter in the filter group to be activated, and then obtains the third parameter information of each filter in the intermediate transition filter group according to the corresponding first parameter information and second parameter information. At this time, the filter corresponding to the first parameter information, the filter corresponding to the second parameter information, and the filter corresponding to the third parameter information are of the same type.
[0052] Step 203: Determine third parameter information of a corresponding filter in the intermediate transition filter group according to the corresponding first parameter information and second parameter information.
[0053] Specifically, when obtaining the third parameter information of each filter in the intermediate transition filter group, the filter corresponding to the first parameter information, the filter corresponding to the second parameter information, and the filter corresponding to the third parameter information are of the same type, that is, under the corresponding filters of the same type, the third parameter information of the corresponding filters in the intermediate transition filter group is determined according to the first parameter information and the second parameter information, so that when transitioning, the transition is performed according to the corresponding filters of the same type, thereby improving the smoothness of the sound effect transition.
[0054] Step 204: determine each filter in the intermediate transition filter group in the sound effect module according to the third parameter information.
[0055] Specifically, after obtaining the third parameter information, each filter in the intermediate transition filter group can be determined in the sound effect module according to the third parameter information. The type of the filter is the same as the type of the filter corresponding to the first parameter information and the type of the filter corresponding to the second parameter information, and each filter in the intermediate transition filter group corresponds one-to-one to each filter in the activated filter group, and also corresponds one-to-one to each filter in the filter group to be activated.
[0056] The following step 205 is a specific implementation of step 103, and step 205 is as follows:
[0057] Step 205: Each filter of the activated filter group is gradually transitioned to a corresponding filter in the filter group to be activated through a filter corresponding to at least one intermediate transition filter group.
[0058] Specifically, in this embodiment, all filters of the activated filter group, all filters of the filter group to be activated, and all filters of the intermediate transition filter group correspond one to one in number and type, so that in the process of step-by-step transition, transition is performed according to the corresponding filters of the same type, thereby improving the smoothness of the sound effect transition.
[0059] Another embodiment of the present invention relates to a sound effect control method, the specific flow chart is as follows Figure 3 As shown, the sound effect control method includes the following steps:
[0060] Step 301: determine an activated filter group and a filter group to be activated in a sound effect module.
[0061] Specifically, the sound effect module includes M types of filters, where M is an integer greater than 0; the activated filter group includes at least one type of filter among the M types, and the filter group to be activated includes at least one type of filter among the M types; the number of filters of the same type contained in the activated filter group and the filter group to be activated may be the same or different.
[0062] Step 302: for one type of filter, determine the relationship between the number K of filters included in the activated filter group and the number L of filters included in the to-be-activated filter group.
[0063] If the number of filters K included in the activated filter group is less than the number of filters L included in the filter group to be activated, the process proceeds to step 303; if the number of filters K included in the activated filter group is greater than the number of filters L included in the filter group to be activated, the process proceeds to step 304; if the number of filters K included in the activated filter group is greater than the number of filters L included in the filter group to be activated, the process proceeds to step 305.
[0064] Step 303: Add a first virtual filter of the same type to the activated filter group, so that all filters of the same type included in the filter group to be activated correspond to all filters of the same type included in the activated filter group.
[0065] Step 304: Add a second virtual filter of the same type to the filter group to be activated, so that all filters of the same type included in the filter group to be activated correspond to all filters of the same type included in the activated filter group.
[0066] Specifically, for one of the filter types, if the number of filters included in the activated filter group is less than the number of filters included in the filter group to be activated, a first virtual filter of the same type is added to the activated filter group; if the number of filters included in the activated filter group is greater than the number of filters included in the filter group to be activated, a second virtual filter of the same type is added to the filter group to be activated, so that all filters included in the filter group to be activated correspond one-to-one to all filters included in the activated filter group.
[0067] Specifically, since the filters included in the activated filter group and the filters included in the filter group to be activated may not correspond in number and type, in order to solve this problem, in this embodiment, for one filter type, the number of filters of the activated filter group and the number of filters of the to-be-activated filter group are respectively obtained. Specifically, the first parameter information of each filter in the activated filter group includes the filter type, and the second parameter information of each filter in the to-be-activated filter group includes the filter type. Therefore, the number of each type of filters included in the activated filter group can be determined according to the first parameter information of each filter currently in the activated filter group, and the number of each type of filters included in the to-be-activated filter group can be determined according to the second parameter information of each filter currently in the to-be-activated filter group.
[0068] Afterwards, for one type of filter, the number of filters of the type included in the activated filter group is compared with the number of filters of the type included in the filter group to be activated. When the number of filters of the type included in the activated filter group is the same as the number of filters of the type included in the filter group to be activated, no processing is required, and the process directly proceeds to step 305, i.e., obtaining the first parameter information of each filter included in the activated filter group and the second parameter information of each filter included in the filter group to be activated. If the number of filters of the type included in the activated filter group is less than the number of filters of the type included in the filter group to be activated, a first virtual filter of the same type is added to the activated filter group, so that all filters included in the filter group to be activated are equal. There are filters that correspond one-to-one with all filters included in the activated filter group, that is, the number of newly added first virtual filters at this time is the difference between the number of filters of this type included in the activated filter group and the number of filters of this type included in the filter group to be activated; if the number of filters of this type included in the activated filter group is greater than the number of filters of this type included in the filter group to be activated, then a second virtual filter of the same type is added to the filter group to be activated, so that all filters included in the filter group to be activated correspond one-to-one with all filters included in the activated filter group, that is, the number of newly added second virtual filters at this time is the difference between the number of filters of this type included in the activated filter group and the number of filters of this type included in the filter group to be activated. In the case where the number of filters of this type included in the activated filter group is less than the number of filters of this type included in the filter group to be activated, it means that the activated filter group does not have this type of filter, and it is necessary to construct some "ineffective" first virtual filters in the activated filter group and set the parameters of the first virtual filters. For example, when the first virtual filter is a high-pass filter and a low-frequency shelf filter, its cutoff frequency is set to 10 Hz, the order is 2nd order, the Q value is 1, and the gain is 0; when the first virtual filter is a low-pass filter and a high-frequency shelf filter, its cutoff frequency is set to 20000 Hz, the order is 2nd order, the Q value is 1, and the gain is 0; when the first virtual filter is a Peak / Notch filter, its order is set to 2, the Q value is 1, the gain is 0, and the cutoff frequency is the same as the cutoff frequency of the target filter of the same type corresponding to the filter group to be activated, that is, the cutoff frequency of the first virtual filter is the same as the cutoff frequency of the filter corresponding to the filter group to be activated.
[0069] When the number of filters of the type included in the activated filter group is greater than the number of filters of the type included in the filter group to be activated, it means that the filter group to be activated does not have filters of the type, and it is necessary to construct some "ineffective" second virtual filters in the filter group to be activated, and set the parameters of the second virtual filters. For example, when the second virtual filter is a high-pass filter and a low-frequency shelf filter, set its cutoff frequency to 10Hz, the order to 2nd order, the Q value to 1, and the gain to 0; when the second virtual filter is a low-pass filter and a high-frequency shelf filter, set its cutoff frequency to 20000Hz, the order to 2nd order, the Q value to 1, and the gain to 0; when the second virtual filter is a Peak / Notch filter, set its order to 2, the Q value to 1, the gain to 0, and the cutoff frequency is the same as the cutoff frequency of the target filter of the same type corresponding to the activated filter group, that is, the cutoff frequency of the second virtual filter is the same as the cutoff frequency of the filter corresponding to the activated filter group.
[0070] Step 305: Acquire first parameter information of each filter of the same type included in the activated filter group and second parameter information of each filter of the same type included in the filter group to be activated.
[0071] Among them, all filters of the same type included in the filter group to be activated correspond one-to-one to all filters of the same type included in the activated filter group.
[0072] Specifically, when the activated filter group includes a first virtual filter, obtaining the first parameter information of each filter included in the activated filter group is to obtain the first parameter information of the filter previously existing in the activated filter group and the first parameter information of the first virtual filter; when the filter group to be activated includes a second virtual filter, obtaining the second parameter information of each filter included in the filter group to be activated is to obtain the second parameter information of the filter previously existing in the filter group to be activated and the second parameter information of the second virtual filter.
[0073] Step 306: Determine third parameter information of a corresponding filter in the intermediate transition filter group according to the corresponding first parameter information and second parameter information.
[0074] Step 307: Determine each filter in the intermediate transition filter group in the sound effect module according to the third parameter information.
[0075] Step 308: Each filter of the activated filter group is gradually transitioned to a corresponding filter in the filter group to be activated through a filter corresponding to at least one intermediate transition filter group.
[0076] Step 301 and step 305 to step 308 of this embodiment are substantially the same as step 201 to step 205 , and will not be described again to avoid repetition.
[0077] Specifically, the parameter generation rule of the intermediate transition filter bank in this embodiment is as follows:
[0078] 1. Transition between groups of the same type;
[0079] 2. If the number of a certain type (such as the high-pass filter in the previous embodiment) of the activated filter group is greater than the number of the corresponding type of the filter group to be activated, the filters of this type are divided into two parts, the first part is the filters of this type in the activated filter group and the filters of this type in the filter group to be activated. The second part is the filters of this type in the activated filter group that are more than the filters of this type in the filter group to be activated, that is, the transition of the filters from enable to disable;
[0080] 3. If the number of a certain type of the activated filter group (such as the Peak / Notch filters in the previous embodiment) is less than the number of the corresponding type of the filter group to be activated, the filters of this type are divided into two parts. The first part is the filters of this type in the activated filter group and the filters of this type in the filter group to be activated with the same number; the second part is the filters of this type in the filter group to be activated that are more than the filters of this type in the activated filter group, that is, the transition of the filters from enable (disable) to disable (enable).
[0081] For the filter types of the first part in points 2 and 3, since the number of activated filter groups and the number of filter groups to be activated are the same, the intermediate transition filter group transitions the cutoff frequency, gain, and Q value linearly or exponentially.
[0082] For the second part of the filter type in point 2, since the filter group to be activated does not have this type of filter, it is necessary to construct some "ineffective" filter parameters. For high-pass filters and Lowshelf filters, its cutoff frequency is 10Hz, the order is 2nd order, the Q value is 1, and the gain is 0; for low-pass filters and Highshelf filters, its cutoff frequency is 20000Hz, the order is 2nd order, the Q value is 1, and the gain is 0; for Peak / Notch filters, its cutoff frequency is the same as the cutoff frequency of the extra filter corresponding to the activated filter group, the order is 2, the Q value is 1, and the gain is 0.
[0083] For the second part of the filter type in point 3, since the activated filter group does not have this type of filter, it is necessary to construct some "ineffective" filter parameters. For high-pass filters and Lowshelf filters, its cutoff frequency is 10Hz, the order is 2nd order, the Q value is 1, and the gain is 0; for low-pass filters and Highshelf filters, its cutoff frequency is 20000Hz, the order is 2nd order, the Q value is 1, and the gain is 0; for Peak / Notch filters, its cutoff frequency is the same as the cutoff frequency of the extra filter corresponding to the activated filter group, the order is 2, the Q value is 1, and the gain is 0.
[0084] In this embodiment, after determining the activated filter group and the filter group to be activated, if the number of filters of the activated filter group and the number of filters of the same type included in the filter group to be activated does not correspond, a virtual first virtual filter and a second virtual filter are added according to the number of filters of each type in the activated filter group and the filter group to be activated, so that all filters of the same type included in the filter group to be activated correspond one-to-one with all filters of the same type included in the activated filter group, so that in the process of step-by-step transition, transition is performed one-to-one according to the corresponding filters of the same type, thereby improving the smoothness of the sound effect transition.
[0085] Another embodiment of the present invention relates to a sound effect control method, the specific flow chart is as follows Figure 4 As shown, the sound effect control method includes the following steps:
[0086] Step 401: determine an activated filter group and a filter group to be activated in a sound effect module.
[0087] Step 402: Acquire first parameter information of each filter of the same type included in the activated filter group and second parameter information of each filter of the same type included in the filter group to be activated.
[0088] Among them, all filters of the same type included in the filter group to be activated correspond one-to-one to all filters of the same type included in the activated filter group.
[0089] Specifically, the first parameter information of this embodiment includes the first parameter value of each filter included in the activated filter group, and the second parameter information includes the second parameter value of each filter included in the filter group to be activated; the third parameter information includes the third parameter value of each filter included in the intermediate transition filter group; the first parameter value, the second parameter value, and the third parameter value are all one of the cutoff frequency, gain, Q value, and filter order; for example, the first parameter value is the cutoff frequency, and the corresponding second parameter value and the corresponding third parameter value are also the cutoff frequency; the first parameter value is the gain, and the corresponding second parameter value and the corresponding third parameter value are also the gain; the first parameter value is the Q value, and the corresponding second parameter value and the corresponding third parameter value are also the Q value; the first parameter value is the filter order, and the corresponding second parameter value and the corresponding third parameter value are also the filter order.
[0090] Step 403, when the first parameter value, the second parameter value, and the third parameter value are all cutoff frequencies or gains or Q values, for filters corresponding to the activated filter group and the filter group to be activated, a linear operation or an exponential operation is performed on the first parameter value and the second parameter value according to the number of intermediate transition filter groups to obtain a third parameter value of the corresponding filter in each intermediate transition filter group.
[0091] Specifically, for the filters corresponding to the activated filter group and the filter group to be activated, the first parameter value and the second parameter value are also of the same type. For parameter values of the same type, such as cutoff frequency, gain, and Q value, linear operations or exponential operations are performed on the first parameter value and the second parameter value according to the number of intermediate transition filter groups to obtain the third parameter value of the corresponding filter in each intermediate transition filter group.
[0092] The following is an example of linear transition. The code for using linear transition for the cutoff frequency is as follows:
[0093] fcDiff=fcInactive–fcActive;
[0094] fcDelta=fcDiff / (stepNum-1);
[0095] transfc(j)=fcActive+(j-1)*fcDelta;
[0096] fcInactive is the cutoff frequency of a filter in the filter group to be activated, fcActive is the cutoff frequency of a corresponding filter in the activated filter group, j is the index of the intermediate transition filter group, j=1, 2, ..., stepNum; stepNum is the number of intermediate transition filter groups, transfc(j) is the cutoff frequency of the corresponding filter of the j-th intermediate transition filter group, and this algorithm can be used to obtain the cutoff frequency of the corresponding filter of each intermediate transition filter group. The above algorithm is performed for each filter in the activated filter group to obtain the cutoff frequency of all filters in each intermediate transition filter group. It is worth mentioning that the linear transition of the Q value and gain of each filter in the intermediate transition filter group is similar to the linear transition of the above cutoff frequency.
[0097] Specifically, the first parameter information of each filter included in the activated filter group includes multiple different first parameter values, that is, the multiple different first parameter values are cutoff frequency, gain, and Q value respectively; the second parameter information of each filter included in the filter group to be activated includes multiple different second parameter values, that is, the multiple different second parameter values are cutoff frequency, gain, and Q value respectively; the third parameter information of each filter included in the intermediate transition filter group includes multiple different third parameter values, that is, the multiple different third parameter values are cutoff frequency, gain, and Q value respectively; the cutoff frequency, gain, and Q value of each filter included in the intermediate transition filter group are respectively acquired in the above-mentioned manner to obtain the cutoff frequency, gain, and Q value of each filter included in the intermediate transition filter group, thereby obtaining the third parameter information of each filter in the intermediate transition filter group.
[0098] Step 404: determine each filter in the intermediate transition filter group in the sound effect module according to the third parameter information.
[0099] Step 405: Each filter of the activated filter group is gradually transitioned to a corresponding filter in the filter group to be activated through a filter corresponding to at least one intermediate transition filter group.
[0100] Step 401 , step 402 , step 404 , and step 405 of this embodiment are substantially the same as step 201 , step 202 , step 204 , and step 205 , and will not be described again to avoid repetition.
[0101] In this embodiment, when the first parameter value, the second parameter value, and the third parameter value are all cutoff frequencies, gains, or Q values, a linear operation or an exponential operation is used to obtain the third parameter value of the corresponding filter in each intermediate transition filter group, thereby making the transition process from the activated filter group to the filter group to be activated smoother, thereby improving the smoothness of the sound effect transition when the environment changes.
[0102] An embodiment of the present invention relates to a sound effect control method, and a specific flow chart is shown as follows: Figure 5 As shown, the sound effect control method includes the following steps:
[0103] Step 501: determine an activated filter group and a filter group to be activated in a sound effect module.
[0104] Step 502: Acquire first parameter information of each filter of the same type included in the activated filter group and second parameter information of each filter of the same type included in the filter group to be activated.
[0105] Among them, all filters of the same type included in the filter group to be activated correspond one-to-one to all filters of the same type included in the activated filter group.
[0106] Step 503, when the first parameter value, the second parameter value, and the third parameter value are all filter orders, for the filters corresponding to the activated filter group and the filter group to be activated, the number of steps required for transition is determined according to the filter orders of the filters corresponding to the activated filter group and the filter orders of the filters corresponding to the filter group to be activated.
[0107] Step 504 : Evenly divide the corresponding filters in the plurality of intermediate transition filter groups into each step in order of order or in reverse order according to the number of steps, so as to determine the filter order of the corresponding filter in each intermediate transition filter group.
[0108] Specifically, in addition to the activated filter group and the filter group to be activated, the number of intermediate transition filter groups that need transition is defined as stepNum, and this numerical value can be adjusted as needed, such as being set to 20 here, that is, 20 different intermediate transition filter groups are passed through when transitioning from the activated filter group to the filter group to be activated. The order of the filter is generally an integer value such as the 2nd order, the 4th order, the 6th order, the 8th order, etc., so the order of the intermediate transition filter group is adopted in the form of steps in the present embodiment.
[0109] For example, Figure 6 As shown, it is a schematic diagram of the filter order transitioning from the 2nd order to the 6th order through 20 levels, and the horizontal axis represents the level of the intermediate transition filter group, wherein the order of a filter in the activated filter group is the 2nd order, the order of the filter of the corresponding type of the filter group to be activated is the 6th order, and the intermediate transition filter group has 20 levels. For a corresponding intermediate transition filter in the intermediate transition filter group, through the 20-level transition, the order of the intermediate transition filter from the 1st level to the 6th level is a 2nd order filter, the order of the intermediate transition filter from the 7th level to the 12th level is a 4th order filter, and the order of the intermediate transition filter from the 13th level to the 20th level is a 6th order, thereby forming three steps, and the corresponding intermediate transition filters of the 20 levels are evenly distributed in each step.
[0110] Among them, the calculation process of the order of a filter of the intermediate transition filter group is: first, determine the order of a filter of the filter group to be activated and the order of the corresponding filter of the activated filter group; secondly, interpolate within the order range of these two filters, for example, insert order 4 between orders 2 and 6, set the steps of orders 2, 4, and 6 to be equal in width, and evenly distribute multi-level intermediate transition filters on each step to determine the order of the corresponding filter in each intermediate transition filter group.
[0111] It should be noted that the first parameter information of each filter included in the activated filter group can simultaneously include multiple first parameter values, namely, the cutoff frequency, gain, Q value, and filter order; the second parameter information of each filter included in the filter group to be activated can simultaneously include multiple second parameter values, namely, the cutoff frequency, gain, Q value, and filter order; the third parameter information of each filter included in the intermediate transition filter group can simultaneously include multiple third parameter values, namely, the cutoff frequency, gain, Q value, and filter order; so that when the third parameter information of the corresponding filter in the intermediate transition filter group is determined according to the corresponding first parameter information and second parameter information, the cutoff frequency, gain, Q value, and filter order are respectively calculated in the above-mentioned manner to obtain the cutoff frequency, gain, Q value, and filter order of the corresponding filter in the intermediate transition filter group.
[0112] Step 505: Determine each filter in the intermediate transition filter group in the sound effect module according to the third parameter information.
[0113] Step 506: Each filter of the activated filter group is gradually transitioned to a corresponding filter in the filter group to be activated through a filter corresponding to at least one intermediate transition filter group.
[0114] Step 501 , step 502 , step 505 , and step 506 of this embodiment are substantially the same as step 201 , step 202 , step 204 , and step 205 , and will not be described again to avoid repetition.
[0115] In this embodiment, when the first parameter value, the second parameter value, and the third parameter value are all filter orders, the filter order of the corresponding filter in each intermediate transition filter group is obtained through an equal step algorithm, thereby making the transition process from the activated filter group to the filter group to be activated smoother, thereby improving the smoothness of the sound effect transition when the environment changes.
[0116] Another embodiment of the present invention relates to a sound effect control method, the specific flow chart is as follows Figure 7 As shown, the sound effect control method includes the following steps:
[0117] Step 601: determine an activated filter group and a filter group to be activated in a sound effect module.
[0118] Step 602: Determine at least one intermediate transition filter group according to the activated filter group and the filter group to be activated.
[0119] Step 601 and step 602 are substantially the same as step 101 and step 102, and will not be described again to avoid repetition.
[0120] Step 603, in the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one intermediate transition filter group; wherein, during each transition process, the filter group before the transition and the filter group after the transition are faded in and out according to a preset number of processing frames.
[0121] Specifically, in each transition process from the activated filter group to the filter group to be activated, the filter group before the transition and the filter group after the transition are faded in and out according to a preset number of processing frames, that is, in each transition process, the number of processing frames of the filter group before the transition and the filter group after the transition are controlled to control the overall transition time, that is, in each transition process, the filter group before the transition and the filter group after the transition jointly process a preset number of processing frames.
[0122] like Figure 8 As shown, it is a process diagram of the activated filter group transitioning to the filter group to be activated through multiple intermediate transition filter groups. The above mentioned intermediate transition filter group group number stepNum, and other parameters need to be defined to control the transition time of the switch. For example, the sampling rate of the audio sequence is 48000Hz. In real-time processing, the filter group before the transition and the filter group after the transition need to process the audio frame by frame, and the length of each frame is 256 sample points, that is, 5.3ms. This embodiment can control the number of processing frames of each intermediate transition filter group to control the overall transition time. For example, an intermediate transition filter group is switched every 45 frames. During this period, the two filter groups currently undergoing transition, namely the filter group before the transition and the filter group after the transition, are kept for filtering processing. Then the overall transition time is equal to 45*(20+1)*5.3ms≈5 seconds, so that the overall transition time of the sound effect can be controlled.
[0123] Specifically, in each transition process in step 603, the filter group before the transition and the filter group after the transition are faded in and out according to a preset number of processing frames, such as Fig. 9 As shown, step 603 includes the following sub-steps:
[0124] Step 701, during each level of transition, determine the attenuation coefficient of the filter group before the transition and the enhancement coefficient of the filter group after the transition for each processing frame in a preset number of processing frames; wherein the attenuation coefficient gradually decreases and the enhancement coefficient gradually increases.
[0125] Step 702: Filter the input processing frame by using the pre-transition filter group to obtain a first filtered frame, and filter the input processing frame by using the post-transition filter group to obtain a second filtered frame.
[0126] Step 703, attenuate the first filter frame according to the attenuation coefficient, and enhance the second filter frame according to the enhancement coefficient; superimpose the attenuated first filter frame and the enhanced second filter frame according to the sample points to obtain a filter frame corresponding to the processing frame.
[0127] Specifically, in each level of transition from the activated filter group to the filter group to be activated, the filter group before the transition and the filter group after the transition jointly process a preset number of processing frames, and the two groups of filters complete the output of the processing frames through a fade-in and fade-out mechanism, thereby making the sound effects switch smoothly.
[0128] like Fig.10 As shown, a schematic diagram of a fade-in and fade-out mechanism for two groups of filters to process frames during a transition process. Specifically, the fade-in and fade-out mechanism is used for switching from the activated filter group to the intermediate transition filter group 1, from the intermediate transition filter group i to the intermediate transition filter group i+1, and from the intermediate transition filter group N to the filter group to be activated, so as to prevent the amplitude jump from causing a pop (POP) sound. The fade-in and fade-out mechanism of this embodiment is to filter one of the processing frames using a group of filters before the transition to obtain a first filter frame, and filter the second frame using a group of filters after the transition to obtain a second filter frame, and then fade out the first filter frame and fade in the second filter frame, and then add the corresponding samples of the first filter frame and the second filter frame processed by the fade-in and fade-out to obtain the final output frame.
[0129] Specifically, Fig.10The upper part is a schematic diagram of the attenuation coefficient of each processing frame in the preset processing frame number of the pre-transition filter group, and the lower part is a schematic diagram of the enhancement coefficient of each processing frame in the preset processing frame number of the post-transition filter group. It can be seen that the processing frames are in the time sequence of the input, the attenuation coefficient corresponding to each processing frame gradually decreases, the enhancement coefficient gradually increases, and the attenuation coefficient shows a linear decreasing trend, and the enhancement coefficient shows a linear increasing trend; each processing frame in the preset number of processing frames corresponds to an attenuation coefficient of the pre-transition filter group and an enhancement coefficient of the post-transition filter group, then, each processing frame is filtered by the pre-transition filter group to obtain a first filter frame, and each processing frame is filtered by the post-transition filter group to obtain a second filter frame; the first filter frame is attenuated by the attenuation coefficient, and the second filter frame is enhanced by the enhancement coefficient; the filter frame corresponding to the processing frame is obtained according to the attenuated first filter frame and the enhanced second filter frame, that is, the attenuated first filter frame and the enhanced second filter frame are added to obtain the final output filter frame, thereby realizing a smooth switching from a group of filters before the transition to a group of filters after the transition.
[0130] An embodiment of the present invention relates to an electronic device, such as Fig.11 As shown, it includes: at least one processor 801; and a memory 802 that is communicatively connected to the at least one processor 801; wherein the memory stores instructions that can be executed by the at least one processor 801, and the instructions are executed by the at least one processor 801 so that the at least one processor 801 can execute the above-mentioned sound effect control method.
[0131] The memory 802 and the processor 801 are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors 801 and the memory 802 together. The bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor 801 is transmitted on a wireless medium via an antenna, and further, the antenna also receives data and transmits the data to the processor 801.
[0132] The processor 801 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management and other control functions. The memory 802 can be used to store data used by the processor when performing operations.
[0133] An embodiment of the present invention relates to a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the above method embodiment is implemented.
[0134] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including several instructions for making a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0135] Those skilled in the art will appreciate that the above embodiments are specific embodiments for implementing the present invention, and that in actual applications, various changes may be made in form and detail without departing from the spirit and scope of the present invention.
Claims
1. A sound effect control method, characterized in that: include: Determining an activated filter group and a filter group to be activated in the sound effect module; Determine at least one intermediate transition filter group according to the activated filter group and the filter group to be activated; In the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one of the intermediate transition filter groups.
2. The sound effect control method according to claim 1, characterized in that: The step of determining at least one intermediate transition filter group according to the activated filter group and the filter group to be activated comprises: Acquire first parameter information of each filter of the same type included in the activated filter group and second parameter information of each filter of the same type included in the filter group to be activated; all filters of the same type included in the filter group to be activated correspond one-to-one to all filters of the same type included in the activated filter group; Determine third parameter information of a corresponding filter in the intermediate transition filter group according to the corresponding first parameter information and the second parameter information; Determine each filter in the intermediate transition filter group in the sound effect module according to the third parameter information; In the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one intermediate transition filter group, including: Each filter of the activated filter group is gradually transitioned to a corresponding filter in the filter group to be activated through a filter corresponding to at least one of the intermediate transition filter groups.
3. The sound effect control method according to claim 2, characterized in that: The sound effect module includes M types of filters, where M is an integer greater than 0; the activated filter group includes at least one type of filter among the M types; the filter group to be activated includes at least one type of filter among the M types; before obtaining the first parameter information of each filter included in the activated filter group and the second parameter information of each filter included in the filter group to be activated, it also includes: For one of the filter types, if the number of filters included in the activated filter group is less than the number of filters included in the filter group to be activated, a first virtual filter of the same type is added to the activated filter group; if the number of filters included in the activated filter group is greater than the number of filters included in the filter group to be activated, a second virtual filter of the same type is added to the filter group to be activated, so that all filters of the same type included in the filter group to be activated correspond one-to-one to all filters of the same type included in the activated filter group.
4. The sound effect control method according to claim 2, characterized in that: The first parameter information includes a first parameter value of each filter included in the activated filter group, and the second parameter information includes a second parameter value of each filter included in the filter group to be activated; the third parameter information includes a third parameter value of each filter included in the intermediate transition filter group; the first parameter value, the second parameter value, and the third parameter value are all one of a cutoff frequency, a gain, a Q value, and a filter order; The determining, according to the corresponding first parameter information and the second parameter information, the third parameter information of the corresponding filter in the intermediate transition filter group comprises: In the case where the first parameter value, the second parameter value, and the third parameter value are all cutoff frequencies, gains, or Q values, for filters corresponding to the activated filter group and the filter group to be activated, linear operations or exponential operations are performed on the first parameter value and the second parameter value according to the number of the intermediate transition filter groups to obtain the third parameter value of the corresponding filter in each of the intermediate transition filter groups.
5. The sound effect control method according to claim 4, characterized in that: The first parameter information of each filter included in the activated filter group includes multiple different first parameter values, the second parameter information of each filter included in the filter group to be activated includes multiple different second parameter values, and the third parameter information of each filter included in the intermediate transition filter group includes multiple different third parameter values.
6. The sound effect control method according to claim 4 or 5, characterized in that: The determining of the third parameter information of the corresponding filter in the intermediate transition filter group according to the first parameter information and the second parameter information further includes: When the first parameter value, the second parameter value, and the third parameter value are all filter orders, for filters corresponding to the activated filter group and the filter group to be activated, determining the number of steps required for transition according to the filter orders of the filters corresponding to the activated filter group and the filter orders of the filters corresponding to the filter group to be activated; According to the number of steps, the corresponding filters in the plurality of intermediate transition filter groups are evenly divided into each step in order of order or in reverse order, so as to determine the filter order of the corresponding filter in each intermediate transition filter group.
7. The sound effect control method according to claim 1, characterized in that: In the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one intermediate transition filter group, including: In the sound effect module, the activated filter group is gradually transitioned to the filter group to be activated through at least one of the intermediate transition filter groups; wherein, in each transition process, the filter group before the transition and the filter group after the transition are faded in and out according to a preset number of processing frames.
8. The sound effect control method according to claim 7, characterized in that: In each level of transition process, the filter group before the transition and the filter group after the transition are faded in and out according to a preset number of processing frames, including: During each level of transition, determining an attenuation coefficient of the filter group before the transition and an enhancement coefficient of the filter group after the transition for each processing frame in the preset number of processing frames; wherein the attenuation coefficient gradually decreases and the enhancement coefficient gradually increases; The input processing frame is filtered by the pre-transition filter group to obtain a first filtered frame, and the input processing frame is filtered by the post-transition filter group to obtain a second filtered frame; The first filter frame is attenuated according to the attenuation coefficient, and the second filter frame is enhanced according to the enhancement coefficient; the attenuated first filter frame and the enhanced second filter frame are superimposed according to sample points to obtain a filter frame corresponding to the processing frame.
9. An electronic device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the sound effect control method according to any one of claims 1 to 8.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the sound effect control method according to any one of claims 1 to 8 is implemented.