A mixing console tuning management method, system, device and storage medium

Abstract

The present application relates to the technical field of digital professional audio equipment, and in particular to a mixing console tuning management method, system, device and storage medium. The present application first obtains the audio signal and the user's mixing selection information to determine the overall mixing numerical information; then, by analyzing the propagation distance, targeted sound parameters are generated for each area, which can better simulate the real sound field, make the sound effect in different areas more natural and realistic, and achieve more refined spatial control; during the actual playback process, the method obtains the real-time sound field monitoring data of each partition, and compares it with the preset ideal sound field model. If the deviation exceeds the threshold range, the sound field optimization is triggered, and the mixing parameters of each audio track are adaptively adjusted according to the optimization feedback, so that the final sound field effect is close to the ideal state, thereby comprehensively improving the efficiency and quality of automatic tuning.

Description

Technical Field

[0001] The present application relates to the technical field of digital professional audio equipment, and in particular to a mixing console tuning management method, system, equipment and storage medium. Background Art

[0002] With the continuous development of audio technology, mixing consoles play an important role in many fields such as music production, film and television production, and game sound effects production. The tuning process requires proper mixing and processing of multiple audio tracks to obtain the ideal sound field effect. The traditional manual tuning method is based on manual experience and audition, which is inefficient and has uneven quality. This situation needs to be further improved. Summary of the invention

[0003] In order to solve the problem that the existing tuning methods are inefficient and of uneven quality, the present application provides a mixing console tuning management method, system, device and storage medium, which adopt the following technical solutions:

[0004] In a first aspect, the present application provides a mixing console tuning management method, comprising the following steps:

[0005] Acquire an audio signal, and obtain audio track attribute information according to the audio signal;

[0006] Acquire the user's mixing selection information, and determine the overall mixing value information according to the audio track attribute information and the mixing selection information;

[0007] Acquire a propagation distance, and determine a sound parameter according to the propagation distance and the overall sound mixing value information, wherein the sound source corresponding to the audio signal is emitted by a speaker, and the speakers are distributed in a plurality of areas, and the sound parameter includes a partitioned sound parameter of the speaker in each partitioned area, and the propagation distance refers to the distance between the sound source and the partitioned area;

[0008] Generate a tuning instruction according to the vocalization parameter and the overall mixing value information;

[0009] Acquire partitioned sound field monitoring data, compare the partitioned sound field monitoring data with a preset ideal sound field model to obtain a sound field difference value, compare the sound field difference value with a preset sound field change threshold range, and generate a sound field optimization instruction if the sound field difference value is outside the preset sound field change threshold range;

[0010] According to the sound field optimization instruction, the mixing parameters of each audio track are adjusted.

[0011] By adopting the above technical solution, the present application divides the overall tuning goal into overall mixing value information by obtaining user mixing selection information and audio track attribute information, and the speakers corresponding to the sound source are distributed in several areas, and each area has a different distance from the sound source. Therefore, according to the overall mixing value information and the propagation distance, the sound parameters of the speakers in each partitioned area are obtained, and each speaker plays audio according to the sound parameters, thereby realizing refined sound field control of different spatial positions; during the audio playback process, the sound field monitoring equipment located in different areas will detect the current sound field data in real time, and compare the detection data with the preset ideal sound field model to obtain the sound field difference value; the sound The sound field difference value is compared with the preset change threshold value. When the sound field difference value is out of the preset change threshold value, the sound field optimization instruction is triggered, and the mixing parameters of each audio track are adjusted according to the instruction. Therefore, by partitioning the speaker area, each partition controls the sound parameters separately according to the distance from the sound source, and then combines the sound field feedback adaptive adjustment, so that the tuning effect can be accurately set according to the specific space, effectively reducing the sound field imbalance and distortion problems. At the same time, the introduction of partitioned control and adaptive adjustment mechanism improves the flexibility and personalization of the tuning system, making it more in line with different music styles and subjective hearing requirements, and comprehensively improves the quality and experience of intelligent tuning.

[0012] Optionally, the obtaining of the user's mixing selection information and determining the overall mixing value information according to the track attribute information and the mixing selection information specifically includes the following steps:

[0013] Extracting a mixing style from the mixing selection information, and using the mixing style as an overall mixing style;

[0014] According to the mixing style, obtaining default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters;

[0015] The overall sound mixing style, the default sound mixing preset parameter, the sound mixing enhancement parameter and the sound mixing attenuation parameter are associated to determine the overall sound mixing value information.

[0016] By adopting the above technical solution, the present application first extracts the desired mixing style, such as rock, pop, pure music, etc., from the user's mixing selection information, and takes it as the overall mixing style. Then, according to the mixing style, the corresponding default mixing preset parameters such as baseline volume, equalization curve, mixing enhancement parameters such as enhanced volume gain adjustment and mixing attenuation parameters such as attenuation equalization adjustment are retrieved from the preset parameter library; finally, the overall mixing style is organically combined with the above three types of parameters to construct a complete overall mixing numerical information model, thereby providing personalized parameter support for the subsequent specific tuning process.

[0017] Optionally, the default mixing preset parameters include a reference volume gain value, a reference equalization curve, and a reference audio feature weight; the mixing enhancement parameters include enhanced volume gain adjustment, enhanced equalization adjustment, and enhanced audio feature weight adjustment; and the mixing attenuation parameters include attenuated volume gain adjustment, attenuated equalization adjustment, and attenuated audio feature weight adjustment;

[0018] The step of obtaining default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters according to the mixing style specifically includes the following steps:

[0019] According to the mixing style, obtaining the reference volume gain value, the reference equalization curve, the enhanced volume gain adjustment, the enhanced equalization adjustment, the attenuated volume gain adjustment and the attenuated equalization adjustment;

[0020] According to the mixing style, a baseline audio feature weight, an enhanced audio feature weight adjustment, and an attenuated audio feature weight adjustment are obtained, wherein the audio feature includes at least one of pitch, loudness, duration, and timbre.

[0021] By adopting the above technical scheme, the existing mixing system has deficiencies in personalized adjustment and audio feature control, and it is difficult to perfectly restore the mixing effects of different styles; the present application first retrieves the default preset parameters such as the benchmark volume gain value, benchmark equalization curve, benchmark audio feature weight, etc. from the preset parameter library according to the mixing style selected by the user, and simultaneously obtains the corresponding enhancement parameter adjustment amount and attenuation parameter adjustment amount; wherein, the enhancement / attenuation parameters include three types: volume gain adjustment, equalization adjustment, and audio feature weight adjustment, which can adjust the relative importance of audio features such as pitch, loudness, duration, and timbre; by associating the extracted overall style with the retrieved default mixing preset parameters, enhancement parameters, and attenuation parameters, a fine mixing effect with a personalized style can be generated.

[0022] Optionally, the partition sound parameters include a partition volume gain and a partition frequency response curve, and the acquiring of the propagation distance determines the sound parameters according to the propagation distance and the overall mixing value information, specifically including the following steps:

[0023] According to the default mixing preset parameters and the propagation distance, obtaining the partition volume gain and the partition frequency response curve;

[0024] According to the sound mixing enhancement parameter, the sound mixing attenuation parameter and the propagation distance, the partition volume gain and the partition frequency response curve are respectively enhanced and attenuated.

[0025] By adopting the above technical solution, since the existing audio system cannot dynamically adjust the sound parameters according to the distance between the sound source and the listener, it is difficult to truly restore the listening experience at different distances. Therefore, the present application proposes a sound parameter adjustment idea based on the propagation distance; first, according to the default overall mixing parameters and propagation distance, the preliminary partition volume gain and frequency response curve are obtained; then, according to the propagation distance, these parameters are enhanced or attenuated, specifically, the volume gain and frequency response curve are progressively fine-tuned using the preset enhancement / attenuation parameters; in this way, personalized sound parameters for different propagation distances are automatically generated to fully simulate the real listening effect of near and far sound sources.

[0026] Optionally, adjusting the mixing parameters of each audio track according to the sound field optimization instruction specifically includes the following steps:

[0027] Acquiring sound field optimization adjustment information according to the sound field optimization instruction;

[0028] Acquiring optimization end information, and generating a sound field detection instruction according to the optimization end information;

[0029] Acquire sound field detection result information, and acquire current sound field state information according to the sound field detection result information and in combination with the sound field optimization adjustment information, wherein the sound field detection result information refers to a partitioned sound field detection result;

[0030] Acquiring mixing adjustment parameter information according to the current sound field state information and the overall mixing value information;

[0031] The mixing parameters of each audio track are adjusted according to the mixing adjustment parameter information.

[0032] By adopting the above technical scheme, due to the differences in playback devices and listening environments, a single mixing parameter is often difficult to obtain an ideal sound field effect, and real-time optimization and adjustment are required; the present application first obtains preliminary sound field optimization adjustment information according to the sound field optimization instruction, and then obtains the current actual sound field state through sound field detection, combines the optimization adjustment information with the actual state, dynamically generates mixing adjustment parameters, and finally adjusts the mixing parameters of each audio track according to the parameters; in this way, the mixing parameters of each channel can be dynamically fine-tuned according to the actual detected sound field effect, so that the sound field effect is continuously optimized, and finally the expected ideal sound field effect is achieved, thereby improving the adaptability of the mixing and the consistency of the sound field effect.

[0033] Optionally, adjusting the mixing parameters of each audio track according to the mixing adjustment parameter information specifically includes the following steps:

[0034] According to the sound mixing adjustment parameter information, obtaining partition sound mixing adjustment information, wherein the partition sound mixing adjustment information includes a partition volume gain adjustment value and a partition equalization adjustment curve;

[0035] The partition volume gain adjustment value is compared with a preset volume gain adjustment threshold, and if the partition volume gain adjustment value is less than the volume gain adjustment threshold, the corresponding mixing parameters of each audio track are adjusted according to the partition mixing adjustment information;

[0036] If the partition volume gain adjustment value is greater than the volume gain adjustment threshold, a mixing parameter secondary adjustment instruction is triggered, secondary mixing adjustment parameter information is obtained according to the mixing parameter secondary adjustment instruction, and the mixing parameters of each audio track are adjusted according to the secondary mixing adjustment parameter information.

[0037] By adopting the above technical scheme, different sound field environments have different requirements for audio systems. A single mixing parameter is difficult to adapt to various situations and needs to be dynamically adjusted to obtain ideal effects. The present application first extracts the partition mixing adjustment information such as the volume gain adjustment value and the equalization adjustment curve of each partition based on the mixing adjustment parameter information. If the partition volume gain adjustment value is small and within a preset threshold range, the corresponding parameters of each audio track are directly fine-tuned based on the partition mixing adjustment information to achieve parameter correction. If the partition volume gain adjustment value is large and exceeds the threshold range, it is considered that the adjustment amplitude is too large at this time, which may cause a sudden change in the sound field or distortion of the sound quality. Therefore, the present application triggers a secondary adjustment instruction for the mixing parameters, re-acquires the secondary mixing adjustment parameter information, and adjusts the mixing parameters of each audio track according to the information, thereby achieving a smooth transition of large adjustments.

[0038] In a second aspect, the present application provides a mixing console tuning management system, comprising:

[0039] The audio track attribute information acquisition module is used to acquire the audio signal and obtain the audio track attribute information according to the audio signal;

[0040] An overall sound mixing value information determination module, used to obtain the sound mixing selection information of the user, and determine the overall sound mixing value information according to the track attribute information and the sound mixing selection information;

[0041] A sound parameter determination module, used to obtain a propagation distance, and determine a sound parameter according to the propagation distance and the overall mixed sound value information, wherein the sound source corresponding to the audio signal is emitted by a speaker, and the speakers are distributed in a plurality of areas, and the sound parameter includes a partitioned sound parameter of the speaker in each partitioned area, and the propagation distance refers to the distance between the sound source and the partitioned area;

[0042] A tuning instruction generating module, used for generating a tuning instruction according to the vocalization parameter and the overall mixing value information;

[0043] A sound field optimization instruction generation module is used to obtain partitioned sound field monitoring data, compare the partitioned sound field monitoring data with a preset ideal sound field model to obtain a sound field difference value, compare the sound field difference value with a preset sound field change threshold range, and generate a sound field optimization instruction if the sound field difference value is outside the preset sound field change threshold range;

[0044] The mixing parameter adjustment module is used to adjust the mixing parameters of each audio track according to the sound field optimization instruction.

[0045] Optionally, the overall mixing value information determination module includes:

[0046] an overall mixing style determining unit, configured to extract a mixing style from the mixing selection information and use the mixing style as the overall mixing style;

[0047] A parameter acquisition unit, used to acquire default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters according to the mixing style;

[0048] The overall sound mixing value information determining unit is used to associate the overall sound mixing style, the default sound mixing preset parameter, the sound mixing enhancement parameter and the sound mixing attenuation parameter to determine the overall sound mixing value information.

[0049] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned mixing console tuning management method when executing the computer program.

[0050] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the above-mentioned mixing console tuning management method are implemented.

[0051] In summary, the present application includes at least one of the following beneficial technical effects:

[0052] 1. This application obtains user mixing selection information and track attribute information to divide the overall tuning goal into overall mixing value information. The speakers corresponding to the sound source are distributed in several areas, and each area is at a different distance from the sound source. Therefore, according to the overall mixing value information and the propagation distance, the sound parameters of the speakers in each partition area are obtained, and each speaker plays audio according to the sound parameters, thereby realizing refined sound field control of different spatial positions; during the audio playback process, the sound field monitoring equipment located in different areas will detect the current sound field data in real time, and compare the detection data with the preset ideal sound field model to obtain the sound field difference value; the sound field difference value The range is compared with the preset change threshold. When the sound field difference value is not within the preset change threshold, the sound field optimization instruction is triggered, and the mixing parameters of each track are adjusted according to the instruction. Therefore, by partitioning the speaker area, each partition controls the sound parameters separately according to the distance from the sound source, and then combines the sound field feedback adaptive adjustment, so that the tuning effect can be accurately set according to the specific space, effectively reducing the sound field imbalance and distortion problems. At the same time, the introduction of partition control and adaptive adjustment mechanism improves the flexibility and personalization of the tuning system, making it more in line with different music styles and subjective hearing requirements, and comprehensively improving the quality and experience of intelligent tuning.

[0053] 2. The default mixing preset parameters of this application include not only the reference volume gain value and the equalization curve, but also the reference audio feature weight, which is used to control the relative importance of audio features such as pitch, loudness, duration, and timbre; by designing the mixing enhancement parameters and mixing attenuation parameters, the adjustment amount of specific parameters is increased and decreased respectively, including volume gain adjustment, equalization adjustment, and audio feature weight adjustment, so as to restore a fine mixing effect with a personalized style;

[0054] 3. The present application first extracts the partition mixing adjustment information such as the volume gain adjustment value and the equalization adjustment curve of each partition according to the mixing adjustment parameter information. If the partition volume gain adjustment value is small and within a preset threshold range, the corresponding parameters of each audio track are directly fine-tuned based on the partition mixing adjustment information to achieve parameter correction; if the partition volume gain adjustment value is large and exceeds the threshold range, it is considered that the adjustment range at this time is too large, which may cause a sudden change in the sound field or distortion of the sound quality; therefore, the present application triggers a secondary adjustment instruction for the mixing parameters, re-acquires the secondary mixing adjustment parameter information, and adjusts the mixing parameters of each audio track according to the information, thereby achieving a smooth transition of large adjustments. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 It is a flow chart of a method for managing a mixing console according to an embodiment of the present application;

[0056] Figure 2It is a flowchart of step S20 in a method for managing a mixing console according to an embodiment of the present application;

[0057] Figure 3 It is a flowchart of step S22 in a method for managing a mixing console according to an embodiment of the present application;

[0058] Figure 4 It is a flowchart of step S30 in a method for managing a mixing console according to an embodiment of the present application;

[0059] Figure 5 It is a flowchart of step S60 in a method for managing a mixing console according to an embodiment of the present application;

[0060] Figure 6 It is a flowchart of step S65 in a method for managing a mixing console according to an embodiment of the present application;

[0061] Figure 7 It is a module diagram of a mixing console tuning management system according to an embodiment of the present application;

[0062] Figure 8 It is a diagram of the internal structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0063] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more listed items.

[0064] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0065] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.

[0066] In the first aspect, the present application provides a mixing console tuning management, referring to Figure 1 , including the following steps:

[0067] S10: Acquire an audio signal, and obtain audio track attribute information according to the audio signal.

[0068] Among them, the audio signal refers to the original audio data that needs to be played, such as the sound data collected by a microphone; the audio track attribute information refers to the attribute parameters that describe the audio, including the audio market, sampling rate, number of channels, etc.

[0069] Specifically, the original audio data set is obtained by decoding the audio file, and the metadata information of the data is analyzed to obtain the audio track attribute information.

[0070] S20: Acquire the user's audio mixing selection information, and determine the overall audio mixing value information according to the audio track attribute information and the audio mixing selection information.

[0071] In this embodiment, the mixing selection information refers to the user's preset parameters for the mixing effect, such as the desired volume, equalization curve, etc.; the overall mixing value information refers to the comprehensive value parameters obtained by combining the track attributes with the user's selection.

[0072] Specifically, the present application provides a user interface to allow the user to select a preset mixing mode, and performs calculations on the user selection and the audio track attribute information to generate overall mixing numerical information.

[0073] S30, obtaining the propagation distance, and determining the sounding parameters according to the propagation distance and the overall mixed sound value information.

[0074] The sound source corresponding to the audio signal is emitted through loudspeakers distributed in several areas. The sound parameters include partitioned sound parameters of the loudspeakers in each partitioned area. The propagation distance refers to the distance between the sound source and the partitioned area.

[0075] In this embodiment, the propagation distance can be manually input by the user or automatically calculated based on the position information of the speaker and the sound source. The sound parameter refers to the value that ultimately controls the playback of the speaker, such as volume, balance, etc.; the partition sound parameter is the unified sound parameter of all speakers in the corresponding partition.

[0076] Specifically, the propagation distance is first obtained according to the position of the loudspeaker and the sound source, and then the propagation distance is combined with the overall mixing value information, and the sound parameters of each partition are calculated according to the preset distance attenuation model.

[0077] S40: Generate a tuning instruction according to the vocalization parameters and the overall mixing value information.

[0078] The tuning command refers to a specific command signal used to control the sound-producing behavior of the speaker.

[0079] Specifically, the sound parameters and the overall mixing value information are encoded and processed to generate tuning instructions that can be parsed and executed by the speaker.

[0080] S50, obtaining partitioned sound field monitoring data, comparing the partitioned sound field monitoring data with a preset ideal sound field model to obtain a sound field difference value, comparing the sound field difference value with a preset sound field change threshold range, and generating a sound field optimization instruction if the sound field difference value is outside the preset sound field change threshold range.

[0081] In this embodiment, the zoned sound field monitoring data refers to the sound field status in each area monitored in real time, such as sound pressure level, spectrum distribution, etc. The ideal sound field model is a pre-set and expected sound field parameter; the sound field difference value refers to the deviation between the actual sound field and the ideal sound field; the sound field change threshold range refers to the acceptable deviation range.

[0082] Specifically, sound field monitoring equipment is deployed to collect partition sound field data in real time and compare it with the ideal model. When the deviation exceeds the threshold range, it is considered that optimization adjustment is needed, and optimization instructions are generated.

[0083] S60. Adjust the mixing parameters of each audio track according to the sound field optimization instruction.

[0084] Among them, adjusting the mixing parameters refers to correcting the original overall mixing numerical information to obtain a mixing effect that is closer to the ideal sound field.

[0085] Specifically, according to the feedback information provided by the optimization instructions, the volume, balance and other mixing parameters of each audio track are fine-tuned to generate new overall mixing value information, and the tuning instructions are regenerated based on the new overall mixing value information, ultimately achieving dynamic optimization of the sound field.

[0086] In one embodiment, referring to Figure 2 In step S20, the user's mixing selection information is obtained, and the overall mixing value information is determined according to the track attribute information and the mixing selection information, which specifically includes the following steps:

[0087] S21. Extracting a mixing style from the mixing selection information, and using the mixing style as the overall mixing style.

[0088] In this embodiment, the mixing selection information includes a mixing style, where the mixing style refers to the overall audio style or scene atmosphere expected by the user, such as "pop music", "cinema surround", "live concert", etc.

[0089] Specifically, this embodiment provides a variety of mixing style options for the user to choose from on the user interface, and extracts mixing style parameters from the user selection results as the overall mixing style settings of the system.

[0090] S22. Obtaining default mixing preset parameters, mixing enhancement parameters, and mixing attenuation parameters according to the mixing style.

[0091] In this embodiment, the default mixing threshold parameter refers to a basic mixing parameter under a corresponding mixing style; the mixing enhancement parameter is a parameter for enhancing certain audio features, and the mixing attenuation parameter is a parameter for weakening certain audio features.

[0092] Specifically, the system presets default parameter configurations corresponding to various mixing styles, and calls corresponding default mixing preset parameters from the parameter library according to the overall mixing style selected by the user. At the same time, according to the characteristics of the mixing style, corresponding enhancement parameters such as enhancing vocals, heavy bass, etc. and attenuation parameters such as suppressing special sound effects and reducing high-frequency energy can be set.

[0093] S23, associating the overall mixing style, the default mixing preset parameter, the mixing enhancement parameter, and the mixing attenuation parameter to determine overall mixing numerical information.

[0094] The overall mixing value information refers to a set of comprehensive value parameters that are ultimately used to control the mixing effect.

[0095] Specifically, this embodiment uses the overall mixing style as the main control parameter, the default preset parameter as the basic parameter, and then adjusts the basic parameter according to the enhancement and attenuation parameters to generate the final overall mixing numerical information. For example, for the "pop music" style, the "pop music" preset can be used as a basis to enhance the human voice, heavy bass, and appropriately enhance the human voice compression, and generate an overall parameter set as the control data of the audio mixing.

[0096] In one embodiment, the default mixing preset parameters include a reference volume gain value, a reference equalization curve, and a reference audio feature weight; the mixing enhancement parameters include enhanced volume gain adjustment, enhanced equalization adjustment, and enhanced audio feature weight adjustment; and the mixing attenuation parameters include attenuated volume gain adjustment, attenuated equalization adjustment, and attenuated audio feature weight adjustment. Figure 3 In step S22, according to the mixing style, the default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters are obtained, which specifically includes the following steps:

[0097] S221. Obtain a reference volume gain value, a reference equalization curve, enhanced volume gain adjustment, enhanced equalization adjustment, attenuated volume gain adjustment, and attenuated equalization adjustment according to the mixing style.

[0098] In this embodiment, the reference volume gain value and the reference equalizer curve refer to the default volume and frequency gain settings under the corresponding mixing style, the boost / attenuation volume gain adjustment is the increase or decrease adjustment value of the default volume, and the boost / attenuation equalizer adjustment refers to the increase and decrease adjustment of the default equalizer curve.

[0099] Specifically, in this embodiment, a corresponding reference volume gain value and reference equalization curve parameter are preset for each mixing style. After the user selects the corresponding mixing style, the system calls the reference volume and equalization data corresponding to the mixing style from the parameter library. At the same time, different adjustment values ​​can be preset for enhancement and attenuation adjustment according to the characteristics of the mixing style, for example, the bass gain can be appropriately enhanced for the cinema style, and the high-frequency gain can be attenuated for the outdoor style.

[0100] S222. Obtain a baseline audio feature weight, an enhanced audio feature weight adjustment, and an attenuated audio feature weight adjustment according to the mixing style, wherein the audio feature includes at least one of pitch, loudness, duration, and timbre.

[0101] In this embodiment, the audio feature weight refers to the degree of emphasis on different features of the audio signal, such as preferred loudness, preferred pitch, etc.; the baseline weight is the default setting, and the enhancement / attenuation adjustment is the weighting or deweighting of the audio feature.

[0102] Specifically, the system presets the corresponding benchmark audio feature weights for each mixing style. For example, the "Pop Music" style can be set with a high loudness weight and a low pitch weight. When a style is selected, the benchmark weight setting corresponding to the selected style is read. At the same time, according to the characteristics of the selected style, the weight adjustment values ​​for strengthening or attenuating different audio features are set. For example, the "Classical Music" style can appropriately strengthen the pitch weight, and the "DJ" style can strengthen the duration weight, etc., and finally the comprehensive weight value of each audio feature under the style is obtained.

[0103] In one embodiment, the partition sound parameters include the partition volume gain and the partition frequency response curve. Figure 4 In step S30, the propagation distance is obtained, and the sound parameters are determined according to the propagation distance and the overall mixed sound value information, which specifically includes the following steps:

[0104] S31. Obtaining a partition volume gain and a partition frequency response curve according to a default mixing preset parameter and a propagation distance.

[0105] Among them, the zone volume gain refers to the overall volume gain value of the speaker zone; the zone frequency response curve describes the response gain of the speaker zone to different frequencies.

[0106] In this embodiment, the initial values ​​of the partition volume gain and the partition frequency response curve are derived from the default mixing preset parameters, but they still need to be adjusted according to the propagation distance between the speaker partition and the sound source.

[0107] Specifically, the system first reads the reference volume gain value and reference equalization curve (frequency response) from the default preset parameters as the initial value. Then, according to the distance between the partition and the sound source, the preset distance attenuation model is applied to adjust the initial volume gain value and equalization curve to generate the final volume gain and frequency response curve of the partition. For partitions with a closer distance, the volume and high-frequency gain can be appropriately enhanced; for partitions with a farther distance, the volume and high-frequency gain need to be lowered.

[0108] S32. According to the mixing enhancement parameter, the mixing attenuation parameter and the propagation distance, respectively, the partition volume gain and the partition frequency response curve are enhanced and attenuated.

[0109] Among them, enhancement adjustment refers to enhancing the volume and frequency response according to the position of the speaker partitions; attenuation adjustment weakens certain characteristics.

[0110] In this embodiment, in addition to the adjustment based on the default parameters and distance, further optimization is required in combination with the mixing enhancement and attenuation parameters.

[0111] Specifically, the system can first read the volume gain adjustment and equalization adjustment value of the speaker partition from the mixing enhancement parameters according to the partition position, and apply it to the partition volume gain and frequency response curve obtained in the previous step to enhance it. For example, for the partition located in the listening area, the low-frequency gain can be appropriately enhanced. Then, according to the mixing attenuation parameters, the partition parameters can be weakened. For example, for the partition far away from the listening area, the mid-high frequency gain can be attenuated. The final partition volume gain and frequency response curve are the comprehensive results of the default preset, enhancement adjustment, attenuation adjustment and distance attenuation, which are more precise and reasonable.

[0112] In one embodiment, referring to Figure 5 In step S60, the mixing parameters of each audio track are adjusted according to the sound field optimization instruction, which specifically includes the following steps:

[0113] S61. Acquire sound field optimization adjustment information according to the sound field optimization instruction.

[0114] In this embodiment, the sound field optimization adjustment information refers to the sound field parameter adjustment suggestions put forward by the system based on the difference between the actual sound field detection and the ideal sound field model, which generally include the type of sound field parameters that need to be adjusted (such as volume, balance, etc.), the adjustment direction (such as enhancement or weakening), and the numerical range of the adjustment amount.

[0115] Specifically, the system encodes information in the sound field optimization instructions, such as "Zone 1 needs to increase the total volume by 10%", etc., as an adjustment target and basis for the sound field optimization.

[0116] S62: Obtain optimization completion information, and generate a sound field detection instruction according to the optimization completion information.

[0117] In this embodiment, the optimization end information refers to the condition of whether the sound field optimization loop is terminated, such as the sound field difference is lower than a certain threshold, the maximum number of iterations is reached, etc. When the optimization conditions are met, the system needs to generate instructions for detecting the current real sound field state to prepare for the next step of mixing parameter adjustment.

[0118] Specifically, the system can set a termination condition based on an error threshold, such as "the sum of the absolute values ​​of the sound field errors of all partitions is less than X". After each optimization iteration, the error value is calculated and compared with the termination condition. When the error is met, a sound field detection instruction is generated. The maximum number of iterations can also be set, and a detection instruction is generated when the upper limit is reached.

[0119] S63, obtaining sound field detection result information, and obtaining current sound field state information according to the sound field detection result information and the sound field optimization adjustment information, wherein the sound field detection result information refers to the partition sound field detection result.

[0120] Among them, the partition sound field detection results refer to the real-time sound field parameter measurement values ​​in each partition, such as sound pressure level, spectrum distribution, etc.; the detection results are correlated with the optimization and adjustment information to obtain comprehensive information representing the current real sound field state.

[0121] Specifically, this embodiment allows the sound field detection device to scan the sound field of each partition after receiving the detection instruction, and upload the measurement data to the system; the system obtains these raw data, and based on the previous optimization adjustment information, calculates the current volume, balance and other actual parameter values ​​of each partition as the overall current sound field status information.

[0122] S64: Acquire mixing adjustment parameter information according to the current sound field state information and the overall mixing value information.

[0123] The mixing adjustment parameter information refers to the adjustment suggestions that the system needs to make to the original mixing parameters in order to optimize the target, and serves as a direct basis for the final adjustment of the mixing parameters.

[0124] Specifically, the system compares the current sound field state with the expected overall mixing value information (preset ideal sound field parameters), analyzes the difference between the two, obtains the type of mixing parameters that need to be adjusted and the adjustment amount, and forms mixing adjustment parameter information. For example, it is necessary to "increase the total volume by 10%", "reduce the high-frequency equalization by 20%", etc.

[0125] S65. Adjust the mixing parameters of each audio track according to the mixing adjustment parameter information.

[0126] In this embodiment, the system calculates the specific parameter values ​​that need to be adjusted for each audio track based on the mixing adjustment information, and applies them to the audio track signals to achieve sound field optimization.

[0127] Specifically, the audio data of each audio track is read in turn, and real-time digital signal processing is performed on the audio data according to the corresponding adjustment parameters (such as total volume +10%, high frequency -20%, etc.) to obtain new optimized audio track data, and then the optimized audio track data is output to the speaker for playback, thereby achieving the purpose of optimizing the sound field.

[0128] In one embodiment, referring to Figure 6 In step S65, the mixing parameters of each audio track are adjusted according to the mixing adjustment parameter information, which specifically includes the following steps:

[0129] S651. Acquire partition mixing adjustment information according to the mixing adjustment parameter information, wherein the partition mixing adjustment information includes a partition volume gain adjustment value and a partition equalization adjustment curve.

[0130] Among them, the partition volume gain adjustment value refers to the gain change that needs to be adjusted for the partition relative to the overall volume, and the partition equalization adjustment curve reflects the gain adjustment of the partition in each frequency band.

[0131] In this embodiment, it is necessary to parse and extract the adjustment value corresponding to each partition from the overall mixing adjustment parameter information.

[0132] Specifically, the system analyzes the volume gain value and the change of the equalization curve of each frequency band that need to be adjusted in the partition from the mixing adjustment information according to factors such as the partition position and the current sound field state, and obtains the complete partition mixing adjustment information. For example, "Partition 1 volume +10%, frequency band below 500Hz +15%".

[0133] S652: Compare the partition volume gain adjustment value with a preset volume gain adjustment threshold. If the partition volume gain adjustment value is less than the volume gain adjustment threshold, adjust the corresponding mixing parameters of each audio track according to the partition mixing adjustment information.

[0134] The volume adjustment threshold is set to avoid drastic fluctuations in volume due to sound field detection errors and other reasons. The system makes actual adjustments only when the adjustment amount is within a certain range.

[0135] In this embodiment, if the partition volume adjustment value is small, the mixing parameters of each audio track are directly adjusted conventionally according to the partition adjustment information.

[0136] Specifically, the system can first determine whether the volume gain adjustment value of the partition is less than a preset threshold (such as ±3dB). If so, the system reads the volume and equalization adjustment parameters of the partition, performs corresponding gain, filtering and other digital signal processing on each audio track, and generates new optimized audio track data output.

[0137] S653: If the partition volume gain adjustment value is greater than the volume gain adjustment threshold, a mixing parameter secondary adjustment instruction is triggered, secondary mixing adjustment parameter information is obtained according to the mixing parameter secondary adjustment instruction, and mixing parameters of each audio track are adjusted according to the secondary mixing adjustment parameter information.

[0138] Among them, excessive volume gain adjustment may be due to abnormal detection, so the system needs to perform secondary analysis and adjustment to avoid the adverse experience caused by sudden volume changes.

[0139] In this embodiment, when it is detected that the volume adjustment of a certain partition exceeds a threshold, the system will issue a secondary adjustment instruction to regenerate new mixing adjustment parameters for guiding the mixing process of the audio track.

[0140] Specifically, when the system detects that the volume adjustment value of a certain zone is too large (such as exceeding ±6dB), it can immediately stop the current mixing adjustment process and issue a secondary adjustment instruction. According to the instruction, the system will re-analyze the sound field status, parameter conflicts, etc., and calculate new secondary mixing adjustment parameter information, including the corrected volume, equalization adjustment suggestions, etc. Then, according to these new parameters, a new round of mixing adjustment is performed on the data of each track, replacing the previous adjustment process.

[0141] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0142] In a second aspect, the present application provides a mixing console tuning management system. The mixing console tuning management system of the present application is described below in conjunction with the above-mentioned mixing console tuning management method.

[0143] Reference Figure 7 , a mixing console tuning management system, comprising:

[0144] The audio track attribute information acquisition module is used to acquire the audio signal and obtain the audio track attribute information according to the audio signal;

[0145] The overall mixing value information determination module is used to obtain the user's mixing selection information and determine the overall mixing value information according to the track attribute information and the mixing selection information;

[0146] A sound parameter determination module is used to obtain the propagation distance, and determine the sound parameters according to the propagation distance and the overall mixing value information, wherein the sound source corresponding to the audio signal is emitted by a speaker, and the speakers are distributed in several areas. The sound parameters include the partition sound parameters of the speakers in each partition area, and the propagation distance refers to the distance between the sound source and the partition area;

[0147] A tuning instruction generation module, used to generate tuning instructions according to the vocalization parameters and the overall mixing value information;

[0148] A sound field optimization instruction generation module is used to obtain partitioned sound field monitoring data, compare the partitioned sound field monitoring data with a preset ideal sound field model, obtain a sound field difference value, compare the sound field difference value with a preset sound field change threshold range, and generate a sound field optimization instruction if the sound field difference value is outside the preset sound field change threshold range;

[0149] The mixing parameter adjustment module is used to adjust the mixing parameters of each audio track according to the sound field optimization instruction.

[0150] Optionally, in one embodiment, the overall mixing value information determination module includes:

[0151] An overall mixing style determination unit, used for extracting a mixing style from the mixing selection information and using the mixing style as the overall mixing style;

[0152] A parameter acquisition unit, used to acquire default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters according to the mixing style;

[0153] The overall sound mixing value information determining unit is used to associate the overall sound mixing style, the default sound mixing preset parameter, the sound mixing enhancement parameter and the sound mixing attenuation parameter to determine the overall sound mixing value information.

[0154] Optionally, in one embodiment, the default mixing preset parameters include a baseline volume gain value, a baseline equalization curve, and a baseline audio feature weight, the mixing enhancement parameters include enhanced volume gain adjustment, enhanced equalization adjustment, and enhanced audio feature weight adjustment, and the mixing attenuation parameters include attenuation volume gain adjustment, attenuation equalization adjustment, and attenuation audio feature weight adjustment.

[0155] The parameter acquisition unit includes:

[0156] The first parameter acquisition subunit acquires a reference volume gain value, a reference equalization curve, an enhanced volume gain adjustment, an enhanced equalization adjustment, an attenuated volume gain adjustment, and an attenuated equalization adjustment according to a mixing style;

[0157] The second parameter acquisition subunit acquires the baseline audio feature weight, enhanced audio feature weight adjustment and attenuated audio feature weight adjustment according to the mixing style, wherein the audio feature includes at least one of pitch, loudness, duration and timbre.

[0158] Optionally, in one embodiment, the partition sound emission parameters include a partition volume gain and a partition frequency response curve, and the sound emission parameter determination module includes:

[0159] A sound parameter acquisition unit, used to acquire a partition volume gain and a partition frequency response curve according to a default mixing preset parameter and a propagation distance;

[0160] The sound parameter adjustment unit is used to perform enhancement adjustment and attenuation adjustment on the partition volume gain and the partition frequency response curve according to the mixing enhancement parameter, the mixing attenuation parameter and the propagation distance.

[0161] Optionally, the mixing parameter adjustment module includes:

[0162] A sound field optimization adjustment information acquisition unit, used to acquire sound field optimization adjustment information according to the sound field optimization instruction;

[0163] A sound field detection instruction generating unit, used for obtaining optimization completion information and generating a sound field detection instruction according to the optimization completion information;

[0164] A sound field state information acquisition unit is used to acquire sound field detection result information, and acquire current sound field state information according to the sound field detection result information and the sound field optimization adjustment information, wherein the sound field detection result information refers to the partition sound field detection result;

[0165] A mixing adjustment parameter information acquisition unit, used to acquire mixing adjustment parameter information according to current sound field state information and overall mixing value information;

[0166] The mixing parameter adjustment unit is used to adjust the mixing parameters of each audio track according to the mixing adjustment parameter information.

[0167] Optionally, in one embodiment, the mixing adjustment parameter information acquiring unit includes:

[0168] The partition mixing adjustment information acquisition subunit is used to acquire the partition mixing adjustment information according to the mixing adjustment parameter information, wherein the partition mixing adjustment information includes the partition volume gain adjustment value and the partition equalization adjustment curve;

[0169] The corresponding mixing parameter adjustment subunit is used to compare the partition volume gain adjustment value with a preset volume gain adjustment threshold value, and if the partition volume gain adjustment value is less than the volume gain adjustment threshold value, adjust the corresponding mixing parameters of each track according to the partition mixing adjustment information;

[0170] The mixing parameter secondary adjustment subunit is used to trigger the mixing parameter secondary adjustment instruction if the partition volume gain adjustment value is greater than the volume gain adjustment threshold, obtain secondary mixing adjustment parameter information according to the mixing parameter secondary adjustment instruction, and adjust the mixing parameters of each audio track according to the secondary mixing adjustment parameter information.

[0171] In one embodiment, the present application provides an electronic device, which may be a server, and its internal structure diagram may be as follows: Figure 8As shown. The electronic device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the electronic device is used to store data. The network interface of the electronic device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a mixing console tuning management method is implemented.

[0172] Those skilled in the art will understand that Figure 8 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0173] In one embodiment, an electronic device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0174] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the above-mentioned computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0175] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. A method for managing audio mixing console, characterized in that: The steps include: Acquire an audio signal, and obtain audio track attribute information according to the audio signal; Acquire the user's mixing selection information, and determine the overall mixing value information according to the audio track attribute information and the mixing selection information; Acquire the propagation distance, and determine the sound parameters according to the propagation distance and the overall sound mixing numerical information, wherein the sound source corresponding to the audio signal is emitted by a speaker, and the speakers are distributed in several areas, and the sound parameters include the partitioned sound parameters of the speakers in each partitioned area, and the propagation distance refers to the distance between the sound source and the partitioned area; first acquire the propagation distance according to the position of the speaker and the sound source, and then combine the propagation distance with the overall sound mixing numerical information, and calculate the sound parameters of each partition according to a preset distance attenuation model; Generate a tuning instruction according to the vocalization parameter and the overall mixing value information; Acquire partitioned sound field monitoring data, compare the partitioned sound field monitoring data with a preset ideal sound field model to obtain a sound field difference value, compare the sound field difference value with a preset sound field change threshold range, and generate a sound field optimization instruction if the sound field difference value is outside the preset sound field change threshold range; According to the sound field optimization instruction, the mixing parameters of each audio track are adjusted.

2. The method for managing the tuning of a mixing console according to claim 1, characterized in that: The obtaining of the user's mixing selection information and determining the overall mixing value information according to the track attribute information and the mixing selection information specifically includes the following steps: Extracting a mixing style from the mixing selection information, and using the mixing style as an overall mixing style; According to the mixing style, obtaining default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters; The overall sound mixing style, the default sound mixing preset parameter, the sound mixing enhancement parameter and the sound mixing attenuation parameter are associated to determine the overall sound mixing value information.

3. The method for managing the tuning of a mixing console according to claim 2, characterized in that: The default mixing preset parameters include a reference volume gain value, a reference equalization curve, and a reference audio feature weight; the mixing enhancement parameters include an enhanced volume gain adjustment, an enhanced equalization adjustment, and an enhanced audio feature weight adjustment; and the mixing attenuation parameters include an attenuated volume gain adjustment, an attenuated equalization adjustment, and an attenuated audio feature weight adjustment; The step of obtaining default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters according to the mixing style specifically includes the following steps: According to the mixing style, obtaining the reference volume gain value, the reference equalization curve, the enhanced volume gain adjustment, the enhanced equalization adjustment, the attenuated volume gain adjustment and the attenuated equalization adjustment; According to the mixing style, a baseline audio feature weight, an enhanced audio feature weight adjustment, and an attenuated audio feature weight adjustment are obtained, wherein the audio feature includes at least one of pitch, loudness, duration, and timbre.

4. The method for managing the tuning of a mixing console according to claim 2, characterized in that: The partition sound parameters include a partition volume gain and a partition frequency response curve, and the acquisition of the propagation distance determines the sound parameters according to the propagation distance and the overall mixing value information, specifically including the following steps: According to the default mixing preset parameters and the propagation distance, obtaining the partition volume gain and the partition frequency response curve; According to the sound mixing enhancement parameter, the sound mixing attenuation parameter and the propagation distance, the partition volume gain and the partition frequency response curve are respectively enhanced and attenuated.

5. The method for managing the sound mixing console according to claim 1, characterized in that: The step of adjusting the mixing parameters of each audio track according to the sound field optimization instruction specifically includes the following steps: Acquiring sound field optimization adjustment information according to the sound field optimization instruction; Acquiring optimization end information, and generating a sound field detection instruction according to the optimization end information; Acquire sound field detection result information, and acquire current sound field state information according to the sound field detection result information and in combination with the sound field optimization adjustment information, wherein the sound field detection result information refers to a partitioned sound field detection result; Acquiring mixing adjustment parameter information according to the current sound field state information and the overall mixing value information; The mixing parameters of each audio track are adjusted according to the mixing adjustment parameter information.

6. The method for managing the sound mixing console according to claim 5, characterized in that: The step of adjusting the mixing parameters of each audio track according to the mixing adjustment parameter information specifically includes the following steps: According to the sound mixing adjustment parameter information, obtaining partition sound mixing adjustment information, wherein the partition sound mixing adjustment information includes a partition volume gain adjustment value and a partition equalization adjustment curve; The partition volume gain adjustment value is compared with a preset volume gain adjustment threshold, and if the partition volume gain adjustment value is less than the volume gain adjustment threshold, the corresponding mixing parameters of each audio track are adjusted according to the partition mixing adjustment information; If the partition volume gain adjustment value is greater than the volume gain adjustment threshold, a mixing parameter secondary adjustment instruction is triggered, secondary mixing adjustment parameter information is obtained according to the mixing parameter secondary adjustment instruction, and the mixing parameters of each audio track are adjusted according to the secondary mixing adjustment parameter information.

7. A mixing console tuning management system, characterized in that: include: The audio track attribute information acquisition module is used to acquire the audio signal and obtain the audio track attribute information according to the audio signal; An overall sound mixing value information determination module, used to obtain the sound mixing selection information of the user, and determine the overall sound mixing value information according to the track attribute information and the sound mixing selection information; A sound parameter determination module is used to obtain a propagation distance, and determine a sound parameter according to the propagation distance and the overall sound mixing value information, wherein the sound source corresponding to the audio signal is emitted by a loudspeaker, and the loudspeakers are distributed in a plurality of areas, and the sound parameter includes a partition sound parameter of the loudspeaker in each partition area, and the propagation distance refers to the distance between the sound source and the partition area; the propagation distance is first obtained according to the position of the loudspeaker and the sound source, and then the propagation distance is combined with the overall sound mixing value information, and the sound parameter of each partition is calculated according to a preset distance attenuation model; A tuning instruction generating module, used for generating a tuning instruction according to the vocalization parameter and the overall mixing value information; A sound field optimization instruction generation module is used to obtain partitioned sound field monitoring data, compare the partitioned sound field monitoring data with a preset ideal sound field model to obtain a sound field difference value, compare the sound field difference value with a preset sound field change threshold range, and generate a sound field optimization instruction if the sound field difference value is outside the preset sound field change threshold range; The mixing parameter adjustment module is used to adjust the mixing parameters of each audio track according to the sound field optimization instruction.

8. The mixing console tuning management system according to claim 7, characterized in that: The overall mixing value information determination module includes: an overall mixing style determining unit, configured to extract a mixing style from the mixing selection information and use the mixing style as the overall mixing style; A parameter acquisition unit, used to acquire default mixing preset parameters, mixing enhancement parameters and mixing attenuation parameters according to the mixing style; The overall sound mixing value information determining unit is used to associate the overall sound mixing style, the default sound mixing preset parameter, the sound mixing enhancement parameter and the sound mixing attenuation parameter to determine the overall sound mixing value information.

9. An electronic device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the mixing console tuning management method according to any one of claims 1 to 6 when executing the computer program.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of managing the mixing console tuning according to any one of claims 1 to 6 are implemented.

Images