An audio integrated simulation prototype verification test platform

Abstract

The present invention provides an audio integrated simulation prototype verification test platform, comprising: a user demand input module for receiving user demand information, including integrated system information and audio to be verified; a simulation prototype building module for building a simulation prototype for processing the audio to be verified based on the integrated system information; a scene tracking and scheduling module for using a timestamp and event-driven mechanism to track and record the input and output of each audio processing module of the audio to be verified in the simulation prototype in real time; and a verification module for verifying the processing effect of the audio to be verified in each audio processing module based on the input and output of the audio to be verified in the simulation prototype. By implementing this method, integration problems can be accurately located, breaking through the limitations of traditional isolated testing, effectively solving the problem that traditional testing cannot simulate complex scenarios, and comprehensively verifying the feasibility and effectiveness of the technology, thereby reducing R&D costs.

Description

Technical Field

[0001] The invention belongs to the technical field of simulation test, and in particular relates to an audio integrated simulation prototype verification test platform. Background Art

[0002] In today's era of rapid digitalization and intelligent development, audio technology has been widely applied in numerous fields. As audio application scenarios become increasingly complex and diverse, the requirements for integrated audio architecture are also becoming increasingly stringent. Integrated audio architectures must integrate multiple aspects of audio acquisition, processing, transmission, storage, and output to achieve high-quality, high-performance audio capabilities.

[0003] However, the research and development of audio integrated architectures faces many challenges. The feasibility and effectiveness of various key technologies, such as advanced audio processing algorithms, efficient scheduling strategies, and stable message communication mechanisms, need to be rigorously verified. Traditional testing methods can often only perform isolated tests on a single technical point, and are unable to simulate actual complex application scenarios, making it difficult to discover compatibility issues, performance bottlenecks, and potential risks that may arise during the technology integration process. This leads to problems such as poor audio quality and system instability in actual product applications, increasing R&D costs and time. Therefore, there is an urgent need to build an audio integration simulation prototype verification test platform to meet the needs of audio integrated architecture technology research and development and verification. Summary of the Invention

[0004] In view of this, the purpose of the present invention is to provide an audio integration simulation prototype verification test platform to meet the needs of audio integration architecture technology research and development and verification.

[0005] In order to achieve the above object, the present invention provides the following technical solutions:

[0006] The present invention provides an audio integrated simulation prototype verification test platform, comprising: a user demand input module for receiving user demand information, including integrated system information and audio to be verified; a simulation prototype building module for building a simulation prototype for processing the audio to be verified according to the integrated system information; a scene tracking and scheduling module for tracking and recording the input and output of each audio processing module of the audio to be verified in the simulation prototype in real time by using a timestamp and event-driven mechanism; and a verification module for verifying the processing effect of the audio to be verified in each audio processing module according to the input and output of the audio to be verified in the simulation prototype.

[0007] Optionally, the integrated system information is integrated system index information, and the simulation prototype building module includes: an integrated system configuration search module, which is used to call the corresponding integrated system configuration list according to the integrated system index information; and a first simulation prototype building sub-module, which is used to build a simulation prototype for processing the audio to be verified according to the integrated system configuration list.

[0008] Optionally, the integrated system configuration list includes: audio function module serial number, audio function module order, audio function parameters, message middleware type and hardware device parameters, wherein each audio function module has a built-in audio processing algorithm, and the audio processing algorithm includes a noise reduction algorithm, an equalizer algorithm, an audio encoding algorithm, a mixing algorithm, and an audio decoding algorithm.

[0009] Optionally, if the integrated system information is a construction document of an audio integrated system to be verified, the simulation prototype building module includes: a configuration factor reading module, which is used to read the construction document of the audio integrated system to be verified, and perform keyword recognition on the audio integrated system construction document to obtain the integrated system configuration factors; a configuration factor matching module, which is used to fuzzy match the integrated system configuration factors with the names of the integrated system component sub-modules pre-stored in the platform; a configuration parameter determination module, which is used to extract the corresponding parameters of the target integrated system configuration factors from the construction document of the audio integrated system to be verified, where the target integrated system configuration factors are the factors that successfully match the names of the integrated system configuration list pre-stored in the platform; and a second simulation prototype building sub-module, which is used to build a simulation prototype for processing the audio to be verified based on the target integrated system configuration factors and their corresponding parameters.

[0010] Optionally, when the integrated system information includes environmental requirement information, the verification module includes: a virtual sound field environment generator determination module, which is used to extract the environmental requirement information from the integrated system index information and determine the corresponding virtual sound field environment generator according to the environmental requirement information; a virtual sound field determination module, which is used to input the output audio of the simulation prototype into the corresponding virtual sound field environment generator to obtain simulated audio; and a virtual sound field performance determination module, which is used to collect the simulated audio and extract performance parameters in the simulated audio.

[0011] Optionally, the virtual sound field environment generator includes a generator and a discriminator, and the construction process of the virtual sound field environment generator includes: obtaining multiple training samples, each training sample contains random noise, real sound frequency in the target sound field environment, and environmental parameters in the target sound field environment; inputting multiple training samples into the virtual sound field environment generator, wherein the random noise and environmental parameters in the target sound field environment are input into the generator, the generator generates simulated sound frequency, the real sound frequency in the target sound field environment and the simulated sound frequency are input into the discriminator, and the corresponding probability value is output, which represents the probability that the input sound frequency is the real sound frequency; the probability output when the discriminator inputs the real sound frequency and the probability output when the simulated sound frequency is input are input into the discrimination loss function to obtain a discrimination loss value; the probability output when the simulated sound frequency is input is input into the generation loss function to obtain a generation loss value; according to the discrimination loss value and the generation loss value, the partial derivative of each parameter in the virtual sound field environment generator is calculated layer by layer, and the parameters are updated until the preset requirements are met to obtain a trained virtual sound field environment generator.

[0012] Optionally, the verification module includes: a user expectation input module for receiving the user's expectation of the audio signal output by the simulation prototype; an expected effect calculation module for treating the expected effect parameter adjustment of each audio processing module as the action of the intelligent agent based on reinforcement learning, and measuring the degree of proximity between the audio signal output by the simulation prototype and the user's expectation according to a preset reward function, so as to obtain the optimal expected effect of each audio processing module; a processing effect verification module for calculating the difference between the output of each audio processing module of the audio to be verified in the simulation prototype and the expected effect of the corresponding audio processing module, and using the difference calculation result as the processing effect verification result of the audio processing module; and a display module for displaying the processing effect verification result of each audio processing module.

[0013] Optionally, an audio integrated simulation prototype verification test platform further includes: an integrated system configuration list modification module, which is used to receive a user's instruction to modify the integrated system configuration list.

[0014] An embodiment of the present invention provides an audio integration simulation prototype verification test platform. By establishing a simulation prototype, a scenario tracking and scheduling module tracks the input and output of each audio module and performs verification, thereby accurately locating integration problems, breaking through the limitations of traditional isolated testing, and effectively solving the problem that traditional testing cannot simulate complex scenarios. It comprehensively verifies the feasibility and effectiveness of the technology and reduces R&D costs.

[0015] Other advantages, objectives and features of the present invention will be described in the following description and will be apparent to those skilled in the art to some extent, or those skilled in the art can be taught from the practice of the present invention. The objectives and other advantages of the present invention can be realized and obtained through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to make the purpose, technical solutions and beneficial effects of the present invention more clear, the present invention provides the following drawings for illustration:

[0017] Figure 1 This is an example diagram of specific modules of an audio integrated simulation prototype verification test platform provided by the present invention;

[0018] Figure 2 This is a schematic diagram of the specific modules of the simulation prototype building module in the present invention. DETAILED DESCRIPTION

[0019] The technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0020] In the description of the present invention, it should be noted that, unless otherwise expressly specified or limited, the terms "installed," "connected," and "connected" should be understood in a broad sense. For example, they can refer to fixed connections, detachable connections, or integral connections; mechanical connections or electrical connections; direct connections or indirect connections through an intermediate medium; internal connections between two components; wireless connections or wired connections. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on specific circumstances.

[0021] In addition, the technical features involved in the different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0022] The embodiment of the present invention provides an audio integrated simulation prototype verification test platform, such as Figure 1 Shown, including:

[0023] User demand input module 101, for receiving user demand information, including integrated system information and audio to be verified;

[0024] A simulation prototype building module 102 is used to build a simulation prototype for processing the audio to be verified based on the integrated system information;

[0025] The scene tracking and scheduling module 103 is used to track and record the input and output of each audio processing module in the simulation prototype of the audio to be verified in real time by using a timestamp and event-driven mechanism;

[0026] The verification module 104 is used to verify the processing effect of the audio to be verified in each audio processing module in the simulation prototype according to the input and output of the audio to be verified in each audio processing module.

[0027] Exemplarily, the user requirement input module 101 may be a graphical user interface (GUI), which may be a touchscreen interface that displays various options and receives the results of user touch selections. The GUI may also include a text-based input interface and / or a file input interface. The integrated system information may be an integrated system index, which can be used to index pre-stored parameters of the audio integrated system to be verified within the test platform. For example, the integrated system information may be a specific number or character that corresponds to a pre-stored audio integrated system to be verified. The audio integrated system is stored in the form of data processing modules and parameters. In other words, the entire audio integrated system can be fully restored using these modules and parameters. The integrated system information may also be text information that records the necessary elements for building the integrated system, such as data processing modules and corresponding parameters. The integrated system information may also be user selection information and input parameters on a graphical user interface (GUI). The GUI displays different data processing modules, allowing users to select the corresponding data processing module according to their needs and modify the parameters within the data processing module. Furthermore, the user may select the connection relationship and connection order between different data processing modules.

[0028] When a user enters very detailed integrated system information into the platform, such as a detailed description in the text input interface of a graphical user interface, the simulation prototype building module 102 conducts a comprehensive analysis of this information, breaking it down into different categories and levels. For example, hardware-related information, such as the model and performance parameters of the audio acquisition device, and software-related information, such as the audio processing algorithm used and software architecture, are distinguished, as well as the overall functional requirements and performance indicators of the system. Key parameters are extracted from the parsed information, which will directly affect the construction of the simulation prototype. For example, key audio processing parameters such as sampling rate, quantization bit number, and filter parameters are determined based on the specific requirements of the audio processing algorithm.

[0029] Next, based on the functional requirements in the system information, a search is performed within a predefined module library, which contains various pre-developed audio processing modules, such as audio filtering, noise reduction, mixing, and encoding / decoding modules. Selected modules are configured according to the specific parameter requirements in the system information. For the filtering module, for example, key parameters such as the filter type (e.g., low-pass, high-pass, bandpass), cutoff frequency, and order are determined to meet the processing requirements of the simulation prototype. Finally, according to the system's audio processing flow and architecture, the configured modules are combined and connected to form a complete audio processing chain. For example, the output of the audio acquisition module is first connected to the input of the noise reduction module, and then to the input of the mixing module. This ensures that audio is transmitted and processed between the modules in the predetermined order and manner.

[0030] When the simulation prototype is started, the scene tracking scheduling module 103 sets a global time base for the entire system, such as the system clock, and creates an initial timestamp to indicate the moment when the simulation begins. At the same time, event listeners are set at the input and output ports of each audio processing module to detect the flow of audio data. When audio data arrives at the input port or is output from the output port, the corresponding listener will be triggered. Specifically, when the listener detects that a corresponding event occurs, an event object will be triggered. This event object contains various information related to the event, such as the event type, the time of occurrence, the audio data involved, etc. For example, when audio data is output from a mixing module, the triggered event object will record that this is a "mixing module output" event, as well as the current timestamp and the content of the audio data output.

[0031] Verification module 104 obtains the input and output data of the audio to be verified from each audio processing module from the scene tracking and scheduling module. It then extracts various audio information, such as waveform, frequency, and amplitude, from this input and output data. Furthermore, the collected data can be preprocessed, including data cleaning to remove possible noise or erroneous data, data normalization to map the data to a specific range, and data format conversion to convert the data into a format suitable for processing by the verification algorithm. Next, the specific functions of each audio processing module are verified. For example, for an audio compression module, the module checks whether its compression ratio meets expectations, whether the decompressed audio quality is within an acceptable range, and whether there is significant distortion or information loss. Finally, based on the preset evaluation indicators corresponding to each module, the index values ​​of the input and output data of the audio to be verified in each module are calculated and compared with preset standard values. Furthermore, the overall audio processing flow within the entire simulation prototype can be verified to ensure correctness and rationality. This includes checking whether the connections between modules are correct, whether data transfer between modules is smooth, and whether there is any degradation in audio quality due to inter-module coordination issues. Finally, conduct an in-depth analysis of the results obtained during the verification process to identify modules or links where the processing results do not meet expectations. Analyze the possible causes of the problem, such as unreasonable module parameter settings, abnormal input data, and defects in the algorithm itself.

[0032] An embodiment of the present invention provides an audio integration simulation prototype verification test platform. By establishing a simulation prototype, a scenario tracking and scheduling module tracks the input and output of each audio module and performs verification, thereby accurately locating integration problems, breaking through the limitations of traditional isolated testing, and effectively solving the problem that traditional testing cannot simulate complex scenarios. It comprehensively verifies the feasibility and effectiveness of the technology and reduces R&D costs.

[0033] As an optional implementation, the integrated system information is integrated system index information, and the simulation prototype building module includes:

[0034] The integrated system configuration search module is used to retrieve the corresponding integrated system configuration list according to the integrated system index information;

[0035] The first simulation prototype building submodule is used to build a simulation prototype for processing the audio to be verified according to the integrated system configuration list.

[0036] For example, in addition to the above-mentioned integrated system information being a detailed description input by the user in the text input interface of the graphical user interface, it can also be an integrated system index. When the integrated system information is an integrated system index, this embodiment provides a corresponding implementation method.

[0037] Receive user-entered integrated system index information, which can be a code. After receiving the integrated system index information, the system parses it and extracts key identifying information from the parsed index information, such as system type, version number, and application scenario. This key information serves as the basis for subsequent searches of the configuration list. For example, if the input index information includes "Audio Processing System 2.0 - Concert Hall Scene," "Audio Processing System," "2.0," and "Concert Hall Scene" are extracted as key information.

[0038] The key information is stored and linked to the integrated system configuration list in a database. Upon receiving the key information, a database query is performed, and the filtered integrated system configuration list is fed back to the first simulation prototype construction sub-model. The first simulation prototype construction sub-model constructs a simulation model based on the integrated system configuration list. Specifically, the integrated system configuration list includes: audio function module serial number, audio function module order, audio function parameters, message middleware type, and hardware device parameters. Each audio function module has a built-in audio processing algorithm, and the audio processing algorithms include noise reduction algorithms, equalizer algorithms, audio encoding algorithms, mixing algorithms, audio decoding algorithms, and the like.

[0039] The audio function module sequence number is used to index the audio processing module with the corresponding function. The audio function module order specifies the connection order of audio processing modules with different functions. The audio function parameters correspond to the audio processing modules and indicate the parameters within each audio processing module. For example, if the audio processing module is an equalizer module, the audio function parameters specify the gain values ​​for each frequency band. These gain values ​​are passed to the module's constructor when the equalizer module is instantiated. The message middleware type is used to configure the corresponding message middleware. Message middleware, such as Kafka and RabbitMQ, is used for communication and data transfer between modules. Configuration includes server addresses, port numbers, topics, and more.

[0040] After the first simulation prototype construction submodule obtains the integrated system configuration list, it calls the corresponding audio processing module according to the list and determines the input and output connection relationship between each audio function module. For example, if the configuration list stipulates that the module order is "noise reduction module--equalizer module--audio encoding module", the output of the noise reduction module is connected to the input of the equalizer module, and the output of the equalizer module is connected to the input of the audio encoding module. Then, the corresponding parameters of each audio processing module are adjusted according to the audio function parameters and hardware device parameters. Finally, the message middleware is configured according to the message middleware type to realize communication between the various modules. Furthermore, after the simulation model is constructed, the simulation model can be displayed in the form of a graphical structure.

[0041] The embodiment of the present invention provides an audio integrated simulation prototype verification test platform, which opens an integrated system index information input interface for users. Users only need to input corresponding index information to complete the verification of the stored integrated system, reducing the user's learning cost and reducing user operations.

[0042] As an optional implementation, Figure 2 As shown, the integrated system information is the audio integrated system construction document to be verified, and the simulation prototype construction module includes:

[0043] Configuration factor reading module 201, used to read the audio integration system construction document to be verified, and perform keyword recognition on the audio integration system construction document to obtain the integrated system configuration factors;

[0044] Configuration factor matching module 202, used for fuzzy matching the integrated system configuration factors with the names of the integrated system component submodules pre-stored in the platform;

[0045] Configuration parameter determination module 203, for extracting corresponding parameters of target integrated system configuration factors from the audio integrated system construction document to be verified, where the target integrated system configuration factors are factors that successfully match the names of the integrated system configuration lists pre-stored in the platform;

[0046] The second simulation prototype building submodule 204 is used to build a simulation prototype for processing the audio to be verified according to the target integrated system configuration factors and their corresponding parameters.

[0047] For example, before building an audio integration system, the system design, such as development files, is usually completed in advance. When a system construction document similar to such a development file is input into the user requirement input module, this embodiment can provide the following modules to complete the reading, mining, and matching of the system construction document, so as to realize the construction of a simulation model based on the document.

[0048] When receiving an audio integration system build document, natural language processing (NLP) technology is used to identify the core content of the document and extract representative and critical configuration factors as keywords. Specifically, deep learning-based named entity recognition (NER) models, such as BERT and BiLSTM-CRF, can be trained on the document content to learn the contextual information and semantic features in the text. This allows the system to accurately identify named entities related to the audio integration system configuration in the document, such as audio function module names, parameter names, message middleware types, and hardware device names, as key configuration factors.

[0049] In this embodiment, a predefined keyword library containing keywords related to the audio integration system is used. These keywords include audio processing module names (e.g., filter, amplifier, etc.) and parameter names (e.g., sampling rate, gain, etc.). To extract key configuration factors, the key configuration factors are cleaned according to the keyword library. Specifically, an appropriate fuzzy matching algorithm, such as the edit distance algorithm (e.g., Levenshtein distance) or the cosine similarity algorithm, is selected to measure the similarity between two character strings. The integrated system configuration factors are then compared one by one with the names of the integrated system's submodules pre-stored within the platform. For each configuration factor, a similarity score is calculated with each submodule name. Based on a preset similarity threshold, matching results with scores above the threshold are selected, and these successfully matched configuration factors are marked as matching the submodule names within the platform. Finally, after the matching is complete, the configuration parameter determination module can extract the parameter values ​​following the parameter names using a regularized method. The simulation process for the second simulation prototype construction submodule is described in the corresponding embodiment above and will not be repeated here.

[0050] An embodiment of the present invention provides an audio integration simulation prototype verification test platform. Through the method of first identifying and then matching, on the one hand, natural language processing technology is used to identify the core content of the document and extract configuration factors as keywords during the identification process. It can deeply understand the semantics of the document and accurately find representative and key configuration factors, rather than simply matching based on literal meanings, thereby avoiding missing important information or mistaking non-key information for keywords. On the other hand, different audio integration systems may construct documents with differences in expression methods, word usage habits, etc. Directly matching and identifying keywords in the file may not be effective due to different document styles. The method of extracting keywords first and then performing fuzzy matching can normalize various expressions through natural language processing technology, extract configuration factors with different expressions but the same meaning, and reasonably match them, which has greater adaptability and flexibility.

[0051] As an optional implementation, when the integrated system information includes environmental requirement information, the verification module includes:

[0052] A virtual sound field environment generator determination module is used to extract environmental requirement information from the integrated system index information and determine the corresponding virtual sound field environment generator according to the environmental requirement information;

[0053] A virtual sound field determination module is used to input the output audio frequency of the simulation prototype into the corresponding virtual sound field environment generator to obtain simulated audio frequency;

[0054] The virtual sound field performance determination module is used to collect simulated audio and extract performance parameters from the simulated audio.

[0055] Exemplarily, the environmental requirement information is used to represent the environmental information where the integrated system actually needs to be placed. For example, when the integrated system is actually used in a music classroom, the environmental information includes the size and shape of the music classroom, the sound absorption coefficient and reflection coefficient corresponding to the surrounding materials, and the location of the integrated system in the room.

[0056] The virtual sound field environment generator determination module determines the corresponding virtual sound field environment generator according to the environmental requirement information by matching the environmental requirement information with the information tag of the pre-trained virtual sound field environment generator, which contains the environmental information corresponding to the virtual sound field environment generator. The virtual sound field environment generator includes a generator and a discriminator. The construction process of the virtual sound field environment generator includes: obtaining multiple training samples, each training sample contains random noise, real sound frequency in the target sound field environment and environmental parameters in the target sound field environment; inputting multiple training samples into the virtual sound field environment generator, wherein the random noise and environmental parameters in the target sound field environment are input into the generator, and the generator generates simulated sound frequency; the real sound frequency in the target sound field environment and the simulated sound frequency are input into the discriminator, and the corresponding probability value is output, which represents the probability that the input sound frequency is the real sound frequency; the probability output when the discriminator inputs the real sound frequency and the probability output when the discriminator inputs the simulated sound frequency are input into the discrimination loss function to obtain the discrimination loss value; the probability output when the simulated sound frequency is input is input into the generation loss function to obtain the generation loss value; according to the discrimination loss value and the generation loss value, the partial derivative of each parameter in the virtual sound field environment generator is calculated layer by layer, and the parameters are updated until the preset requirements are met to obtain a trained virtual sound field environment generator.

[0057] Specifically, in a virtual sound field generator based on an adversarial network, a random noise vector and environmental parameters are input. The generator generates simulated audio by combining the random noise vector and conditional information. The discriminator compares the simulated audio with real audio from the target sound field environment to determine its authenticity, providing feedback to the generator and prompting it to continuously improve its generation. After processing through a series of neural network layers, the generator outputs simulated audio data of the virtual sound field environment. This data differs significantly from real data at the beginning of training, but as training progresses, it gradually approaches the characteristics of real data, thereby deceiving the discriminator. The discriminator then compares the real data input with the generated data and outputs a probability value representing the probability that the input audio is real. For real audio, the discriminator aims to output a probability close to 1; for simulated audio, the discriminator aims to output a probability close to 0. Therefore, the generator and discriminator work in a mutually adversarial and collaborative manner. During continuous adversarial training, the generator strives to produce more realistic simulated audio to deceive the discriminator, while the discriminator continuously improves its ability to distinguish real from fake data. During training, the discriminator feeds its judgment results back to the generator in the form of gradients. The generator uses this gradient information to adjust its network parameters, making the generated data more similar to the distribution of real audio data. After multiple rounds of training iterations, the generator gradually learns the distribution characteristics of real audio data, enabling it to generate simulated audio data of increasingly higher quality.

[0058] The specific training process includes: the goal of the generator is to maximize the output probability of the discriminator for the simulated audio. Therefore, its loss function can be constructed based on the output probability of the discriminator for the simulated audio. For example, it can be converted into minimizing the negative log-likelihood, that is:

[0059] ,

[0060] in, Represents the output probability of the simulated audio in the discrimination module, Represents the log-likelihood value of the output probability of the simulated audio in the discrimination module The expected value of is the probability distribution of the simulated audio frequency.

[0061] The discriminator should make the discrimination score of the real audio higher than the discrimination probability of the simulated audio data as much as possible. Therefore, the discrimination loss function can be:

[0062] ;

[0063] in, Represents the input probability of the real audio frequency in the discrimination module, represents the expected probability of the real audio frequency in the input of the discrimination module, represents the probability distribution of the real sound frequency, Represents the expected output probability of the simulated audio in the discrimination module.

[0064] Based on the above two loss functions, an overall loss function can be constructed. Specifically, the two are added together to obtain a total loss function value. Then, the gradient of the loss function with respect to the discriminator parameters is calculated using the backpropagation algorithm, and the discriminator parameters are updated according to the optimization algorithm (such as stochastic gradient descent, Adam, etc.), making the discriminator more accurate in subsequent judgments.

[0065] When actually using the virtual sound field environment generator, the user can determine the corresponding virtual sound field environment generator according to the needs. For example, if the audio integration system will be used in a concert hall, the user can input the environmental requirement information, and then input the environmental information into the trained virtual sound field environment generator. The virtual sound field environment generator simulates the sound effect of the audio to be verified in the concert hall, that is, simulates the audio. Finally, the simulated audio is collected and the performance parameters of the simulated audio are extracted. The performance parameters may include volume, frequency, signal-to-noise ratio, etc.

[0066] An embodiment of the present invention provides an audio integration simulation prototype verification test platform. By constructing a virtual sound field environment generator, the audio effects of an audio integration system under different environmental requirements can be verified. Compared with general sound field simulation methods, the method proposed in this embodiment can more accurately verify the performance of audio in specific environments, ensuring the effectiveness of the audio integration system in actual target scenarios. It can also provide a reference for users to facilitate the adjustment of the internal parameters of the audio integration system based on this basis.

[0067] As an optional implementation, the verification module includes:

[0068] A user expectation input module for receiving the user's expectation on the output audio signal of the simulation prototype;

[0069] An expected effect calculation module is used to treat the adjustment of the expected effect parameters of each audio processing module as the action of the intelligent agent based on reinforcement learning, and to measure the degree of proximity between the audio signal output by the simulation prototype and the user's expectation based on a preset reward function to obtain the optimal expected effect of each audio processing module;

[0070] a processing effect verification module, configured to calculate the difference between the output of each audio processing module of the audio to be verified in the simulation prototype and the expected effect of the corresponding audio processing module, and use the difference calculation result as the processing effect verification result of the audio processing module;

[0071] The display module is used to display the processing effect verification results of each audio processing module.

[0072] For example, this embodiment proposes using reinforcement learning to infer the optimal expected performance of each audio processing module from the user's desired outcome. Specifically, a reinforcement learning environment is first defined, including a simulation prototype and the adjustable parameter ranges for each audio processing module. For example, for the equalizer module, the adjustable parameters might be the gain values ​​for each frequency band, set within a range of -20dB to +20dB; for the reverberation module, the reverberation time might be adjusted from 0.1s to 5s, etc. Next, an intelligent agent is initialized, and its state is composed of the current parameter settings for each audio processing module and the characteristics of the audio signal output by the simulation prototype. A reward function is used to measure the degree to which the audio signal output by the simulation prototype matches the user's expectations. For example, for volume expectations, the difference between the output volume and the user's desired volume can be calculated; the smaller the difference, the higher the reward. For sound quality expectations, the difference between the output audio frequency response and the user's desired frequency response is analyzed using methods such as mean squared error, with the smaller the difference, the higher the reward. Multiple expectation factors are comprehensively considered, and each factor is assigned a corresponding weight to determine the total reward value. For example, if the user is more concerned about volume, a higher weight is assigned to the volume factor.

[0073] Specifically, the reward function can be:

[0074] ;

[0075] in, represents the weight of the i-th indicator, represents the reward for the i-th indicator, and n represents the total number of indicators.

[0076] Take the indicators including volume, timbre and clarity as an example to illustrate:

[0077] ;

[0078] in, Indicates the reward value of volume, Indicates the maximum volume of the system. Indicates the user's desired volume. Indicates the actual output volume.

[0079] ;

[0080] in, Indicates the reward value of the timbre, Indicates the user's expected audio spectrum, represents the actual output audio spectrum, and MSE represents the mean square error.

[0081] ;

[0082] in, Rewards for clarity, represents the actual output signal-to-noise ratio, The maximum signal-to-noise ratio of the system.

[0083] The agent performs a series of actions in the environment (i.e., adjusting the parameters of the audio processing modules for the desired effect). After each action, the simulation prototype processes a test audio signal according to the new parameter settings and outputs the results. The reward value for this action is calculated based on the reward function. The agent updates its policy based on the reward value and its current state to select the best action. This can be achieved using common reinforcement learning algorithms such as Q-learning and Deep Q Networks (DQNs). This process is repeated for multiple rounds of training until the agent converges to a stable policy. The resulting parameter settings for each audio processing module are the optimal desired effect.

[0084] After obtaining the optimal parameters for each audio processing module, the scene tracking and scheduling module obtains the output data of each audio processing module in the simulation prototype. This data includes the audio's time-domain waveform and frequency-domain features. Based on the different audio characteristics, an appropriate difference calculation method is selected. For time-domain waveforms, the mean square error (MSE) can be calculated to measure the amplitude difference between the output waveform and the expected waveform. For frequency-domain features, a spectral distance metric, such as the Kullback-Leibler divergence (KL-divergence), can be used to evaluate the difference between the output spectrum and the expected spectrum. For each audio processing module, the difference calculation results of multiple features are comprehensively considered, and each feature is assigned a corresponding weight to obtain a comprehensive difference value.

[0085] The embodiment of the present invention provides an audio integrated simulation prototype verification test platform, which adopts a reinforcement learning method to seek the optimal parameters of each audio processing module. Compared with manual determination, it not only saves manpower but is also more scientific.

[0086] As an optional implementation, an audio integrated simulation prototype verification test platform further includes: an integrated system configuration list modification module for receiving a user's instruction to modify the integrated system configuration list.

[0087] Finally, it should be noted that the above preferred embodiments are only used to illustrate the technical solutions of the present invention and are not limiting. Although the present invention has been described in detail through the above preferred embodiments, those skilled in the art should understand that various changes can be made in form and details without departing from the scope defined by the claims of the present invention.

Claims

1. An audio integrated simulation prototype verification test platform, characterized in that: include: A user demand input module, used for receiving user demand information, including integrated system information and audio to be verified; A simulation prototype building module is used to build a simulation prototype for processing the audio frequency to be verified based on the integrated system information; A scene tracking and scheduling module is used to track and record the input and output of each audio processing module in the simulation prototype in real time using a timestamp and event-driven mechanism; A verification module, configured to verify the processing effect of the audio to be verified in each audio processing module in the simulation prototype according to the input and output of the audio to be verified in each audio processing module; When the integrated system information includes environmental requirements information, the verification module includes: A virtual sound field environment generator determination module is used to extract environmental requirement information from the integrated system index information and determine the corresponding virtual sound field environment generator according to the environmental requirement information; A virtual sound field determination module is used to input the output audio frequency of the simulation prototype into the corresponding virtual sound field environment generator to obtain simulated audio frequency; The virtual sound field performance determination module is used to collect simulated audio and extract performance parameters from the simulated audio.

2. The audio integrated simulation prototype verification test platform according to claim 1, characterized in that: The integrated system information is the integrated system index information, and the simulation prototype building module includes: The integrated system configuration search module is used to retrieve the corresponding integrated system configuration list according to the integrated system index information; The first simulation prototype building submodule is used to build a simulation prototype for processing the audio to be verified according to the integrated system configuration list.

3. The audio integrated simulation prototype verification test platform according to claim 2, characterized in that: The integrated system configuration list includes: audio function module serial number, audio function module order, audio function parameters, message middleware type and hardware device parameters. Among them, each audio function module has a built-in audio processing algorithm, and the audio processing algorithm includes noise reduction algorithm, equalizer algorithm, audio encoding algorithm, mixing algorithm and audio decoding algorithm.

4. The audio integrated simulation prototype verification test platform according to claim 1, characterized in that: The integrated system information is the document for the audio integrated system to be verified, and the simulation prototype building module includes: A configuration factor reading module is used to read the audio integration system construction document to be verified, and perform keyword recognition on the audio integration system construction document to obtain the integrated system configuration factors; The configuration factor matching module is used to perform fuzzy matching between the configuration factors of the integrated system and the names of the sub-modules of the integrated system pre-stored in the platform; a configuration parameter determination module, configured to extract corresponding parameters of target integrated system configuration factors from the audio integrated system construction document to be verified, wherein the target integrated system configuration factors are factors that successfully match the names of the integrated system configuration lists pre-stored in the platform; The second simulation prototype building submodule is used to build a simulation prototype for processing the audio to be verified based on the target integrated system configuration factors and their corresponding parameters.

5. The audio integrated simulation prototype verification test platform according to claim 1, characterized in that: The virtual sound field environment generator includes a generator and a discriminator. The construction process of the virtual sound field environment generator includes: Acquire multiple training samples, each training sample containing random noise, a real sound frequency in a target sound field environment, and environmental parameters in the target sound field environment; Inputting multiple training samples into a virtual sound field environment generator, wherein random noise and environmental parameters in the target sound field environment are input into the generator, the generator generates simulated audio, and the real audio in the target sound field environment and the simulated audio are input into the discriminator, which outputs corresponding probability values, which represent the probability that the input audio is the real audio; The probability of the discriminator outputting real audio and the probability of the discriminator outputting simulated audio are input into the discriminant loss function to obtain the discriminant loss value; Input the probability of the output when the simulated audio is input into the generation loss function to obtain the generation loss value; According to the discrimination loss value and the generation loss value, the partial derivative of each parameter in the virtual sound field environment generator is calculated layer by layer, and the parameters are updated until the preset requirements are met to obtain a trained virtual sound field environment generator.

6. The audio integrated simulation prototype verification test platform according to claim 1, characterized in that: Verification modules, including: A user expectation input module for receiving the user's expectation on the output audio signal of the simulation prototype; An expected effect calculation module is used to treat the adjustment of the expected effect parameters of each audio processing module as the action of the intelligent agent based on reinforcement learning, and to measure the degree of proximity between the audio signal output by the simulation prototype and the user's expectation based on a preset reward function to obtain the optimal expected effect of each audio processing module; a processing effect verification module, configured to calculate the difference between the output of each audio processing module of the audio to be verified in the simulation prototype and the expected effect of the corresponding audio processing module, and use the difference calculation result as the processing effect verification result of the audio processing module; The display module is used to display the processing effect verification results of each audio processing module.

7. The audio integrated simulation prototype verification test platform according to claim 3, characterized in that: Also includes: The integrated system configuration list modification module is used to receive user instructions to modify the integrated system configuration list.

Images