Sound quality calibration method, electronic device, vehicle, medium and program product

By obtaining and analyzing the sound information in multiple areas of the car, identifying sound quality damage scenes and adjusting speaker parameters, the sound quality stability problem of the car audio system under environmental changes is solved, and a high-quality listening experience is achieved.

CN118574056BActive Publication Date: 2024-11-15BYD CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
CN202411011544.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-15
Estimated Expiration
2044-07-26

AI Technical Summary

Technical Problem

The existing car audio system cannot effectively reduce the impact of environmental changes on sound quality, and cannot meet users' high pursuit of sound quality.

Method used

By obtaining sound information from multiple areas in the target space, determining sound variable information, identifying sound quality damage scenes, and adjusting the operating parameters of the speaker system according to the recognition results to reduce the impact of environmental changes on sound quality.

Benefits of technology

Real-time monitoring of the sound change state in the target space and accurate adjustment of sound quality, ensuring that users can obtain stable and high-quality listening effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118574056B_ABST
    Figure CN118574056B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a sound quality calibration method, electronic device, vehicle, medium and program product. The method includes: obtaining sound information of multiple areas in the target space within the current acquisition cycle; determining the sound variable information of each area based on the sound information; identifying the sound quality damage scene based on the sound variable information of each area, and adjusting the operating parameters of the speaker system based on the result of the scene recognition. In this way, the system's ability to perceive the environment can be enhanced through multi-area sound acquisition, and then the real-time monitoring of the sound change state in the target space can be accurately realized; based on the sound variable information of each area, the sound quality damage scene that is adapted to the environmental changes in the target space can be identified, and then the sound quality that conforms to the environmental changes in the target space can be adjusted to reduce the impact of environmental changes on the sound quality and ensure the listening effect of users in the target space.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of audio playback, and in particular, to a sound quality calibration method, electronic equipment, vehicle, medium and program product. Background Art

[0002] As the intelligent development of car cockpits continues, users have higher requirements for the stability and consistency of the cockpit audio experience. However, the sound quality of the car audio system is constantly changing with the environment inside and outside the car. How to reduce the impact of the environment on the sound quality of the car audio system is an important challenge facing current car audio products. The current common volume speed compensation technology automatically adjusts the audio volume based on the vehicle speed information provided by the sensor or vehicle information system, which cannot meet the current users' high pursuit of sound quality. Summary of the invention

[0003] The purpose of the present disclosure is to provide a sound quality calibration method, electronic equipment, vehicle, medium and program product to ensure the listening effect of users in the target space and meet the users' high pursuit of sound quality.

[0004] In order to achieve the above object, the present disclosure provides a sound quality calibration method in a first aspect, comprising:

[0005] Acquire sound information of multiple areas in the target space within the current acquisition cycle;

[0006] Determine the sound variable information of each area according to the sound information;

[0007] According to the sound variable information of each area, the sound quality damage scene is identified;

[0008] According to the results of scene recognition, the operating parameters of the speaker system are adjusted.

[0009] A second aspect of the present disclosure provides an electronic device, including:

[0010] a memory having a computer program stored thereon;

[0011] A processor is used to execute a computer program in a memory to implement the steps of the method provided in the first aspect of the present disclosure.

[0012] A third aspect of the present disclosure provides a vehicle, comprising a speaker system, a controller, and a plurality of microphones;

[0013] Wherein, the controller is used to implement the steps of the method provided in the first aspect of the present disclosure when executed; at least one microphone is set in each area of ​​the vehicle.

[0014] A fourth aspect of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method provided in the first aspect of the present disclosure.

[0015] A fifth aspect of the present disclosure provides a computer program product, including a computer program, which implements the steps provided in the first aspect of the disclosure when executed by a processor.

[0016] Through the above technical solution, during the audio playback process, first obtain the sound information of multiple areas in the target space within the current acquisition cycle; then determine the sound variable information of each area based on the sound information; then identify the sound quality damage scene based on the sound variable information of each area, and adjust the operating parameters of the speaker system based on the results of the scene recognition. In this way, the system's ability to perceive the environment can be enhanced through multi-area sound acquisition, and then accurately realize real-time monitoring of the sound change state in the target space; based on the sound variable information of each area, it can identify the sound quality damage scene that is compatible with the environmental changes in the target space, and then adjust the sound quality that meets the environmental changes in the target space, so as to reduce the impact of environmental changes on the sound quality, ensure the listening effect of users in the target space, and meet the users' high pursuit of sound quality.

[0017] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings are used to provide further understanding of the present disclosure and constitute a part of the specification. They are used to explain the present disclosure together with the following detailed description, but do not constitute a limitation of the present disclosure.

[0019] Figure 1 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure.

[0020] Figure 2A Schematic diagram of microphone distribution in a five-seater vehicle provided by an exemplary embodiment of the present disclosure.

[0021] Figure 2B Schematic diagram of microphone distribution in a five-seater vehicle provided by an exemplary embodiment of the present disclosure.

[0022] Figure 2C Schematic diagram of microphone distribution in a five-seater vehicle provided by an exemplary embodiment of the present disclosure.

[0023] Figure 2D Schematic diagram of microphone distribution in a five-seater vehicle provided by an exemplary embodiment of the present disclosure.

[0024] Figure 3ASchematic diagram of microphone distribution in a seven-seater vehicle provided by an exemplary embodiment of the present disclosure.

[0025] Figure 3B Schematic diagram of microphone distribution in a seven-seater vehicle provided by an exemplary embodiment of the present disclosure.

[0026] Figure 4 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure.

[0027] Figure 5 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure.

[0028] Figure 6 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure.

[0029] Figure 7 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure.

[0030] Figure 8 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure.

[0031] Fig. 9 It is a schematic diagram of a sound quality calibration system provided by an exemplary embodiment of the present disclosure when the target space is the interior space of a car cabin.

[0032] Fig.10 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure.

[0033] Fig.11 is a block diagram of a sound quality calibration device provided by an exemplary embodiment of the present disclosure.

[0034] Fig.12 is a block diagram of an electronic device provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] The specific implementation of the present disclosure is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described herein is only used to illustrate and explain the present disclosure, and is not used to limit the present disclosure.

[0036] Figure 1 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure. The method can be applied to a vehicle computer (vehicle infotainment system) or a power amplifier platform, and specifically, can be applied to a DSP (Digital Signal Processor) chip in the vehicle computer or the power amplifier platform. Figure 1 As shown, the method may include steps S101 to S104.

[0037] In step S101, sound information of multiple areas in a target space in a current collection period is obtained.

[0038] For example, the duration of the acquisition cycle can be pre-set based on actual needs, for example, it can be set to 5s. In this way, sound quality calibration can be implemented periodically to avoid too frequent calibration of the sound quality, so as to reduce energy waste, balance the stability and flexibility of the sound quality adjustment of the audio played by the speaker system, and avoid the reduction of user hearing effect due to too frequent calibration.

[0039] In one embodiment, sound information of multiple areas in the target space in the current collection period can be acquired through a distributed microphone array, wherein each area includes at least one microphone in the distributed microphone array.

[0040] Among them, the distributed microphone array can be understood as an acoustic sensor network used to collect and process sound information in the target space. The distributed microphone array can realize the state detection of a large range of acoustic space, with stronger robustness, and can realize the accurate collection of sound information. The distributed microphone array is also flexible and scalable, and can be applied to target spaces of different sizes and types.

[0041] The target space can be the interior space of a car cabin. Taking the cabin of a five-seater car as an example, the existing microphones in the car can be used to form a distributed array. The 4-microphone distributed array can be Figure 2A As shown, a 2-microphone distributed array can be Figure 2B As shown; you can also use the original microphones in the car and additional microphones to form a distributed array. Figure 2C The original microphone in front of the main driving seat of the vehicle shown in the figure can form a distributed array with an additional central microphone, such as Figure 2D The original 4 microphones of the vehicle shown can be combined with the additional center microphone and the front center microphone to form a distributed array. Taking the cockpit of a seven-seater car as an example, a 6-microphone distributed array can be Figure 3A As shown, a 4-microphone distributed array can be Figure 3B As shown. Among them, FIG. 2A to FIG. 2D as well as Figure 3A and Figure 3B The shaded part in can be the target space. FIG. 2A to FIG. 2D as well as Figure 3A and Figure 3B The microphones in the array may be installed in locations including but not limited to the roof, pillars, center console, sunroof, etc. of the vehicle. Other layouts of distributed microphone arrays may also be used to implement the present disclosure, and will not be elaborated on here.

[0042] In step S102, the sound variable information of each area is determined according to the sound information.

[0043] For example, the sound variable information of each area may be the difference between the sound information of the current collection cycle and the sound information of the previous collection cycle. In this case, the sound variable information may represent the change of the sound of the area itself in the current environment in the time dimension.

[0044] In step S103, sound quality impairment scenes are identified based on the sound variable information of each area.

[0045] In step S104, operating parameters of the speaker system are adjusted according to the result of scene recognition.

[0046] For example, the sound change information of the target space can be obtained according to the sound variable information of each area, and the sound quality damage scene corresponding to the current sound change information can be simply and quickly determined according to the predetermined correspondence between the sound change information of the target space and the sound quality damage scene. Among them, the correspondence between the sound change information of the target space and the sound quality damage scene can be preset by the test results, and the correspondence can be represented by a mapping table or the like. In this way, the listening effect of the user in the target space can be ensured. For example, in the case of obtaining the sound change information of the target space, it can also be determined whether the sound quality in the target space is impaired according to the sound change information, that is, whether the sound quality damage condition is met; and when it is determined that the sound quality is impaired, that is, the sound quality damage condition is met, the sound quality damage scene corresponding to the current sound change information is determined according to the predetermined correspondence between the sound change information of the target space and the sound quality damage scene. For example, when the sound change information is greater than the sound change threshold, it can be determined that the sound quality damage condition is met. In this way, the listening effect of the user in the target space can be ensured, unnecessary calibration of the sound quality can be avoided, and the operating resources of the system can be saved.

[0047] According to the sound variable information of each area, the sound quality damage scenario that adapts to the environmental changes in the target space can be identified, and then the operating parameters of the speaker system can be controlled to reduce the impact of environmental changes on the sound quality and ensure the listening effect of users in the target space. Among them, the operating parameters of the speaker system may include one or more of the minimum phase filter coefficient, all-pass filter coefficient, comb filter coefficient and gain filter coefficient of the speaker system, so that calibration of multiple dimensions of sound quality can be achieved to ensure the listening effect of users in the target space.

[0048] Through the above technical solution, during the audio playback process, first obtain the sound information of multiple areas in the target space within the current acquisition cycle; then determine the sound variable information of each area based on the sound information; then identify the sound quality damage scene based on the sound variable information of each area, and adjust the operating parameters of the speaker system based on the results of the scene recognition. In this way, the system's ability to perceive the environment can be enhanced through multi-area sound acquisition, and then accurately realize real-time monitoring of the sound change state in the target space. According to the sound variable information of each area, the sound quality damage scene that is adapted to the environmental changes in the target space can be identified, and then the sound quality that meets the environmental changes in the target space can be adjusted to reduce the impact of environmental changes on the sound quality, ensure the listening effect of users in the target space, and meet the user's high pursuit of sound quality.

[0049] Figure 4 FIG. 1 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure. Figure 4 As shown, step S102 may include steps S1021 to S1023.

[0050] In step S1021, the sound information of each area is separated and extracted to obtain the target separation information of the area.

[0051] The target separation information at least includes sound source information and / or noise information.

[0052] For example, if the sound information of area a is obtained, the sound information of area a can be separated and extracted to obtain the sound source information and / or noise information of area a; if the sound information of area b is obtained, the sound information of area b can be separated and extracted to obtain the sound source information and / or noise information of area b. When the speaker system plays the original audio, the sound information collected by the microphone may include the sound source information provided by the original audio and the noise information caused by the environment of the target space. By separating and extracting the sound information, a better foundation can be provided for subsequent processing, so that the sound source information and noise information can be processed more specifically in the subsequent process, thereby improving the reliability of sound quality calibration.

[0053] In one embodiment, when the sound variable information includes the sound source state variable and the corresponding target separation information includes the sound source information, the sound information of each area can be separated and extracted in the following manner to obtain the target separation information of the area:

[0054] According to the original audio played in the target space, the sound information of each area is separated and extracted to obtain the sound source information of the area.

[0055] Among them, the sound source information of the area can be obtained based on the method of separating and extracting sound information according to the original audio in the relevant technology, which will not be elaborated here.

[0056] In another embodiment, when the sound variable information includes the noise state variable and the corresponding target separation information includes the noise information, the sound information of each region may be separated and extracted in the following manner to obtain the target separation information of the region:

[0057] According to the original audio played in the target space, the sound information of each area is separated and extracted to obtain the sound source information of the area; according to the sound information and sound source information of the area, the noise information of the area is obtained.

[0058] For example, the sound information of each area I n , sound source information A n and noise information N n , with the following relationship: I n =A n + N n Therefore, when the sound source information of the area is obtained by separating and extracting the sound information according to the original audio in the related art, the noise information of the area can be determined based on the difference between the sound information and the sound source information of the area.

[0059] In step S1022, corresponding spectrum information is determined according to the target separation information of the area.

[0060] For example, if the target separation information of the area includes sound source information, the sound source information of the area can be Fourier transformed to obtain the sound source spectrum information of the area. If the target separation information of the area includes noise information, the noise information of the area can be Fourier transformed to obtain the noise spectrum information of the area. Among them, the width of the time window when the noise information is Fourier transformed is greater than the width of the time window when the sound source information is Fourier transformed. In this way, the influence of non-steady-state noise in the target space can be weakened. The non-steady-state noise can include one or more of the conversation sound in the car, the short impact sound, and the device prompt sound.

[0061] In step S1023, the sound variable information of each area is determined according to the frequency spectrum information corresponding to each area.

[0062] The sound variable information at least includes a sound source state variable and / or a noise state variable.

[0063] For example, the target space includes area a and area b, and the corresponding frequency spectrum information can be determined according to the target separation information of area a and area b, and the sound variable information of area a and the sound variable information of area b can be determined.

[0064] In one embodiment, when the sound variable information includes the sound source state variable and the corresponding target separation information includes the sound source information, the sound variable information of each region is determined according to the spectrum information corresponding to each region, that is, the sound source state variable of each region is determined according to the sound source spectrum information of each region. The confirmation of the sound source state variable of each region can be achieved in the following manner:

[0065] In each frequency band, the time variables of the sound source spectrum information of each area in the current acquisition cycle and the previous acquisition cycle are determined; the time variables of each area are compared with those of other areas to obtain the sound source state variables of the area in each frequency band.

[0066] For example, the frequency band can be pre-divided. For example, the full audio frequency band can be divided according to an octave or 1 / 3 octave relationship to obtain multiple frequency bands. For example, according to the octave division, the first frequency band can be (31.5Hz~63Hz), the second frequency band can be (63Hz~125Hz), the third frequency band can be (125Hz~250Hz), and so on, until the maximum frequency audible to the human ear is 20kHz.

[0067] Assuming that the target space includes area a, area b and area c, the sound source spectrum information of area a is determined separately. , b area sound source spectrum information and the sound source spectrum information in the c area In this case, the time variables of the sound source spectrum information of area a in the current acquisition cycle and the previous acquisition cycle, the time variables of the sound source spectrum information of area b in the current acquisition cycle and the previous acquisition cycle, and the time variables of the sound source spectrum information of area c in the current acquisition cycle and the previous acquisition cycle can be determined in different frequency bands. Taking area a as an example, the time variables of area a can be compared with the time variables of areas b and c in different frequency bands to obtain the sound source state variables of area a. For example, in the third frequency band, the sound source state variables of area a can be: compared with the sound source spectrum information of area b and the sound source spectrum information in the c area , the sound source spectrum information of area a The local attenuation in the third frequency band exceeds 3dB.

[0068] As the original audio is played, the sound source information will continue to change. Therefore, by comparing the sound source state variables of different area contents, it is possible to more accurately reflect the changes in the sound source information in the target space caused by external influences, and avoid the sound source state variables being affected by changes in the original audio playback content. In other words, the sound source state variables determined in this way can characterize the changes in the sound source of this area relative to other areas in the current environment, and by integrating information in the two dimensions of time and space, the reliability of the determined sound source state variables can be improved.

[0069] In another embodiment, when the sound variable information includes noise state variables and the corresponding target separation information includes noise information, the sound variable information of each region is determined according to the spectrum information corresponding to each region, that is, the noise state variable of each region is determined according to the noise spectrum information of each region. The confirmation of the noise state variable of each region can be achieved in the following manner:

[0070] In each frequency band, the time variables of the noise spectrum information of each area in the current acquisition cycle and the previous acquisition cycle are determined; the time variables of each area are compared with those of other areas to obtain the noise state variables of the area in each frequency band.

[0071] In this way, the determined noise state variable can characterize the change of the noise in the area relative to other areas in the current environment. By integrating the information of the two dimensions of time and space, the reliability of the determined noise state variable is improved to avoid the noise state variable being affected by the change of the playback content of the original audio. Among them, the noise state variable of each area is determined according to the noise spectrum information of each area, which is similar to the specific implementation method of determining the sound source state variable of each area according to the sound source spectrum information of each area given in the previous text, and will not be repeated here.

[0072] In the present disclosure, the sound information of multiple areas in the target space is obtained in the current collection cycle. Due to the difference in the setting position of the sound collection devices, i.e., microphones in different areas, the time to obtain the same sound information may be delayed to varying degrees. Therefore, in order to ensure the consistency and coherence of the sound information in different areas and improve the reliability of the subsequent processing process, the sound information may be time-aligned before the corresponding spectrum information is determined according to the target separation information of the area.

[0073] In one embodiment, the target separation information includes sound source information, and the sound source information may be time aligned in the following manner:

[0074] By matching the content of the sound source information of each area, the time correction amount of each area is determined; according to the time correction amount, the sound source information of each area is time-aligned to determine the sound source spectrum information according to the aligned sound source information.

[0075] For example, the correlation between the sound source information of each area is high, so the time correction amount of each area can be determined by content matching of the sound source information of each area. Among them, content matching can include phase matching, waveform matching, etc. Specifically, the characteristic points of the waveform of the sound source information of each area can be determined, such as peaks and troughs. These characteristic points should appear at the same time points on different audio tracks. Therefore, the time correction amount of each area can be determined based on the characteristic points of the waveform of the sound source information of each area. According to the time correction amount, the sound source information of each area is time-aligned. In this way, the consistency and coherence of the sound source information of different areas can be ensured, and different degrees of delay in the sound source information of different areas can be avoided, thereby improving the reliability of subsequent processing.

[0076] In another embodiment, the target classification information may further include noise information, and the noise information may be time aligned in the following manner:

[0077] The noise information of each region is time-aligned according to the time correction amount, so as to determine the noise spectrum information according to the aligned noise information.

[0078] In this way, different degrees of delay in noise information in different areas can be avoided, and the reliability of subsequent processing can be improved.

[0079] Figure 5 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure. Figure 5 , the process of determining the sound variable information in the sound quality calibration method provided by the present disclosure can be more clearly understood. Figure 5 As shown, step S102 may include steps S201 to S211.

[0080] In step S201, the sound information of each area is separated and extracted according to the original audio played in the target space to obtain the sound source information of the area.

[0081] In step S202, the time correction amount of each area is determined by matching the content of the sound source information of each area.

[0082] In step S203, the sound source information of each area is time-aligned according to the time correction amount.

[0083] In step S204, Fourier transform is performed on the sound source information of the area to obtain the sound source spectrum information of the area.

[0084] In step S205, in each frequency band, the time variable of the sound source spectrum information of each region in the current collection cycle and the previous collection cycle is determined.

[0085] In step S206, the time variables of each region are compared with those of other regions to obtain the sound source state variables of the region in each frequency band.

[0086] In step S207, noise information of the area is obtained according to the sound information and sound source information of the area.

[0087] In step S208, the noise information of each region is time-aligned according to the time correction amount.

[0088] In step S209, Fourier transform is performed on the noise information of the region to obtain noise spectrum information of the region.

[0089] In step S210, in each frequency band, the time variable of the noise spectrum information of each region in the current acquisition cycle and the previous acquisition cycle is determined.

[0090] In step S211, the time variables of each region are compared with those of other regions to obtain the noise state variables of the region in each frequency band.

[0091] It should be noted that the specific implementation of the above steps S201 to S211 has been described in detail above, and the repeated contents will not be repeated here.

[0092] In an optional embodiment, in step S103, sound quality impairment scenarios are identified based on the sound variable information of each area, which may include: in response to determining that the sound quality impairment condition is met, sound quality impairment scenarios are identified based on the sound variable information of each area.

[0093] In one embodiment, the sound quality impairment condition may be determined by:

[0094] If the sound variable information of the areas exceeding the target number is greater than the corresponding variable threshold, it is determined that the sound quality damage condition is met.

[0095] For example, the target number can be preset based on actual needs, for example, it can be set to 1 / 2 of the total number of areas in the target space. The variable threshold corresponding to the sound variable information of each area can be preset based on actual needs, for example, it can be set to 4dB. If the sound variable information includes a sound source state variable, it can be determined whether the sound source state variable of each area is greater than the corresponding sound source variable threshold; if the sound variable information includes a noise state variable, it can be determined whether the noise state variable of each area is greater than the corresponding noise variable threshold. If the sound variable information of areas exceeding the target number is greater than the corresponding variable threshold, it can be determined that the sound in the target space is affected by the outside world and the amplitude of the change is large, and the sound quality needs to be adjusted to reduce the impact of environmental changes on the sound quality. At this time, it can be determined that the sound quality damage condition is met. In this way, by analyzing and comparing the sound variable information of each area separately, it can be more clearly understood whether the changes in each area affected by the outside world are large, so as to accurately determine whether the sound quality needs to be adjusted.

[0096] In yet another embodiment, the sound quality impairment condition may be determined by:

[0097] According to the sound variable information of each area, the sound fusion variable of the target space is determined, and the sound fusion variable includes the sound source fusion variable and / or the noise fusion variable; if the sound fusion variable is greater than the corresponding fusion variable threshold, it is determined that the sound quality damage condition is met.

[0098] For example, if the sound fusion variable includes a sound source fusion variable, the sound source variable information of each area can be weighted summed or averaged to determine the sound source fusion variable; if the sound fusion variable includes a noise fusion variable, the noise variable information of each area can be weighted summed or averaged to determine the noise fusion variable. If the sound source fusion variable is greater than the corresponding sound source fusion variable threshold, it can be determined that the sound source in the target space is affected by the outside world and the amplitude of the change is large, and the sound quality needs to be adjusted; if the noise fusion variable is greater than the corresponding noise fusion variable threshold, it can be determined that the noise in the target space is affected by the outside world and the amplitude of the change is large, and the sound quality also needs to be adjusted. If the sound fusion variable is greater than the corresponding fusion variable threshold, it can be determined that the sound in the target space is affected by the outside world and the amplitude of the change is large, and the sound quality needs to be adjusted to reduce the impact of environmental changes on the sound quality, and it can be determined that the sound quality damage condition is met. In this way, by comparing the sound fusion variable and the corresponding fusion variable threshold, it can be more comprehensively determined whether the sound in the entire target space is affected by the outside world and the change is large, and then more accurately determine whether the sound quality needs to be adjusted.

[0099] In an optional embodiment, when the sound variable information includes a sound source state variable, in step S103, the sound quality impairment scene identification is performed according to the sound variable information of each area, which may include:

[0100] The sound source change information of the target space is generated according to each sound source state variable and the area and frequency band corresponding to the sound source state variable; the first sound source damage scene of the target space is determined according to the sound source change information and the door and window opening and closing status of the target space.

[0101] For example, the sound source change information The sound source state variables of each region in each frequency band can be included in the target space. Taking the target space including region a, region b and region c as an example, the determined sound source change information The sound source state variables of region a in each frequency band, region b in each frequency band, and region c in each frequency band may be included. It can comprehensively reflect the overall changes in the sound source state in the target space.

[0102] In one embodiment, the first sound source damage scene of the target space may be determined according to the sound source change information and the door and window opening and closing states of the target space in the following manner:

[0103] According to the predetermined correspondence between the door and window opening and closing states, the sound source change information and the first sound source damage scene, the first sound source damage scene corresponding to the current door and window opening and closing states and the current sound source change information.

[0104] In one embodiment, the first sound source damage scene of the target space may be determined according to the sound source change information and the door and window opening and closing states of the target space in the following manner:

[0105] Obtain the door and window opening and closing status, which includes the door and window position and opening degree; determine the reference sound source change information corresponding to the current door and window opening and closing status based on the predetermined correspondence between the door and window opening and closing status and the sound source change information; if the similarity between the current sound source change information and the reference sound source change information is greater than a similarity threshold, generate a first sound source damage scenario for characterizing the current door and window opening and closing status.

[0106] Among them, the door and window opening and closing status affects the sound environment of the target space. Generally speaking, opening the doors and windows will increase the noise level of the target space, which is particularly obvious in vehicles. Therefore, the sound source damage scenario can be determined by combining the door and window opening and closing status and the current sound source change information.

[0107] For example, the door and window opening and closing status can be collected by sensors pre-set on the doors and windows, and the door and window opening and closing status can be obtained through the CAN bus. Taking the target space as the interior space of the car cabin as an example, it is possible to obtain whether each door, vehicle side window and vehicle sunroof is open and its opening degree, wherein the opening degree can be fed back in percentage, and the door and window opening and closing status can include the sunroof being open by 10%. The correspondence between the door and window opening and closing status and the sound source change information can be preset through test results, and the correspondence can be expressed, for example, by a function, a mapping table, etc. By searching for the correspondence, the reference sound source change information corresponding to the current door and window opening and closing status can be determined.

[0108] The similarity threshold can be pre-set based on actual needs. If the similarity between the current sound source change information and the reference sound source change information is greater than the similarity threshold, it can be determined that the current sound source change state of the target space is consistent with the pre-calibrated possible first sound source damage scene, that is, the availability of the relevant information of the pre-calibrated first sound source damage scene is relatively high. At this time, the first sound source damage scene representing the current door and window opening and closing state is actually a pre-calibrated scene.

[0109] The change of the door and window opening and closing state has a significant impact on the sound balance of the sound source in the target space. Therefore, according to the first sound source damage scenario, the minimum phase filter coefficient and the all-pass filter coefficient of the speaker system can be adjusted according to the current door and window opening and closing state to calibrate the sound balance of the sound source in the target space, reduce the impact of the door and window opening and closing on the sound quality, and enable users in the target space to obtain a stable and balanced listening effect close to that of a closed target space. Correspondingly, in step S104, adjusting the operating parameters of the speaker system according to the result of scene recognition may include:

[0110] If the result of scene recognition is a first sound source damage scene, the minimum phase filter coefficient and the all-pass filter coefficient corresponding to the current first sound source damage scene are determined according to the predetermined correspondence between the first sound source damage scene and the minimum phase filter coefficient and the all-pass filter coefficient; based on the determined minimum phase filter coefficient and the all-pass filter coefficient, the speaker system is controlled to adjust the frequency response and delay parameters of the speaker system.

[0111] For example, as described above, the information related to the pre-calibrated first sound source damage scenario is highly available, so the minimum phase filter coefficient and the all-pass filter coefficient corresponding to the current first sound source damage scenario can be further determined by searching for the correspondence between the pre-determined first sound source damage scenario and the minimum phase filter coefficient and the all-pass filter coefficient, and then the minimum phase filter coefficient and the all-pass filter coefficient of the speaker system can be adjusted to adjust the frequency response and delay parameters of the speaker system and improve the sound equalization effect in the target space. Among them, the correspondence between the first sound source damage scenario and the minimum phase filter coefficient and the all-pass filter coefficient can be preset through test results, and the correspondence can be represented, for example, by a function, a mapping table, etc.

[0112] In one embodiment, when the sound variable information includes the sound source state variable, in step S103, the sound quality impairment scene identification is performed according to the sound variable information of each area, and the following may also be included:

[0113] If the similarity between the current sound source change information and the reference sound source change information is not greater than the similarity threshold, the personnel status information in the target space is obtained, and the personnel status information includes the personnel position and the number of personnel; and a second sound source damage scenario is generated to characterize the current personnel status.

[0114] For example, if the similarity between the current sound source change information and the reference sound source change information is not greater than the similarity threshold, it can be determined that the current sound source change state of the target space is inconsistent with the pre-calibrated possible first sound source damage scene, that is, the availability of the pre-calibrated first sound source damage scene related information is low. Although the impact of personnel changes in the target space on the sound environment of the target space is lower than the opening and closing state of doors and windows, it still has a certain impact. At this time, a second sound source damage scene can be generated to characterize the current status of the personnel, and then the sound quality can be adjusted in combination with the second sound source damage scene. To ensure the reliability of the sound quality adjustment as much as possible. Among them, the personnel status information can be collected by cameras, infrared sensors and other devices, and the collected personnel status information can be obtained through the CAN bus.

[0115] The change of personnel status information has a more obvious impact on the spatial sense of the sound source in the target space. Therefore, according to the second sound source damage scenario used to characterize the current personnel status, the comb filter coefficients of the speaker system can be adjusted according to the current personnel status to calibrate the spatial sense of the sound source in the target space, reduce the impact of personnel changes on the sound quality, and enable users in the target space to obtain a stable and balanced listening effect close to that of a closed target space.

[0116] In another embodiment, when the sound variable information includes the sound source state variable, in step S103, the sound quality impairment scene identification is performed according to the sound variable information of each area, and the following may also be included:

[0117] If the similarity between the current sound source change information and the reference sound source change information is not greater than the similarity threshold, then the reference sound source damage scene corresponding to the current sound source change information is determined based on the correspondence between the predetermined reference sound source damage scene and the sound source change information, and the determined reference sound source damage scene is determined as the second sound source damage scene.

[0118] For example, the correspondence between the reference sound source damage scene and the sound source change information can be preset through test results, and the correspondence can be represented, for example, by a function, a mapping table, etc. By searching for the correspondence, the reference sound source damage scene corresponding to the current sound source change information can be determined and determined as the second sound source damage scene, wherein the second sound source damage scene is a standard scene pre-calibrated, which can represent the equalized scene information associated with the spatial sense of the sound source corresponding to the current sound source change information. Therefore, according to the second sound source damage scene, the comb filter coefficients of the speaker system can be adjusted to calibrate the spatial sense of the sound source in the target space.

[0119] In yet another embodiment, when the sound variable information includes a sound source state variable, in step S103, the sound quality impairment scene identification is performed according to the sound variable information of each area, which may include:

[0120] According to the sound source change information and the personnel status information of the target space, the second sound source damage scenario of the target space is determined.

[0121] For example, according to the correspondence between predetermined sound source change information, occupant status information of the target space and the second sound source damage scene, the second sound source damage scene corresponding to the current sound source change information and the current occupant status information of the target space may be generated.

[0122] Correspondingly, in step S104, adjusting the operating parameters of the speaker system according to the result of scene recognition may include:

[0123] If the result of scene recognition is a second sound source damage scene, the comb filter coefficients corresponding to the current second sound source damage scene are determined based on the predetermined correspondence between the second sound source damage scene and the comb filter coefficients; and the speaker system is controlled based on the determined comb filter coefficients to adjust the reverberation parameters of the speaker system.

[0124] For example, the correspondence between the second sound source impairment scenario and the comb filter coefficient can be preset through test results, and the correspondence can be represented by a function, a mapping table, etc. By searching the correspondence, the comb filter coefficient corresponding to the current second sound source impairment scenario can be determined, and then the comb filter coefficient of the speaker system can be adjusted to adjust the reverberation parameters of the speaker system and improve the spatial sense of the sound source in the target space.

[0125] Figure 6 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure. Figure 6 , it is possible to more clearly understand the process of determining the sound variable information in the sound quality calibration method provided by the present disclosure when the sound variable information includes the sound source state variable. Figure 6 As shown, step S103 may include steps S301 to S311.

[0126] In step S301, it is determined whether the sound quality impairment condition is met. If yes, step S302 is executed; if not, step S101 is executed.

[0127] In step S302, sound source change information of the target space is generated according to each sound source state variable and the region and frequency band corresponding to the sound source state variable.

[0128] In step S303, the door and window opening and closing states are obtained.

[0129] Among them, the opening and closing status includes the position and opening degree of doors and windows.

[0130] In step S304, reference sound source change information corresponding to the current door and window opening and closing state is determined according to the predetermined correspondence between the door and window opening and closing state and the sound source change information.

[0131] In step S305, it is determined whether the similarity between the current sound source change information and the reference sound source change information is greater than a similarity threshold. If yes, step S306 is executed; if no, step S309 is executed.

[0132] In step S306, a first sound source damage scene is generated for representing the current door and window opening and closing state.

[0133] In step S307, the minimum phase filter coefficient and the all-pass filter coefficient corresponding to the current first sound source damage scenario are determined according to the predetermined correspondence between the first sound source damage scenario and the minimum phase filter coefficient and the all-pass filter coefficient.

[0134] In step S308, the speaker system is controlled according to the determined minimum phase filter coefficient and all-pass filter coefficient to adjust the frequency response and delay parameters of the speaker system.

[0135] In step S309, the status information of the personnel in the target space is obtained, and a second sound source damage scene for representing the current status of the personnel is generated.

[0136] Among them, the personnel status information includes the personnel location and the number of personnel.

[0137] In step S310, based on the predetermined correspondence between the second sound source impairment scenario and the comb filter coefficients, the comb filter coefficients corresponding to the current second sound source impairment scenario are determined.

[0138] In step S311, the speaker system is controlled according to the determined comb filter coefficients to adjust the reverberation parameters of the speaker system.

[0139] In this way, the sound quality impairment scenario can be accurately identified based on the sound source variable information to achieve accurate adjustment of the operating parameters of the speaker system. In addition, the specific implementation of the above steps S301 to S311 has been described in detail above, and the repeated content will not be repeated here.

[0140] In an optional embodiment, when the sound variable information includes a sound source state variable, in step S103, the sound quality impairment scene identification is performed according to the sound variable information of each area, which may include:

[0141] According to each noise state variable and the area and frequency band corresponding to the noise state variable, noise change information of the target space is generated; according to the noise change information, the noise interference scene of the target space is determined.

[0142] For example, noise variation information The noise state variables of each region in each frequency band can be included in the target space. Taking the target space including region a, region b and region c as an example, the noise change information determined is The noise state variables of region a in each frequency band, the noise state variables of region b in each frequency band, and the noise state variables of region c in each frequency band may be included. It can comprehensively reflect the overall noise state changes in the target space.

[0143] In one embodiment, the noise interference scene of the target space may be determined according to the noise change information in the following manner:

[0144] According to the predetermined correspondence relationship between the noise change information and the noise interference scene, the noise interference scene corresponding to the current noise change information is determined.

[0145] The noise interference scenario is used to characterize the noise situation in the target space, and the noise situation in the target space includes the noise level, noise frequency band, and noise distribution of the target space. The correspondence between the noise change information and the noise interference scenario can be preset through test results, and the correspondence can be represented by a function, a mapping table, etc. By searching the correspondence, the noise interference scenario corresponding to the current noise change information can be determined.

[0146] Correspondingly, in step S104, adjusting the operating parameters of the speaker system according to the result of scene recognition may include:

[0147] If the result of scene recognition is a noise interference scene, a gain filter coefficient is generated according to the noise situation in the target space represented by the noise interference scene; and the speaker system is controlled according to the gain filter coefficient to adjust the gain parameters of the speaker system.

[0148] Among them, the change of noise conditions has a more obvious impact on the clarity of the sound source in the target space. The gain filter coefficient can be generated according to the noise conditions in the target space represented by the noise interference scene to adjust the gain filter coefficient of the speaker system, and then calibrate the clarity of the sound source in the target space, reduce the impact of noise on the sound quality, and enable users in the target space to obtain a clear listening effect close to that of a closed target space. Among them, the generation of the gain filter coefficient can be achieved based on the method of determining the gain filter coefficient according to the noise level, noise frequency band and noise distribution in the relevant technology, which will not be repeated here.

[0149] Figure 7 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure. Figure 7 , it is possible to more clearly understand the process of determining the sound variable information in the sound quality calibration method provided by the present disclosure when the sound variable information includes the noise state variable. Figure 7 As shown, step S103 may include step S301, step S312 and step S313; step S104 may include step S314 and step S315.

[0150] In step S301, it is determined whether the sound quality impairment condition is met. If yes, step S312 is executed; if not, step S101 is executed.

[0151] In step S312, noise change information of the target space is generated according to each noise state variable and the region and frequency band corresponding to the noise state variable.

[0152] In step S313, the noise interference scene corresponding to the current noise change information is determined according to the predetermined correspondence relationship between the noise change information and the noise interference scene.

[0153] In step S314, a gain filter coefficient is generated according to the noise situation in the target space represented by the noise interference scene.

[0154] In step S315, the speaker system is controlled according to the gain filter coefficient to adjust the gain parameter of the speaker system.

[0155] In this way, the sound quality impairment scenario can be accurately identified based on the noise variable information to achieve accurate adjustment of the operating parameters of the speaker system. In addition, the specific implementation of the above steps S312 to S315 has been described in detail above, and the repeated content will not be repeated here.

[0156] Figure 8 is a flow chart of a sound quality calibration method provided by an exemplary embodiment of the present disclosure. Figure 8 The steps shown in the above are combined Figure 6 and Figure 7 The description is consistent and will not be repeated here. Fig. 9 1 is a schematic diagram of a sound quality calibration system provided by an exemplary embodiment of the present disclosure when the target space is the interior space of a car cabin. The system includes a distributed microphone array, a DSP chip, an MCU (Microcontroller Unit), a SoC (System on Chip), and a speaker system, wherein the DSP chip can be used to implement Figure 8 In the solution shown, the MCU can be used to obtain data on the CAN bus, such as the door and window opening and closing status and personnel status information, and transmit it to the DSP chip via the communication protocol, and the SoC can be used to transmit the original audio to the DSP chip.

[0157] pass Figure 8 The solution shown can calibrate the sound quality from multiple dimensions, so that people in the target space can obtain a stable, balanced and clear listening effect close to that of a closed target space, satisfying users' high pursuit of sound quality.

[0158] like Fig.10 As shown, Figure 8 Steps S304 to S306 in the above method can be replaced by step S316, which is to obtain the first sound source damage scene corresponding to the current door and window opening state and the current sound source change information according to the predetermined correspondence between the door and window opening state, the sound source change information and the first sound source damage scene. Step S317 can be added after step S302, which is to obtain the personnel status information. Figure 8Step S309 in the above method can be replaced by step S318, which is to convert the second sound source damage scene corresponding to the current sound source change information and the current target space personnel status information according to the predetermined correspondence between the sound source change information, the target space personnel status information and the second sound source damage scene. Fig.10 The solution shown can also calibrate the sound quality from multiple dimensions, so that people in the target space can obtain a stable, balanced and clear listening effect close to that of a closed target space, satisfying users' high pursuit of sound quality.

[0159] Based on the same inventive concept, the present disclosure also provides a sound quality calibration device. Fig.11 4 is a block diagram of a sound quality calibration device 400 provided by an exemplary embodiment of the present disclosure. Fig.11 , the sound quality calibration device 400 may include:

[0160] The acquisition module 401 is used to obtain the sound information of multiple areas in the target space within the current acquisition cycle; the determination module 402 is used to determine the sound variable information of each area based on the sound information; the identification module 403 is used to identify the sound quality damage scene based on the sound variable information of each area; the control module 404 is used to adjust the operating parameters of the speaker system according to the result of scene identification.

[0161] Through the above technical solution, during the audio playback process, first obtain the sound information of multiple areas in the target space within the current acquisition cycle; then determine the sound variable information of each area based on the sound information; then identify the sound quality damage scene based on the sound variable information of each area, and adjust the operating parameters of the speaker system based on the results of the scene recognition. In this way, the system's ability to perceive the environment can be enhanced through multi-area sound acquisition, and then accurately realize real-time monitoring of the sound change state in the target space; based on the sound variable information of each area, it can identify the sound quality damage scene that is compatible with the environmental changes in the target space, and then adjust the sound quality that meets the environmental changes in the target space, so as to reduce the impact of environmental changes on the sound quality, ensure the listening effect of users in the target space, and meet the users' high pursuit of sound quality.

[0162] Optionally, the determining module 402 includes:

[0163] A separation submodule is used to separate and extract the sound information of each area to obtain the target separation information of the area, wherein the target separation information at least includes sound source information and / or noise information; a first determination submodule is used to determine the corresponding frequency spectrum information according to the target separation information of the area; a second determination submodule is used to determine the sound variable information of each area according to the frequency spectrum information corresponding to each area, wherein the sound variable information at least includes sound source state variables and / or noise state variables.

[0164] Optionally, the sound variable information includes the sound source state variable, and the target separation information includes the sound source information; a separation submodule is used to separate and extract the sound information of each area according to the original audio played in the target space to obtain the sound source information of the area; a second determination submodule is used to determine the sound source state variable of each area according to the sound source spectrum information of each area, wherein the sound source spectrum information of each area is determined based on the sound source information of the area.

[0165] Optionally, the second determining submodule is used to determine the sound source state variable of each area in the following manner:

[0166] In each frequency band, the time variables of the sound source spectrum information of each area in the current acquisition cycle and the previous acquisition cycle are determined; the time variables of each area are compared with those of other areas to obtain the sound source state variables of the area in each frequency band.

[0167] Optionally, the sound variable information includes the noise state variable, and the target separation information includes noise information; a separation submodule is used to separate and extract the sound information of each area according to the original audio played in the target space to obtain the sound source information of the area; based on the sound information and sound source information of the area, the noise information of the area is obtained; a second determination submodule is used to determine the noise state variable of each area according to the noise spectrum information of each area, wherein the noise spectrum information of each area is determined based on the noise information of the area.

[0168] Optionally, the second determination submodule is used to determine the noise state variable of each area in the following manner: in each frequency band, determine the time variable of the noise spectrum information of each area in the current acquisition cycle and the previous acquisition cycle; compare the time variables of each area with those of other areas to obtain the noise state variable of the area in each frequency band.

[0169] Optionally, the first determination submodule is used to determine corresponding spectrum information according to the target separation information of the area in the following manner:

[0170] Performing Fourier transform on the sound source information of the area to obtain the sound source spectrum information of the area; and / or performing Fourier transform on the noise information of the area to obtain the noise spectrum information of the area; wherein the width of the time window when performing Fourier transform on the noise information is greater than the width of the time window when performing Fourier transform on the sound source information.

[0171] Optionally, the target separation information includes sound source information, and the separation submodule is further used to determine the time correction amount of each area by matching the content of the sound source information of each area before determining the corresponding spectrum information according to the target separation information of the area; and according to the time correction amount, time-align the sound source information of each area to determine the sound source spectrum information based on the aligned sound source information.

[0172] Optionally, the target separation information also includes noise information, and the separation submodule is further used to time-align the noise information of each area according to the time correction amount before determining the corresponding spectrum information according to the target separation information of the area, so as to determine the noise spectrum information based on the aligned noise information.

[0173] Optionally, the identification module 403 includes:

[0174] The identification submodule is used to identify the sound quality damage scene according to the sound variable information of each area in response to determining that the sound quality damage condition is met.

[0175] Optionally, the sound variable information includes a sound source state variable and / or a noise state variable, and the first identification submodule is used to determine whether the sound quality impairment condition is met in the following manner:

[0176] If the sound variable information of the areas exceeding the target number is greater than the corresponding variable threshold, it is determined that the sound quality damage condition is met.

[0177] Optionally, the sound variable information includes a sound source state variable and / or a noise state variable, and an identification submodule is used to determine whether the sound quality impairment condition is met in the following manner:

[0178] According to the sound variable information of each area, the sound fusion variable of the target space is determined, and the sound fusion variable includes a sound source fusion variable and / or a noise fusion variable; if the sound fusion variable is greater than the corresponding fusion variable threshold, it is determined that the sound quality damage condition is met.

[0179] Optionally, the sound variable information includes a sound source state variable, and the identification submodule includes:

[0180] The first generating submodule is used to generate the sound source change information of the target space according to each of the sound source state variables and the area and frequency band corresponding to the sound source state variable; the third determining submodule is used to determine the first sound source damage scene of the target space according to the sound source change information and the opening and closing status of the doors and windows of the target space.

[0181] Optionally, the third determining submodule is used to determine the first sound source damage scene of the target space in the following manner:

[0182] The door and window opening and closing states are obtained, wherein the opening and closing states include the door and window positions and opening and closing degrees; reference sound source change information corresponding to the current door and window opening and closing states is determined based on a predetermined correspondence between the door and window opening and closing states and the sound source change information; if the similarity between the current sound source change information and the reference sound source change information is greater than a similarity threshold, a first sound source damage scenario is generated for characterizing the current door and window opening and closing states.

[0183] Optionally, the control module 404 includes:

[0184] The fourth determination submodule is used to determine the minimum phase filter coefficient and the all-pass filter coefficient corresponding to the current first sound source damage scene according to the predetermined correspondence between the first sound source damage scene and the minimum phase filter coefficient and the all-pass filter coefficient if the result of the scene recognition is the first sound source damage scene; the first control submodule is used to control the speaker system according to the determined minimum phase filter coefficient and the all-pass filter coefficient to adjust the frequency response and delay parameters of the speaker system.

[0185] Optionally, the identification submodule further includes:

[0186] The fifth determination submodule is used to obtain the personnel status information in the target space if the similarity between the current sound source change information and the reference sound source change information is not greater than the similarity threshold, and the personnel status information includes the personnel position and the number of personnel; and generate a second sound source damage scenario for characterizing the current personnel status.

[0187] Optionally, the identification submodule further includes:

[0188] The sixth determination submodule is used to determine the reference sound source damage scene corresponding to the current sound source change information based on the correspondence between the predetermined reference sound source damage scene and the sound source change information if the similarity between the current sound source change information and the reference sound source change information is not greater than the similarity threshold, and determine the determined reference sound source damage scene as the second sound source damage scene.

[0189] Optionally, the identification submodule further includes:

[0190] The seventh determination submodule is used to determine a second sound source damage scenario of the target space according to the sound source change information and the personnel status information of the target space.

[0191] Optionally, the control module 404 includes:

[0192] an eighth determination submodule, for determining, if the result of the scene recognition is the second sound source damage scene, the comb filter coefficients corresponding to the current second sound source damage scene according to the correspondence between the predetermined second sound source damage scene and the comb filter coefficients; and a second control submodule, for controlling the speaker system according to the determined comb filter coefficients to adjust the reverberation parameters of the speaker system.

[0193] Optionally, the sound variable information includes a noise state variable, and the identification submodule includes:

[0194] The second generating submodule is used to generate the noise change information of the target space according to each of the noise state variables and the area and frequency band corresponding to the noise state variable; the ninth determining submodule is used to determine the noise interference scene of the target space according to the noise change information.

[0195] Optionally, the ninth determining submodule is used to determine the noise interference scene in which the target space is located in the following manner:

[0196] According to the predetermined correspondence between the noise change information and the noise interference scene, the noise interference scene corresponding to the current noise change information is determined, wherein the noise interference scene is used to characterize the noise situation in the target space.

[0197] Optionally, the control module 404 includes:

[0198] a tenth determination submodule, for generating a gain filter coefficient according to the noise condition in the target space represented by the noise interference scene if the result of the scene recognition is the noise interference scene, wherein the noise condition in the target space includes the noise level, noise frequency band and noise distribution of the target space; and a third control submodule, for controlling the speaker system according to the gain filter coefficient to adjust the gain parameters of the speaker system.

[0199] Optionally, the acquisition module 401 is used to acquire sound information of multiple areas in the target space within the current acquisition cycle in the following manner: acquiring sound information of multiple areas in the target space within the current acquisition cycle through a distributed microphone array, wherein each area includes at least one microphone in the distributed microphone array.

[0200] Fig.12FIG. 7 is a block diagram of an electronic device 700 according to an exemplary embodiment. Fig.12 As shown, the electronic device 700 may include: a processor 701 , a memory 702 . The electronic device 700 may also include one or more of a multimedia component 703 , an input / output (I / O) interface 704 , and a communication component 705 .

[0201] The processor 701 is used to control the overall operation of the electronic device 700 to complete all or part of the steps in the above-mentioned sound quality calibration method. The memory 702 is used to store various types of data to support the operation of the electronic device 700. For example, these data may include instructions for any application or method used to operate on the electronic device 700, and application-related data, such as contact data, sent and received messages, pictures, audio, video, etc. The memory 702 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, referred to as EPROM), programmable read-only memory (Programmable Read-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic memory, flash memory, magnetic disk or optical disk. The multimedia component 703 may include a screen and an audio component. The screen may be, for example, a touch screen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may be further stored in the memory 702 or sent through the communication component 705. The audio component also includes at least one speaker for outputting audio signals. The I / O interface 704 provides an interface between the processor 701 and other interface modules, and the other interface modules may be keyboards, mice, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 705 is used for wired or wireless communication between the electronic device 700 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or a combination of one or more of them, is not limited here. Therefore, the corresponding communication component 705 may include: Wi-Fi module, Bluetooth module, NFC module, etc.

[0202] In an exemplary embodiment, the electronic device 700 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned sound quality calibration method.

[0203] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, and when the program instructions are executed by a processor, the steps of the above-mentioned sound quality calibration method are implemented. For example, the computer-readable storage medium can be the above-mentioned memory 702 including program instructions, and the above-mentioned program instructions can be executed by the processor 701 of the electronic device 700 to complete the above-mentioned sound quality calibration method.

[0204] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and the computer program has a code portion for executing the above-mentioned sound quality calibration method when executed by the programmable device.

[0205] The preferred embodiments of the present disclosure are described in detail above in conjunction with the accompanying drawings; however, the present disclosure is not limited to the specific details in the above embodiments. Within the technical concept of the present disclosure, a variety of simple modifications can be made to the technical solution of the present disclosure, and these simple modifications all fall within the protection scope of the present disclosure.

[0206] It should also be noted that the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, the present disclosure will not further describe various possible combinations.

[0207] In addition, various embodiments of the present disclosure may be arbitrarily combined, and as long as they do not violate the concept of the present disclosure, they should also be regarded as the contents disclosed by the present disclosure.

Claims

1. A sound quality calibration method, characterized in that: include: Acquire sound information of multiple areas in the target space within the current acquisition cycle; Determine the sound variable information of each area according to the sound information; According to the sound variable information of each area, the sound quality damage scene is identified; According to the result of scene recognition, the operating parameters of the speaker system are adjusted; In response to determining that the sound quality impairment condition is met, the sound quality impairment scene is identified according to the sound variable information of each area; The sound variable information includes noise state variables, and the sound quality impairment scene identification is performed according to the sound variable information of each area, including: Generate noise change information of the target space according to each of the noise state variables and the region and frequency band corresponding to the noise state variable; A noise interference scenario of the target space is determined according to the noise change information.

2. The method according to claim 1, characterized in that The step of determining the sound variable information of each area according to the sound information includes: Separate and extract the sound information of each area to obtain target separation information of the area, wherein the target separation information at least includes sound source information and / or noise information; Determine corresponding spectrum information according to target separation information of the area; The sound variable information of each area is determined according to the frequency spectrum information corresponding to each area, wherein the sound variable information at least includes a sound source state variable and / or a noise state variable.

3. The method according to claim 2, characterized in that The sound variable information includes the sound source state variable, and the target separation information includes the sound source information; The step of separating and extracting the sound information of each area to obtain target separation information of the area includes: Separating and extracting the sound information of each area according to the original audio played in the target space to obtain the sound source information of the area; The step of determining the sound variable information of each region according to the spectrum information corresponding to each region includes: The sound source state variable of each region is determined according to the sound source spectrum information of each region, wherein the sound source spectrum information of each region is determined based on the sound source information of the region.

4. The method according to claim 3, characterized in that The step of determining the sound source state variable of each area according to the sound source spectrum information of each area includes: In each frequency band, determine the time variable of the sound source spectrum information of each area in the current acquisition cycle and the previous acquisition cycle; By comparing the time variables of each area with those of other areas, the state variables of the sound source in each frequency band are obtained.

5. The method according to claim 2, characterized in that: The sound variable information includes the noise state variable, and the target separation information includes noise information; The step of separating and extracting the sound information of each area to obtain target separation information of the area includes: Separating and extracting the sound information of each area according to the original audio played in the target space to obtain the sound source information of the area; According to the sound information and sound source information of the area, the noise information of the area is obtained; The step of determining the sound variable information of each region according to the spectrum information corresponding to each region includes: The noise state variable of each region is determined according to the noise spectrum information of each region, wherein the noise spectrum information of each region is determined based on the noise information of the region.

6. The method according to claim 5, characterized in that The step of determining the noise state variable of each region according to the noise spectrum information of each region includes: In each frequency band, determine the time variable of the noise spectrum information of each area in the current acquisition cycle and the previous acquisition cycle; By comparing the time variables of each area with those of other areas, the noise state variables of the area in each frequency band are obtained.

7. The method according to claim 2, characterized in that The determining corresponding spectrum information according to the target separation information of the area includes: Performing Fourier transformation on the sound source information of the area to obtain the sound source spectrum information of the area; and / or performing Fourier transformation on the noise information of the area to obtain the noise spectrum information of the area; The width of the time window when Fourier transform is performed on the noise information is greater than the width of the time window when Fourier transform is performed on the sound source information.

8. The method according to claim 2, characterized in that: The target separation information includes sound source information. Before determining corresponding spectrum information according to the target separation information of the area, the method further includes: By matching the content of the sound source information of each area, the time correction amount of each area is determined; The sound source information of each area is time-aligned according to the time correction amount, so as to determine the sound source spectrum information according to the aligned sound source information.

9. The method according to claim 8, characterized in that The target separation information also includes noise information. Before determining corresponding spectrum information according to the target separation information of the area, the method further includes: The noise information of each region is time-aligned according to the time correction amount, so as to determine the noise spectrum information according to the aligned noise information.

10. The method according to claim 1, characterized in that The sound variable information includes a sound source state variable and / or a noise state variable, and the determining that the sound quality impairment condition is met includes: If the sound variable information of the areas exceeding the target number is greater than the corresponding variable threshold, it is determined that the sound quality damage condition is met.

11. The method according to claim 1, characterized in that: The sound variable information includes a sound source state variable and / or a noise state variable, and the determining that the sound quality impairment condition is met includes: Determine the sound fusion variable of the target space according to the sound variable information of each area, wherein the sound fusion variable includes a sound source fusion variable and / or a noise fusion variable; If the sound fusion variable is greater than the corresponding fusion variable threshold, it is determined that the sound quality damage condition is met.

12. The method according to claim 1, characterized in that The sound variable information includes a sound source state variable, and the sound quality impairment scene identification is performed according to the sound variable information of each area, including: Generating sound source change information of the target space according to each of the sound source state variables and the region and frequency band corresponding to the sound source state variable; A first sound source damage scene of the target space is determined according to the sound source change information and the door and window opening and closing states of the target space.

13. The method according to claim 12, characterized in that The determining, according to the sound source change information and the door and window opening and closing states of the target space, a first sound source damage scene of the target space includes: Acquire the door and window opening and closing status, wherein the door and window opening and closing status includes the door and window position and opening and closing degree; Determine reference sound source change information corresponding to the current door and window opening and closing state according to the predetermined correspondence between the door and window opening and closing state and the sound source change information; If the similarity between the current sound source change information and the reference sound source change information is greater than a similarity threshold, a first sound source damage scenario is generated for characterizing the current door and window opening and closing state.

14. The method according to claim 13, characterized in that The step of adjusting the operating parameters of the speaker system according to the result of the scene recognition includes: If the result of the scene recognition is the first sound source damage scene, determining the minimum phase filter coefficient and the all-pass filter coefficient corresponding to the current first sound source damage scene according to the predetermined correspondence between the first sound source damage scene and the minimum phase filter coefficient and the all-pass filter coefficient; The speaker system is controlled according to the determined minimum phase filter coefficient and the all-pass filter coefficient to adjust the frequency response and delay parameters of the speaker system.

15. The method according to claim 13, characterized in that The step of identifying the sound quality impairment scene according to the sound variable information of each area further includes: If the similarity between the current sound source change information and the reference sound source change information is not greater than the similarity threshold, obtaining the personnel status information in the target space, wherein the personnel status information includes the position and number of personnel; A second sound source impairment scenario is generated for representing the current status of the person.

16. The method according to claim 13, characterized in that The step of identifying the sound quality impairment scene according to the sound variable information of each area further includes: If the similarity between the current sound source change information and the reference sound source change information is not greater than the similarity threshold, then the reference sound source damage scene corresponding to the current sound source change information is determined based on the correspondence between the predetermined reference sound source damage scene and the sound source change information, and the determined reference sound source damage scene is determined as the second sound source damage scene.

17. The method according to claim 1, characterized in that The sound variable information includes a sound source state variable, and the sound quality impairment scene identification is performed according to the sound variable information of each area, including: Generating sound source change information of the target space according to each of the sound source state variables and the region and frequency band corresponding to the sound source state variable; A second sound source damage scenario of the target space is determined according to the sound source change information and the personnel status information of the target space.

18. The method according to any one of claims 15 to 17, characterized in that The step of adjusting the operating parameters of the speaker system according to the result of the scene recognition includes: If the result of the scene recognition is the second sound source damage scene, determining the comb filter coefficients corresponding to the current second sound source damage scene according to the predetermined correspondence between the second sound source damage scene and the comb filter coefficients; The speaker system is controlled according to the determined comb filter coefficients to adjust the reverberation parameters of the speaker system.

19. The method according to claim 1, characterized in that The step of determining the noise interference scene in which the target space is located according to the noise change information includes: According to the predetermined correspondence between the noise change information and the noise interference scene, the noise interference scene corresponding to the current noise change information is determined, wherein the noise interference scene is used to characterize the noise situation in the target space.

20. The method according to claim 19, characterized in that The step of adjusting the operating parameters of the speaker system according to the result of the scene recognition includes: If the result of the scene recognition is the noise interference scene, generating a gain filter coefficient according to the noise situation in the target space represented by the noise interference scene, wherein the noise situation in the target space includes the noise level, noise frequency band and noise distribution of the target space; The speaker system is controlled according to the gain filter coefficient to adjust a gain parameter of the speaker system.

21. The method according to claim 1, characterized in that The acquiring of sound information of multiple areas in the target space within the current acquisition cycle includes: The sound information of multiple areas in the target space in the current collection period is acquired through the distributed microphone array, wherein each area includes at least one microphone in the distributed microphone array.

22. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 1 to 21.

23. A vehicle, characterized in that: Includes speaker system, controller and multiple microphones; Wherein, the controller is used to implement the steps of the method described in any one of claims 1-21 when executed; at least one microphone is set in each area of ​​the vehicle.

24. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 21 are implemented.

25. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 21.

Citation Information

Patent Citations

  • Automobile-based random sound source automatic sound control device

    CN105632521A

  • Noise processing method, device and system

    CN111391771A

  • Apparatus, system and method of sound control

    CN113261310A

  • Sound playing method and device, earphone and storage medium

    CN115225997A

  • Noise-dependent gain method and device, vehicle-mounted system, electronic equipment and storage medium

    CN115862657A