Loudspeaker signal adjusting method and device, electronic equipment, storage medium and vehicle

By determining the speaker's transfer function and filtering coefficients and adjusting the speaker's output signal, the problem of car audio systems failing to produce different sounds in different seating areas was solved, improving the user experience and audio control.

CN118972759APending Publication Date: 2024-11-15CHONGQING CHANGAN AUTOMOBILE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411023904.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

Existing car audio systems cannot produce different sounds in different seating areas, failing to meet users' diverse sound needs and impacting driving safety and passenger experience.

Method used

By acquiring the audio signal input from the speaker and the signal received by the microphone, the transfer function and target filter coefficient are determined, and the speaker output signal is adjusted to achieve sound field zoning control, ensuring that the audio playback effect in different areas meets the user's needs.

Benefits of technology

It enables adjustment of speaker playback effects in different areas of the vehicle cabin, improving user experience and audio control while reducing sound interference.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118972759A_ABST
    Figure CN118972759A_ABST
Patent Text Reader

Abstract

The invention relates to a loudspeaker signal adjusting method and device, electronic equipment, a storage medium and a vehicle, and relates to the technical field of signal control. The method at least solves the technical problems that the effect of controlling the sound effect of a vehicle is poor and the use experience of a user is affected in the related technology, is applied to the vehicle, and is characterized in that a cabin of the vehicle comprises a first area and a second area. The second audio signal is received by a microphone in a cabin of the vehicle; based on the first audio signal and the second audio signal, a first transfer function is determined, and the first transfer function is used for indicating a corresponding transfer parameter between an audio signal output by a loudspeaker and an audio signal received by a microphone in the same area; and determining a target filter coefficient corresponding to the loudspeaker in the cabin of the vehicle based on the first transfer function, and adjusting an audio signal input by the loudspeaker in the cabin of the vehicle based on the target filter coefficient.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of signal control technology, and in particular to a speaker signal adjustment method, device, electronic device, storage medium and vehicle. Background Art

[0002] With the rapid development of vehicle technology, sound field control technology has become an important part of the smart cockpit, and users are paying more and more attention to the sound environment in the cockpit. Currently, the cockpit is filled with a variety of sounds, such as music, navigation voice, call sound, vehicle alarm sound, etc. Usually different passengers in the cockpit need to focus on different sounds. For example, the driver needs to focus on the navigation voice and vehicle alarm sound, and the passengers in the back seat may want to watch a movie or listen to music.

[0003] However, existing car audio systems cannot produce different sounds in different areas, and cannot focus on playing corresponding sounds in different seats, which cannot meet user needs. Whether it is to ensure driving safety or to avoid different sounds from disturbing other passengers, current car audio systems cannot achieve the desired effect. Therefore, the current control of vehicle sound effects is poor and affects the user experience. Summary of the invention

[0004] The present application provides a speaker signal adjustment method, device, electronic device, storage medium and vehicle to at least solve the technical problem in the related art that the control effect of the vehicle sound effect is poor and affects the user experience. The technical solution of the present application is as follows:

[0005] According to a first aspect of the present application, there is provided a speaker signal adjustment method, which is applied to a vehicle, wherein a cabin of the vehicle comprises a first area and a second area, wherein the first area and the second area are both provided with a speaker and a microphone, and the method comprises: obtaining a first audio signal input to a speaker in the first area, and a second audio signal received by a microphone in the cabin of the vehicle; determining a first transfer function based on the first audio signal and the second audio signal, the first transfer function being used to indicate a corresponding transfer parameter between an audio signal output by a speaker in the same area and an audio signal received by the microphone, the audio signal output by the speaker being an audio signal output after processing the input first audio signal; determining a target filter coefficient corresponding to the speaker in the cabin of the vehicle based on the first transfer function, and adjusting the audio signal input to the speaker in the cabin of the vehicle based on the target filter coefficient.

[0006] According to the above technical means, the present application can determine a first transfer function for indicating the corresponding transfer parameters between the audio signal output by the speaker in the same area and the audio signal received by the microphone by obtaining a first audio signal input to the speaker in the first area and a second audio signal received by the microphone in the vehicle's cabin; determine the target filter coefficient corresponding to the speaker in the vehicle's cabin based on the first transfer function, and adjust the audio signal input to the speaker in the vehicle's cabin based on the target filter coefficient. In this way, the speakers in different areas of the vehicle's cabin can be adjusted, the playback effects of the speakers in different areas can be adjusted, the effect of controlling the speakers in the vehicle can be improved, and the user experience can be enhanced.

[0007] In a possible implementation, determining a first transfer function based on a first audio signal and a second audio signal includes: performing Fourier transform processing on the first audio signal to obtain a first frequency domain signal, and performing Fourier transform processing on the second audio signal to obtain a second frequency domain signal; determining the first transfer function based on the first frequency domain signal, the second frequency domain signal, and a weight vector corresponding to the speaker.

[0008] According to the above technical means, the present application can obtain a first frequency domain signal by performing Fourier transform processing on the first audio signal, and obtain a second frequency domain signal by performing Fourier transform processing on the second audio signal. Thus, the first transfer function is determined based on the first frequency domain signal, the second frequency domain signal and the weight vector corresponding to the speaker. In this way, the frequency domain signal corresponding to the audio signal is obtained through Fourier transform processing, and the required first transfer function can be accurately determined, thereby improving the accuracy of the determined transfer function.

[0009] In a possible implementation, a first transfer function is determined based on a first frequency domain signal, a second frequency domain signal, and a weight vector corresponding to a speaker, including: determining a second transfer function based on a ratio of the second frequency domain signal to the first frequency domain signal, the second transfer function being used to indicate a transfer parameter corresponding to an audio signal input by a speaker and an audio signal received by a microphone in the same area; and determining a first transfer function based on the second transfer function and a weight vector corresponding to the speaker under the constraint of a target condition, the target condition being used to indicate that a difference between a product of the weight vector corresponding to the speaker and the first transfer function and the second transfer function is minimized.

[0010] According to the above technical means, the present application can first determine the second transfer function indicating the corresponding transfer parameters between the audio signal input by the speaker and the audio signal received by the microphone in the same area based on the ratio of the second frequency domain signal to the first frequency domain signal. Then, under the constraint of the target condition, the first transfer function is determined based on the second transfer function and the weight vector corresponding to the speaker. In this way, under the constraint of the target condition, the product between the weight vector corresponding to the speaker and the determined first transfer function and the difference between the second transfer function can be minimized. Thus, a more accurate first transfer function is determined.

[0011] In one possible implementation, under the constraints of target conditions, the first transfer function is determined based on the second transfer function and the weight vector corresponding to the speaker, including: under the constraints of the target conditions, determining the pseudo-inverse matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function; and determining the first transfer function based on the pseudo-inverse matrix and the second transfer function.

[0012] According to the above technical means, the present application can first determine the pseudo-inverse matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function, and then determine the first transfer function based on the pseudo-inverse matrix and the second transfer function. In this way, by processing the weight vector corresponding to the speaker through the pseudo-inverse function, the accuracy of the determined first transfer function can be improved.

[0013] In a possible implementation, the method further includes: iteratively training target filter coefficients corresponding to the speakers in the vehicle cabin based on audio signals input to the speakers in the first area and audio signals received by the microphone in the vehicle cabin to obtain target filter coefficients after iterative training.

[0014] According to the above-mentioned technical means, the present application can iteratively train the target filter coefficients corresponding to the speakers in the vehicle's cabin after determining the target filter coefficients corresponding to the speakers in the vehicle's cabin, thereby further improving the accuracy of the target filter coefficients corresponding to the speakers in the vehicle's cabin.

[0015] In one possible implementation, under the constraint of target conditions, the pseudo-inverse matrix of the weight vector corresponding to the speaker is determined based on a pseudo-inverse function, including: under the constraint of target conditions, when the number of iterative trainings for the target filter coefficients corresponding to the speakers in the cabin of the vehicle is less than or equal to the number of speakers in the first area, the product of the conjugate matrix of the weight vector corresponding to the speaker and the inverse matrix of the first matrix is ​​determined based on the pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, where the first matrix is ​​the product of the weight vector corresponding to the speaker and the conjugate matrix of the weight vector corresponding to the speaker; under the constraint of target conditions, when the number of iterative trainings for the target filter coefficients corresponding to the speakers in the cabin of the vehicle is greater than the number of speakers in the first area, the product of the inverse matrix of the second matrix and the conjugate matrix of the weight vector corresponding to the speaker is determined based on the pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, where the second matrix is ​​the product of the conjugate matrix of the weight vector corresponding to the speaker and the weight vector corresponding to the speaker.

[0016] According to the above technical means, the present application can determine the pseudo-inverse matrix of the weight vector corresponding to the speaker through different algorithms based on the relationship between the number of iterative trainings of the target filter coefficients corresponding to the speakers in the vehicle cabin and the number of speakers in the first area. Thus, in different situations, the first transfer function can be determined through a more accurate algorithm, which can improve the accuracy of the determined first transfer function.

[0017] In one possible implementation, the first transfer function includes: a first transfer function of a first area and a first transfer function of a second area; determining a target filter coefficient corresponding to a speaker in a cabin of a vehicle based on the first transfer function includes: determining an eigenvector of a maximum eigenvalue corresponding to the first transfer function of the first area; determining the target filter coefficient corresponding to the speaker in the cabin of the vehicle based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area.

[0018] According to the above technical means, the present application can determine the target filter coefficient corresponding to the speaker in the cabin of the vehicle through the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area. In this way, by determining the eigenvector of the maximum eigenvalue corresponding to the first transfer function, the accuracy of determining the target filter coefficient corresponding to the speaker in the cabin of the vehicle can be improved.

[0019] In one possible implementation, the target filter coefficient is a time domain filter coefficient; based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area, the target filter coefficient corresponding to the speaker in the cabin of the vehicle is determined, including: based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area, determining the frequency domain filter coefficient corresponding to the speaker in the cabin of the vehicle; performing Fourier transform processing on the frequency domain filter coefficient corresponding to the speaker in the cabin of the vehicle to obtain the time domain filter coefficient corresponding to the speaker in the cabin of the vehicle.

[0020] According to the above technical means, the present application can first determine the frequency domain filter coefficients corresponding to the speakers in the vehicle's cabin, and then perform Fourier transform processing on the frequency domain filter coefficients corresponding to the speakers in the vehicle's cabin to obtain the time domain filter coefficients corresponding to the speakers in the vehicle's cabin. By converting the filter coefficients between the frequency domain and the time domain based on Fourier transform, the accuracy of determining the target filter coefficients corresponding to the speakers in the vehicle's cabin can be improved.

[0021] In a possible implementation, adjusting an audio signal input to a speaker in a cabin of a vehicle based on a target filter coefficient includes: performing convolution processing on the audio signal input to the speaker in the cabin of the vehicle based on the target filter coefficient to obtain a convolution processed audio signal.

[0022] According to the above technical means, the present application can perform convolution processing on the audio signal input by the speaker in the cabin of the vehicle based on the target filter coefficient to obtain the audio signal after convolution processing. Therefore, the speaker plays the corresponding audio based on the audio signal after convolution processing, which can adjust the playback effect of different areas in the cabin of the vehicle, improve the effect of controlling the speaker in the vehicle, and enhance the user experience.

[0023] According to a second aspect provided by the present application, a speaker signal adjustment device is provided, which is applied to a vehicle, wherein the vehicle cabin includes a first area and a second area, and the first area and the second area are both provided with a speaker and a microphone, and the speaker signal adjustment device includes: an acquisition module and a processing module; the acquisition module is used to acquire a first audio signal input to the speaker in the first area, and a second audio signal received by the microphone in the vehicle cabin; the processing module is used to determine a first transfer function based on the first audio signal and the second audio signal, the first transfer function is used to indicate the corresponding transfer parameters between the audio signal output by the speaker in the same area and the audio signal received by the microphone, and the audio signal output by the speaker is an audio signal output after processing the input first audio signal; the processing module is also used to determine a target filter coefficient corresponding to the speaker in the vehicle cabin based on the first transfer function, and adjust the audio signal input to the speaker in the vehicle cabin based on the target filter coefficient.

[0024] In one possible implementation, the processing module is specifically used to perform Fourier transform processing on the first audio signal to obtain a first frequency domain signal, and to perform Fourier transform processing on the second audio signal to obtain a second frequency domain signal; the processing module is specifically used to determine the first transfer function based on the first frequency domain signal, the second frequency domain signal and the weight vector corresponding to the speaker.

[0025] In one possible implementation, the processing module is specifically used to determine a second transfer function based on a ratio of a second frequency domain signal to a first frequency domain signal, the second transfer function being used to indicate a transfer parameter corresponding to an audio signal input by a speaker and an audio signal received by a microphone in the same area; the processing module is specifically used to determine a first transfer function based on the second transfer function and a weight vector corresponding to the speaker under the constraint of a target condition, the target condition being used to indicate that the difference between the product of the weight vector corresponding to the speaker and the first transfer function and the second transfer function is minimized.

[0026] In a possible implementation, the processing module is specifically used to determine the pseudo-inverse matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function under the constraint of the target condition; the processing module is specifically used to determine the first transfer function based on the pseudo-inverse matrix and the second transfer function.

[0027] In one possible implementation, the processing module is further used to iteratively train target filter coefficients corresponding to the speakers in the vehicle's cabin based on audio signals input to the speakers in the first area and audio signals received by the microphone in the vehicle's cabin to obtain target filter coefficients after iterative training.

[0028] In one possible implementation, the processing module is specifically used to, under the constraint of the target condition, determine the product of the conjugate matrix of the weight vector corresponding to the speaker and the inverse matrix of the first matrix based on the pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, when the number of iterative trainings for the target filter coefficients corresponding to the speakers in the cabin of the vehicle is less than or equal to the number of speakers in the first area, where the first matrix is ​​the product of the weight vector corresponding to the speaker and the conjugate matrix of the weight vector corresponding to the speaker; the processing module is specifically used to determine the product of the inverse matrix of the second matrix and the conjugate matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, where the second matrix is ​​the product of the conjugate matrix of the weight vector corresponding to the speaker and the weight vector corresponding to the speaker, where the second matrix is ​​the product of the conjugate matrix of the weight vector corresponding to the speaker.

[0029] In one possible implementation, the first transfer function includes: a first transfer function of a first area and a first transfer function of a second area; a processing module, specifically used to determine an eigenvector of a maximum eigenvalue corresponding to the first transfer function of the first area; and a processing module, specifically used to determine a target filter coefficient corresponding to a speaker in a cabin of the vehicle based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area.

[0030] In one possible implementation, the target filter coefficient is a time domain filter coefficient; the processing module is specifically used to determine the frequency domain filter coefficient corresponding to the speaker in the vehicle's cabin based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area; the processing module is specifically used to perform Fourier transform processing on the frequency domain filter coefficient corresponding to the speaker in the vehicle's cabin to obtain the time domain filter coefficient corresponding to the speaker in the vehicle's cabin.

[0031] In a possible implementation, the processing module is specifically configured to perform convolution processing on an audio signal input from a speaker in a cabin of the vehicle based on a target filter coefficient to obtain a convolution-processed audio signal.

[0032] According to the third aspect provided by the present application, an electronic device is provided, comprising: a processor; a memory for storing processor executable instructions; wherein the processor is configured to execute instructions to implement the method of the above-mentioned first aspect and any possible implementation manner thereof.

[0033] According to the fourth aspect provided by the present application, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method in the above-mentioned first aspect and any possible implementation method thereof.

[0034] According to a fifth aspect provided by the present application, a vehicle is provided, the vehicle comprising the speaker signal adjustment device according to the second aspect, the vehicle being used to implement the method according to the first aspect.

[0035] According to the sixth aspect provided by the present application, a computer program product is provided, the computer program product comprising computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method of the above-mentioned first aspect and any possible implementation manner thereof.

[0036] Therefore, the above technical features of the present application have the following beneficial effects:

[0037] (1) The present application can determine a first transfer function for indicating the corresponding transfer parameters between the audio signal output by the speaker in the same area and the audio signal received by the microphone by obtaining a first audio signal input to the speaker in the first area and a second audio signal received by the microphone in the vehicle's cabin; determine the target filter coefficient corresponding to the speaker in the vehicle's cabin based on the first transfer function, and adjust the audio signal input to the speaker in the vehicle's cabin based on the target filter coefficient. In this way, the speakers in different areas of the vehicle's cabin can be adjusted, the playback effects of the speakers in different areas can be adjusted, the effect of controlling the speakers in the vehicle can be improved, and the user experience can be enhanced.

[0038] (2) The present application can obtain a first frequency domain signal by performing Fourier transform processing on the first audio signal, and obtain a second frequency domain signal by performing Fourier transform processing on the second audio signal. Thus, the first transfer function is determined based on the first frequency domain signal, the second frequency domain signal and the weight vector corresponding to the speaker. In this way, by obtaining the frequency domain signal corresponding to the audio signal through Fourier transform processing, the required first transfer function can be accurately determined, thereby improving the accuracy of the determined transfer function.

[0039] (3) The present application can first determine the second transfer function indicating the corresponding transfer parameters between the audio signal input by the speaker and the audio signal received by the microphone in the same area based on the ratio of the second frequency domain signal to the first frequency domain signal. Then, under the constraint of the target condition, the first transfer function is determined based on the second transfer function and the weight vector corresponding to the speaker. In this way, under the constraint of the target condition, the difference between the product of the weight vector corresponding to the speaker and the determined first transfer function and the second transfer function can be minimized. Thus, a more accurate first transfer function can be determined.

[0040] (4) The present application can first determine the pseudo-inverse matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function, and then determine the first transfer function based on the pseudo-inverse matrix and the second transfer function. In this way, by processing the weight vector corresponding to the speaker through the pseudo-inverse function, the accuracy of the determined first transfer function can be improved.

[0041] (5) After determining the target filter coefficients corresponding to the speakers in the vehicle's cabin, the present application may iteratively train the target filter coefficients corresponding to the speakers in the vehicle's cabin, thereby further improving the accuracy of the target filter coefficients corresponding to the speakers in the vehicle's cabin.

[0042] (6) The present application can determine the pseudo-inverse matrix of the weight vector corresponding to the speaker through different algorithms based on the relationship between the number of iterative training times for the target filter coefficients corresponding to the speakers in the vehicle cabin and the number of speakers in the first area. Thus, in different situations, the first transfer function can be determined through a more accurate algorithm, which can improve the accuracy of the determined first transfer function.

[0043] (7) The present application can determine the target filter coefficient corresponding to the speaker in the cabin of the vehicle through the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first region and the first transfer function of the second region. In this way, by determining the eigenvector of the maximum eigenvalue corresponding to the first transfer function, the accuracy of determining the target filter coefficient corresponding to the speaker in the cabin of the vehicle can be improved.

[0044] (8) The present application can first determine the frequency domain filter coefficients corresponding to the speakers in the vehicle's cabin, and then perform Fourier transform processing on the frequency domain filter coefficients corresponding to the speakers in the vehicle's cabin to obtain the time domain filter coefficients corresponding to the speakers in the vehicle's cabin. By converting the filter coefficients between the frequency domain and the time domain based on Fourier transform, the accuracy of determining the target filter coefficients corresponding to the speakers in the vehicle's cabin can be improved.

[0045] (9) The present application can perform convolution processing on the audio signal input by the speaker in the vehicle cabin based on the target filter coefficient to obtain the convolution processed audio signal. The speaker plays the corresponding audio based on the convolution processed audio signal, thereby adjusting the playback effect of different areas in the vehicle cabin, improving the effect of controlling the speaker in the vehicle, and enhancing the user experience.

[0046] It should be noted that the technical effects brought about by any implementation method in the second to sixth aspects can refer to the technical effects brought about by the corresponding implementation method in the first aspect, and will not be repeated here.

[0047] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application, and do not constitute an improper limitation on the present application.

[0049] Figure 1 is a structural schematic diagram of a loudspeaker signal adjustment system according to an exemplary embodiment;

[0050] Figure 2 is a flow chart of a method for adjusting a loudspeaker signal according to an exemplary embodiment;

[0051] Figure 3 is a schematic diagram of area distribution in a vehicle cabin according to an exemplary embodiment;

[0052] Figure 4 is a schematic diagram showing a corresponding relationship between a bandwidth average acoustic energy ratio and the number of iterations according to an exemplary embodiment;

[0053] Figure 5 is a schematic diagram showing a corresponding relationship between a bandwidth average acoustic energy ratio and the number of iterations according to an exemplary embodiment;

[0054] Figure 6 is a block diagram of a speaker signal adjustment device according to an exemplary embodiment;

[0055] Figure 7 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0056] In order to enable ordinary persons in the art to better understand the technical solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0057] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0058] At present, with the improvement of living standards, cars are playing an increasingly important role in people's lives, and users are paying more and more attention to the sound environment in the car. Nowadays, the cabin is often filled with a variety of sounds, and different people in the car usually want to hear different sounds. For example, the driver wants to hear navigation voice and warning sounds, and the passengers sitting in the back seat may want to watch a movie. Existing car audio cannot produce different sounds in different areas and cannot meet user needs. Based on this, whether it is to protect privacy or to avoid interfering with other users, it is necessary to apply sound field zoning control technology to generate a target sound field in a specific area while suppressing the sound energy in other areas.

[0059] At present, the main technical means of sound field partitioning is to use a speaker array to emit sound superposition to achieve the sound field partition of the cockpit. There are two ways to implement it. One is based on active noise cancellation technology, that is, a reverse sound wave is generated at the human ear through the speaker to cancel the sound transmitted from the dimming area. This method has good low-frequency partitioning performance. The other is based on the sound pressure matching method (Pressure Matching, PM) and the acoustic contrast method (Acoustic Contrast Control, ACC). This method designs the control filter coefficient corresponding to the speaker unit by measuring the transfer function from the speaker unit to the control area. For vehicles that are used for a long time, the transfer function is time-varying, so the regional sound control filter coefficient needs to be updated at all times to ensure the optimal control state.

[0060] The speaker signal adjustment method provided in the embodiment of the present application can be applied to a speaker signal adjustment system. Figure 1 FIG. 2 shows a structural schematic diagram of the speaker signal adjustment system. Figure 1 As shown, the speaker signal adjustment system 10 includes: a controller 11, a speaker 12 and a microphone 13. The controller 11 may be a computer control unit (ECU), and the speaker 12 and the microphone 13 may be multiple and arranged in each area of ​​the vehicle cabin.

[0061] The controller 11 is used to obtain a first audio signal input to a speaker 12 in a first area and a second audio signal received by a microphone 13 in a cabin of the vehicle.

[0062] The controller 11 is further used to determine a first transfer function based on the first audio signal and the second audio signal, where the first transfer function is used to indicate corresponding transfer parameters between the audio signal output by the speaker 12 and the audio signal received by the microphone 13 in the same area.

[0063] The controller 11 is further configured to determine a target filter coefficient corresponding to the speaker 12 in the cabin of the vehicle based on the first transfer function, and adjust an audio signal input to the speaker 12 in the cabin of the vehicle based on the target filter coefficient.

[0064] For ease of understanding, the speaker signal adjustment method provided in the present application is specifically introduced below with reference to the accompanying drawings.

[0065] Figure 2 is a flow chart of a speaker signal adjustment method according to an exemplary embodiment, which is applied to a vehicle, wherein the vehicle cabin includes a first area and a second area, and the first area and the second area are both provided with a speaker and a microphone, such as Figure 2 As shown, the speaker signal adjustment method includes the following S201-S203:

[0066] S201: Acquire a first audio signal input to a speaker in a first area and a second audio signal received by a microphone in a cabin of a vehicle.

[0067] In the embodiment of the present application, in view of the real-time changing environment in the current cabin, the sound field zoning control effect is reduced. The transfer function between the sub-region audio signal input to the bright area (i.e., the first area) and the dark area (i.e., the second area) and the signal received by the microphones in the bright area and the dark area can be solved through the audio signal played online, and then the transfer function corresponding to each speaker is separated, and finally the optimal sub-region sound control filter coefficient (i.e., the filter coefficient) at the current moment is determined, so that the sub-region sound system always works in the optimal state.

[0068] It should be noted that the first area and the second area refer to two types of areas, and are not intended to indicate that the vehicle cabin includes two areas. There may be multiple first areas and multiple second areas. The first area can be understood as a bright area, i.e., an area where audio needs to be reconstructed, and the second area is a dark area, i.e., an area where audio signal energy needs to be suppressed.

[0069] For example, the driver's seat is a bright area and the other three seats are dark areas. Figure 3 As shown, the control filter adjusts the driver's bright zone input signal through the corresponding filter coefficient to obtain the input audio signal corresponding to each unit of the headrest speaker. According to the audio signals received by the bright zone and dark zone microphones, the transfer function corresponding to the bright zone headrest speaker from the bright zone to the dark zone is updated. According to the updated transfer function corresponding to the bright zone and the dark zone, the optimal filter coefficient is calculated.

[0070] Optionally, taking the headrest speaker of the main driver's seat as an example, it is assumed that the speaker array is integrated in the driver's seat headrest and is a horizontal line array. The bright area is the area near the headrest speaker (i.e. the area corresponding to the main driver's seat), and the dark area is the area corresponding to the other three seats. By designing the regional sound control filter coefficient, the input audio signal of the headrest speaker unit is filtered so that the sound does not leak to the other three seats and interfere with other passengers.

[0071] Optionally, multiple frames of audio signals input by the speaker in the first area and multiple frames of audio signals received by the microphone in the vehicle's cabin can be obtained, wherein the first audio signal of the mth frame input by the sound card in real time to the bright area headrest speaker array is as shown in Formula 1, and the second audio signal received by the microphone in the vehicle's cabin is as shown in Formula 2.

[0072] x(m)=[x(m×N-N+1), x(m×N-N+2),...x(m×N)] T Formula 1

[0073] d k (m) = [d k (m×N-N+1), d k (m×N-N+2),...d k (m×N)] T Formula 2

[0074] Wherein, N represents the frame length, k is a subscript with a value ranging from 1 to k, and k represents the number of all microphones included in the first area and the second area.

[0075] S202: Determine a first transfer function based on the first audio signal and the second audio signal.

[0076] The first transfer function is used to indicate the corresponding transfer parameters between the audio signal output by the speaker and the audio signal received by the microphone in the same area, and the audio signal output by the speaker is an audio signal output after processing the input first audio signal.

[0077] In the embodiment of the present application, the first audio signal can be understood as an electrical signal input to the speaker, the second audio signal can be understood as a sound signal received by the microphone, and the audio signal output by the speaker can be understood as a sound signal output by the speaker. The speaker can output a corresponding sound signal by processing the input electrical signal.

[0078] It should be noted that the first transfer function can be determined by calculating the first audio signal and the second audio signal. For the specific calculation process, reference may be made to the following steps, which will not be described in detail here.

[0079] In some embodiments, determining a first transfer function based on a first audio signal and a second audio signal includes: performing Fourier transform processing on the first audio signal to obtain a first frequency domain signal, performing Fourier transform processing on the second audio signal to obtain a second frequency domain signal; and determining the first transfer function based on the first frequency domain signal, the second frequency domain signal, and a weight vector corresponding to the speaker.

[0080] Optionally, the first audio signal and the second audio signal may be simultaneously subjected to an N-point Fourier transform to obtain a first frequency domain signal X(m, jω) corresponding to the first audio signal and a second frequency domain signal D corresponding to the second audio signal. k (m,jω).

[0081] Then, further, in combination with the weight vector corresponding to the loudspeaker, based on the relationship between the first frequency domain signal, the second frequency domain signal and the weight vector corresponding to the loudspeaker, a first transfer function may be determined.

[0082] In the embodiment of the present application, the first frequency domain signal is obtained by performing Fourier transform processing on the first audio signal, and the second frequency domain signal is obtained by performing Fourier transform processing on the second audio signal. Thus, the first transfer function is determined based on the first frequency domain signal, the second frequency domain signal and the weight vector corresponding to the speaker. In this way, the frequency domain signal corresponding to the audio signal is obtained by Fourier transform processing, and the required first transfer function can be accurately determined, thereby improving the accuracy of the determined transfer function.

[0083] In some embodiments, a first transfer function is determined based on a first frequency domain signal, a second frequency domain signal, and a weight vector corresponding to a speaker, including: determining a second transfer function based on a ratio of the second frequency domain signal to the first frequency domain signal, the second transfer function being used to indicate a transfer parameter corresponding to an audio signal input by a speaker and an audio signal received by a microphone in the same area; and determining a first transfer function based on the second transfer function and a weight vector corresponding to the speaker under the constraint of a target condition, the target condition being used to indicate that the difference between the product of the weight vector corresponding to the speaker and the first transfer function and the second transfer function is minimized.

[0084] First, based on the ratio of the second frequency domain signal to the first frequency domain signal, a second transfer parameter indicating the correspondence between the audio signal input by the speaker and the audio signal received by the microphone in the same area can be determined, as shown in Formula 3.

[0085]

[0086] Then, when the difference between the product of the weight vector corresponding to the loudspeaker and the first transfer function and the second transfer function is the smallest, the corresponding first transfer function is determined, so that the accuracy of the first transfer function can be guaranteed.

[0087] In an embodiment of the present application, a second transfer function indicating the corresponding transfer parameters between an audio signal input by a speaker and an audio signal received by a microphone in the same area can be determined based on the ratio of the second frequency domain signal to the first frequency domain signal. Then, under the constraint of the target condition, the first transfer function is determined based on the second transfer function and the weight vector corresponding to the speaker. In this way, under the constraint of the target condition, the difference between the product of the weight vector corresponding to the speaker and the determined first transfer function and the second transfer function can be minimized. Thus, a more accurate first transfer function is determined.

[0088] In some embodiments, under the constraints of target conditions, the first transfer function is determined based on the second transfer function and the weight vector corresponding to the speaker, including: under the constraints of the target conditions, determining the pseudo-inverse matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function; and determining the first transfer function based on the pseudo-inverse matrix and the second transfer function.

[0089] It should be noted that, in theory, the corresponding transfer function H between the audio signal input by the speaker in the first area and the audio signal received by the microphone in the vehicle cabin (ie, the first area and the second area) is k (jω), should be equal to the weight vector W(jω) corresponding to the loudspeaker and the transfer function G corresponding to the audio signal output by the loudspeaker in the first area and the audio signal received by the microphone in the vehicle's cabin k The product of (jω).

[0090] Furthermore, the least squares method is used to separate the transfer function corresponding to the audio signal output by the speaker in the first area and the audio signal received by the microphone in the vehicle cabin, with the optimization goal of minimizing the error between the weight vector corresponding to the speaker and the transfer function corresponding to the audio signal output by the speaker in the first area and the audio signal received by the microphone in the vehicle cabin, as shown in Formula 4.

[0091]

[0092] Among them, G k The specific vector form of (jω) is shown in Formula 5:

[0093] G k (jω)=[G 1k (jω)G 2k (jω)…G Jk (jω)] T Formula 5

[0094] The specific vector form of the weight vector W(jω) corresponding to the speaker is expressed as shown in Formula 6:

[0095]

[0096] The corresponding transfer function H between the audio signal input by the speaker in the first area and the audio signal received by the microphone in the vehicle cabin is k The specific vector form of (jω) is shown in Formula 7:

[0097]

[0098] Where J represents the number of loudspeakers in the first zone, w j (m,jω) represents the filter coefficient corresponding to the mth frame, G jk (jω) represents the transfer function corresponding to the audio signal output by the j-th loudspeaker in the first area and the audio signal received by the k-th microphone in the cabin of the vehicle, M represents the number of iterations, and pinv{} represents the pseudo-inverse function.

[0099] In the embodiment of the present application, the pseudo-inverse matrix of the weight vector corresponding to the speaker can be determined based on the pseudo-inverse function, and then the first transfer function can be determined based on the pseudo-inverse matrix and the second transfer function. In this way, the weight vector corresponding to the speaker is processed by the pseudo-inverse function, which can improve the accuracy of the determined first transfer function.

[0100] In some embodiments, under the constraints of target conditions, the pseudo-inverse matrix of the weight vector corresponding to the speaker is determined based on a pseudo-inverse function, including: under the constraints of target conditions, when the number of iterative training of the target filter coefficients corresponding to the speakers in the vehicle's cabin is less than or equal to the number of speakers in the first area, the product of the conjugate matrix of the weight vector corresponding to the speaker and the inverse matrix of the first matrix is ​​determined based on the pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, the first matrix being the product of the weight vector corresponding to the speaker and the conjugate matrix of the weight vector corresponding to the speaker.

[0101] Exemplarily, when M≤J, the pseudo-inverse matrix of the weight vector corresponding to the speaker can be specifically determined by Formula 8.

[0102] pinv{W(jω)}=W(jω) H *(W(jω)*W(jω) H ) -1 Formula 8

[0103] Alternatively, under the constraints of target conditions, when the number of iterative training of the target filter coefficients corresponding to the speakers in the vehicle's cabin is greater than the number of speakers in the first area, the product of the inverse matrix of the second matrix and the conjugate matrix of the weight vector corresponding to the speaker is determined based on the pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, and the second matrix is ​​the product of the conjugate matrix of the weight vector corresponding to the speaker and the weight vector corresponding to the speaker.

[0104] Exemplarily, when M>J, the pseudo-inverse matrix of the weight vector corresponding to the speaker can be specifically determined by Formula 9.

[0105] pinv{W(jω)}=(W(jω) H *W(jω)) -1 *W(jω) H Formula 9

[0106] In the embodiment of the present application, based on the relationship between the number of iterative trainings of the target filter coefficients corresponding to the speakers in the vehicle cabin and the number of speakers in the first area, the pseudo-inverse matrix of the weight vector corresponding to the speakers can be determined by different algorithms. Thus, in different situations, the first transfer function can be determined by a more accurate algorithm, which can improve the accuracy of the determined first transfer function.

[0107] S203 . Determine a target filter coefficient corresponding to a speaker in a cabin of the vehicle based on the first transfer function, and adjust an audio signal input to the speaker in the cabin of the vehicle based on the target filter coefficient.

[0108] It should be noted that, for determining the target filter coefficient corresponding to the speaker in the cabin of the vehicle based on the first transfer function, specific steps may be referred to the following steps, which will not be described in detail here.

[0109] In some embodiments, the method further includes: iteratively training target filter coefficients corresponding to the speakers in the vehicle cabin based on audio signals input to the speakers in the first area and audio signals received by the microphone in the vehicle cabin to obtain target filter coefficients after iterative training.

[0110] Optionally, after determining the target filter coefficient corresponding to the speaker in the vehicle cabin, the audio signal input to the speaker in the first area can be adjusted based on the target filter coefficient. Since the audio signal input to the speaker in the first area is an audio signal adjusted by the target filter coefficient, the target filter coefficient can be re-determined based on the audio signal input to the speaker in the first area and the audio signal received by the microphone in the vehicle cabin, that is, the target filter coefficient is iteratively trained to improve the accuracy of the target filter coefficient.

[0111] It should be noted that, during the first iterative training, the above algorithm involves the problem of initializing the frequency domain filter coefficients. In the embodiment of the present application, the frequency domain filter coefficients can be initialized to a random vector of length J.

[0112] In an embodiment of the present application, after determining the target filter coefficients corresponding to the speakers in the vehicle's cabin, the present application can iteratively train the target filter coefficients corresponding to the speakers in the vehicle's cabin, thereby further improving the accuracy of the target filter coefficients corresponding to the speakers in the vehicle's cabin.

[0113] In the embodiment of the present application, a first audio signal input to a speaker in a first area and a second audio signal received by a microphone in a vehicle cabin can be obtained to determine a first transfer function for indicating the corresponding transfer parameters between an audio signal output by a speaker in the same area and an audio signal received by a microphone; a target filter coefficient corresponding to the speaker in the vehicle cabin can be determined based on the first transfer function, and the audio signal input to the speaker in the vehicle cabin can be adjusted based on the target filter coefficient. In this way, the speakers in different areas of the vehicle cabin can be adjusted, the playback effects of the speakers in different areas can be adjusted, the effect of controlling the speakers in the vehicle can be improved, and the user experience can be enhanced.

[0114] In some embodiments, the first transfer function includes: a first transfer function of a first area and a first transfer function of a second area; determining a target filter coefficient corresponding to a speaker in a cabin of a vehicle based on the first transfer function includes: determining an eigenvector of a maximum eigenvalue corresponding to the first transfer function of the first area; determining the target filter coefficient corresponding to the speaker in the cabin of the vehicle based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area.

[0115] Optionally, for the first transfer function of the first region, the frequency domain filter coefficient vector corresponding to the next frame (ie, the m+1th frame) of the audio signal may be calculated using the ACC method, as shown in Formula 10:

[0116]

[0117] Where λ is the regularization factor, subscript b represents the first region, d represents the second region, G b (jω) represents the corresponding transfer function between the loudspeaker of the first area and the microphone of the first area. The specific vector form expression based on formula 4 is shown in formula 11. d (jω) represents the corresponding transfer function between the loudspeaker in the first area and the microphone in the second area, and the specific vector form expression based on formula 4 is shown in formula 12. And, G(jω)=[G b (jω),G d (jω)], Pr[] is used to find the eigenvector corresponding to the maximum eigenvalue, and I is the unit matrix.

[0118]

[0119]

[0120] Wherein, k1 represents the number of microphones included in the first area, k2 represents the number of microphones included in the second area, k1+k2=k, and k represents the total number of microphones included in the cabin of the vehicle.

[0121] In the embodiment of the present application, the target filter coefficient corresponding to the speaker in the cabin of the vehicle can be determined by the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first region and the first transfer function of the second region. In this way, by determining the eigenvector of the maximum eigenvalue corresponding to the first transfer function, the accuracy of determining the target filter coefficient corresponding to the speaker in the cabin of the vehicle can be improved.

[0122] In some embodiments, the target filter coefficient is a time domain filter coefficient; the target filter coefficient corresponding to the speaker in the cabin of the vehicle is determined based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area, including: determining the frequency domain filter coefficient corresponding to the speaker in the cabin of the vehicle based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area; performing Fourier transform processing on the frequency domain filter coefficient corresponding to the speaker in the cabin of the vehicle to obtain the time domain filter coefficient corresponding to the speaker in the cabin of the vehicle.

[0123] Optionally, using the above method, the target filter coefficient corresponding to the loudspeaker determined is a frequency domain filter coefficient, so it is necessary to use Fourier transform to convert the frequency domain filter coefficient into a time domain filter coefficient w i (m+1).

[0124] In the embodiment of the present application, the frequency domain filter coefficient corresponding to the speaker in the vehicle's cabin can be determined first, and then the frequency domain filter coefficient corresponding to the speaker in the vehicle's cabin can be Fourier transformed to obtain the time domain filter coefficient corresponding to the speaker in the vehicle's cabin. By converting the filter coefficient between the frequency domain and the time domain based on the Fourier transform, the accuracy of determining the target filter coefficient corresponding to the speaker in the vehicle's cabin can be improved.

[0125] In some embodiments, adjusting an audio signal input to a speaker in a cabin of a vehicle based on a target filter coefficient includes: performing convolution processing on the audio signal input to the speaker in the cabin of the vehicle based on the target filter coefficient to obtain a convolution processed audio signal.

[0126] Optionally, based on the target filter coefficient determined above, the audio signal input from the speaker in the cabin of the vehicle may be convolved using Formula 13 to obtain an audio signal after convolution.

[0127]

[0128] In the embodiment of the present application, the audio signal input by the speaker in the cabin of the vehicle can be convolved based on the target filter coefficient to obtain the audio signal after the convolution processing. Therefore, the speaker plays the corresponding audio based on the audio signal after the convolution processing, and the playback effect of different areas in the cabin of the vehicle can be adjusted, thereby improving the effect of controlling the speaker in the vehicle and enhancing the user experience.

[0129] For example, when an experimental platform is built in a simulated cockpit environment for experimental verification, the following results are obtained through multiple iterations of training: Figure 4 The diagram shows the relationship between the bandwidth average sound energy ratio and the number of iterations. The main driver's seat is used as the bright area, the co-driver's seat and the back seat are used as the dark area, and the two small speakers embedded in the main driver's headrest and the small speakers placed on both sides of the headrest together form a line array consisting of 4 speakers. Two microphones are placed in front of the headrests in the bright area and the dark area to simulate human ears for collecting sound signals. The relationship between the bandwidth average sound energy ratio and the number of iterations is determined through 100 iterations of training.

[0130] Furthermore, the sound field partition control experiment was carried out by the method disclosed in the present application, 1000-3400 Hz was selected as the research frequency band, 100 iterations were performed, and the curve of the bandwidth average sound energy ratio obtained by each iteration training with the frequency change was determined, such as Figure 5 As shown, the curve of the bandwidth average sound energy ratio determined by the present application as a function of frequency is compared with the curve of the bandwidth average sound energy ratio determined by the ACC algorithm for sound field partition control as a function of frequency. It can be seen that after 15 iterations, the broadband average sound energy ratio achieved by the present application is stabilized at around 19.5dB, while the sound energy ratio determined by the ACC algorithm control is 17.2dB.

[0131] The present application is specifically a method for controlling the sound field partition in a time-varying environment. First, under the current control filter coefficient, the transfer function between the input audio signal of the speaker and the audio signal received by the microphone is calculated. Then, based on the transfer function and the measurement results of the past time, the transfer function corresponding to each speaker is separated. Finally, based on the transfer function corresponding to each speaker, the filter coefficient of the regional sound control is updated. The problem of the degradation of the regional sound effect in a time-varying environment is solved, and the robustness of the sound field partition control is improved.

[0132] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to achieve the above functions, the speaker signal adjustment device or electronic device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed in this document, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0133] The embodiments of the present application can exemplarily divide the functional modules of the speaker signal adjustment device or the electronic device according to the above method. For example, the speaker signal adjustment device or the electronic device can include various functional modules corresponding to the various functional divisions, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0134] Figure 6 1 is a block diagram of a speaker signal adjustment device according to an exemplary embodiment, which is applied to a vehicle, wherein the vehicle cabin includes a first area and a second area, and the first area and the second area are both provided with a speaker and a microphone. Figure 6 The loudspeaker signal adjustment device 600 includes: an acquisition module 601 and a processing module 602 .

[0135] The acquisition module 601 is used to acquire a first audio signal input to a speaker in a first area and a second audio signal received by a microphone in a vehicle cabin; the processing module 602 is used to determine a first transfer function based on the first audio signal and the second audio signal, the first transfer function being used to indicate the corresponding transfer parameters between the audio signal output by the speaker in the same area and the audio signal received by the microphone, the audio signal output by the speaker being the audio signal output after processing the input first audio signal; the processing module 602 is also used to determine a target filter coefficient corresponding to the speaker in the vehicle cabin based on the first transfer function, and to adjust the audio signal input to the speaker in the vehicle cabin based on the target filter coefficient.

[0136] In one possible implementation, the processing module 602 is specifically used to perform Fourier transform processing on the first audio signal to obtain a first frequency domain signal, and to perform Fourier transform processing on the second audio signal to obtain a second frequency domain signal; the processing module 602 is specifically used to determine the first transfer function based on the first frequency domain signal, the second frequency domain signal and the weight vector corresponding to the speaker.

[0137] In one possible implementation, the processing module 602 is specifically used to determine a second transfer function based on a ratio of the second frequency domain signal to the first frequency domain signal, the second transfer function being used to indicate a transfer parameter corresponding to an audio signal input by a speaker and an audio signal received by a microphone in the same area; the processing module 602 is specifically used to determine a first transfer function based on the second transfer function and a weight vector corresponding to the speaker under the constraint of a target condition, the target condition being used to indicate that the difference between the product of the weight vector corresponding to the speaker and the first transfer function and the second transfer function is minimized.

[0138] In a possible implementation, the processing module 602 is specifically used to determine the pseudo-inverse matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function under the constraint of the target condition; the processing module 602 is specifically used to determine the first transfer function based on the pseudo-inverse matrix and the second transfer function.

[0139] In a possible implementation, the processing module 602 is also used to iteratively train the target filter coefficients corresponding to the speakers in the vehicle's cabin based on the audio signals input to the speakers in the first area and the audio signals received by the microphone in the vehicle's cabin to obtain the target filter coefficients after iterative training.

[0140] In one possible implementation, processing module 602 is specifically used to determine, based on a pseudo-inverse function, the product of a conjugate matrix of a weight vector corresponding to the speaker and an inverse matrix of a first matrix, to obtain a pseudo-inverse matrix of the weight vector corresponding to the speaker, when the number of iterative training times for target filter coefficients corresponding to the speakers in the cabin of the vehicle is less than or equal to the number of speakers in the first area under the constraint of target conditions, where the first matrix is ​​the product of the weight vector corresponding to the speaker and the conjugate matrix of the weight vector corresponding to the speaker; processing module 602 is specifically used to determine, based on a pseudo-inverse function, the product of an inverse matrix of a second matrix and a conjugate matrix of the weight vector corresponding to the speaker, to obtain a pseudo-inverse matrix of the weight vector corresponding to the speaker, where the second matrix is ​​the product of the conjugate matrix of the weight vector corresponding to the speaker and the weight vector corresponding to the speaker, when the number of iterative training times for target filter coefficients corresponding to the speakers in the cabin of the vehicle is greater than the number of speakers in the first area.

[0141] In one possible implementation, the first transfer function includes: a first transfer function of the first area and a first transfer function of the second area; a processing module 602, specifically used to determine an eigenvector of a maximum eigenvalue corresponding to the first transfer function of the first area; and a processing module 602, specifically used to determine a target filter coefficient corresponding to a speaker in a cabin of the vehicle based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area.

[0142] In one possible implementation, the target filter coefficient is a time domain filter coefficient; the processing module 602 is specifically used to determine the frequency domain filter coefficient corresponding to the speaker in the cabin of the vehicle based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area; the processing module 602 is specifically used to perform Fourier transform processing on the frequency domain filter coefficient corresponding to the speaker in the cabin of the vehicle to obtain the time domain filter coefficient corresponding to the speaker in the cabin of the vehicle.

[0143] In a possible implementation, the processing module 602 is specifically configured to perform convolution processing on an audio signal input from a speaker in a cabin of the vehicle based on a target filter coefficient to obtain a convolution-processed audio signal.

[0144] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0145] Figure 7 FIG. 1 is a block diagram of an electronic device according to an exemplary embodiment. Figure 7 As shown, the electronic device 700 includes but is not limited to: a processor 701 and a memory 702 .

[0146] The memory 702 is used to store executable instructions of the processor 701. It can be understood that the processor 701 is configured to execute instructions to implement the loudspeaker signal adjustment method in the above embodiment.

[0147] It should be noted that those skilled in the art can understand that Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device may include Figure 7 More or fewer components may be shown, or certain components may be combined, or the components may be arranged differently.

[0148] The processor 701 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 702, and calling data stored in the memory 702, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The processor 701 may include one or more processing units. Optionally, the processor 701 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 701.

[0149] The memory 702 can be used to store software programs and various data. The memory 702 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application program required by at least one functional module (such as a detection module, a control module, etc.), etc. In addition, the memory 702 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0150] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 702 including instructions. The above instructions can be executed by a processor 701 of an electronic device 700 to implement the speaker signal adjustment method in the above embodiment.

[0151] In actual implementation, Figure 6 The functions of the acquisition module 601 and the processing module 602 in Figure 7 The processor 701 in the embodiment calls the computer program stored in the memory 702. The specific execution process can refer to the description of the loudspeaker signal adjustment method in the above embodiment, which will not be repeated here.

[0152] Optionally, the computer-readable storage medium may be a non-temporary computer-readable storage medium, for example, the non-temporary computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0153] In an exemplary embodiment, the present application also provides a computer program product including one or more instructions, and the one or more instructions can be executed by the processor 701 of the electronic device 700 to complete the speaker signal adjustment method in the above embodiment.

[0154] It should be noted that when the instructions in the above-mentioned computer-readable storage medium or one or more instructions in the computer program product are executed by the processor of the electronic device, the various processes of the above-mentioned speaker signal adjustment method embodiment are implemented, and the same technical effect as the above-mentioned speaker signal adjustment method can be achieved. To avoid repetition, they will not be repeated here.

[0155] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0156] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0157] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0158] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0159] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the full classification part or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute the full classification part or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, ROM, RAM, disk or CD and other media that can store program code.

[0160] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for adjusting a loudspeaker signal, characterized in that: Applied to a vehicle, the vehicle cabin includes a first area and a second area, the first area and the second area are both provided with a speaker and a microphone, and the method includes: Acquire a first audio signal input to a speaker in the first area and a second audio signal received by a microphone in a cabin of the vehicle; Determine a first transfer function based on the first audio signal and the second audio signal, wherein the first transfer function is used to indicate a corresponding transfer parameter between an audio signal output by a loudspeaker and an audio signal received by a microphone in the same area, and the audio signal output by the loudspeaker is an audio signal output after processing the first audio signal input; A target filter coefficient corresponding to a speaker in a cabin of the vehicle is determined based on the first transfer function, and an audio signal input to the speaker in the cabin of the vehicle is adjusted based on the target filter coefficient.

2. The method according to claim 1, characterized in that The determining a first transfer function based on the first audio signal and the second audio signal comprises: Performing Fourier transform processing on the first audio signal to obtain a first frequency domain signal, and performing Fourier transform processing on the second audio signal to obtain a second frequency domain signal; The first transfer function is determined based on the first frequency domain signal, the second frequency domain signal, and a weight vector corresponding to the speaker.

3. The method according to claim 2, characterized in that The determining the first transfer function based on the first frequency domain signal, the second frequency domain signal and a weight vector corresponding to the speaker includes: Determine a second transfer function based on a ratio of the second frequency domain signal to the first frequency domain signal, wherein the second transfer function is used to indicate a corresponding transfer parameter between an audio signal input by a loudspeaker and an audio signal received by a microphone in the same area; The first transfer function is determined based on the second transfer function and the weight vector corresponding to the speaker under the constraint of a target condition, wherein the target condition is used to indicate that the difference between the product of the weight vector corresponding to the speaker and the first transfer function and the second transfer function is minimal.

4. The method according to claim 3, characterized in that The determining, under the constraint of the target condition, of the first transfer function based on the second transfer function and the weight vector corresponding to the loudspeaker comprises: Under the constraint of the target condition, determining a pseudo-inverse matrix of a weight vector corresponding to the loudspeaker based on a pseudo-inverse function; The first transfer function is determined based on the pseudo-inverse matrix and the second transfer function.

5. The method according to claim 4, characterized in that The method further comprises: Based on the audio signal input to the speaker in the first area and the audio signal received by the microphone in the cabin of the vehicle, the target filter coefficient corresponding to the speaker in the cabin of the vehicle is iteratively trained to obtain the target filter coefficient after iterative training.

6. The method according to claim 5, characterized in that The determining of the pseudo-inverse matrix of the weight vector corresponding to the speaker based on the pseudo-inverse function under the constraint of the target condition includes: Under the constraint of the target condition, when the number of iterative trainings for the target filter coefficients corresponding to the speakers in the cabin of the vehicle is less than or equal to the number of speakers in the first area, the product of the conjugate matrix of the weight vector corresponding to the speaker and the inverse matrix of the first matrix is ​​determined based on a pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, where the first matrix is ​​the product of the weight vector corresponding to the speaker and the conjugate matrix of the weight vector corresponding to the speaker; Under the constraints of the target conditions, when the number of iterative training of the target filter coefficients corresponding to the speakers in the cabin of the vehicle is greater than the number of speakers in the first area, the product of the inverse matrix of the second matrix and the conjugate matrix of the weight vector corresponding to the speaker is determined based on the pseudo-inverse function to obtain the pseudo-inverse matrix of the weight vector corresponding to the speaker, where the second matrix is ​​the product of the conjugate matrix of the weight vector corresponding to the speaker and the weight vector corresponding to the speaker.

7. The method according to any one of claims 1 to 6, characterized in that The first transfer function includes: a first transfer function of the first region and a first transfer function of the second region; The determining, based on the first transfer function, a target filter coefficient corresponding to a speaker in a cabin of the vehicle comprises: determining an eigenvector of a maximum eigenvalue corresponding to a first transfer function of the first region; A target filter coefficient corresponding to a speaker in a cabin of the vehicle is determined based on an eigenvector of a maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area.

8. The method according to claim 7, characterized in that The target filter coefficient is a time domain filter coefficient; The determining, based on the eigenvector of the maximum eigenvalue corresponding to the first transfer function of the first area and the first transfer function of the second area, a target filter coefficient corresponding to the speaker in the cabin of the vehicle comprises: determining a frequency domain filter coefficient corresponding to a speaker in a cabin of the vehicle based on an eigenvector of a maximum eigenvalue corresponding to the first transfer function of the first region and the first transfer function of the second region; Fourier transform processing is performed on the frequency domain filter coefficients corresponding to the speakers in the cabin of the vehicle to obtain the time domain filter coefficients corresponding to the speakers in the cabin of the vehicle.

9. The method according to any one of claims 1 to 6, characterized in that: The step of adjusting the audio signal input to the speaker in the cabin of the vehicle based on the target filter coefficient comprises: Based on the target filter coefficient, a convolution process is performed on an audio signal input from a speaker in a cabin of the vehicle to obtain a convolution-processed audio signal.

10. A loudspeaker signal conditioning device, characterized in that: Applied to a vehicle, the vehicle cabin includes a first area and a second area, the first area and the second area are both provided with a speaker and a microphone, and the speaker signal adjustment device includes: an acquisition module and a processing module; The acquisition module is used to acquire a first audio signal input to a speaker in the first area and a second audio signal received by a microphone in a cabin of the vehicle; The processing module is used to determine a first transfer function based on the first audio signal and the second audio signal, wherein the first transfer function is used to indicate a corresponding transfer parameter between an audio signal output by a loudspeaker and an audio signal received by a microphone in the same area, and the audio signal output by the loudspeaker is an audio signal output after processing the input first audio signal; The processing module is further configured to determine a target filter coefficient corresponding to a speaker in a cabin of the vehicle based on the first transfer function, and adjust an audio signal input to the speaker in the cabin of the vehicle based on the target filter coefficient.

11. An electronic device, characterized in that: include: A processor and a memory; wherein the memory is used to store one or more programs, and the one or more programs include computer-executable instructions. When the electronic device is running, the processor executes the computer-executable instructions stored in the memory to enable the electronic device to perform the method described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that: When the computer-executable instructions stored in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can perform the method as claimed in any one of claims 1 to 9.

13. A vehicle, characterized in that: The vehicle comprises the loudspeaker signal conditioning device according to claim 10, and the vehicle is used to implement the method according to any one of claims 1-9.