Audio processing method, system, electronic device and readable storage medium

Abstract

The present invention provides an audio processing method, system, electronic device and readable storage medium, which relates to the field of signal technology, wherein the method comprises: obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed; based on the target playback mode, determining the filter corresponding to each audio playback component; using each filter to filter the audio to be processed, obtaining the signal to be played corresponding to each filter, and transmitting the signal to be played corresponding to each filter to the audio playback component corresponding to each filter for playback. The flexibility and diversity of audio playback are improved.

Description

Technical Field

[0001] The present invention relates to the field of signal technology, and in particular to an audio processing method, system, electronic device and readable storage medium. Background Art

[0002] With the development of signal technology, common vehicles such as trains, airplanes and cars are equipped with audio systems. As the utilization rate of vehicles increases, users have higher and higher requirements for the audio systems on vehicles.

[0003] Currently, the sound system of a vehicle often has a fixed playback mode, that is, all speakers in the sound system receive uniform audio for playback, which results in poor flexibility in audio playback. Summary of the invention

[0004] The embodiments of the present invention provide an audio processing method, system, electronic device and readable storage medium to solve the problem of poor flexibility of audio playback in the prior art.

[0005] In a first aspect, an embodiment of the present invention provides an audio processing method, which is applied to a processing end included in an audio processing system, wherein the audio processing system includes at least one audio playback array, the processing end is connected to the at least one audio playback array, and the audio playback array includes at least two audio playback components, including:

[0006] Obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed;

[0007] Based on the target playback mode, determining the filter corresponding to each of the audio playback components;

[0008] Each of the filters is used to perform a filtering operation on the audio to be processed to obtain a signal to be played corresponding to each of the filters, and the signal to be played corresponding to each of the filters is respectively transmitted to the audio playback component corresponding to each of the filters for playback.

[0009] Optionally, determining the filter corresponding to each of the audio playback components based on the target playback mode includes:

[0010] Based on the frequency sub-band range corresponding to each of the audio playback components, obtaining the number of taps of each of the audio playback components;

[0011] Based on the target playback mode and the number of taps of each audio playback component, a filter corresponding to each audio playback component is determined.

[0012] Optionally, determining the filter corresponding to each audio playback component based on the target playback mode and the number of taps of each audio playback component includes:

[0013] Determining, from the playback areas included in the audio processing system, a playback area to be processed indicated by the target playback mode;

[0014] Based on the acoustic transfer function corresponding to each of the audio playback components and the to-be-processed playback area, and the number of taps of each of the audio playback components, the filter corresponding to each of the audio playback components is determined.

[0015] Optionally, determining the to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system includes:

[0016] In the case that the target playback mode belongs to the isolation playback mode, a lossless playback area and a silent playback area indicated by the target playback mode are determined from the playback areas included in the audio processing system as playback areas to be processed.

[0017] Optionally, determining the filter corresponding to each audio playback component based on the acoustic transfer function corresponding to each audio playback component and the to-be-processed playback area and the number of taps of each audio playback component includes:

[0018] For any of the audio playback components, based on the acoustic transfer functions corresponding to the audio playback component and the lossless playback area and the silent playback area, respectively, and the number of taps of the audio playback component, determine the energy contrast of the audio playback component in the lossless playback area and the silent playback area;

[0019] Based on the energy contrast of each audio playback component, a filter corresponding to each audio playback component is determined.

[0020] Optionally, determining the to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system includes:

[0021] In the case that the target playback mode belongs to the optimized playback mode, a target optimized area indicated by the target playback mode is determined from the playback areas included in the audio processing system as the playback area to be processed.

[0022] Optionally, the acoustic transfer function corresponding to each of the audio playback components and any of the playback areas is determined in the following manner:

[0023] For any audio playback component and any playback area, play a test signal through the audio playback component;

[0024] collecting a collection signal corresponding to the test signal through at least one measurement point pre-set in the playback area;

[0025] Based on the test signal and the collected signal, an acoustic transfer function corresponding to the audio playback component and the playback area is determined.

[0026] Optionally, the obtaining of the audio to be processed and the target playback mode corresponding to the audio to be processed includes:

[0027] In response to a first interaction operation of a user, acquiring audio indicated by the first interaction operation as audio to be processed;

[0028] In response to a second interaction operation of the user on the audio to be processed, a play mode indicated by the second interaction operation is obtained as a target play mode.

[0029] Optionally, the audio processing system further includes at least one audio playback component having an installation height inconsistent with that of the audio playback components included in the audio playback array.

[0030] In a second aspect, the present invention provides an audio processing system, comprising a processing end and at least one audio playback array, wherein the processing end is connected to the at least one audio playback array, wherein the audio playback array comprises at least two audio playback components; the processing end is used to:

[0031] Obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed;

[0032] Based on the target playback mode, determining the filter corresponding to each of the audio playback components;

[0033] Each of the filters is used to perform a filtering operation on the audio to be processed to obtain a signal to be played corresponding to each of the filters, and the signal to be played corresponding to each of the filters is respectively transmitted to the audio playback component corresponding to each of the filters for playback.

[0034] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a processor, a communication interface, a memory, and a communication bus; wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0035] Memory, used to store computer programs;

[0036] The processor is used to implement the steps of the audio processing method described in the first aspect when executing the program stored in the memory.

[0037] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the audio processing method described in the first aspect above.

[0038] In a fifth aspect, an embodiment of the present invention provides a vehicle, comprising a processor, a memory, and an audio processing program stored in the memory, wherein when the processor executes the audio processing program stored in the memory, the steps in the audio processing method described in the first aspect are implemented.

[0039] Compared with the prior art, the present invention has the following advantages:

[0040] In the embodiment of the present invention, a fixed playback mode is no longer used to avoid having all audio playback components receive uniform audio for direct playback. The target playback mode can be used to determine the corresponding filters for each audio playback component for filtering. Accordingly, the signals to be played after the filtering operation received by different audio playback components are different, thereby improving the flexibility and diversity of audio playback. At the same time, by setting at least one audio playback array including at least two audio playback components, based on the interference effect, the audio signals output by each audio playback component in the audio playback array are superimposed or offset at different propagation distances, and the audio signal can be focused on the superimposed area to achieve the directionality of the audio. Therefore, by setting the audio playback array in the audio processing system, the embodiment of the present invention can facilitate the control of the directionality of the audio playback.

[0041] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for describing the embodiments are briefly introduced below.

[0043] Figure 1 is a flowchart of the steps of an audio processing method provided by an embodiment of the present invention;

[0044] Figure 2 is a structural schematic diagram of a center speaker array provided by an embodiment of the present invention;

[0045] Figure 3 is a schematic diagram of the distribution of an audio playback component in a top view provided by an embodiment of the present invention;

[0046] Figure 4 is a schematic diagram of an acoustic transfer function measurement provided by an embodiment of the present invention;

[0047] Figure 5 is a structural schematic diagram of an audio processing system provided by an embodiment of the present invention;

[0048] Figure 6 is a flow chart of an audio processing method based on a vehicle-mounted multi-sound zone sound field control system provided by an embodiment of the present invention;

[0049] Figure 7 is a structural schematic diagram of another audio processing system provided by an embodiment of the present invention;

[0050] Figure 8 A schematic diagram of the structure of a vehicle provided by an embodiment of the present invention;

[0051] Fig. 9 A block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0052] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can also be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0053] Figure 1 is a flowchart of the steps of an audio processing method provided by an embodiment of the present invention. The method can be applied to a processing end included in an audio processing system. The audio processing system includes at least one audio playback array. The processing end is connected to the audio playback array. The audio playback array includes at least two audio playback components, such as Figure 1 As shown, the method may include:

[0054] Step 101: Obtain audio to be processed and a target playback mode corresponding to the audio to be processed.

[0055] The audio processing method provided by the embodiment of the present invention can be applied to vehicles, motor vehicles, aircraft or ships, etc., and a sound system can be configured in the vehicle, and the sound system can be used as an audio processing system to process the audio. Among them, the above-mentioned audio playback component refers to a device for playing audio, which can be called a speaker, which can be a common type of audio playback device or a miniature audio playback device. The embodiment of the present invention does not limit the type of audio playback component. The processing end can be a software or hardware device with computing capabilities, which can be connected to the audio playback array through hardware or software.

[0056] The audio playback array may also be referred to as a speaker array, which refers to an audio playback group including at least two audio playback components, and the at least two audio playback components are often located in the same plane, and as a whole audio playback device, they can be arranged horizontally, stacked vertically, or distributed in other ways. It should be noted that the types of audio playback components included in the audio playback array are often consistent, and they have the same audio playback properties (for example, operating voltage, sound pressure, or frequency response).

[0057] Specifically, the speaker array can be based on the interference effect, so that the audio signals output by each audio playback component are superimposed or offset at different propagation distances, and the audio signals can be focused in the superimposed area to achieve the directionality of the audio. Furthermore, the above-mentioned speaker array can be set in the center area of ​​the playback space to obtain a center speaker array, so as to facilitate the control of the directionality of the audio in the entire playback space and propagate the audio to the desired playback area as much as possible. Exemplarily, taking a vehicle as an example, the center speaker array can be set at the center of the center console under the front windshield. Of course, the above-mentioned speaker array can also be set in other areas of the playback space, and the embodiments of the present invention are not limited to this.

[0058] For example, Figure 2 is a schematic diagram of the structure of a center speaker array provided by an embodiment of the present invention, such as Figure 2 As shown, it shows the distribution forms of several conventional center speaker arrays, where the circular array element represents a speaker, 11 is a uniform linear array form, ΔL represents the spacing between the array elements, and the spacing between each two adjacent array elements in 11 is the same. 12 is a uniform rectangular array form, ΔL1 and ΔL2 represent the horizontal spacing and vertical spacing of the array elements, respectively, and the two can be equal or unequal. 13 is a uniform arc array form, R represents the radius of the arc array, θ represents the arc of the arc array, that is, the angle formed by the first array element and the last array element, and Δθ represents the angle difference between each two adjacent array elements. 14 is a non-uniform array form or an unequal spacing array form, ΔL1, ΔL2, and ΔL3 all represent the spacing between two adjacent array elements, and the spacing values ​​are unequal.

[0059] The embodiment of the present invention may be performed when there is a demand for audio playback, and the audio playback may be a voice call, music playback, etc. The embodiment of the present invention may determine that there is a demand for audio playback when an audio playback instruction is received, and then obtain the audio to be processed and the target playback mode from the information carried by the audio playback instruction through the audio playback instruction.

[0060] Optionally, the above step 101 may include:

[0061] S1011. In response to a first interaction operation of a user, obtain audio indicated by the first interaction operation as audio to be processed.

[0062] S1012: In response to a second interaction operation of the user on the audio to be processed, obtaining a play mode indicated by the second interaction operation as a target play mode.

[0063] Among them, the above-mentioned first interactive operation and second interactive operation can be manual interactions such as clicking and long pressing, or can be voice interactions, which is not limited in this embodiment of the present invention.

[0064] Among them, the above-mentioned first interactive operation can be an interactive operation performed by the user on the audio playback service, and the audio playback service can be provided by a third-party audio platform for the carrier, and the user can play any audio provided by the third-party audio platform through the service. Furthermore, an audio playback instruction can be generated through the first interactive operation, and the audio playback instruction can include an audio identifier of the audio indicated by the first interactive operation, and then the audio is obtained from the audio library provided by the third-party audio platform through the audio identifier as the audio to be processed. Alternatively, the above-mentioned first interactive operation can also be an interactive operation performed by the user on the voice call service, and the user can make voice calls with other devices on the carrier through the service. Furthermore, the voice stream of other devices can be received as the audio to be processed through the voice interface provided by the voice call service.

[0065] The second interactive operation may be an interactive operation for determining a playback mode of the audio to be processed, or may be a selection operation for a preset optional playback mode. The embodiment of the present invention can improve the user's interactive experience by receiving the user's interactive operation and determining the audio to be processed and the corresponding target playback mode, and the user can flexibly select the desired audio to be processed and playback mode.

[0066] Among them, the playback mode refers to the way the audio is played, which can be used to indicate the playback area of ​​the audio, or the quality optimization area, etc. Among them, the playback area refers to the playback area where the audio is expected to be losslessly played, which can also be called the sound weight area or bright area, and the non-playback area refers to the playback area where the sound is expected to be shielded, which can also be called the dark area or silent area. The audio quality optimization area refers to the playback area where the sound quality is expected to be improved. Among them, the above-mentioned playback area can also be called the sound zone, which can usually be divided according to the playback space where the audio processing system is located. For example, taking the vehicle as an example, the playback area of ​​the two-seat model can include the main driving sound zone and the co-pilot sound zone. Correspondingly, the playback area of ​​the four- or five-seat model can include the main driving sound zone, the co-pilot sound zone, the left rear sound zone, and the right rear sound zone. The playback area of ​​the seven-seat and above models can include the main driving sound zone, the co-pilot sound zone, the middle row left sound zone, the middle row right sound zone, the rear row left sound zone, and the rear row right sound zone.

[0067] After obtaining the audio to be processed and the target playback mode, the following steps 102 and 103 are performed.

[0068] Step 102: Based on the target playback mode, determine the filter corresponding to each of the audio playback components.

[0069] Step 103: Use each of the filters to perform filtering operations on the audio to be processed to obtain the to-be-played signals corresponding to each of the filters, and transmit the to-be-played signals corresponding to each of the filters to the audio playback components corresponding to each of the filters for playback.

[0070] The filter is used to filter the signal to obtain a signal of a specific frequency. Accordingly, the signals filtered by different filters are different. Specifically, the filter determined in the embodiment of the present invention can be a finite impulse response filter (Finite Impulse Response, FIR), which has a higher accuracy in filtering the audio signal.

[0071] Furthermore, the embodiment of the present invention can select a corresponding filter calculation algorithm according to the playback area or quality optimization area indicated by the target playback mode, and calculate the corresponding filter for each audio playback component. Alternatively, the embodiment of the present invention can also pre-calculate the filter of each audio playback component offline for different playback modes to be selected, and obtain the filter group corresponding to the different playback modes to be selected, so that the above step 102 can select the filter group corresponding to the target playback mode from different filter groups based on the target playback mode, and make each audio playback component use each filter in the filter group to perform filtering operations, which can improve the efficiency of audio processing to a certain extent.

[0072] Furthermore, the above-mentioned filter calculation algorithm can be an acoustic contrast control algorithm (Acoustic Constraint Control, ACC), a sound pressure matching algorithm (Pressure Matching, PM), an acoustic contrast-sound pressure matching weighted control algorithm (Acoustic Constraint Control - Pressure Matching, ACC-PM), a convex optimization algorithm (ConvexOptimization), a bright area frequency response control algorithm (Frequency Response Control, FRC), etc.

[0073] It can be understood that, through the above steps, the number of filters obtained is consistent with the number of audio playback components. Further, after obtaining the filters corresponding to each audio playback component, the audio to be processed can be simultaneously input into the filters corresponding to each audio playback component, and the signals to be played corresponding to each filter can be obtained by reading the output signals of each filter. Further, the playback signals output by each filter are transmitted to the audio playback components corresponding to each filter for playback.

[0074] Specifically, the above transmission method can be realized through an audio transmission link included in the audio processing system. The audio transmission link, as a signal transmission path, can include an audio source input terminal, a microcontroller unit (MCU), a digital signal processor (DSP), a power amplifier and an audio transmission line.

[0075] In summary, the audio processing method provided in the embodiment of the present invention no longer adopts a fixed playback mode to avoid having all audio playback components receive uniform audio for direct playback. The target playback mode can be used to determine the corresponding filters for each audio playback component for filtering. Accordingly, the signals to be played after the filtering operation received by different audio playback components are different, thereby improving the flexibility and diversity of audio playback. At the same time, by setting at least one audio playback array including at least two audio playback components, based on the interference effect, the audio signals output by each audio playback component in the audio playback array are superimposed or offset at different propagation distances, and the audio signal can be focused on the superimposed area to achieve the directionality of the audio. Therefore, the embodiment of the present invention can facilitate the control of the directionality of audio playback by setting an audio playback array in the audio processing system.

[0076] Optionally, in an embodiment of the present invention, the audio processing system further includes at least one audio playback component having an installation height inconsistent with that of the audio playback components included in the audio playback array.

[0077] Among them, the above-mentioned installation height refers to the coordinate size on the z-axis of the spatial coordinate system. Specifically, by setting at least one audio playback component that is inconsistent with the installation height of the audio playback array, an audio processing system with a three-dimensional sound array can be constructed, which can make the audio processing system easier to achieve multi-zone control. It should be noted that the more audio playback components that are inconsistent with the installation height of the audio playback array, the more flexible the audio processing system can be in performing multi-zone control, and then in the corresponding playback mode, the sound isolation can be higher, the sound field reconstruction range can be larger, and the sound quality can be better.

[0078] For example, taking a vehicle as an example, Figure 3 is a schematic diagram of the distribution of an audio playback component in a top view provided by an embodiment of the present invention, such as Figure 3 As shown, the vehicle may include a center speaker array 31, a left / right front door speaker group 32, a left / right rear door speaker group 33, a left / right surround speaker 34, a subwoofer 35, a ceiling speaker group 36, and a headrest speaker group 37. Optionally, Figure 3 The front and rear door speaker groups and the surround speakers are high-frequency, mid-frequency and low-frequency three-way speaker groups, and the frequency is positively correlated with the size of the speakers in the figure. Of course, in specific embodiments, full-range single speakers (i.e., no frequency division) and high-frequency and low-frequency two-way speaker groups can also be used. Figure 3 The center speaker array in the embodiment is a uniform linear array structure. In the specific implementation, the following structure can also be used: Figure 2 The other array structures shown are not limited in the embodiments of the present invention.

[0079] Furthermore, the audio processing system includes at least one audio playback array and at least one audio playback component with inconsistent installation heights, which can make the audio processing system more flexible in multi-zone control.

[0080] Optionally, in an embodiment of the present invention, determining a filter corresponding to each of the audio playback components based on the target playback mode includes:

[0081] Based on the frequency sub-band range corresponding to each of the audio playback components, the number of taps of each of the audio playback components is obtained.

[0082] Based on the target playback mode and the number of taps of each audio playback component, a filter corresponding to each audio playback component is determined.

[0083] Among them, since the spacing between the array elements in the audio playback array is often small, the spatial aliasing frequency is high, which easily produces a spatial aliasing effect, resulting in audio playback distortion. To avoid this problem, the embodiment of the present invention can use a sub-band filtering algorithm to determine the filter corresponding to each audio playback component based on the frequency sub-band range corresponding to each audio playback component.

[0084] The above-mentioned frequency sub-band range is often an inherent characteristic of the audio processing system, and is related to parameters such as the size and spacing of the audio playback components.

[0085] Specifically, the playback frequency range of each audio playback component in the audio playback array is usually consistent, which is related to the total size of the audio playback array and the array element spacing. Specifically, the frequency band of audible sound to the human ear is often 20Hz~20kHz, and the frequency sub-band range of each audio playback component often belongs to the frequency band of audible sound to the human ear, which can correspond to the high frequency sub-band, the middle frequency sub-band and the low frequency sub-band respectively.

[0086] The frequency sub-band range of each audio playback component can be obtained by calibrating or simulating the audio processing system in advance. Specifically, for the audio playback array, since the larger the total size of the audio playback array is when other directional parameters remain unchanged, the lower the lower limit frequency is, then the embodiment of the present invention can determine the lower limit frequency of the high-frequency sub-band by the total size of the audio playback array, and can determine the lowest frequency that can be achieved by the audio playback array while meeting the preset sound contrast and sound field reconstruction quality requirements through simulation or testing, and use it as the lower limit frequency of the high-frequency sub-band. At the same time, the smaller the array element spacing of the audio playback array, the higher the spatial aliasing frequency, so the upper limit frequency of the high-frequency sub-band can be determined according to the array element spacing:

[0087] ,

[0088] Among them, the above represents the spatial aliasing frequency, c represents the speed of sound in the air, d represents the array element spacing of the audio playback array, It represents the angle between the central axis of the array and the center of the target playback area, where the target playback area can be a playback area or a quality optimization area.

[0089] Optionally, if the audio processing system also includes other audio playback components in addition to the audio playback array, after obtaining the frequency sub-band range of the audio playback array, the frequency sub-band range of the other audio playback components can be determined according to the frequency response characteristics of the other audio playback components. Exemplarily, taking a vehicle as an example, usually, the intermediate frequency sub-bands connecting the high frequency sub-bands can be divided according to the characteristics of the vehicle tweeter and headrest speakers, and the low frequency sub-bands connecting the intermediate frequency sub-bands can be divided according to the characteristics of the vehicle mid-range, bass and subwoofer speakers. The above-mentioned high frequency sub-bands, intermediate frequency sub-bands and low frequency sub-bands can be further divided. For example, when there are ceiling speakers, the high frequency sub-bands can be further divided according to the number and layout of the ceiling speakers. When there are seat subwoofers, the intermediate frequency sub-bands and low frequency sub-bands can be further divided, etc.

[0090] Furthermore, through the above steps, the frequency sub-band range that each audio playback component in the audio processing system is responsible for can be obtained.

[0091] The above tap number refers to the number of filter taps, which is used to characterize the weight vector length of the filter. The higher the frequency, the more taps the filter requires. Specifically, the number of taps of each audio playback component can be determined by the following formula:

[0092] ,

[0093] Among them, the above f represents the upper limit frequency of the frequency sub-band range, Characterize the sampling rate, which is not less than twice f, the above Characterize the control frequency interval, which is not less than the frequency interval of adjacent points of the sound transfer function of the corresponding audio playback component. The number of taps corresponding to different frequency sub-band ranges can be obtained by the above formula. Further, based on the frequency sub-band range of each audio playback component, the calculated number of taps corresponding to different frequency sub-band ranges can be allocated to the audio playback component corresponding to each frequency sub-band range.

[0094] Exemplarily, taking a vehicle as an example, the filters corresponding to the high-frequency sub-band can be assigned to the center speaker array, the filters corresponding to the mid-frequency sub-band can be assigned to the vehicle tweeters and headrest speakers, and the filters corresponding to the low-frequency sub-band can be assigned to the vehicle mid-range, bass and subwoofer speakers.

[0095] Furthermore, after the number of taps of each audio playback component is obtained, it can be used as the weight vector length of the corresponding filter, and based on the target playback mode, the filter corresponding to each audio playback component can be determined through the corresponding filter algorithm.

[0096] In the embodiment of the present invention, in order to reduce the impact of the spatial aliasing effect brought by the audio playback array, the number of taps can be determined for different audio playback components according to the frequency sub-band range corresponding to each audio playback component, and the filter corresponding to the audio playback component can be determined according to the number of taps and the target playback mode, so that the determined filter is more compatible with the frequency sub-band range of the audio playback component. And by determining the number of taps for different audio playback components, the problem of low calculation efficiency caused by uniformly selecting a larger number of taps in the prior art is also avoided.

[0097] Optionally, in an embodiment of the present invention, determining the filter corresponding to each audio playback component based on the target playback mode and the number of taps of each audio playback component includes:

[0098] Determining a to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system;

[0099] Based on the acoustic transfer function corresponding to each of the audio playback components and the to-be-processed playback area, and the number of taps of each of the audio playback components, the filter corresponding to each of the audio playback components is determined.

[0100] The above-mentioned playback area refers to the sound area included in the audio processing system, which can be divided according to the spatial area of ​​the audio processing system. For example, taking the audio processing system belonging to a vehicle as an example, its playback area can include the main driving area, the co-pilot area, etc. in the vehicle.

[0101] The above-mentioned playback area to be processed refers to the playback area indicated by the target playback mode, and different types of target playback modes can indicate different playback areas to be processed. In one case, the playback mode can be divided into an isolated playback mode and an optimized playback mode. Accordingly, in the isolated playback mode, algorithms such as sound contrast control can be used to calculate the filters of each audio playback component. In the optimized playback mode, a sound quality enhancement algorithm can be used to calculate the filters of each audio playback component.

[0102] Optionally, the number of the to-be-processed playback areas may be one or more, which is not limited in the embodiment of the present invention.

[0103] Optionally, determining the to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system includes:

[0104] In the case that the target playback mode belongs to the isolation playback mode, a lossless playback area and a silent playback area indicated by the target playback mode are determined from the playback areas included in the audio processing system as playback areas to be processed.

[0105] Among them, the above-mentioned isolation playback mode refers to the playback mode of isolating the bright and dark areas, that is, setting the playback mode of the sound-heavy area and the sound-dark area, so that the audio is played in a specific sound area and the interference of other sound areas is reduced. Correspondingly, the above-mentioned lossless playback area is the target area (Bright Zone) where the sound is expected to be played without loss, which can also be called the bright area. The above-mentioned silent playback area is the silent area (Dark Zone) where the sound is expected to be shielded, which can also be called the dark area.

[0106] Specifically, the number of the lossless playback area may be one or more, and the number of the silent playback area may be one or more, which is not limited in the embodiment of the present invention.

[0107] Optionally, the audio to be processed in the embodiment of the present invention may be one or more, and the target playback modes corresponding to different audios to be processed may be the same or different, which is not limited by the embodiment of the present invention. Accordingly, any audio playback component may use different filters to perform filtering operations on multiple audios to be processed, obtain multiple signals to be played, and play the multiple signals to be played after superimposing them.

[0108] The isolated playback mode may include a single bright zone mode and a multiple bright zone mode. The single bright zone mode refers to playback of sound in only a single local sound zone, and other sound zones are dark zones. Correspondingly, the multiple bright zone mode refers to playback of sound in multiple local sound zones or all sound zones, and non-playback zones are dark zones.

[0109] Optionally, the overall playback mode of the audio processing system can also be determined according to the different numbers of audios to be processed. Specifically, when there is one audio to be processed, the overall playback mode may include a single-source single-brightness zone mode and a single-source multiple-brightness zone mode. Correspondingly, when there are multiple audios to be processed, the overall playback mode may include a multiple-source multiple-brightness zone mode, that is, multiple (≥2) audio sources are played simultaneously, and the multiple audio sources are reproduced in different areas, and the bright areas of different audio sources are mutually dark areas.

[0110] Among them, the above-mentioned acoustic transfer function can also be called an acoustic transfer function (ATF), which is used to characterize the signal correlation of audio transmission between a loudspeaker and a sound zone, and is a function used to describe the sound propagation and conversion characteristics in an acoustic system. It is related to the loudspeaker position and the sound zone position, and can be obtained by pre-calibrating the audio processing system. Specifically, the embodiment of the present invention can pre-calibrate the audio processing system to obtain the acoustic transfer function of each audio playback component and each sound zone, and pre-store it in a database of the audio processing system, so that after determining the lossless playback area and the silent playback area, the embodiment of the present invention can directly obtain the acoustic transfer function corresponding to each audio playback component and the sound zone as the lossless playback area, and the acoustic transfer function corresponding to the sound zone as the silent playback area from the database.

[0111] Optionally, in an embodiment of the present invention, the acoustic transfer function corresponding to each of the audio playback components and any of the playback areas may also be determined in the following manner:

[0112] For any audio playback component and any playback area, play a test signal through the audio playback component;

[0113] collecting a collection signal corresponding to the test signal through at least one measurement point pre-set in the playback area;

[0114] Based on the test signal and the collected signal, an acoustic transfer function corresponding to the audio playback component and the playback area is determined.

[0115] Specifically, for any audio playback component and any sound zone, one or more measurement points can be selected from the sound zone, and the spatial coordinates of the measurement points can be determined. A spatial coordinate system can be constructed in advance for the audio processing system to facilitate the determination of the spatial coordinates of the measurement points. Furthermore, a measurement microphone can be placed at each measurement point, and the audio playback component can play a test signal and record the acquisition signal collected by the measurement microphone. The test signal and the acquisition signal are cross-correlated to obtain a time domain impulse response. After Fourier transformation to the frequency domain, the sound transfer function of the audio playback component in the sound zone is obtained.

[0116] For example, Figure 4 is a schematic diagram of an acoustic transfer function measurement provided by an embodiment of the present invention, such as Figure 4 As shown, a vehicle is taken as an example, 71 is a center speaker array in the vehicle, 72 is a measurement point in different playback areas, and 73 is other vehicle speakers that are highly inconsistent with the configuration of the center speaker array. Figure 4 As shown, by playing the test signal through the audio playing component and collecting the signal at each measuring point, the acoustic transfer function corresponding to the audio playing component and each measuring point in each playing area can be determined.

[0117] Furthermore, after obtaining the sound transfer function of each audio playback component in each sound zone, the sound transfer function matrix of the audio processing system in different sound zones can be further constructed. Exemplarily, the sound transfer function matrix of the audio processing system can be expressed as:

[0118]

[0119] Wherein, a is the number of audio playback components included in the audio processing system, b is the number of measurement points selected in all sound zones, and h ab Represents the acoustic transfer function between the ath audio playback component and the bth measurement point.

[0120] Optionally, the above-mentioned acoustic transfer function may also be determined by pre-calibrating the audio processing system through a dedicated measuring instrument, which is not limited in the embodiment of the present invention.

[0121] Furthermore, the filter corresponding to each audio playback component can be determined based on the number of taps and the acoustic transfer function. Specifically, since the target playback mode belongs to the isolation playback mode, that is, there is a need to isolate the light and dark areas, in this case, the embodiment of the present invention can determine the filter based on the number of taps and the acoustic transfer function through the light and dark area isolation algorithm.

[0122] Among them, the bright and dark area separation algorithm can include an acoustic contrast control algorithm ACC, an acoustic contrast-sound pressure matching weighted control algorithm ACC-PM and a convex optimization algorithm.

[0123] Optionally, in an embodiment of the present invention, determining the filter corresponding to each audio playback component based on the acoustic transfer function corresponding to each audio playback component and the to-be-processed playback area and the number of taps of each audio playback component includes:

[0124] For any of the audio playback components, based on the acoustic transfer functions corresponding to the audio playback component and the lossless playback area and the silent playback area, respectively, and the number of taps of the audio playback component, determine the energy contrast of the audio playback component in the lossless playback area and the silent playback area;

[0125] Based on the energy contrast of each audio playback component, a filter corresponding to each audio playback component is determined.

[0126] Furthermore, the acoustic contrast control algorithm ACC, the acoustic contrast-sound pressure matching weighted control algorithm ACC-PM and the convex optimization algorithm may be used to calculate the energy contrast of the audio playback component and the corresponding filter.

[0127] Among them, the method of calculating the filter using the ACC algorithm is as follows:

[0128]

[0129] Among them, the above represents the calculated optimal filter, Characterization W corresponding to the maximum value is obtained, where W is an independent variable with dimension N and N is the number of taps. Characterizes the energy contrast between the bright area (lossless playback area) and the dark area (silent playback area). The above H is a conjugate operator, R B Characterize the bright area spatial correlation matrix, R D Characterize the dark region spatial correlation matrix.

[0130] Among them, the above R B The above R is calculated by the sound transfer function corresponding to the audio playback component and the bright area (lossless playback area). D It is calculated by the sound transfer function corresponding to the audio playback component and the dark area (silent playback area). The calculation method is as follows:

[0131] ,

[0132] ,

[0133] Among them, the above G represents the number of measurement points in the bright area or dark area, the above T represents the matrix transpose, and the above represents the acoustic transfer function between the audio playback component and the gth measurement point in the bright area. Accordingly, the above Represents the acoustic transfer function between the audio playback component and the gth measurement point in the dark area, where the value of g ranges from 1 to G.

[0134] Among them, the method of calculating the filter using the ACC-PM algorithm is as follows:

[0135]

[0136] Among them, the above Characterization makes W,d corresponding to the minimum value is a preset target sound field matrix, which is determined by the target sound pressure of each measurement point and can be an all-1 matrix. Characterizes the operator for taking the L2 norm, k is a preset weighting factor, and the value of k can be 0~1. The larger the k, the better the acoustic contrast control effect, and the worse the sound quality in the bright area. Correspondingly, the smaller the k, the worse the acoustic contrast control effect, and the better the sound quality in the bright area. The embodiment of the present invention can set the value of k according to actual needs. The meanings of other parameters are consistent with those of the ACC algorithm and will not be repeated here.

[0137] Among them, the method of calculating the filter using the convex optimization algorithm is as follows:

[0138] ,

[0139] st ,

[0140] Among them, the above st is used to characterize the constraints that need to be met during the optimization process, C= Characterizes the acoustic energy contrast between bright and dark areas, C con The preset minimum contrast value.

[0141] In addition, the meanings of other parameters in the formula are consistent with those of the ACC algorithm and the ACC-PM algorithm and will not be repeated here.

[0142] It should be noted that the above three algorithms can be further selected according to actual needs, and the embodiment of the present invention does not limit this. For example, if the user has low requirements for the quality of audio playback and high requirements for the separation of light and dark areas, the ACC algorithm can be used. If the user has high requirements for both the quality of audio playback and the separation of light and dark areas, the ACC-PM algorithm can be used. Correspondingly, if the user has high requirements for the quality of audio playback and low requirements for the separation of light and dark areas, the convex optimization algorithm can be used.

[0143] For example, taking new energy vehicles as an example, a large number of vehicle users currently regard the car cabin as the "third space" outside of work and family, and thus have higher requirements for the car cabin experience. For example, users hope to experience different audio content in different seats without interfering with each other, or to make the audio play only in a specific area without affecting other passengers. In order to achieve this goal, the sound isolation between seats is often improved by setting headrest speakers. Since the headrest speakers are closer to the ears of each passenger, the passengers can only listen to the corresponding audio through the headrest speakers of their seats to achieve sound field isolation. However, this method has high requirements on the user's own sitting posture, and the user's head needs to be confined to a smaller space, resulting in poor user comfort.

[0144] In the embodiment of the present invention, when the target playback mode belongs to the isolated playback mode, by determining the lossless playback area and the silent playback area, and determining the filters of each audio playback component according to the sound transfer function between the audio playback component and the two playback areas, each audio playback component can use a different filter to obtain a signal to be played, without the need to rely on a headrest speaker to achieve sound field isolation. While achieving accurate isolation of light and dark areas of the sound field in the playback area, there is no need to impose requirements on the user's own sitting posture, thereby providing better comfort.

[0145] Optionally, in an embodiment of the present invention, determining the to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system includes:

[0146] In the case that the target playback mode belongs to the optimized playback mode, a target optimized area indicated by the target playback mode is determined from the playback areas included in the audio processing system as the playback area to be processed.

[0147] Among them, the above-mentioned optimized playback mode refers to a playback mode that optimizes the sound quality, and the target optimization area refers to a specific sound area where the sound quality needs to be optimized, which can be one or more. For example, taking a vehicle as an example, the user can choose to optimize the sound quality of the main driving area and / or the co-pilot area. Furthermore, in the case where the target optimization area is all the sound areas included in the audio processing system, the target playback mode can be an overall sound quality enhancement mode, that is, a sound quality optimization mode that takes into account all sound areas. Correspondingly, in the case where the target optimization area does not include all sound areas, the target playback mode can be a local sound quality enhancement mode, that is, a sound quality optimization mode for a specific sound area.

[0148] Specifically, when the target playback mode belongs to the optimized playback mode, the filter can be calculated by selecting the acoustic optimization algorithm based on the acoustic transfer function corresponding to the audio playback component and the target optimization area, and the number of taps. The acoustic optimization algorithm may include a sound pressure matching algorithm PM and a bright area frequency response control algorithm.

[0149] Among them, the PM algorithm can be calculated by the following formula:

[0150] ,

[0151] The H in this formula B It is used to characterize the acoustic transfer function corresponding to the audio playback component and the target optimization area. The meanings of other parameters are consistent with the above-mentioned ACC algorithm and ACC-PM algorithm, and will not be repeated here.

[0152] Among them, the bright area frequency response control algorithm can include the following three formulas, and any one of them can be used for calculation:

[0153] Take the reference frequency response as the constraint: ,

[0154] Among them, the above R i (f) = H i W, the frequency response vector used to characterize the i-th measurement point in the target optimization area, and the acoustic transfer function H through the i-th measurement point in the target optimization area i The above I represents the number of measurement points in the target optimization area, J is used to represent the number of discrete frequency points contained in the frequency response vector, and f j Represents the jth discrete frequency point in the frequency response vector, f ref Characterizes the preset frequency response reference frequency. In addition, J is not greater than the acoustic transfer function H i The number of data points.

[0155] The difference value of the response of adjacent frequency points is used as a constraint:

[0156] .

[0157] The meanings of the above parameters are consistent with the formula constrained by the reference frequency response, and will not be repeated here.

[0158] The mean value of the frequency response is constrained:

[0159] .

[0160] Among them, the above E[] is the mean operator, Characterizes the mean value of the frequency response vector. The meanings of other parameters are consistent with the formula constrained by the reference frequency response, and will not be repeated here.

[0161] In an embodiment of the present invention, when the target playback mode belongs to the optimized playback mode, the filter corresponding to the audio playback component is determined based on the acoustic transfer function and the number of taps corresponding to the target optimization area, so as to achieve sound quality optimization of the target optimization area.

[0162] For example, taking the application of the audio processing system to a vehicle as an example, Figure 5 is a schematic diagram of the structure of an audio processing system provided by an embodiment of the present invention, such as Figure 5 As shown, the audio processing system may be a vehicle-mounted multi-zone sound field control system, which may include a vehicle-mounted speaker system 21 and a sound field control algorithm system 22 .

[0163] Among them, the vehicle-mounted speaker system corresponds to the above-mentioned audio playback component, and the sound field control algorithm system corresponds to the above-mentioned processing end.

[0164] Optionally, the vehicle-mounted multi-zone sound field control system described in the present invention can be used in cars equipped with 2.0 stereo, 4.0 stereo, 5.1 surround sound, 7.1 surround sound, 7.1.4 panoramic sound and higher specification audio systems, and can also be used in vehicles such as motor vehicles, airplanes and ships equipped with audio systems.

[0165] Further, Figure 6 is a flow chart of an audio processing method based on a vehicle-mounted multi-zone sound field control system provided by an embodiment of the present invention, such as Figure 6 As shown, the embodiment of the present invention can pre-calculate the array signal control filter bank offline according to different playback modes to be selected, which includes finite impulse response filter banks (FIR-Banks) corresponding to different modes (Modes), and each FIR-Bank includes the same number of FIR filters as the speaker units of the whole vehicle. The user can select a mode from the playback modes to be selected, and then after obtaining the sound source and the mode corresponding to the sound source, determine the target filter bank FIR-Bank from the array signal control filter bank, and then use the filters corresponding to each speaker in the target filter bank to filter the sound source respectively, obtain array audio signals corresponding to different filters, and transmit each array audio signal to the corresponding speaker for playback. Figure 6 Taking the vehicle speaker system including a center speaker array and other vehicle speakers as an example, the center speaker array includes P array elements, and the number of other vehicle speakers is Q, then P+Q array audio signals can be obtained.

[0166] Figure 7 is a schematic diagram of the structure of another audio processing system provided by an embodiment of the present invention. Figure 7As shown, the system may include: a processing end 201 and at least one audio playback array 202; the processing end 201 is connected to the at least one audio playback array 202, and the audio playback array 202 includes at least two audio playback components 2021. The processing end 201 is used to:

[0167] Obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed;

[0168] Based on the target playback mode, determining the filter corresponding to each of the audio playback components;

[0169] Each of the filters is used to perform a filtering operation on the audio to be processed to obtain a signal to be played corresponding to each of the filters, and the signal to be played corresponding to each of the filters is respectively transmitted to the audio playback component corresponding to each of the filters for playback.

[0170] Optionally, the processing end 201 is further used for:

[0171] Based on the frequency sub-band range corresponding to each of the audio playback components, obtaining the number of taps of each of the audio playback components;

[0172] Based on the target playback mode and the number of taps of each audio playback component, a filter corresponding to each audio playback component is determined.

[0173] Optionally, the processing end 201 is further used for:

[0174] Determining a to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system;

[0175] Based on the acoustic transfer function corresponding to each of the audio playback components and the to-be-processed playback area, and the number of taps of each of the audio playback components, the filter corresponding to each of the audio playback components is determined.

[0176] Optionally, the processing end 201 is further used for:

[0177] In the case that the target playback mode belongs to the isolation playback mode, a lossless playback area and a silent playback area indicated by the target playback mode are determined from the playback areas included in the audio processing system as playback areas to be processed.

[0178] Optionally, the processing end 201 is further used for:

[0179] For any of the audio playback components, based on the acoustic transfer functions corresponding to the audio playback component and the lossless playback area and the silent playback area, respectively, and the number of taps of the audio playback component, determine the energy contrast of the audio playback component in the lossless playback area and the silent playback area;

[0180] Based on the energy contrast of each audio playback component, a filter corresponding to each audio playback component is determined.

[0181] Optionally, the processing end 201 is further used for:

[0182] In the case that the target playback mode belongs to the optimized playback mode, a target optimized area indicated by the target playback mode is determined from the playback areas included in the audio processing system as the playback area to be processed.

[0183] Optionally, the processing end 201 is further used for:

[0184] For any audio playback component and any playback area, play a test signal through the audio playback component;

[0185] collecting a collection signal corresponding to the test signal through at least one measurement point pre-set in the playback area;

[0186] Based on the test signal and the collected signal, an acoustic transfer function corresponding to the audio playback component and the playback area is determined.

[0187] Optionally, the processing end 201 is further used for:

[0188] In response to a first interaction operation of a user, acquiring audio indicated by the first interaction operation as audio to be processed;

[0189] In response to a second interaction operation of the user on the audio to be processed, a play mode indicated by the second interaction operation is obtained as a target play mode.

[0190] Optionally, the audio processing system further includes at least one audio playback component having an installation height inconsistent with that of the audio playback components included in the audio playback array.

[0191] The audio processing system provided by the embodiment of the present invention no longer adopts a fixed playback mode to avoid having all audio playback components receive uniform audio for direct playback. The target playback mode can be used to determine the corresponding filters for each audio playback component for filtering. Accordingly, the signals to be played after the filtering operation received by different audio playback components are different, thereby improving the flexibility and diversity of audio playback. At the same time, by setting at least one audio playback array including at least two audio playback components, based on the interference effect, the audio signals output by each audio playback component in the audio playback array are superimposed or offset at different propagation distances, and the audio signal can be focused on the superimposed area to achieve the directionality of the audio. Therefore, by setting the audio playback array in the audio processing system, the embodiment of the present invention can facilitate the control of the directionality of audio playback.

[0192] The embodiment of the present invention further provides a vehicle, such as Figure 8 As shown, it includes a processor 401, a memory 402 and an audio processing program 4021 stored in the memory. When the processor executes the audio processing program stored in the memory, the following steps are implemented: obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed; based on the target playback mode, determining the filter corresponding to each of the audio playback components; using each of the filters to filter the audio to be processed to obtain the signal to be played corresponding to each of the filters, and transmitting the signal to be played corresponding to each of the filters to the audio playback components corresponding to each of the filters for playback.

[0193] The processor 401 may also implement other steps in the above audio processing method, which will not be described in detail here.

[0194] The embodiment of the present invention further provides an electronic device, such as Fig. 9 As shown, it includes a processor 501 , a communication interface 502 , a memory 503 and a communication bus 504 , wherein the processor 501 , the communication interface 502 , and the memory 503 communicate with each other via the communication bus 504 .

[0195] The memory 503 is used to store computer programs.

[0196] When the processor 501 is used to execute the program stored in the memory 503, the following steps are implemented: obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed; based on the target playback mode, determining the filter corresponding to each of the audio playback components; using each of the filters to filter the audio to be processed to obtain the signal to be played corresponding to each of the filters, and transmitting the signal to be played corresponding to each of the filters to the audio playback components corresponding to each of the filters for playback.

[0197] The processor 501 may also implement other steps in the above audio processing method, which will not be described in detail here.

[0198] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0199] The communication interface is used for communication between the above electronic device and other devices.

[0200] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0201] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0202] In another embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores instructions. When the instructions are executed on a computer, the computer executes the audio processing method described in the above embodiment.

[0203] In another embodiment of the present invention, a computer program product including instructions is provided. When the computer program product is run on a computer, the computer executes the audio processing method described in the above embodiment.

[0204] In another embodiment of the present invention, a vehicle is provided, the vehicle includes an audio processing system, the audio processing system includes a processing end and at least one audio playback array, the audio playback array includes at least two audio playback components; the processing end is used to:

[0205] Obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed;

[0206] Based on the target playback mode, determining the filter corresponding to each of the audio playback components;

[0207] Each of the filters is used to perform a filtering operation on the audio to be processed to obtain a signal to be played corresponding to each of the filters, and the signal to be played corresponding to each of the filters is respectively transmitted to the audio playback component corresponding to each of the filters for playback.

[0208] Among them, the processing end can also implement other steps in the above audio processing method, which will not be repeated here.

[0209] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.

[0210] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0211] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. For the embodiments of the device, electronic device, computer-readable storage medium and computer program products containing instructions, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0212] The above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. An audio processing method, characterized in that: The method is applied to a processing end included in an audio processing system, the audio processing system also includes at least one audio playback array, the processing end is connected to the at least one audio playback array, the audio playback array includes at least two audio playback components, and the method includes: Obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed; Based on the frequency sub-band range corresponding to each of the audio playback components, the number of taps of each of the audio playback components is obtained; the frequency sub-band range is determined based on the size and spacing of the audio playback components; Determining a to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system; Determine the filter corresponding to each audio playback component based on the acoustic transfer function corresponding to each audio playback component and the to-be-processed playback area, and the number of taps of each audio playback component; Each of the filters is used to perform a filtering operation on the audio to be processed to obtain a signal to be played corresponding to each of the filters, and the signal to be played corresponding to each of the filters is respectively transmitted to the audio playback component corresponding to each of the filters for playback.

2. The method according to claim 1, characterized in that The step of determining the to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system comprises: In the case that the target playback mode belongs to the isolation playback mode, a lossless playback area and a silent playback area indicated by the target playback mode are determined from the playback areas included in the audio processing system as playback areas to be processed.

3. The method according to claim 2, characterized in that The determining of the filter corresponding to each audio playback component based on the acoustic transfer function corresponding to each audio playback component and the to-be-processed playback area and the number of taps of each audio playback component comprises: For any of the audio playback components, based on the acoustic transfer functions corresponding to the audio playback component and the lossless playback area and the silent playback area, respectively, and the number of taps of the audio playback component, determine the energy contrast of the audio playback component in the lossless playback area and the silent playback area; Based on the energy contrast of each audio playback component, a filter corresponding to each audio playback component is determined.

4. The method according to claim 1, characterized in that: The step of determining the to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system comprises: In the case that the target playback mode belongs to the optimized playback mode, a target optimized area indicated by the target playback mode is determined from the playback areas included in the audio processing system as the playback area to be processed.

5. The method according to claim 1, characterized in that The acoustic transfer function corresponding to each of the audio playback components and any of the playback areas is determined in the following manner: For any audio playback component and any playback area, play a test signal through the audio playback component; collecting a collection signal corresponding to the test signal through at least one measurement point pre-set in the playback area; Based on the test signal and the collected signal, an acoustic transfer function corresponding to the audio playback component and the playback area is determined.

6. The method according to any one of claims 1 to 5, characterized in that: The obtaining of the audio to be processed and the target playback mode corresponding to the audio to be processed includes: In response to a first interaction operation of a user, acquiring audio indicated by the first interaction operation as audio to be processed; In response to a second interaction operation of the user on the audio to be processed, a play mode indicated by the second interaction operation is obtained as a target play mode.

7. The method according to any one of claims 1 to 5, characterized in that: The audio processing system further includes at least one audio playback component whose installation height is inconsistent with that of the audio playback components included in the audio playback array.

8. An audio processing system, characterized in that: The audio processing system includes a processing end and at least one audio playback array, wherein the processing end is connected to the at least one audio playback array, and the audio playback array includes at least two audio playback components; the processing end is used to: Obtaining the audio to be processed and the target playback mode corresponding to the audio to be processed; Based on the frequency sub-band range corresponding to each of the audio playback components, the number of taps of each of the audio playback components is obtained; the frequency sub-band range is determined based on the size and spacing of the audio playback components; Determining a to-be-processed playback area indicated by the target playback mode from the playback areas included in the audio processing system; Determine the filter corresponding to each audio playback component based on the acoustic transfer function corresponding to each audio playback component and the to-be-processed playback area, and the number of taps of each audio playback component; Each of the filters is used to perform a filtering operation on the audio to be processed to obtain a signal to be played corresponding to each of the filters, and the signal to be played corresponding to each of the filters is respectively transmitted to the audio playback component corresponding to each of the filters for playback.

9. An electronic device, characterized in that: include: A processor, a communication interface, a memory and a communication bus; wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory, used to store computer programs; The processor is used to implement the steps in the audio processing method as described in any one of claims 1 to 7 when executing the program stored in the memory.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the audio processing method according to any one of claims 1 to 7 are implemented.

11. A vehicle, characterized in that: The method comprises a processor, a memory and an audio processing program stored in the memory. When the processor executes the audio processing program stored in the memory, the steps in the audio processing method according to any one of claims 1 to 7 are implemented.

Images