Sound field partitioning method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a sound field partition control method. The method comprises the following steps: acquiring a plurality of first transfer functions between a plurality of first playing devices and a plurality of control points in a target scene; obtaining a bright area transfer function array and a dark area transfer function array according to the plurality of first transfer functions and a sound field control area where each control point is located; based on the bright region transfer function array and the dark region transfer function array, determining a target filter coefficient corresponding to each first playing device when the sound energy contrast ratio between a declaration control region and a sound-dark control region reaches a specified condition, according to the embodiment of the invention, the audio needing to be played is filtered and then played by using the target filtering coefficient corresponding to each first playing device, so that the sound energy in the declaration control region can be ensured to be obviously higher than that in the sound-dark control region, namely, the audio is clearly audible only in the declaration control region and hardly audible in the sound-dark control region, and thus clear partitioning of a sound field is realized.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and more specifically, to a sound field partitioning method, device, electronic device and storage medium. Background Art

[0002] In the related art, audio is played on a playback device in a target scene, and each position in the target scene usually has a good sense of hearing. However, for some audio, usually only people in some areas of the target scene need to be able to hear it, while people in other areas cannot hear it. Taking the target scene as a driving scene as an example, when the vehicle is driving, some operations of the driver may trigger the vehicle's interactive prompt sounds, such as driving mode switching sounds, steering prompt sounds, gear switching sounds or driving navigation sounds, etc. These signals have certain meanings for the driver. However, for other passengers in the car, they may be resting or concentrating on a certain work and do not want to be disturbed. Based on this, providing a sound field zoning control for such sounds is a technical problem that needs to be solved urgently. Summary of the invention

[0003] In view of this, the embodiments of the present application propose a sound field partitioning method, device, electronic device and storage medium, by obtaining the target filter coefficient corresponding to each second playback device when the sound energy contrast between the declaration control area and the sound and darkness control area reaches a specified condition, so that after filtering and playing the sound using the target filter coefficient corresponding to each second playback device, the sound in the declaration control area is louder and the sound in the sound and darkness control area is smaller, thereby realizing the sound field partitioning of the target scene.

[0004] In a first aspect, an embodiment of the present application provides a sound field zoning method, the method comprising: obtaining a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points in a target scene, the plurality of control points being respectively arranged in a plurality of sound field control zones, the plurality of sound field control zones including at least one declared control zone and at least one sound-dark control zone; obtaining a bright area transfer function array and a dark area transfer function array according to the plurality of first transfer functions and the sound field control zone where each control point is located, the bright area transfer function array including the transfer function between each of the first playback devices and each control point in the declared control zone, the dark area transfer function array including the transfer function between each of the first playback devices and each control point in the sound-dark control zone; based on the bright area transfer function array and the dark area transfer function array, determining a target filter coefficient corresponding to each of the first playback devices when the sound energy contrast between the declared control zone and the sound-dark control zone reaches a specified condition, the specified condition including that the sound energy contrast reaches a preset contrast threshold or reaches a maximum value.

[0005] Second aspect, an embodiment of the present application provides an acoustic field zoning device. The device includes a transfer function acquisition module, configured to acquire a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points in a target scene, where the plurality of control points are respectively arranged in a plurality of acoustic field control areas, and the plurality of acoustic field control areas include at least one declared control area and at least one sound-dark control area; an array generation module, configured to obtain a bright area transfer function array and a dark area transfer function array according to the plurality of first transfer functions and the acoustic field control area where each control point is located, where the bright area transfer function array includes transfer functions between each of the first playback devices and each control point in the declared control area, and the dark area transfer function array includes transfer functions between each of the first playback devices and each control point in the sound-dark control area; an acoustic field zoning parameter determination module, configured to determine, based on the bright area transfer function array and the dark area transfer function array, target filter coefficients corresponding to each of the first playback devices when the acoustic energy contrast between the declared control area and the sound-dark control area reaches a specified condition, where the specified condition includes that the acoustic energy contrast reaches a preset contrast threshold or reaches a maximum value.

[0006] In an implementable manner, the transfer function acquisition module includes a signal acquisition sub-module, a transfer function generation sub-module, and a transfer function acquisition sub-module; the signal acquisition sub-module is configured to acquire a plurality of audio signals obtained by a plurality of audio acquisition devices in the target scene respectively collecting swept-frequency signals sequentially played by a plurality of playback devices arranged in the target scene, where each audio signal corresponds to an audio acquisition device and a playback device, and the plurality of playback devices include second playback devices arranged at each of the control points and the plurality of first playback devices; the transfer function generation sub-module is configured to generate a transfer function corresponding to the audio signal according to the swept-frequency signal and the audio signal; the plurality of transfer functions include a plurality of second transfer functions between the plurality of audio acquisition devices and the plurality of first playback devices and a plurality of third transfer functions between the plurality of audio acquisition devices and the plurality of control points; the transfer function acquisition sub-module is configured to multiply the second transfer functions and the third transfer functions with the same audio acquisition device in the plurality of second transfer functions and the plurality of third transfer functions to obtain a plurality of first transfer functions between the plurality of control points and the plurality of first playback devices.

[0007] In an implementable manner, the transfer function generation sub-module is further configured to respectively convert the swept-frequency signal and the audio signal from the time domain to the frequency domain to obtain a first frequency domain signal corresponding to the swept-frequency signal and a second frequency domain signal corresponding to the audio signal; and obtain a transfer function corresponding to the audio signal according to the frequency domain representations of the first frequency domain signal and the second frequency domain signal at each frequency point.

[0008] In an implementable manner, the sound field zoning parameter determination module includes a function construction sub-module and a function solution sub-module; the function construction sub-module is configured to construct an optimization function regarding the filter coefficients corresponding to the plurality of first playback devices and the sound energy contrast ratio between the declared control area and the sound-dark control area based on the bright area transfer function array and the dark area transfer function array; the function solution sub-module is configured to solve the optimization function to obtain the target filter coefficients corresponding to each of the first playback devices when the sound energy contrast ratio between the declared control area and the sound-dark control area reaches a specified condition.

[0009] In an implementable manner, the longitudinal arrangement order of the first playback devices in the first function transfer array is the same as that in the second function array; the filter coefficients corresponding to the plurality of first playback devices form a filter coefficient array, and the sorting of the first playback devices to which the filter coefficients in the filter coefficient array belong is the same as the longitudinal arrangement order of each first playback device in the dark area transfer function array; the function construction sub-module is further configured to use the ratio obtained by dividing the first dot product result obtained by sequentially dot-multiplying the target array, the bright area transfer function array, and the filter coefficient array by the second dot product result obtained by sequentially dot-multiplying the target array, the dark area transfer function array, and the filter coefficient array as the sound energy contrast ratio between the declared control area and the sound-dark control area, where the target array is an array obtained by conjugating and transposing the filter coefficient array.

[0010] In an implementable manner, the array generation module is further configured to construct a bright area transfer function array based on the first transfer functions corresponding to the control points in the declared control area; construct a dark area transfer function array based on the first transfer functions corresponding to the control points in the sound-dark control area.

[0011] In an implementable manner, the sound field zoning device further includes an audio acquisition module, a coefficient adjustment module, and a filtering processing module; the audio acquisition module is configured to acquire the audio to be played; the coefficient adjustment module is configured to adjust the current filter coefficients corresponding to each of the first playback devices to the target filter coefficients when it is determined that the audio to be played is an audio that requires sound field zoning; the filtering processing module is configured to filter the audio to be played according to the target filter coefficients corresponding to each of the first playback devices and then send it to the corresponding first playback device for playback.

[0012] In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory; one or more programs are stored in the memory and are configured to be executed by the processor to implement the above method.

[0013] In an implementable manner, the electronic device includes a vehicle, the vehicle includes a plurality of seats, a plurality of audio collection devices, and a plurality of first playback devices, and the plurality of audio collection devices and the plurality of first playback devices are respectively arranged on the vehicle body; the control points are arranged on the seats, and at least one control point is correspondingly arranged for each seat.

[0014] In an implementable manner, the plurality of seats include a driver's seat, the sound field control area where the control point is arranged on the driver's seat is the sound control area, and the sound field control area where the control point is arranged on the seats other than the driver's seat among the plurality of seats is the sound dark control area.

[0015] In an implementable manner, the plurality of first playback devices include a plurality of bass speakers and a plurality of midrange speakers, and the maximum value of the working frequency range of the bass speakers is less than the maximum value of the sound frequency range of the midrange speakers.

[0016] Fourthly, an embodiment of the present application provides a computer-readable storage medium, in which program codes are stored, and when the program codes are run by a processor, the above-mentioned method is executed.

[0017] A sound field zoning method, device, electronic device and storage medium provided by an embodiment of the present application. By obtaining a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points in a target scene, and constructing a bright area transfer function array and a dark area transfer function array according to the plurality of first transfer functions and the sound field control area where each control point is located, so as to determine, based on the bright area transfer function array and the dark area transfer function array, the target filter coefficients corresponding to each second playback device when the sound energy contrast between the sound control area and the sound dark control area reaches a specified condition, and by filtering the audio to be played with the target filter coefficients corresponding to each first playback device and then playing it, it can be ensured that the sound energy in the sound control area is significantly higher than that in the sound dark control area, that is, the audio is only clearly audible in the sound control area and almost inaudible in the sound dark control area, thereby realizing clear zoning of the sound field in the target scene. Description of the Drawings

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative efforts.

[0019] Figure 1 The flowchart showing a sound field zoning method provided by an embodiment of the present application is shown;

[0020] Figure 2 shows a schematic structural diagram of a vehicle provided by an embodiment of the present application;

[0021] Figure 3 shows Figure 1 a schematic flowchart of step S110 in;

[0022] Figure 4 shows another schematic structural diagram of a vehicle provided by an embodiment of the present application;

[0023] Figure 5 shows another schematic flowchart of a sound field zoning method provided by an embodiment of the present application;

[0024] Figure 6 shows a flowchart of a sound field zoning method provided by an embodiment of the present application;

[0025] Figure 7 shows a connection block diagram of a sound field zoning device proposed by an embodiment of the present application;

[0026] Figure 8 shows a structural block diagram of an electronic device for executing the method of an embodiment of the present application. Detailed implementation manners

[0027] Now, example embodiments will be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more complete and comprehensive, and will fully convey the concept of the example embodiments to those skilled in the art.

[0028] In addition, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present application. However, those skilled in the art will realize that the technical solutions of the present application can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. can be used. In other cases, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the present application.

[0029] The block diagrams shown in the drawings are only functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0030] The flowcharts shown in the accompanying drawings are only illustrative and not necessarily include all contents and operations / steps, nor are they necessarily executed in the described order. For example, some operations / steps can be decomposed, while some operations / steps can be combined or partially combined. Therefore, the actual execution order may change according to the actual situation.

[0031] It should be noted that: "a plurality of" mentioned in this article means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after.

[0032] Figure 1 Specifically, the sound field zoning method of the present application is shown. This method can be applied to an electronic device, and the electronic device can be a terminal device or a server. The terminal device can be a mobile terminal or a vehicle, etc. This method includes:

[0033] Step S110: Obtain a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points within a target scene.

[0034] Among them, a plurality of control points are respectively set in a plurality of sound field control areas, and the plurality of sound field control areas include at least one sound declaration control area and at least one sound darkness control area.

[0035] The target scene can be a vehicle driving scene. In this scene, the sound declaration control area can be near the driver's seat, and the sound darkness control area can be near other seats in the vehicle except the driver's seat. Exemplarily, the sound declaration control area can specifically be the area where the human ear is located during the normal driving process of the vehicle when a driver is sitting in the driver's seat of the vehicle. In this case, if there is one control point in the sound declaration area, the control point can be located at the midpoint of the line connecting the human ears on both sides of the driver; Exemplarily, as Figure 2 shown, if there are two control points in the sound declaration area, they can be respectively set at positions near the human ears on both sides of the driver. When there are multiple control points, they can be arranged at intervals near the human ears on both sides. It is worth mentioning that the setting method of the positions of the control points in the sound darkness area can be similar to the setting method of the positions of the control points in the sound declaration area, and will not be elaborated here one by one.

[0036] The target scene can also be a meeting room, a theater or a concert venue, etc. Exemplarily, when the target scene is a meeting room, the sound declaration area can be the podium, and the sound darkness area can be the audience area; when the target scene is a theater or a concert venue, the sound declaration control area can be the auditorium to ensure the best auditory effect of music or performance sounds; the sound darkness control area can be the backstage or other non-viewing areas to reduce sound leakage.

[0037] Among them, multiple first playback devices in the target scenario may refer to devices fixedly arranged in the target scenario for playing audio signals, such as speakers in a vehicle (e.g., it may include a woofer with a frequency range of 0 - 200 Hz and a midrange speaker with a frequency range of 200 - 20 KHz), and speakers fixedly installed in a meeting room, theater, or concert venue.

[0038] The first transfer function is used to represent the amplitude and phase changes of the signal during the propagation of the sound signal from the first playback device to the control point.

[0039] In one implementable manner, the above step S110 may be: when audio acquisition devices (e.g., microphones) are respectively arranged at each control point, controlling the multiple first playback devices to sequentially play known test signals (e.g., sweep signals), obtaining the audio collected by the audio acquisition devices at each control point for the test signals played by each first playback device, converting the audio collected by the audio acquisition devices at each control point and the test signals into frequency - domain representations, and comparing the frequency - domain representations of the audio collected by the audio acquisition devices with the frequency - domain representation of the test signal (to calculate the amplitude and phase difference at each frequency point) to obtain the first transfer function.

[0040] Exemplarily, if the number of multiple first playback devices is k (where, when K is 8, the numbers of the multiple first playback devices are k = 1, 2,...., 8), and the number of multiple control points is specifically j (where, when j is 8, the numbers of the multiple control points are j = 1, 2,...., 8), then the number of multiple first transfer functions is k×j, where any one of the first transfer functions can be expressed as G k,j 。

[0041] Step S120: Obtain a bright - area transfer - function array and a dark - area transfer - function array according to the multiple first transfer functions and the sound - field control area where each control point is located.

[0042] Among them, the bright - area transfer - function array includes the transfer functions between each of the first playback devices and each control point in the bright - area control region, and the dark - area transfer - function array includes the transfer functions between each of the first playback devices and each control point in the dark - area control region.

[0043] In one implementable manner, the above step S120 may specifically be to construct a bright - area transfer - function array based on the first transfer functions corresponding to the control points in the bright - area control region; construct a dark - area transfer - function array based on the first transfer functions corresponding to the control points in the dark - area control region.

[0044] Exemplarily, if the number of multiple control points is specifically 8, and the control points numbered 1 and 2 among the multiple control points are located in the declared control area, and the control points numbered 3 to 8 are located in the sound-dark control area, then the bright area transfer function array can be expressed as The second transfer function array can be expressed as: Wherein, the longitudinal arrangement order of the first playback device in the first function transfer array and the second function array is the same.

[0045] Step S130: Based on the bright area transfer function array and the dark area transfer function array, determine the target filter coefficients corresponding to each of the first playback devices when the sound energy contrast between the declared control area and the sound-dark control area reaches a specified condition.

[0046] Wherein, the specified condition includes that the sound energy contrast reaches a preset contrast threshold or reaches the maximum value.

[0047] The sound energy contrast between the declared control area and the sound-dark control area refers to the ratio of the sound energy in the declared control area to the sound energy in the sound-dark control area. Among them, when the audio to be played is filtered by the target filter coefficients corresponding to the first playback device when the sound energy contrast reaches the specified condition and then played through the corresponding first playback device, the sound can be enhanced in the declared control area, while the sound can be weakened or eliminated in the sound-dark control area.

[0048] In an implementable manner, an optimization model can be constructed to solve the target filter coefficients that make the sound energy contrast reach the specified condition. Specifically, the sound energy contrast can be used as the optimization target, and the objective function can be expressed as the ratio of the sound energy in the declared control area to the sound energy in the sound-dark control area. Use numerical optimization algorithms (such as gradient descent method, conjugate gradient method, genetic algorithm, etc.) to solve the optimal solution of the objective function to obtain the filter coefficients that make the sound energy contrast reach the preset contrast threshold or the maximum value.

[0049] Under this implementation manner, the above step S130 includes:

[0050] Step S130a: Based on the bright area transfer function array and the dark area transfer function array, construct an optimization function regarding the filter coefficients corresponding to the multiple first playback devices and the sound energy contrast between the declared control area and the sound-dark control area.

[0051] Specifically, the longitudinal arrangement order of the first playback devices in the first function transfer array is the same as that in the second function array; the filtering coefficients corresponding to the multiple first playback devices form a filtering coefficient array, and the sorting of the first playback devices to which the respective filtering coefficients in the filtering coefficient array belong is the same as the longitudinal arrangement order of the first playback devices in the dark area transfer function array; specifically, the above step S130a may be to use the ratio obtained by comparing the first multiplication result obtained by successively multiplying the target array, the bright area transfer function array, and the filtering coefficient array with the second multiplication result obtained by successively multiplying the target array, the dark area transfer function array, and the filtering coefficient array as the sound energy contrast between the statement control area and the sound-dark control area, where the target array is an array obtained by conjugating and transposing the filtering coefficient array.

[0052] Step S130b: Solve the optimization function to obtain the target filtering coefficients corresponding to the respective first playback devices when the sound energy contrast between the statement control area and the sound-dark control area reaches a specified condition.

[0053] Exemplarily, the filter coefficient array is q = [q1 q2…q k T , which represents the filter coefficient corresponding to the first playback device numbered k, and the superscript T represents the transpose of the vector [q1 q2…q k ; the purpose of sound field partition control is to solve the filter coefficient array q so that the sound wave signals emitted by multiple first playback devices interfere in a specific area to form a statement area and a sound-dark area, where the sound energy contrast is The superscript H represents the conjugate and transpose of the filter coefficient array q. By solving the maximization of the sound volume contrast The target filter coefficients of the respective first playback devices can be obtained where Eig is the abbreviation of Eigenvalue, representing the eigenvalue decomposition of the matrix .

[0054] In another implementable manner, an adaptive filtering algorithm (such as the least mean square error algorithm, LMS) can be used to dynamically adjust the filtering coefficients so that the sound energy contrast gradually approaches the specified condition. Specifically, the initial filtering coefficients of the respective first playback devices can be set, the actual sound energy contrast of the first playback devices under the initial filtering coefficients can be obtained, and the initial filtering coefficients of the respective first playback devices can be iteratively updated using an adaptive algorithm according to the actual sound energy contrast until the actual sound energy contrast obtained after the iterative process reaches a preset contrast threshold or no longer changes significantly, and then the iteration is stopped. The initial filtering coefficients of the respective first playback devices updated for the last time are used as the target filtering coefficients of the respective first playback devices.

[0055] ​By adopting the above method of the present application, first, by controlling the sound field control area where the control points are located, an array of bright area transfer functions corresponding to the control points in the declared control area and an array of dark area transfer functions corresponding to the control points in the sound dark area are constructed, so as to establish independent sound field models for the declared control area and the sound dark control area respectively, which is convenient for subsequent optimization of different areas; further, based on the array of bright area transfer functions and the array of dark area transfer functions, when the sound energy contrast between the declared control area and the sound dark control area reaches a specified condition, the target filter coefficients corresponding to each of the first playback devices are determined. By filtering the audio to be played with the target filter coefficients corresponding to each first playback device and then playing it, it can be ensured that the sound energy in the declared control area is significantly higher than that in the sound dark control area, that is, the audio is only clearly audible in the declared control area and almost inaudible in the sound dark control area, thus realizing clear zoning of the sound field.

[0056] By adopting the above settings, sound leakage can be prevented in occasions where privacy needs to be protected, and noise pollution can be reduced in occasions where noise control is required. For example, when the main driver in a vehicle answers a call through multiple first audio devices, only the sound at the main driver's seat is clearly audible and the sound at other seats is relatively small, thus avoiding privacy leakage. Or when a reminder sound is played through multiple first audio devices in a vehicle, only the sound at the main driver's seat is clearly audible and the sound at other seats is relatively small, thus avoiding the noise pollution caused by the reminder sound to the passengers in other seats.

[0057] Considering that audio acquisition devices and multiple audio playback devices have been set in the target scenario in some cases. For example, the electronic device is a vehicle, the target scenario is a vehicle scenario, and multiple audio acquisition devices and multiple first playback devices are usually set in the vehicle. To ensure the accuracy and effectiveness of sound field zoning control, and to avoid the influence of various factors such as reflection, refraction, and absorption on the propagation of sound waves in a complex environment (such as inside a vehicle), directly measuring the transfer function may not be accurate enough. Also, due to the limited space inside the vehicle and the complex layout of the devices, it may be difficult to directly measure the transfer function between each playback device and the control point.

[0058] Please refer to Figure 3 , in an implementable manner, the above step S110 includes:

[0059] Step S112: Obtain multiple audio signals collected by multiple audio acquisition devices in the target scenario respectively when collecting the swept-frequency signals sequentially played by multiple playback devices set in the target scenario.

[0060] Each of the audio signals corresponds to an audio acquisition device and a playback device. The multiple playback devices include second playback devices set at each of the control points and the multiple first playback devices.

[0061] By cooperating with a swept-frequency signal and an audio acquisition device, the propagation characteristics of sound waves in a target scenario are comprehensively acquired.

[0062] Step S114: Generate a transfer function corresponding to the audio signal according to the swept-frequency signal and the audio signal.

[0063] Among them, the multiple transfer functions include multiple second transfer functions between multiple audio acquisition devices and multiple first playback devices and multiple third transfer functions between multiple audio acquisition devices and multiple control points.

[0064] In an implementable manner, the above step S144 may be to convert the swept-frequency signal and the audio signal from the time domain to the frequency domain respectively to obtain a first frequency-domain signal corresponding to the swept-frequency signal and a second frequency-domain signal corresponding to the audio signal; according to the frequency-domain representations of the first frequency-domain signal and the second frequency-domain signal at each frequency point, obtain the transfer function corresponding to the audio signal.

[0065] Among them, the manner of converting the swept-frequency signal and the audio signal from the time domain to the frequency domain respectively may be to use Fourier transform to convert the swept-frequency signal and the audio signal from the time domain to the frequency domain respectively. The manner of obtaining the transfer function corresponding to the audio signal according to the frequency-domain representations of the first frequency-domain signal and the second frequency-domain signal at each frequency point may be to divide the first frequency-domain signal by the second frequency-domain signal (to calculate the amplitude and phase difference at each frequency point) to obtain the transfer function corresponding to the audio signal.

[0066] Step S116: Multiply the second transfer functions and the third transfer functions with the same audio acquisition device among the multiple second transfer functions and multiple third transfer functions to obtain multiple first transfer functions between multiple control points and multiple first playback devices.

[0067] Specifically, through the dot product operation, the second transfer function and the third transfer function are fused to obtain the first transfer function between the control point and the first playback device. The fused first transfer function more accurately describes the propagation characteristics of sound waves from the first playback device to the control point.

[0068] Exemplarily, please refer to Figure 2 and Figure 4As shown, in a vehicle scenario where the electronic device is a vehicle, there are specifically 4 seats on the vehicle, and each seat corresponds to two control points (the specific details of the control points can be referred to the foregoing description). The area where the two control points corresponding to each seat are located is the sound field control area. At the positions near each seat on the top of the vehicle, a first playback device (such as a midrange speaker and a bass speaker) and an audio acquisition device (such as a microphone) are respectively provided. If the sound field control area corresponding to the control point of the driver's seat is determined as the declared control area, and the sound field control areas corresponding to the control points of the other seats except the driver's seat are sound shadow control areas. If the number of multiple first playback devices is k (where when k is 8, the numbers of the multiple first playback devices are k = 1, 2,...., 8), the number of multiple control points is specifically j (where when j is 8, the numbers of the multiple control points are j = 1, 2,...., 8), and the number of multiple audio acquisition devices is i (where when i is 4, the numbers of the multiple control points are j = 1, 2,....), then the second transfer function can be expressed as h k,i , and the third transfer function can be expressed as g j,i : According to the principle of reciprocity of transfer functions, the transfer function g l,j between the microphone and the control point is equivalent to the transfer function g j,l between the control point and the microphone. At this time, the function between the first playback device and the control point can be expressed as: G k,j = h k,l * g l,j , and can be specifically expressed as:

[0069]

[0070] In the above steps S112 - S116, after obtaining the first transfer function and the second transfer function through the cooperation of the sweep signal and the audio acquisition device, the first transfer function is obtained by fusing the second transfer function and the third transfer function of the second playback device, so that the obtained first transfer function can more accurately express the propagation characteristics of sound waves in a complex environment, ensuring that the obtained first transfer function more accurately describes the propagation characteristics of sound waves from the first playback device to the control point, providing an accurate model for subsequent sound field control, and at the same time avoiding errors caused by direct measurement.

[0071] Please refer to Figure 5 As shown, after performing step S130, the method includes:

[0072] Step S140: Obtain the audio to be played.

[0073] Among them, the audio to be played can be media audio, such as music, video and other audio, or it can also be prompt audio, such as navigation prompt sounds or device switching prompt sounds, etc.

[0074] Step S150: If it is determined that the audio to be played is an audio that needs to be subjected to sound field zoning, adjust the current filtering coefficients corresponding to each of the first playback devices to the target filtering coefficients.

[0075] In an implementable manner, it can be determined whether the audio to be played is an audio that needs to be subjected to sound field zoning based on the user's operation, or it can be determined whether it is an audio that needs to be subjected to sound field zoning according to the type or source of the audio to be played. Exemplarily, if it is determined that the audio to be played is an audio generated by a navigation application or an operation such as application switching adjustment (such as, driving mode switching sound, steering prompt sound, gear shifting sound), it can be determined that the audio to be played is an audio that needs to be subjected to sound field zoning.

[0076] Step S160: After filtering the audio to be played according to the target filtering coefficients corresponding to each of the first playback devices, send it to the corresponding first playback device for playback.

[0077] It is worth mentioning that if it is determined that the audio to be played is an audio that does not need to be subjected to sound field zoning, then it is played after filtering according to the original filtering coefficients of each first playback device.

[0078] By adopting the above method, it is possible to realize corresponding sound field zoning optimization for the audio to be played as needed, enhance the compatibility and flexibility of the electronic device. Further, by using the pre-calculated target filtering coefficients, the sound characteristics output by each first playback device are precisely adjusted, making the sound distribution in the entire space more reasonable and harmonious. In addition, since the sound field zoning method of this solution mainly relies on the adjustment of filtering coefficients at the software level, it is relatively simple to implement on the existing hardware, facilitating popularization and application on various devices without significantly modifying the existing audio playback architecture.

[0079] Taking the target scenario as a vehicle scenario for example, by adopting the above method of the present application, it can be ensured that the driver can hear while avoiding the influence of the prompt sound on passengers in other positions; in addition, since the first speaker and the audio acquisition device are the microphones and speakers in the vehicle, therefore, this solution can also update the transfer function between the speaker and the control point in real time, ensuring the stability of the algorithm, and at the same time not introducing other hardware devices to increase the vehicle development and hardware costs, making this solution more practical when applied to vehicles.

[0080] Taking the electronic device as a vehicle for example, please refer to Figure 6As shown, the vehicle includes a controller, a plurality of first playback devices, a plurality of audio collection devices, and a plurality of seats. The controller may be a DSP controller (Digital Signal Processing). Among them, the plurality of first playback devices and the plurality of audio collection devices are respectively arranged at positions close to the upper part of the seats on the vehicle body. After obtaining the target filtering coefficients of each first playback device by using the foregoing steps S110 - S130, when the DSP controller receives the audio to be played and determines that the audio to be played needs to perform sound field zoning, the DSP controller can perform different filtering processes on the audio signal to be played according to the target filtering coefficients corresponding to each first playback device and then output it to each first playback device, so that the sound signal output by the first playback device realizes sound field zoning control through the principle of sound wave interference.

[0081] It should be understood that although the steps in the flowcharts involved in the above embodiments are sequentially shown according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least a part of other steps or steps in other steps.

[0082] Please refer to Figure 7, Another embodiment of the present application provides an acoustic field zoning device 200. The acoustic field zoning device 200 includes a transfer function acquisition module 210 configured to acquire a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points in a target scene. The plurality of control points are respectively arranged in a plurality of acoustic field control areas, and the plurality of acoustic field control areas include at least one declared control area and at least one sound-dark control area; an array generation module 220 configured to obtain a bright area transfer function array and a dark area transfer function array according to the plurality of first transfer functions and the acoustic field control area where each control point is located. The bright area transfer function array includes the transfer functions between each of the first playback devices and each control point in the declared control area, and the dark area transfer function array includes the transfer functions between each of the first playback devices and each control point in the sound-dark control area; an acoustic field zoning parameter determination module 230 configured to determine, based on the bright area transfer function array and the dark area transfer function array, the target filter coefficients corresponding to each of the first playback devices when the acoustic energy contrast between the declared control area and the sound-dark control area reaches a specified condition. The specified condition includes that the acoustic energy contrast reaches a preset contrast threshold or reaches the maximum value.

[0083] In an implementable manner, the transfer function acquisition module 210 includes a signal acquisition sub-module, a transfer function generation sub-module, and a transfer function acquisition sub-module; the signal acquisition sub-module is configured to acquire a plurality of audio signals obtained by a plurality of audio acquisition devices in the target scene respectively collecting swept-frequency signals sequentially played by a plurality of playback devices arranged in the target scene. Each of the audio signals corresponds to an audio acquisition device and a playback device. The plurality of playback devices include second playback devices arranged at each of the control points and the plurality of first playback devices; the transfer function generation sub-module is configured to generate transfer functions corresponding to the audio signals according to the swept-frequency signals and the audio signals; the plurality of transfer functions include a plurality of second transfer functions between the plurality of audio acquisition devices and the plurality of first playback devices and a plurality of third transfer functions between the plurality of audio acquisition devices and the plurality of control points; the transfer function acquisition sub-module is configured to multiply the second transfer functions and the third transfer functions with the same audio acquisition device in the plurality of second transfer functions and the plurality of third transfer functions to obtain a plurality of first transfer functions between the plurality of control points and the plurality of first playback devices.

[0084] In an implementable manner, the transfer function generation sub-module is further configured to respectively convert the swept-frequency signal and the audio signal from the time domain to the frequency domain to obtain a first frequency domain signal corresponding to the swept-frequency signal and a second frequency domain signal corresponding to the audio signal; and obtain the transfer function corresponding to the audio signal according to the frequency domain representations of the first frequency domain signal and the second frequency domain signal at each frequency point.

[0085] In an implementable manner, the sound field zoning parameter determination module 230 includes a function construction sub-module and a function solving sub-module; the function construction sub-module is configured to construct an optimization function regarding the filter coefficients corresponding to a plurality of the first playback devices and the sound energy contrast between the declared control area and the sound-light control area based on the bright area transfer function array and the dark area transfer function array; the function solving sub-module is configured to solve the optimization function to obtain the target filter coefficients corresponding to each of the first playback devices when the sound energy contrast between the declared control area and the sound-light control area reaches a specified condition.

[0086] In an implementable manner, the longitudinal arrangement order of the first playback devices in the first function transfer array is the same as that in the second function array; the filter coefficients corresponding to the plurality of the first playback devices form a filter coefficient array, and the sorting of the first playback devices to which the filter coefficients in the filter coefficient array belong is the same as the longitudinal arrangement order of each of the first playback devices in the dark area transfer function array; the function construction sub-module is further configured to use the ratio obtained by dividing the first dot product result obtained by sequentially dot-multiplying the target array, the bright area transfer function array, and the filter coefficient array by the second dot product result obtained by sequentially dot-multiplying the target array, the dark area transfer function array, and the filter coefficient array as the sound energy contrast between the declared control area and the sound-light control area, where the target array is an array obtained by conjugating and transposing the filter coefficient array.

[0087] In an implementable manner, the array generation module 220 is further configured to construct a bright area transfer function array based on the first transfer function corresponding to the control point in the declared control area; construct a dark area transfer function array based on the first transfer function corresponding to the control point in the sound-light control area.

[0088] In an implementable manner, the sound field zoning device 200 further includes an audio acquisition module, a coefficient adjustment module, and a filtering processing module; the audio acquisition module is configured to acquire the audio to be played; the coefficient adjustment module is configured to adjust the current filter coefficients corresponding to each of the first playback devices to the target filter coefficients when it is determined that the audio to be played is an audio that needs to perform sound field zoning; the filtering processing module is configured to filter the audio to be played according to the target filter coefficients corresponding to each of the first playback devices and then send it to the corresponding first playback device for playing.

[0089] Each module in the above device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above modules can be embedded in the processor in the computer device in hardware form or be independent of it, or can be stored in the memory in the computer device in software form, so that the processor can call and execute the operations corresponding to each of the above modules. It should be noted that the device embodiments in this application correspond to the foregoing method embodiments. For the specific principles in the device embodiments, reference can be made to the content in the foregoing method embodiments, which will not be elaborated here.

[0090] Next, a description will be given of Figure 8 an electronic device provided in this application.

[0091] Please refer to Figure 8 , based on the sound field zoning method provided in the foregoing embodiments, another electronic device 100 provided in the embodiments of this application includes a processor 102 that can execute the foregoing method, and this electronic device 100 can be a vehicle.

[0092] The electronic device 100 further includes a memory 104. Among them, a program that can execute the content in the foregoing embodiments is stored in the memory 104, and the processor 102 can execute the program stored in the memory 104.

[0093] Among them, the processor 102 can include one or more cores for processing data and a message matrix unit. The processor 102 connects various parts within the entire electronic device 100 through various interfaces and lines. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 104, and by calling the data stored in the memory 104, it executes various functions of the electronic device 100 and processes data. Optionally, the processor 102 can be implemented in at least one of the hardware forms of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 102 can integrate one or a combination of several of a central processing unit (CPU), a graphics processing unit (GPU), and a modem, etc. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing the display content; the modem is used to process wireless communication. It can be understood that the above modem may not be integrated into the processor 102 and can be implemented separately through a communication chip.

[0094] In this embodiment, the above-mentioned processor 102 includes a main controller and a system-on-chip for implementing the foregoing method steps.

[0095] The memory 104 may include a Random Access Memory (RAM), or may also include a Read-Only Memory. The memory 104 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 104 may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the following various method embodiments, etc. The data storage area may also store data obtained by the electronic device 100 during use.

[0096] The electronic device 100 may further include a network module and a screen. The network module is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, such as communicating with a playback device. The network module may include various existing circuit elements for performing these functions. For example, an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a Subscriber Identity Module (SIM) card, a memory, and so on. The network module can communicate with various networks such as the Internet, an enterprise intranet, a wireless network, or communicate with other devices through a wireless network. The above-mentioned wireless network may include a cellular phone network, a wireless local area network, or a metropolitan area network. The screen can display interface content and perform data interaction, such as displaying the foregoing interface, and triggering operations through the screen.

[0097] In an implementable manner, the electronic device includes a vehicle, and the vehicle includes a plurality of seats, a plurality of audio collection devices, and a plurality of first playback devices. The plurality of audio collection devices and the plurality of first playback devices are respectively arranged on the vehicle body; the control points are arranged on the seats, and at least one control point is correspondingly arranged for each seat.

[0098] In an implementable manner, the plurality of seats include a driver's seat. The sound field control area where the control point is located on the driver's seat is the sound control area, and the sound field control area where the control point is located on other seats except the driver's seat among the plurality of seats is the sound dark control area.

[0099] In an implementable manner, the plurality of first playback devices include a plurality of bass speakers and a plurality of midrange speakers. The maximum value of the working frequency range of the bass speakers is less than the maximum value of the sound frequency range of the midrange speakers. The maximum value of the bass working frequency is greater than the minimum value of the midrange working frequency to prevent certain frequencies from not being controlled.

[0100] The embodiments of the present application also provide a computer-readable storage medium. Program codes are stored in the computer-readable medium, and the program codes can be called by a processor to execute the methods described in the above method embodiments.

[0101] The computer-readable storage medium may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium includes a non-transitory computer-readable storage medium. The computer-readable storage medium has a storage space for the program codes for executing any method steps in the above methods. These program codes can be read out from or written into one or more computer program products. The program codes can be compressed in a suitable form, for example.

[0102] The embodiments of the present application also provide a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods described in the above various optional implementation manners.

[0103] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A sound field partitioning method, characterized in that: The method comprises: Acquire a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points in a target scene, wherein the plurality of control points are respectively arranged in a plurality of sound field control areas, and the plurality of sound field control areas include at least one voice control area and at least one dark sound control area; According to the multiple first transfer functions and the sound field control area where each control point is located, a bright area transfer function array and a dark area transfer function array are obtained, wherein the bright area transfer function array includes a transfer function between each of the first playback devices and each control point in the sound field control area, and the dark area transfer function array includes a transfer function between each of the first playback devices and each control point in the sound field control area; Based on the bright area transfer function array and the dark area transfer function array, the target filter coefficient corresponding to each of the first playback devices is determined when the sound energy contrast between the declaration control area and the dark control area reaches a specified condition, and the specified condition includes that the sound energy contrast reaches a preset contrast threshold or reaches a maximum value.

2. The method according to claim 1, characterized in that Acquiring a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points in a target scene, comprising: Acquire multiple audio acquisition devices in the target scene to respectively acquire sweep frequency signals sequentially played by multiple playback devices set in the target scene, to obtain multiple audio signals, each of which corresponds to an audio acquisition device and a playback device, and the multiple playback devices include a second playback device set at each of the control points and the multiple first playback devices; Generate a transfer function corresponding to the audio signal according to the swept frequency signal and the audio signal; the multiple transfer functions include multiple second transfer functions between multiple audio acquisition devices and multiple first playback devices and multiple third transfer functions between multiple audio acquisition devices and multiple control points; The second transfer functions and the third transfer functions having the same audio acquisition device among the plurality of second transfer functions and the plurality of third transfer functions are point-multiplied to obtain a plurality of first transfer functions between the plurality of control points and the plurality of first playback devices.

3. The method according to claim 2, characterized in that The step of generating a transfer function corresponding to the audio signal according to the frequency sweep signal and the audio signal comprises: Convert the frequency sweep signal and the audio signal from the time domain to the frequency domain respectively, to obtain a first frequency domain signal corresponding to the frequency sweep signal and a second frequency domain signal corresponding to the audio signal; A transfer function corresponding to the audio signal is obtained according to the frequency domain representations of the first frequency domain signal and the second frequency domain signal at each frequency point.

4. The method according to claim 1, characterized in that: The determining, based on the bright area transfer function array and the dark area transfer function array, the target filter coefficient corresponding to each of the first playback devices when the sound energy contrast between the declaration control area and the sound-dark control area reaches a specified condition comprises: Based on the bright area transfer function array and the dark area transfer function array, construct an optimization function between the filter coefficients corresponding to the plurality of first playback devices and the sound energy contrast between the statement control area and the sound-dark control area; The optimization function is solved to obtain target filter coefficients corresponding to each of the first playback devices when the sound energy contrast between the voice control area and the sound-dark control area reaches a specified condition.

5. The method according to claim 4, characterized in that The first playback devices in the first function transfer array and the second function array are arranged in the same order in the longitudinal direction; the filter coefficients corresponding to the plurality of first playback devices constitute a filter coefficient array, and the order of the first playback devices to which the filter coefficients belong in the filter coefficient array is the same as the order of the first playback devices in the dark area transfer function array; The constructing, based on the bright area transfer function array and the dark area transfer function array, an optimization function between the filter coefficients corresponding to the plurality of first playback devices and the sound energy contrast between the declaration control area and the sound-dark control area comprises: The ratio of the first dot product result obtained by sequentially dot-multiplying the target array, the bright area transfer function array and the filter coefficient array to the second dot product result obtained by sequentially dot-multiplying the target array, the dark area transfer function array and the filter coefficient array is used as the sound energy contrast between the declared control area and the dark control area, wherein the target array is an array obtained by conjugating and transposing the filter coefficient array.

6. The method according to claim 1, characterized in that The step of obtaining a bright area transfer function array and a dark area transfer function array according to the plurality of first transfer functions and the sound field control area where each control point is located comprises: Constructing a bright area transfer function array based on first transfer functions corresponding to control points in the declared control area; A dark area transfer function array is constructed based on the first transfer functions corresponding to the control points in the acoustic dark control area.

7. The method according to claim 1, characterized in that After determining the target filter coefficients corresponding to the first playback devices when the sound energy contrast between the voice control area and the dark control area reaches a specified condition based on the bright area transfer function array and the dark area transfer function array, the method further includes: Get the audio to be played; If it is determined that the audio to be played is audio that needs to be partitioned into sound fields, adjusting the current filter coefficient corresponding to each of the first playback devices to the target filter coefficient; After filtering the audio to be played according to the target filter coefficient corresponding to each of the first playback devices, the audio is sent to the corresponding first playback device for playback.

8. A sound field partitioning device, characterized in that: The device comprises: A transfer function acquisition module, used to acquire a plurality of first transfer functions between a plurality of first playback devices and a plurality of control points in a target scene, wherein the plurality of control points are respectively arranged in a plurality of sound field control areas, wherein the plurality of sound field control areas include at least one voice control area and at least one dark sound control area; an array generation module, configured to obtain a bright area transfer function array and a dark area transfer function array according to the plurality of first transfer functions and the sound field control area where each control point is located, wherein the bright area transfer function array includes a transfer function between each of the first playback devices and each control point in the sound field control area, and the dark area transfer function array includes a transfer function between each of the first playback devices and each control point in the sound field control area; The sound field partition parameter determination module is used to determine the target filter coefficient corresponding to each of the first playback devices when the sound energy contrast between the declaration control area and the sound-dark control area reaches a specified condition based on the bright area transfer function array and the dark area transfer function array, and the specified condition includes that the sound energy contrast reaches a preset contrast threshold or reaches a maximum value.

9. An electronic device, characterized in that: include: one or more processors; Memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1 to 7.

10. The electronic device according to claim 9, characterized in that: The electronic device includes a vehicle, which includes multiple seats, multiple audio acquisition devices and multiple first playback devices, and the multiple audio acquisition devices and the multiple first playback devices are respectively arranged on the body of the vehicle; the control points are arranged on the seats, and at least one control point is correspondingly arranged for each seat.

11. The electronic device according to claim 10, characterized in that: The multiple seats include a main driver's seat, the sound field control area where the control point set at the main driver's seat is located is a voice control area, and the sound field control area where the control points set at other seats among the multiple seats except the main driver's seat are located is a sound darkness control area.

12. The electronic device according to claim 10, characterized in that: The plurality of first playback devices include a plurality of woofers and a plurality of mid-range speakers, and the maximum value of the operating frequency range of the woofers is smaller than the maximum value of the sound frequency range of the mid-range speakers.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, and the program codes can be called by a processor to execute the method according to any one of claims 1 to 7.

Images