Sound field adjustment methods and computer-readable storage media

Abstract

This invention discloses a sound field adjustment method and a computer-readable storage medium. The sound field adjustment method is applied to a multi-functional cockpit and includes: acquiring the user's position and spatial structure information of the sound field space; for any target speaker among the various speakers installed in the sound field space, calculating the sound field space parameters corresponding to the user's position based on the user's position and spatial structure information; determining the target processing parameters of the target speaker based on the sound field space parameters; processing the input audio signal of the target speaker according to the target processing parameters to obtain an output audio signal, and outputting the output audio signal using the target speaker. This invention improves the user experience in a multi-functional cockpit.

Description

Technical Field

[0001] This invention relates to the field of audio processing technology, and in particular to a sound field adjustment method and a computer-readable storage medium. Background Technology

[0002] Spatial audio technology can bring people an immersive acoustic experience. Currently, spatial audio technology can be applied to multi-functional cockpits to provide panoramic audio for users in the cockpit. Multi-functional cockpits are generally set with an initial position for the best experience. When the user is in the initial position, the spatial audio played by the built-in speaker array of the multi-functional cockpit makes the user feel as if they are there. However, in actual use, due to individual differences between different users or the possibility of users moving in the multi-functional cockpit, the immersive experience of users hearing audio signals in the multi-functional cockpit deteriorates. Summary of the Invention

[0003] The main objective of this invention is to provide a sound field adjustment method, device, and computer-readable storage medium, which aims to improve the user experience in a multi-functional cockpit.

[0004] To achieve the above objectives, the present invention provides a sound field adjustment method, which is applied to a multi-functional cockpit, and the sound field adjustment method includes the following steps:

[0005] Obtain the user's position in the sound field space and the spatial structure information of the sound field space;

[0006] For any target loudspeaker among the loudspeakers set in the sound field space, the sound field space parameters corresponding to the user position are calculated based on the user position and the spatial structure information.

[0007] The target processing parameters of the target loudspeaker are determined based on the sound field spatial parameters.

[0008] The input audio signal of the target speaker is processed according to the target processing parameters to obtain an output audio signal, and the output audio signal is output using the target speaker.

[0009] Optionally, the spatial structure information includes spatial location information characterizing the location of the hardware structure in the sound field space and spatial propagation parameters of the sound signal in the sound field space. The step of calculating the sound field spatial parameters corresponding to the user position based on the user position and the spatial structure information includes:

[0010] The relative position information of the user's position with respect to the target position where the target speaker is located is determined based on the user's position and the spatial position information;

[0011] The sound field spatial parameters are calculated based on the relative position information and the spatial propagation parameters. The sound field spatial parameters include parameters characterizing the transmission process of the audio signal from the target position to the user position and parameters characterizing the state of the audio signal when it is transmitted from the target position to the user position.

[0012] Optionally, when the sound field spatial parameter is the fluctuation difference of the frequency response curve characterizing the transmission of the audio signal from the target location to the user location, the step of calculating the sound field spatial parameter based on the relative position information and the spatial propagation parameter includes:

[0013] The fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0014] For any target gain frequency band in each gain frequency band of the basic frequency response curve, the fluctuation difference of the target gain frequency band is calculated based on the highest and lowest response values ​​of the target gain frequency band.

[0015] The target processing parameters include gain parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0016] A first gain parameter is determined to limit the fluctuation difference of the target gain frequency band within a preset range, and the first gain parameter is used as the target processing parameter of the target loudspeaker.

[0017] Optionally, when the sound field spatial parameter is the sound pressure level characterizing the transmission of an audio signal from the target location to the user location, the step of calculating the sound field spatial parameter based on the relative position information and the spatial propagation parameter includes:

[0018] The basic sound pressure level when the swept frequency signal is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0019] The target processing parameters include gain parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0020] Obtain the initial sound pressure level when the sweep frequency signal is transmitted from the target loudspeaker to the initial position in the sound field space;

[0021] The second gain parameter is calculated based on the difference between the initial sound pressure level and the basic sound pressure level, and the second gain parameter is used as the target processing parameter.

[0022] Optionally, when the sound field spatial parameter is a reverberation volume parameter characterizing the transmission of an audio signal from the target location to the user location, the step of calculating the sound field spatial parameter based on the relative position information and the spatial propagation parameter includes:

[0023] The first volume of the sweep frequency signal when it travels directly from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0024] Based on the reflected sound signal obtained by reverberating the swept frequency signal and the spatial propagation parameters, the second volume of the reflected sound signal when it is transmitted to the user's location is calculated.

[0025] The ratio of the first volume to the second volume is determined as the reverberation volume parameter;

[0026] The target processing parameters include the reverberation dry-wet ratio, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0027] The initial wet / dry ratio of the target loudspeaker is adjusted according to the reverberation volume parameter to obtain the target wet / dry ratio, and the target wet / dry ratio is used as the target processing parameter of the target loudspeaker.

[0028] Optionally, when the sound field spatial parameter is a frequency response intensity parameter characterizing the transmission of an audio signal from the target location to the user location, the step of calculating the sound field spatial parameter based on the relative position information and the spatial propagation parameter includes:

[0029] The fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0030] The response intensity of each equalized frequency band of the basic frequency response curve is determined as the frequency response intensity parameter;

[0031] The target processing parameters include equalization parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0032] The initial equalization filter parameters corresponding to each equalization frequency band in the target loudspeaker are adjusted according to each of the frequency response intensity parameters to obtain the target equalization filter parameters corresponding to each of the equalization frequency bands, and each target equalization filter parameter is used as the target processing parameter of the target loudspeaker.

[0033] Optionally, when the sound field spatial parameters represent the transmission time of the audio signal from the target location to the user location, the step of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes:

[0034] The basic transmission time of the swept frequency signal to the user's location is calculated based on the relative position information and the spatial propagation parameters.

[0035] The target processing parameters include delay processing parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0036] Obtain the initial transmission time of the swept frequency signal from the target position to the initial position in the sound field space;

[0037] The delay processing parameters are calculated based on the initial transmission duration and the basic transmission duration, and the delay processing parameters are used as the target processing parameters for the target loudspeaker.

[0038] Optionally, the spatial structure information includes regional location information characterizing the positions of each sub-region in the sound field space, and the step of calculating the sound field spatial parameters corresponding to the user position based on the user position and the spatial structure information includes:

[0039] Based on the user location and the area location information, the target sub-region where the user's location is located is determined from each of the sub-regions;

[0040] The step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0041] The preset processing parameters corresponding to the target sub-region are determined as the target processing parameters for the target speaker.

[0042] 5. Optionally, a depth camera or an infrared camera is provided in the sound field space, and the step of obtaining the user's position in the sound field space includes:

[0043] The user's position in the sound field space is obtained using the depth camera or the infrared camera based on target capture technology.

[0044] To achieve the above objectives, the present invention also provides a sound field adjustment device, wherein the sound field adjustment device

[0045] It includes: a memory, a processor, and a sound field adjustment program stored in the memory and executable on the processor, wherein the sound field adjustment program, when executed by the processor, implements the steps of the sound field adjustment method as described above.

[0046] 5. In addition, to achieve the above objectives, the present invention also proposes a computer-readable storage medium storing a sound field adjustment program, which, when executed by a processor, implements the steps of the sound field adjustment method as described above.

[0047] In this invention, by obtaining the user's position and spatial structure information of the sound field space, for any target speaker among the various speakers set in the sound field space, the sound field space parameters corresponding to the user's position are calculated based on the user's position and spatial structure information. The target processing parameters of the target speaker are determined based on the sound field space parameters. The input audio signal of the target speaker is processed according to the target processing parameters to obtain the output audio signal. The target speaker outputs the output audio signal. This invention enables the audio processing parameters of any speaker in the multi-functional cockpit to change according to the user's position in the multi-functional cockpit, and the audio signal output by any speaker in the multi-functional cockpit to change according to the user's position in the multi-functional cockpit. This ensures that the audio listening effect of the user at any position in the multi-functional cockpit is consistent with the audio listening effect of the user at the initial position, so that the user can obtain the best listening effect at any position in the multi-functional cockpit, thus improving the user's experience in the multi-functional cockpit. Attached Figure Description

[0048] Figure 1 This is a schematic diagram of the hardware operating environment involved in the embodiments of the present invention;

[0049] Figure 2 This is a flowchart illustrating the first embodiment of the sound field adjustment method of the present invention;

[0050] Figure 3 This is a schematic diagram of the multi-functional cockpit structure involved in one embodiment of the sound field adjustment method of the present invention;

[0051] Figure 4 This is a schematic diagram of the process involved in one embodiment of the sound field adjustment method of the present invention;

[0052] Figure 5 This is a schematic diagram of the multi-functional cockpit area division involved in one embodiment of the sound field adjustment method of the present invention;

[0053] Figure 6 This is a schematic diagram of the process involved in one embodiment of the sound field adjustment method of the present invention;

[0054] Figure 7 This is an overhead view of the multi-functional cockpit structure involved in one embodiment of the sound field adjustment method of the present invention.

[0055] Figure 8 This is a schematic diagram of the reverberation calculation model involved in one embodiment of the sound field adjustment method of the present invention;

[0056] Figure 9 This is a schematic flowchart illustrating one embodiment of the sound field adjustment method of the present invention.

[0057] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0058] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0059] like Figure 1 As shown, Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of the present invention.

[0060] It should be noted that the sound field adjustment device in the embodiments of the present invention can be a multi-functional cockpit or a terminal device connected to the multi-functional cockpit, such as a smartphone, personal computer, server, and head-mounted device, etc., without specific limitations.

[0061] like Figure 1 As shown, the sound field adjustment device may include: a processor 1001, such as a CPU; a network interface 1004; a user interface 1003; a memory 1005; and a communication bus 1002. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM or a stable, non-volatile memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0062] Those skilled in the art will understand that Figure 1 The device structure shown does not constitute a limitation on the sound field adjustment device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0063] like Figure 1 As shown, the memory 1005, as a computer storage medium, may include an operating system, a network communication module, a user interface module, and a sound field adjustment program. The operating system is a program that manages and controls the device's hardware and software resources, supporting the operation of the sound field adjustment program and other software or programs. Figure 1In the device shown, the user interface 1003 is mainly used for data communication with the client; the network interface 1004 is mainly used for establishing a communication connection with the server; and the processor 1001 can be used to call the sound field adjustment program stored in the memory 1005 and perform the following operations:

[0064] Obtain the user's position in the sound field space and the spatial structure information of the sound field space;

[0065] For any target loudspeaker among the loudspeakers set in the sound field space, the sound field space parameters corresponding to the user position are calculated based on the user position and the spatial structure information.

[0066] The target processing parameters of the target loudspeaker are determined based on the sound field spatial parameters.

[0067] The input audio signal of the target speaker is processed according to the target processing parameters to obtain an output audio signal, and the output audio signal is output using the target speaker.

[0068] Furthermore, the spatial structure information includes spatial location information characterizing the location of the hardware structure in the sound field space and spatial propagation parameters of the sound signal in the sound field space. The operation of calculating the sound field spatial parameters corresponding to the user position based on the user position and the spatial structure information includes:

[0069] The relative position information of the user's position with respect to the target position where the target speaker is located is determined based on the user's position and the spatial position information;

[0070] The sound field spatial parameters are calculated based on the relative position information and the spatial propagation parameters. The sound field spatial parameters include parameters characterizing the transmission process of the audio signal from the target position to the user position and parameters characterizing the state of the audio signal when it is transmitted from the target position to the user position.

[0071] Furthermore, when the sound field spatial parameter is the fluctuation difference of the frequency response curve characterizing the transmission of the audio signal from the target location to the user location, the operation of calculating the sound field spatial parameter based on the relative position information and the spatial propagation parameter includes:

[0072] The fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0073] For any target gain frequency band in each gain frequency band of the basic frequency response curve, the fluctuation difference of the target gain frequency band is calculated based on the highest and lowest response values ​​of the target gain frequency band.

[0074] The target processing parameters include gain parameters, and the operation of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0075] A first gain parameter is determined to limit the fluctuation difference of the target gain frequency band within a preset range, and the first gain parameter is used as the target processing parameter of the target loudspeaker.

[0076] Furthermore, when the sound field spatial parameters are the sound pressure levels characterizing the transmission of an audio signal from the target location to the user location, the operation of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes:

[0077] The basic sound pressure level when the swept frequency signal is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0078] The target processing parameters include gain parameters, and the operation of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0079] Obtain the initial sound pressure level when the sweep frequency signal is transmitted from the target loudspeaker to the initial position in the sound field space;

[0080] The second gain parameter is calculated based on the difference between the initial sound pressure level and the basic sound pressure level, and the second gain parameter is used as the target processing parameter.

[0081] Furthermore, when the sound field spatial parameter is a reverberation volume parameter characterizing the transmission of an audio signal from the target location to the user location, the operation of calculating the sound field spatial parameter based on the relative position information and the spatial propagation parameter includes:

[0082] The first volume of the sweep frequency signal when it travels directly from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0083] Based on the reflected sound signal obtained by reverberating the swept frequency signal and the spatial propagation parameters, the second volume of the reflected sound signal when it is transmitted to the user's location is calculated.

[0084] The ratio of the first volume to the second volume is determined as the reverberation volume parameter;

[0085] The target processing parameters include the reverberation wet / dry ratio, and the operation of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0086] The initial wet / dry ratio of the target loudspeaker is adjusted according to the reverberation volume parameter to obtain the target wet / dry ratio, and the target wet / dry ratio is used as the target processing parameter of the target loudspeaker.

[0087] Furthermore, when the sound field spatial parameter is a frequency response intensity parameter characterizing the transmission of an audio signal from the target location to the user location, the operation of calculating the sound field spatial parameter based on the relative position information and the spatial propagation parameter includes:

[0088] The fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters.

[0089] The response intensity of each equalized frequency band of the basic frequency response curve is determined as the frequency response intensity parameter;

[0090] The target processing parameters include equalization parameters, and the operation of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0091] The initial equalization filter parameters corresponding to each equalization frequency band in the target loudspeaker are adjusted according to each of the frequency response intensity parameters to obtain the target equalization filter parameters corresponding to each of the equalization frequency bands, and each target equalization filter parameter is used as the target processing parameter of the target loudspeaker.

[0092] Furthermore, when the sound field spatial parameters represent the transmission time of the audio signal from the target location to the user location, the operation of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes:

[0093] The basic transmission time of the swept frequency signal to the user's location is calculated based on the relative position information and the spatial propagation parameters.

[0094] The target processing parameters include delay processing parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0095] Obtain the initial transmission time of the swept frequency signal from the target position to the initial position in the sound field space;

[0096] The delay processing parameters are calculated based on the initial transmission duration and the basic transmission duration, and the delay processing parameters are used as the target processing parameters for the target loudspeaker.

[0097] Furthermore, the spatial structure information includes regional location information characterizing the positions of each sub-region in the sound field space, and the operation of calculating the sound field space parameters corresponding to the user position based on the user position and the spatial structure information includes:

[0098] Based on the user location and the region location information, the target sub-region where the user location is located is determined from each of the sub-regions;

[0099] The operation of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes:

[0100] The preset processing parameters corresponding to the target sub-region are determined as the target processing parameters for the target speaker.

[0101] Furthermore, a depth camera or infrared camera is installed in the sound field space, and the operation of acquiring the user's position in the sound field space includes:

[0102] The user's position in the sound field space is obtained using the depth camera or the infrared camera based on target capture technology.

[0103] Based on the above structure, various embodiments of the sound field adjustment method are proposed.

[0104] Reference Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the sound field adjustment method of the present invention.

[0105] This invention provides an embodiment of a sound field adjustment method. It should be noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order. In this embodiment, the executing entity of the sound field adjustment method can be a multi-functional cockpit or a terminal device connected to the multi-functional cockpit, such as a smartphone, personal computer, server, or head-mounted device. No limitation is made in this embodiment, and for ease of description, the execution entity is omitted from the description of each embodiment. In this embodiment, the sound field adjustment method is applied to a multi-functional cockpit. Specifically, the multi-functional cockpit can be a semi-enclosed cockpit or a fully enclosed cockpit, without limitation. In this embodiment, the sound field adjustment method includes:

[0106] Step S10: Obtain the user's position in the sound field space and the spatial structure information of the sound field space;

[0107] In this embodiment, the space in which the sound signal propagates is called the sound field space. When the sound signal propagates in the multi-functional cockpit, the space inside the multi-functional cockpit is the sound field space. Specifically, the sound...

[0108] At least two loudspeakers and an audio signal processing module are installed in the field space. The audio signal processing module is connected to each of the five loudspeakers, and the audio signal input to the audio signal processing module (hereinafter referred to as the input audio signal) is used for this purpose.

[0109] (To distinguish them) After processing, the signals are output to each speaker for playback. An initial position is also preset in the sound field space. When the user is in the initial position, the sound signals played by each speaker in the sound field space can provide the user with the best listening experience.

[0110] In a specific implementation, the loudspeakers in the sound field space can be a multi-layered structure, and the individual loudspeakers can be arranged around the initial position to ensure that the user obtains optimal audio reception at the initial position.

[0111] The effect, for example, is that the speaker can be above the initial position, at the same horizontal level as the initial position, or below the initial position; the specific level can be set according to actual needs and is not limited here. For example, in one embodiment, referring to... Figure 3 , Figure 3 This is an embodiment of the sound field adjustment method of the present invention.

[0112] A schematic diagram of the multi-functional cockpit structure, such as... Figure 3 As shown, the multi-functional cockpit can be a semi-enclosed cockpit. In this embodiment, the multi-functional cockpit has two built-in speakers, i.e. Figure 3 The Top Layer speaker and Surround Layer speakers shown are in their initial positions (i.e., Figure 3 Above the initial position of the human head shown in the diagram, the surround layer speaker is at the same horizontal line as the initial position.

[0113] Furthermore, in one embodiment, the input audio signal of each speaker in the sound field space can...

[0114] This is a spatial audio signal. In this embodiment, the audio signals output by each speaker can be different audio signals, thereby providing users in the sound field space with directional spatial audio.

[0115] In this implementation, the user's initial position in the sound field space can achieve the best sense of immersion and presence;

[0116] In another embodiment, the input audio signal can be a mono audio signal. In this embodiment, the audio signals output by each speaker are the same audio signal. In this embodiment, the user can obtain the best listening experience from the initial position in the sound field space.

[0117] 5. When the user's position changes, if the speaker continues to play the audio signal from the user's initial position (hereinafter referred to as the initial audio signal for distinction), the audio signal heard by the user at the current position will be worse than the audio signal heard at the initial position due to factors such as attenuation during sound signal transmission. Therefore, in this embodiment, when the user's position changes...

[0118] When the initial position changes, the processing parameters for processing the input audio signal can be adjusted so that the user can have the same listening experience at the user's current position as at the initial position.

[0119] Specifically, in this embodiment, the user's position in the sound field space (hereinafter referred to as the user position for distinction) and the spatial structure information of the sound field space are obtained. Specifically, in one embodiment, the spatial structure information may include spatial location information characterizing the location of hardware structures in the sound field space, such as the distribution location of loudspeakers, the size of the sound field space, etc. The spatial structure information of the sound field space may also include spatial propagation parameters of sound signals in the sound field space, such as the sound absorption coefficient at various locations in the sound field space, etc. In another embodiment, the sound field space can be divided into multiple sub-regions. In this embodiment, the spatial structure information may also include the regional location information of each sub-region in the sound field space.

[0120] In specific implementations, the user's position can be determined based on the user's head. For example, in one implementation, the user's position can be determined based on the center point of the line connecting the user's left and right ears; in another implementation, the user's position can be determined based on either the user's left or right ear. The specific method can be set according to actual needs and is not limited here. The user's position can be the orientation of the user's head and the direction the user's head faces, which can be set according to actual needs and is not limited here. Furthermore, in specific implementations, the reference system for determining the user's position can be the entire sound field space or a reference system based on the initial position, which can be set according to actual needs and is not limited here. Specifically, the representation of the user's position can be in coordinate form or in orientation form, which is not limited here.

[0121] In a specific implementation, at least one sensor can be set in the sound field space to obtain the user's position. Specifically, the sensor can be an image sensor or an infrared sensor, etc. For example, in one implementation, a depth camera can be set in the sound field space to obtain image data of the user in the sound field space. The user's position in the sound field space can be obtained by analyzing the image data.

[0122] Step S20: For any target loudspeaker among the loudspeakers set in the sound field space, calculate the sound field space parameters corresponding to the user position based on the user position and the spatial structure information;

[0123] In this embodiment, for any one of the loudspeakers in the sound field space (hereinafter referred to as the target loudspeaker for distinction), the sound field space parameters corresponding to the user's position are calculated based on the user's position and spatial structure information.

[0124] Specifically, in one embodiment, the sound field spatial parameters may include parameters characterizing the transmission process of the audio signal from the target location to the user location and parameters characterizing the state of the audio signal when it is transmitted from the target location to the user location; in another embodiment, the sound field spatial parameters may also be parameters characterizing the location of a sub-region of the sound field space, and there is no specific limitation here.

[0125] Step S30: Determine the target processing parameters of the target loudspeaker based on the sound field spatial parameters;

[0126] In this embodiment, after determining the sound field spatial parameters, the parameters for processing the input audio signal corresponding to the target loudspeaker are determined based on the sound field spatial parameters (hereinafter referred to as target processing parameters for distinction).

[0127] Step S40: Process the input audio signal of the target speaker according to the target processing parameters to obtain the output audio signal, and output the output audio signal using the target speaker.

[0128] In this embodiment, after determining the target processing parameters, the input audio signal of the target speaker is processed according to the target processing parameters to obtain the output audio signal, and the output audio signal is output by the target speaker.

[0129] Furthermore, in some feasible implementations, the spatial structure information includes spatial location information characterizing the location of the hardware structure in the sound field space and spatial propagation parameters of the sound signal in the sound field space, and step S20 includes:

[0130] Step S201: Determine the relative position information of the user's position with respect to the target position where the target speaker is located, based on the user's position and the spatial position information;

[0131] In this embodiment, the relative position information of the user's position with respect to the location of the target speaker (hereinafter referred to as the target position for distinction) is determined based on the user's position and spatial position information.

[0132] In specific implementations, the form of relative position information is not limited and can be set according to the data set requirements. For example, in one implementation, the relative position information can be in the form of coordinates.

[0133] Step S202: Calculate the sound field spatial parameters based on the relative position information and the spatial propagation parameters. The sound field spatial parameters include parameters characterizing the transmission process of the audio signal from the target position to the user position and parameters characterizing the state of the audio signal when it is transmitted from the target position to the user position.

[0134] In this embodiment, after determining the relative position information of the user's position with respect to the target loudspeaker, the sound field spatial parameters are calculated based on the relative position information and spatial propagation parameters. The sound field spatial parameters include parameters characterizing the transmission process of the audio signal from the target position to the user's position and parameters characterizing the state of the audio signal when it is transmitted from the target position to the user's position.

[0135] In a specific implementation, the target processing parameters may include: gain parameters, delay processing parameters, reverberation parameters, and equalization parameters, etc. The target processing parameters can be determined according to actual needs and are not limited here.

[0136] Furthermore, in this embodiment, reference is made to Figure 4 , Figure 4 This is a schematic diagram of a process involved in one embodiment of the sound field adjustment method of the present invention. In this embodiment, spatial structure information of the sound field space is obtained based on a depth camera (i.e., Figure 4 The environmental characteristics shown in the figure) and the user's location are used to determine relative location information (i.e., Figure 4 The orientation information shown is illustrated in this embodiment. In this embodiment, the spatial structure information includes information representing the hardware structure of the sound field space (i.e.,...). Figure 4 The sound absorption coefficient shown in the figure) and the transmission parameters of the sound signal in the sound field space (i.e., Figure 4 The location of the sound source shown is the location of the target speaker. The user's relative position information includes the direction the user's head is facing (i.e., the direction the sound source is located). Figure 4 The head orientation shown) and the user's head movement information (i.e. Figure 4 (See head movement shown). In this embodiment, target processing parameters for the target loudspeaker in multi-channel signal processing are determined based on relative position information and spatial structure information. The input audio signal (i.e., ...) to the target loudspeaker is processed using these target processing parameters. Figure 4 The audio input shown is processed to obtain the output audio signal (i.e., Figure 4 (The audio output shown).

[0137] It should be noted that in this embodiment, the target processing parameters for the target speaker are determined by determining the relative position information of the user's position with respect to the target speaker, and based on the relative position information and the spatial structure information of the sound field. Compared to determining the target processing parameters from various preset processing parameters based on the user's position, the target processing parameters obtained in this embodiment process the input audio signal of the target speaker, making the audio heard by the user at the user's position closer to the audio heard by the user at the initial position, thereby providing the user with a better experience in the multi-functional cockpit.

[0138] Furthermore, in some feasible implementations, the spatial structure information includes regional location information characterizing the positions of various sub-regions in the sound field space, and step S20 includes:

[0139] Step S203: Determine the target sub-region where the user's location is located from each of the sub-regions based on the user's location and the region location information;

[0140] In this embodiment, the sound field space is pre-divided into multiple sub-regions, and the spatial structure information includes regional location information characterizing the position of each sub-region in the sound field space. In this embodiment, the sub-region where the user's position is located (hereinafter referred to as the target sub-region for distinction) is determined from each sub-region based on the user's position and regional location information.

[0141] Specifically, in one embodiment, reference is made to Figure 5 , Figure 5 This is a schematic diagram of the multi-functional cockpit area division involved in one embodiment of the sound field adjustment method of the present invention, as shown below. Figure 5 As shown, the multi-functional cockpit is divided into multiple sub-areas.

[0142] In this embodiment, step S30 includes:

[0143] Step S301: The preset processing parameters corresponding to the target sub-region are determined as the target processing parameters of the target loudspeaker.

[0144] In this embodiment, each sub-region corresponds to a different preset processing parameter, and the preset processing parameter corresponding to the target sub-region is determined as the target processing parameter of the target speaker.

[0145] Furthermore, in one embodiment, when the user's position is at the intersection of multiple sub-regions, the sub-region closer to the interior of the sound field space can be used as the target sub-region. For example, when the sound field space is a semi-enclosed cockpit, the sub-region farther away from the cockpit can be used as the target sub-region.

[0146] The preset processing parameters can be calculated based on spatial structure information and each sub-region. Specifically, the process of calculating the preset processing parameters can be as follows: taking the center point of each sub-region as the position point of each sub-region, for any sub-region, the transmission audio of the target speaker playing the initial audio signal to the sub-region is calculated based on the position point and spatial structure information, and the preset processing parameters of the sub-region are calculated based on the transmission audio and the second transmission audio. The preset processing parameters can also be set according to the engineer's experience, and there are no restrictions on them here.

[0147] In a specific implementation, the preset processing parameters may include: gain parameters, delay processing parameters, reverberation parameters, and equalization parameters, etc. The preset processing parameters can be determined according to actual needs and are not limited here.

[0148] Furthermore, in one embodiment, referring to Figure 6 , Figure 6 This is a flowchart illustrating an embodiment of the sound field adjustment method of the present invention. The step of determining the target processing parameters of the target loudspeaker based on the user's location and the spatial structure information of the sound field space may further include: based on the user's location (i.e....) Figure 6 The orientation information shown (specifically including head orientation and head movement) determines the user's sub-region in the sound field space (i.e., Figure 6 The partitions shown are hereinafter referred to as target regions for distinction. Target processing parameters are determined from the preset processing parameters of each sub-region based on the target region. In this embodiment, the input audio signal (i.e.,...) to the target speaker is processed using the target processing parameters. Figure 6 The audio input shown is processed to obtain the output audio signal (i.e., Figure 6 (The audio output shown).

[0149] It should be noted that in this embodiment, the target area of ​​the user in the sound field space is determined based on the user's location, and the target processing parameters are determined from the preset processing parameters of each sub-region based on the target area. Compared with calculating the target processing parameters based on the user's location and spatial structure information, this embodiment can reduce processing time and save computing resources.

[0150] Furthermore, in some feasible implementations, a depth camera or infrared camera is set in the sound field space, and step S10: obtaining the user's position in the sound field space includes:

[0151] Step S101: Obtain the user's position in the sound field space using the depth camera or the infrared camera based on target capture technology.

[0152] In this embodiment, a depth camera or infrared camera capable of capturing the user's position is set in the sound field space. The user's position within the sound field space can be obtained using target capture technology via the depth camera or infrared camera. In a specific embodiment, multiple depth cameras or infrared cameras can be set in the sound field space, and these multiple cameras can be positioned centered on an initial position. For example, in one embodiment, referring to... Figure 7 , Figure 7 This is a top-down structural diagram of the multi-functional cockpit involved in one embodiment of the sound field adjustment method of the present invention, as shown below. Figure 7 As shown, the user is positioned at the center of the multi-functional cockpit and facing the center speaker (i.e., Figure 7 The center position shown is the initial position, and the depth camera and infrared camera (i.e., Figure 7 The cameras shown are positioned behind, to the left front, and to the right front of the user when the user is in the initial position.

[0153] In a specific implementation, the process of obtaining the user's position in the sound field space based on target capture technology can be as follows: acquiring image data captured by a depth camera or an infrared camera, and analyzing the image data captured by the depth camera or infrared camera based on target capture technology to determine the user's position.

[0154] Furthermore, in one embodiment, the user's location can also be obtained through other feasible target acquisition technologies. For example, an ultrasonic sensor can be set in the sound field space, and the location can be determined by ultrasonic positioning technology. The specific settings can be configured according to actual needs.

[0155] In this embodiment, the user's position and spatial structure information of the sound field space are obtained. For any target speaker among the various speakers set in the sound field space, the sound field space parameters corresponding to the user's position are calculated based on the user's position and spatial structure information. The target processing parameters of the target speaker are determined based on the sound field space parameters. The input audio signal of the target speaker is processed according to the target processing parameters to obtain the output audio signal. The output audio signal is then output by the target speaker. This embodiment allows the audio processing parameters of any speaker in the multi-functional cockpit to change according to the user's position in the multi-functional cockpit. This also allows the audio signal output by any speaker in the multi-functional cockpit to change according to the user's position in the multi-functional cockpit. As a result, the audio listening effect of the user at any position in the multi-functional cockpit is consistent with the audio listening effect of the user at the initial position. This ensures that the user can obtain the best listening effect at any position in the multi-functional cockpit, improving the user's experience in the multi-functional cockpit.

[0156] Furthermore, based on the first embodiment described above, a second embodiment of the sound field adjustment algorithm of the present invention is proposed. In this embodiment, when the sound field spatial parameter is the fluctuation difference of the frequency response curve characterizing the transmission of the audio signal from the target location to the user location, step S202 includes:

[0157] Step S2021: Calculate the fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location based on the relative position information and the spatial propagation parameters;

[0158] In this embodiment, the sound field spatial parameters are the fluctuation difference of the frequency response curve characterizing the transmission of the audio signal from the target location to the user location. Specifically, in this embodiment, the frequency response curve of the swept frequency signal transmitted from the target location to the user location (hereinafter referred to as the basic frequency response curve for distinction) is calculated based on the relative position information and spatial propagation parameters.

[0159] Specifically, in one embodiment, the spatial structure information may include the sound absorption coefficients at various points in the sound field space and information about the hardware characterizing the sound field spatial structure. In this embodiment, the information about the hardware characterizing the sound field spatial structure may be in the form of a 3D (three-dimensional) model of the sound field space. The process of determining the fundamental frequency response curve may be as follows: calculate the direct and reflected waves of the initial audio signal transmitted to the user's position based on the relative position information and the spatial structure information, and calculate the fundamental frequency response curve based on the direct and reflected waves. Further, in another embodiment, the fundamental frequency response curve may also be determined based on the region where the user's position is located in the sound field space, from the preset frequency response curves corresponding to each region. The specific settings can be configured according to actual needs and are not limited here.

[0160] Step S2022: For any target gain frequency band among the gain frequency bands of the basic frequency response curve, calculate the fluctuation difference of the target gain frequency band based on the highest and lowest response values ​​of the target gain frequency band.

[0161] In this embodiment, for any target gain frequency band in each frequency band of the basic frequency response curve (hereinafter referred to as gain frequency band for distinction), the difference between the response value at the highest point (hereinafter referred to as the highest response value) and the response value at the lowest point (hereinafter referred to as the lowest response value) in the target gain frequency band is used (hereinafter referred to as the fluctuation difference for distinction).

[0162] In specific implementations, the division of gain frequency bands can be set according to actual needs and is not limited here. For example, in one implementation, it can be that the gain frequency band is below 200 Hz, the gain frequency band is between 200 and 6000 Hz, and the gain frequency band is above 6000 Hz.

[0163] In this embodiment, the target processing parameters include gain parameters, and step S30 includes:

[0164] Step S302: Determine a first gain parameter that limits the fluctuation difference of the target gain frequency band within a preset range, and use the first gain parameter as the target processing parameter of the target loudspeaker.

[0165] In this embodiment, a preset range of fluctuation difference is set in advance. In a specific implementation, the preset range can be determined based on the difference between the highest and lowest response values ​​in each gain band of the initial audio signal, or it can be set based on the engineer's experience. No restrictions are imposed here.

[0166] In this embodiment, a first gain parameter is determined to limit the fluctuation difference of the target gain frequency band within a preset range, and the first gain parameter is used as the target processing parameter for the target loudspeaker.

[0167] It should be noted that in this embodiment, the first gain parameter of each gain frequency band is determined so as to add gain to the sound waves of different frequencies through the first gain parameter, so that the frequency response curve of the output audio signal transmitted to the user's position tends to be flat, thereby improving the user's listening effect at the user's position and thus improving the user's experience in the multi-functional cockpit.

[0168] Furthermore, in some feasible implementations, when the sound field spatial parameter is the sound pressure level characterizing the transmission of the audio signal from the target location to the user's location, step S20 includes:

[0169] Step S2023: Calculate the basic sound pressure level when the swept frequency signal is transmitted from the target location to the user location based on the relative position information and the spatial propagation parameters;

[0170] In this embodiment, the gain processing parameters of the target loudspeaker are also determined based on the sound pressure levels at the user's location and the initial location. Specifically, in this embodiment, the sound pressure level (hereinafter referred to as the base sound pressure level) when the swept frequency signal is transmitted from the target location to the user's location is calculated based on the relative position information and spatial propagation parameters.

[0171] In a specific implementation, the basic sound pressure level and the initial sound pressure level can be calculated using the following formula: Sound pressure level value = Sensitivity of target loudspeaker + 10lgp - 20lgh, where p is the input power of the target loudspeaker and h is the distance between the target loudspeaker and the user.

[0172] In this embodiment, the target processing parameters include gain parameters, and step S30 includes:

[0173] Step S303: Obtain the initial sound pressure level when the sweep frequency signal is transmitted from the target loudspeaker to the initial position in the sound field space;

[0174] In this embodiment, the sound pressure level (hereinafter referred to as the initial sound pressure level) is obtained when the sweep signal is transmitted from the target loudspeaker to the initial position in the sound field space. In a specific embodiment, the initial sound pressure level can be calculated based on the sweep signal and the initial position, or it can be preset; no specific limitation is imposed here.

[0175] Step S304: Calculate the second gain parameter based on the difference between the initial sound pressure level and the basic sound pressure level, and use the second gain parameter as the target processing parameter.

[0176] The gain parameter of the target loudspeaker (hereinafter referred to as the second gain parameter for distinction) is calculated based on the difference between the initial sound pressure level and the basic sound pressure level.

[0177] Furthermore, in one embodiment, the processing of the input audio signal by each gain frequency band can be calculated based on the first gain parameter and the second gain parameter of each gain frequency band.

[0178] The gain parameters are calculated (hereinafter referred to as target gain parameters for distinction), and the gain parameters of each gain band 5 are used as target processing parameters. In a specific implementation, the target gain parameters can be obtained by performing arithmetic operations on the first gain parameter and the second gain parameter.

[0179] It should be noted that in this embodiment, the second gain parameter of the target loudspeaker is determined so that the sound pressure level of the audio signal transmitted to the user's position is consistent with the sound pressure level of the audio signal transmitted to the initial position.

[0180] The listening experience of users at their current location is consistent with that at their initial location, thereby improving the user experience in the multi-functional cockpit.

[0181] Furthermore, in some feasible implementations, when the sound field spatial parameter is a reverberation volume parameter characterizing the transmission of the audio signal from the target location to the user location, step S202 includes:

[0182] Step S2024: Calculate the first volume of the sweep frequency signal when it travels directly from the target location to the user location based on the relative position information and the spatial propagation parameters;

[0183] 5. In this embodiment, the swept frequency signal is calculated based on the relative position information and spatial propagation parameters.

[0184] The volume when the target location reaches the user's location (hereinafter referred to as the first volume for distinction). Specifically, the direct sound signal can be calculated based on the signal attenuation coefficient, sound absorption coefficient, etc. in the sound field space, which will not be elaborated here.

[0185] Step S2025: Calculate the second volume of the reflected sound signal when it is transmitted to the user's location based on the reflected sound signal obtained by reverberation processing of the frequency sweep signal and the 0-space propagation parameters;

[0186] In this embodiment, the volume of the reflected sound signal when it is transmitted to the user's location is calculated based on the reflected sound signal obtained by reverberation processing of the frequency sweep signal and the spatial propagation parameters (hereinafter referred to as the second volume for distinction).

[0187] It is understandable that, relative to the entire sound field space, the 5-directional difference between the user's position and the initial position has a relatively small impact on the reflected sound signal. Therefore, in this embodiment, the reflected sound signals received at the initial position and the user's position are not distinguished. In a specific embodiment, the reflected sound signal can be obtained through simulation using a reverberation processing model based on a comb filter and an all-pass filter. Specifically, the number of comb filters and all-pass filters in the reverberation processing model can be adjusted according to actual conditions.

[0188] Requirements are set, and in the specific implementation method, refer to Figure 8 , Figure 8 This is a schematic diagram of the reverberation calculation model involved in the first embodiment of the sound field adjustment method of the present invention, using a comb filter (i.e., Figure 8 The comb filters shown can be connected in parallel, and the comb filters and all-pass filters (such as...) can be connected in parallel. Figure 8 The Allpass filters shown can be connected in series.

[0189] Step S2026: The ratio of the first volume to the second volume is determined as the reverberation volume parameter.

[0190] In this embodiment, the ratio of the first volume to the second volume is determined as the reverberation volume parameter.

[0191] In this embodiment, the target processing parameter includes an equalization parameter, specifically, the equalization parameter is the reverberation wet-dry ratio, and step S30 includes:

[0192] Step S305: Adjust the initial wet / dry ratio of the target loudspeaker according to the reverberation volume parameter to obtain the target wet / dry ratio, and use the target wet / dry ratio as the target processing parameter of the target loudspeaker.

[0193] The initial wet / dry ratio of the target loudspeaker is adjusted based on the reverberation volume parameter to obtain the wet / dry ratio at the user's position (hereinafter referred to as the target wet / dry ratio for distinction), and the target wet / dry ratio is used as the target processing parameter of the target loudspeaker.

[0194] In this embodiment, after calculating the reflected sound signal, the signal when the audio signal is transmitted to the user's location can be calculated based on the direct sound signal, the reflected sound signal, and the target wet / dry ratio of the target loudspeaker (hereinafter referred to as the initial wet / dry ratio for distinction). Specifically, the signal when the audio signal is transmitted to the user's location can be calculated using the following formula:

[0195] output=dry*mono+wet*mono*(n1*comb+allpass1+allpass2……+

[0196] allpassn2),

[0197] Where output is the first transmitted audio, dry is the direct sound factor, wet is the factor for adjusting the simulated reverberation, the ratio between dry and wet is also called the reverberation dry-wet ratio, n1 is the number of comb filters, n2 is the number of all-pass filters, and mono is the input audio signal corresponding to the target loudspeaker.

[0198] It should be noted that the target processing parameters in this embodiment include reverberation parameters, specifically the reverberation dry-to-wet ratio. This embodiment ensures that the reverberation effect heard by the user at the user's current position is consistent with the reverberation effect heard by the user at the initial position, improving the user's listening experience at the user's current position and thus enhancing the user's overall experience in the multi-functional cockpit.

[0199] Furthermore, in some feasible implementations, when the sound field spatial parameter is a frequency response intensity parameter characterizing the transmission of the audio signal from the target location to the user location, step S202 includes:

[0200] Step S2027: Calculate the fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location based on the relative position information and the spatial propagation parameters;

[0201] In this embodiment, the target processing parameters also include equalizer parameters. Specifically, in this embodiment, the fundamental frequency response curve of the swept frequency signal transmitted from the target location to the user location is calculated based on the relative position information and spatial propagation parameters.

[0202] Step S2028: Determine the response intensity of each equalized frequency band of the basic frequency response curve as the frequency response intensity parameter;

[0203] In this embodiment, the response intensity of each equalized frequency band of the basic frequency response curve is determined as the frequency response intensity parameter.

[0204] In this embodiment, the target processing parameters include equalization parameters, and step S30 includes:

[0205] Step S306: Adjust the initial equalization filter parameters corresponding to each equalization frequency band in the target loudspeaker according to each frequency response intensity parameter to obtain the target equalization filter parameters corresponding to each equalization frequency band, and use each target equalization filter parameter as the target processing parameter of the target loudspeaker.

[0206] In this embodiment, the initial equalization filter parameters corresponding to each equalization frequency band in the target loudspeaker are adjusted according to each frequency response intensity parameter to obtain the target equalization filter parameters corresponding to each equalization frequency band, and each target equalization filter parameter is used as the target processing parameter of the target loudspeaker.

[0207] In specific implementations, the equalizer's filter can be an IIR filter (Infinite Impulse Response, recursive filter). For example, in one implementation, it can be a Biquad filter (double second-order filter). Specifically, the equalizer can be composed of five double second-order filters. The specific filter type can be set according to the division of the equalization frequency bands and actual needs, and is not limited here. Using an IIR filter in the equalizer can reduce the error of the coefficients of each filter when the equalization filters are cascaded. At the same time, the IIR filter only needs a small order to achieve the same equalization effect as the FIR filter (Finite Impulse Response, non-recursive filter).

[0208] It should be noted that in this embodiment, the clarity perceived by the user at the user's current position is consistent with the clarity perceived by the user at the initial position, thereby improving the listening effect at the user's current position and enhancing the user's experience in the multi-functional cockpit.

[0209] Furthermore, in some feasible implementations, the sound field spatial parameter characterizes the transmission time of the audio signal from the target location to the user location, and step S202 includes:

[0210] Step S2029: Calculate the basic transmission time of the swept frequency signal to the user's location based on the relative position information and the spatial propagation parameters;

[0211] In this embodiment, the target processing parameters also include delay processing parameters. In this embodiment, the basic transmission time of the initial audio signal output by the target speaker to the user's location is calculated based on the relative position information. The specific calculation process will not be described in detail here.

[0212] In this embodiment, the target processing parameters include delay processing parameters, and step S30 includes:

[0213] Step S307: Obtain the initial transmission time of the swept frequency signal from the target position to the initial position in the sound field space. ；

[0214] The initial transmission duration of the initial audio signal output from the target speaker to the user's location is obtained. In specific implementations, the initial transmission duration can be calculated or directly obtained from a preset duration; no limitation is imposed here.

[0215] Step S308: Calculate the delay processing parameters based on the initial transmission duration and the basic transmission duration, and use the delay processing parameters as the target processing parameters for the target loudspeaker.

[0216] In this embodiment, delay processing parameters are calculated based on the initial transmission duration and the basic transmission duration, and the delay processing parameters are used as the target processing parameters for the target loudspeaker.

[0217] It should be noted that this embodiment can adjust the time it takes for the audio signal output by the target speaker to be transmitted to the user's location. The time when the user perceives the audio signal at the user's location is the same as the time when the user perceives the audio signal at the initial location, which improves the listening effect at the user's location and thus enhances the user's experience in the multi-functional cockpit.

[0218] Furthermore, in one embodiment, the target processing parameters include: gain parameters, delay processing parameters, reverberation parameters, and equalization parameters. Specifically, refer to... Figure 9 , Figure 9 This is a schematic flowchart illustrating an embodiment of the sound field adjustment method of the present invention. In this embodiment, the input audio signal to the target loudspeaker (i.e., Figure 9 The original signal shown is processed to obtain the output audio signal. Specifically, the processing includes: delaying the input audio signal to synchronize the sound signals transmitted from each speaker in the sound field to the user's position when the input audio signal is a mono signal (i.e.,...). Figure 9 The speaker synchronization shown makes the user's location the sweet spot of the sound field, or when the input audio signal is a stereo signal, it makes the sound signal heard by the user at the user's location consistent with the sound signal heard by the user at the initial location.

[0219] In this embodiment, the input audio signal is also subjected to gain processing to change the frequency response characteristics of the input audio signal so that the frequency response curve of the audio signal output by the target speaker is transmitted to the user's position is smooth, thereby enhancing the user's experience.

[0220] In this embodiment, the input audio signal is also subjected to reverberation processing using a reverberation calculation model based on a comb filter and an all-pass filter (i.e., Figure 9 The comb + all-pass model shown in the diagram obtains the reflected sound signal, and the output audio signal with reverberation is calculated based on the reflected sound signal (i.e., Figure 9 (The sound field reverberation shown in the figure).

[0221] In this embodiment, the input audio signal is also processed by an equalizer. Specifically, in this embodiment, the equalization filter is an IIR filter that adjusts each frequency band of the input audio signal to improve the clarity of the output audio signal heard by the user at the user's location.

[0222] In this embodiment, the fundamental frequency response curve of the swept signal output by the target loudspeaker at the user's location is calculated based on the relative position information and the spatial structure information of the sound field. For any target gain frequency band in each gain band of the fundamental frequency response curve, the fluctuation difference of the target gain frequency band is calculated based on the highest and lowest response values ​​of the target gain frequency band. A first gain parameter is determined to limit the fluctuation difference of the target gain frequency band within a preset range, and this first gain parameter is used as the target processing parameter for the target loudspeaker. In this embodiment, the first gain parameter for each gain frequency band is determined to add gain to sound waves of different frequencies through the first gain parameter, making the frequency response curve of the output audio signal transmitted to the user's location smoother, improving the user's listening effect at the user's location, and thus enhancing the user's experience in the multi-functional cockpit.

[0223] Furthermore, embodiments of the present invention also propose a computer-readable storage medium storing a sound field adjustment program, wherein when the sound field adjustment program is executed by a processor, it implements the steps of the sound field adjustment method described below.

[0224] The various embodiments of the sound field adjustment device and computer-readable storage medium of the present invention can be referred to the various embodiments of the sound field adjustment method of the present invention, and will not be repeated here.

[0225] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0226] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0227] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0228] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A sound field adjustment method, characterized in that, The sound field adjustment method is applied to a multi-functional cockpit, and the sound field adjustment method includes the following steps: The user's position in the sound field space and the spatial structure information of the sound field space are obtained. The spatial structure information includes spatial position information representing the position of hardware structures in the sound field space, spatial propagation parameters of sound signals in the sound field space, and regional position information representing the position of each sub-region in the sound field space. The sound field space is pre-divided into multiple sub-regions, and each sub-region corresponds to preset processing parameters. For any target loudspeaker among the loudspeakers arranged within the sound field space, the sound field space parameters corresponding to the user position are calculated based on the user position and the spatial structure information. These sound field space parameters include the fluctuation difference of the frequency response curve, sound pressure level, transmission duration, reverberation volume parameter, and frequency response intensity parameter. The step of calculating the sound field space parameters corresponding to the user position based on the user position and the spatial structure information includes: Based on the user location and the region location information, the target sub-region where the user location is located is determined from each of the sub-regions; The target processing parameters of the target loudspeaker are determined based on the sound field spatial parameters. The target processing parameters include gain parameters, delay processing parameters, reverberation parameters, and equalization parameters. The gain parameters include a first gain parameter that limits the fluctuation difference of the frequency response curve within a preset range, and a second gain parameter calculated based on the difference between the base sound pressure level and the initial sound pressure level when the swept frequency signal is transmitted to the initial position. The step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes: determining the preset processing parameters corresponding to the target sub-region as the target processing parameters of the target loudspeaker. The delay processing parameter is calculated based on the difference between the basic transmission duration and the initial transmission duration of the sweep signal to the initial position; The input audio signal of the target speaker is processed according to the target processing parameters to obtain an output audio signal, and the output audio signal is output using the target speaker.

2. The sound field adjustment method as described in claim 1, characterized in that, The step of calculating the sound field spatial parameters corresponding to the user's location based on the user's location and the spatial structure information includes: The relative position information of the user's position with respect to the target position where the target speaker is located is determined based on the user's position and the spatial position information; The sound field spatial parameters are calculated based on the relative position information and the spatial propagation parameters. The sound field spatial parameters include parameters characterizing the transmission process of the audio signal from the target position to the user position and parameters characterizing the state of the audio signal when it is transmitted from the target position to the user position.

3. The sound field adjustment method as described in claim 2, characterized in that, The step of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes: The fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters. For any target gain frequency band in each gain frequency band of the basic frequency response curve, the fluctuation difference of the target gain frequency band is calculated based on the highest and lowest response values ​​of the target gain frequency band. The target processing parameters include gain parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes: A first gain parameter is determined to limit the fluctuation difference of the target gain frequency band within a preset range, and the first gain parameter is used as the target processing parameter of the target loudspeaker.

4. The sound field adjustment method as described in claim 2, characterized in that, The step of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes: The basic sound pressure level when the swept frequency signal is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters. The target processing parameters include gain parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes: Obtain the initial sound pressure level when the sweep frequency signal is transmitted from the target loudspeaker to the initial position in the sound field space; The second gain parameter is calculated based on the difference between the initial sound pressure level and the basic sound pressure level, and the second gain parameter is used as the target processing parameter.

5. The sound field adjustment method as described in claim 2, characterized in that, The step of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes: The first volume of the sweep frequency signal when it travels directly from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters. Based on the reflected sound signal obtained by reverberating the swept frequency signal and the spatial propagation parameters, the second volume of the reflected sound signal when it is transmitted to the user's location is calculated. The ratio of the first volume to the second volume is determined as the reverberation volume parameter; The target processing parameters include the reverberation dry-wet ratio, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes: The initial wet / dry ratio of the target loudspeaker is adjusted according to the reverberation volume parameter to obtain the target wet / dry ratio, and the target wet / dry ratio is used as the target processing parameter of the target loudspeaker.

6. The sound field adjustment method as described in claim 2, characterized in that, The step of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes: The fundamental frequency response curve of the swept frequency signal when it is transmitted from the target location to the user location is calculated based on the relative position information and the spatial propagation parameters. The response intensity of each equalized frequency band of the basic frequency response curve is determined as the frequency response intensity parameter; The target processing parameters include equalization parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes: The initial equalization filter parameters corresponding to each equalization frequency band in the target loudspeaker are adjusted according to each of the frequency response intensity parameters to obtain the target equalization filter parameters corresponding to each of the equalization frequency bands, and each target equalization filter parameter is used as the target processing parameter of the target loudspeaker.

7. The sound field adjustment method as described in claim 2, characterized in that, The step of calculating the sound field spatial parameters based on the relative position information and the spatial propagation parameters includes: The basic transmission time of the swept frequency signal to the user's location is calculated based on the relative position information and the spatial propagation parameters. The target processing parameters include delay processing parameters, and the step of determining the target processing parameters of the target loudspeaker based on the sound field spatial parameters includes: Obtain the initial transmission time of the swept frequency signal from the target position to the initial position in the sound field space; The delay processing parameters are calculated based on the initial transmission duration and the basic transmission duration, and the delay processing parameters are used as the target processing parameters for the target loudspeaker.

8. The sound field adjustment method according to any one of claims 1 to 7, characterized in that, A depth camera or an infrared camera is set in the sound field space, and the step of obtaining the user's position in the sound field space includes: The user's position in the sound field space is obtained using the depth camera or the infrared camera based on target capture technology.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a sound field adjustment program, which, when executed by a processor, implements the steps of the sound field adjustment method as described in any one of claims 1 to 8.

Images