Audio control method and device of in-vehicle acoustic system, storage medium and equipment

Abstract

The application discloses an audio control method and device of an in-vehicle acoustic system, a storage medium and equipment. The method comprises the following steps: acquiring an audio control instruction triggered by an object at different positions in a vehicle, the audio control instruction being used to indicate an audio playing position, audio content and an audio volume; determining a bright area and a dark area of a sound field space in the vehicle according to the audio control instruction, the bright area being used to represent a position of playing audio in the sound field space in the vehicle, and the dark area being used to represent a position of suppressing audio in the sound field space in the vehicle; determining a first control signal corresponding to the bright area and a second control signal corresponding to the dark area according to the bright area and the dark area; controlling a loudspeaker corresponding to the bright area to play audio according to the first control signal, and controlling a loudspeaker corresponding to the dark area to suppress audio according to the second control signal, so that different audio content is played in the bright area and the dark area respectively, and / or different audio volume is played in the bright area and the dark area respectively, thereby achieving the effect of a personalized space sound field.

Description

Technical Field

[0001] This application relates to the field of vehicle acoustic control technology, specifically to an audio control method, device, storage medium, and equipment for an in-vehicle acoustic system. Background Technology

[0002] Traditional in-vehicle audio systems have continuously improved in terms of speaker quality and quantity, resulting in an overall improvement in in-vehicle sound quality. However, passengers in different positions within the vehicle hear the same audio content, failing to meet their individual audio preferences. Furthermore, the energy distribution of in-vehicle audio is uniform, creating a uniform sound field within the vehicle, meaning passengers in different positions hear the same volume, again failing to satisfy their individual volume requirements. Summary of the Invention

[0003] This application provides an audio control method, device, storage medium, and equipment for an in-vehicle acoustic system, which can realize phase and amplitude control of a multi-point, multi-input, and multi-output sound field to achieve different audio content and different audio volumes for different users, realize directional acoustic beams, and achieve a personalized spatial sound field effect.

[0004] On one hand, this application provides an audio control method for an in-vehicle acoustic system, the in-vehicle acoustic system including a speaker array disposed at different locations within the vehicle, the method comprising: acquiring audio control commands triggered by objects at different locations within the vehicle, the audio control commands indicating audio playback location, audio content, and audio volume; determining, based on the audio control commands, a bright zone and a dark zone within the in-vehicle sound field space, the bright zone representing the location where audio is played in the in-vehicle sound field space, and the dark zone representing the location where audio is suppressed in the in-vehicle sound field space; determining, based on the bright zone and the dark zone, a first control signal corresponding to the bright zone and a second control signal corresponding to the dark zone; controlling the speaker corresponding to the bright zone to play audio according to the first control signal, and controlling the speaker corresponding to the dark zone to suppress audio according to the second control signal, so as to play different audio content in the bright zone and the dark zone respectively, and / or play different audio volumes in the bright zone and the dark zone respectively.

[0005] On the other hand, embodiments of this application provide an audio control device for an in-vehicle acoustic system, the in-vehicle acoustic system including a speaker array disposed at different locations within the vehicle, the device comprising:

[0006] The acquisition unit is used to acquire audio control commands triggered by objects in different locations inside the vehicle. The audio control commands are used to indicate the audio playback position, audio content, and audio volume.

[0007] The first determining unit is used to determine the bright area and dark area of ​​the in-vehicle sound field space according to the audio control command. The bright area is used to characterize the position of playing audio in the in-vehicle sound field space, and the dark area is used to characterize the position of suppressing audio in the in-vehicle sound field space.

[0008] The second determining unit is used to determine the first control signal corresponding to the bright area and the second control signal corresponding to the dark area based on the bright area and the dark area;

[0009] The control unit is configured to control the speaker corresponding to the bright area to play audio according to the first control signal, and to control the speaker corresponding to the dark area to suppress audio according to the second control signal, so as to play different audio content in the bright area and the dark area respectively, and / or play different audio volumes in the bright area and the dark area respectively.

[0010] On the other hand, embodiments of this application provide a computer-readable storage medium storing a computer program adapted for loading by a processor to execute the audio control method of the in-vehicle acoustic system as described in any of the above embodiments.

[0011] On the other hand, embodiments of this application provide a computer device, the computer device including a processor and a memory, the memory storing a computer program, the processor executing the audio control method of the in-vehicle acoustic system as described in any of the above embodiments by calling the computer program stored in the memory.

[0012] On the other hand, embodiments of this application provide a computer program product, including computer instructions, which, when executed by a processor, implement the audio control method of the in-vehicle acoustic system as described in any of the above embodiments.

[0013] This application embodiment applies to an in-vehicle acoustic system, which includes a speaker array disposed at different locations within the vehicle. It acquires audio control commands triggered by objects at different locations within the vehicle. These audio control commands indicate the audio playback location, audio content, and audio volume. Based on the audio control commands, it determines a bright zone and a dark zone within the in-vehicle sound field space. The bright zone characterizes the location where audio is played within the sound field space, and the dark zone characterizes the location where audio is suppressed within the sound field space. Based on the bright and dark zones, it determines a first control signal corresponding to the bright zone and a second control signal corresponding to the dark zone. It controls the speaker corresponding to the bright zone to play audio according to the first control signal and controls the speaker corresponding to the dark zone to suppress audio according to the second control signal, thereby playing different audio content in the bright and dark zones respectively, and / or playing different audio volumes in the bright and dark zones respectively. This application embodiment determines the bright and dark zones based on the needs of objects (passengers) in different positions inside the vehicle. Then, it generates a first control signal corresponding to the bright zone and a second control signal corresponding to the dark zone. Based on the first control signal, audio is played in the bright zone, and based on the second control signal, audio is suppressed in the dark zone. This allows for the playback of different audio content and different audio volumes in the bright and dark zones, enabling phase and amplitude control of the sound field at multiple points, multiple inputs, and multiple outputs. This achieves the effect of different audio content and volumes for different users, realizing directional acoustic beams and a personalized spatial sound field. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is a schematic diagram of the structure of the in-vehicle acoustic system provided in an embodiment of this application.

[0016] Figure 2 This is a schematic diagram of the control system of the in-vehicle acoustic system provided in an embodiment of this application.

[0017] Figure 3 A flowchart illustrating the audio control method for an in-vehicle acoustic system provided in this application embodiment.

[0018] Figure 4 This is a schematic diagram of the relationship between frequency range and array factor amplitude value provided in an embodiment of this application.

[0019] Figure 5 This is a schematic diagram of the relationship between frequency range and acoustic contrast amplitude provided in an embodiment of this application.

[0020] Figure 6 This is a schematic diagram of the structure of the audio control device of the in-vehicle acoustic system provided in an embodiment of this application.

[0021] Figure 7 A schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0022] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0023] Traditional in-vehicle audio systems have continuously improved in terms of speaker quality and quantity, resulting in an overall improvement in in-vehicle sound quality. However, passengers in different positions within the vehicle hear the same audio content, failing to meet their individual audio preferences. Furthermore, the energy distribution of in-vehicle audio is uniform, creating a uniform sound field within the vehicle, meaning passengers in different positions hear the same volume, again failing to satisfy their individual volume requirements.

[0024] For example, a traditional headrest speaker-based audio system may include speakers, microphones, and processing units, enabling the headrest to perform functions such as user interaction and calls, providing a better voice interaction experience. In this traditional technology, N speakers are configured as one audio stream transmission channel, and P microphones are configured as one audio reception channel. Because the speakers and microphones are located closer to the user and a backlash cancellation module is provided, the user experience is better when sending voice recognition commands in hands-free mode.

[0025] For example, traditional in-vehicle audio volume control methods and devices can obtain information about the distribution of occupants in the vehicle, such as in-vehicle image information and seat pressure information, and then determine the playback volume of each audio device in the vehicle based on this information. The audio device located in the middle of the vehicle is designated as the main audio device, with a volume higher than that of other audio devices. This traditional technology mainly uses multiple sensors to detect user positions, but it lacks specific methods for speaker control and cannot prevent sound interference between devices in different locations. It can only ensure that the volume is higher in areas where people are sitting, and it cannot achieve the effect of different volumes for different passengers when multiple people are in the vehicle.

[0026] For example, traditional in-car immersive sound systems utilize two-channel headrest speakers and crosstalk cancellation technology to achieve a virtual multi-channel playback effect, thus creating an immersive sound field experience. This traditional technology can achieve basic surround sound effects, but it only utilizes headrest speakers, making it suitable only for a single passenger's experience. The sound quality is not optimal, and crosstalk can still occur between headrest speakers in different locations, especially at lower frequencies.

[0027] In summary, the main drawbacks of traditional technologies are as follows: 1) They rely solely on headrest speakers for functions such as calls and surround sound, and the content played by different headrest speakers is the same, failing to meet the personalized experience needs of users in different positions; 2) They require auxiliary devices such as cameras and pressure sensors to determine the user's position, which are complex and cannot distinguish volume differences between different positions in multi-person scenarios; 3) The frequency response range of headrest speakers is limited, and they cannot achieve good reproduction in the low-frequency range below 200Hz, resulting in poor sound quality; 4) For multi-channel audio content, headrest speakers cannot achieve multi-channel effects, limiting the immersive sound field effect.

[0028] This application embodiment utilizes a combination of in-vehicle multi-channel array speakers and headrest speakers, along with signal feedback from multiple microphones, to achieve phase and amplitude control of a multi-point MIMO sound field. This allows for a personalized audio experience for passengers in different positions within the vehicle, with the volume and surround sound perceived by each passenger adjustable according to individual preferences. MIMO stands for Multiple Input Multiple Output, encompassing multiple speakers and microphones. This application embodiment, building upon existing speaker layouts at the front, rear, and left / right doors, adds speaker placement above and behind each passenger position. Microphones are also added to each speaker location for sound field feedback. Combined with a multi-band acoustic contrast optimization control algorithm, directional acoustic beams are achieved, resulting in a personalized sound field effect.

[0029] Please refer to Figure 1 , Figure 1This is a schematic diagram of the in-vehicle acoustic system provided in an embodiment of this application. The in-vehicle acoustic system 100 includes a speaker array 20 and a microphone array 30 located at different positions within the vehicle interior 10. For example, the speaker array 20 may include channel speakers 21 located on the door 11, a center speaker 22 located at the front 12, a low-frequency unit 23 located at the rear 13, a linear array of front and rear speakers 24, and a linear array of rear speakers 25, as well as headrest speakers 26 located at each seat position 14. Each speaker can be configured as a combination of mid-to-low frequency band units and high-frequency band units, or a combination of low-frequency, mid-frequency, and high-frequency band units, to cover different frequency bands and different surround sound channels for audio reproduction. The microphone array 30 may include an array layout of microphones at each seat position 14 and microphones located at positions such as seat belts 15. By detecting the sound pressure at the corresponding microphone positions, when the sound field inside the vehicle 10 changes, the microphones at different positions collect the sound pressure at different positions and feed it back to the control algorithm so as to calculate the acoustic power difference at different positions. In order to achieve the ideal control effect, the vehicle 10 usually needs to be equipped with a combination of a speaker array 20 consisting of dozens of speakers and a microphone array 30 consisting of dozens of microphones to complete the control of the sound field beam.

[0030] Please refer to Figure 2 , Figure 2 This is a schematic diagram of the control system of the in-vehicle acoustic system provided in this application embodiment. The in-vehicle acoustic system 100 also includes a control system 40, which is used to execute corresponding control algorithms. The control system 40 may include a main control module 41, a computing module 42, a first audio module 43, a second audio module 44, and a baseband module 45. For example, the main control module 41 can perform system control, the computing module 42 can use a processing chip to run the control algorithm, the first audio module 43 and the second audio module 44 can drive the multi-channel speakers 20, and the second audio module 44 can receive audio signals from the multi-channel microphones 30. The baseband module 45 can also perform demodulation, descrambling, despreading, and decoding of wireless signals in the mobile network, and transmit the finally decoded digital signal to the upper-level processing system for processing.

[0031] For example, the first audio module 43 may include a DSP digital signal processor 46 and a power amplifier 47. The first end of the DSP digital signal processor 46 is connected to the power supply and network, and the second end of the DSP digital signal processor 46 is connected to the power amplifier 47 via an audio cable. The power amplifier 47 is connected to the speaker array 20 (such as the channel speakers 21 in the speaker array 20) via an audio cable, and finally transmits the audio signal to the speaker array 20 to realize the playback function.

[0032] For example, the second audio module 44 may include a DSP digital signal processor 46, a power amplifier 47, and an ADC digital-to-analog converter 48. The first terminal of the DSP digital signal processor 46 is connected to the power supply and network. The second terminal of the DSP digital signal processor 46 is connected to the power amplifier 47 via an audio cable. The power amplifier 47 is connected to the speaker array 20 (e.g., the headrest speakers 22 in the speaker array 20) via an audio cable, ultimately transmitting the audio signal to the speaker array 20 to achieve playback. Additionally, the first terminal of the ADC digital-to-analog converter 47 is connected to the power supply and network. The third terminal of the DSP digital signal processor 46 is connected to the second terminal of the ADC digital-to-analog converter 47 via an audio cable. The third terminal of the ADC digital-to-analog converter 47 is connected to the microphone array 30 via an audio cable to receive audio signals from the multi-channel microphone array 30.

[0033] For example, the computing module 42 may include a DSP digital signal processor 46, a power amplifier 47, and an ADC digital-to-analog converter 48. The first terminal of the DSP digital signal processor 46 is connected to a power supply and a network. The second terminal of the DSP digital signal processor 46 is connected to the power amplifier 47 via an audio cable. The power amplifier 47 is connected to the speaker array 20 (e.g., channel speakers 21 and / or headrest speakers 22 in the speaker array 20) via an audio cable, ultimately transmitting audio signals to the speaker array 20. The first terminal of the ADC digital-to-analog converter 47 is connected to a power supply and a network. The third terminal of the DSP digital signal processor 46 is connected to the second terminal of the ADC digital-to-analog converter 47 via an audio cable. The third terminal of the ADC digital-to-analog converter 47 is connected to the microphone 30 via an audio cable. Through this computing module 42, the processing chip is used to run the control algorithm, combined with a multi-band acoustic contrast optimization control algorithm, to achieve directional acoustic beams and a personalized sound field effect.

[0034] DSP (Digital Signal Processor) is the theory and technology of representing and processing signals digitally.

[0035] An ADC (Analog-to-digital converter) converts analog signals generated in the real world (such as temperature, pressure, sound, fingerprints, or images) into a more easily processed digital form.

[0036] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0037] Please see Figures 3 to 5 , Figure 3 This is a flowchart illustrating the audio control method for an in-vehicle acoustic system provided in an embodiment of this application. Figure 4 This is a schematic diagram of a curve representing the relationship between frequency range and array factor amplitude value, provided in an embodiment of this application. Figure 5 This is a schematic diagram illustrating the relationship between frequency range and acoustic contrast amplitude values, provided as an embodiment of this application. This method can be applied to, for example... Figure 1 and 2 The in-vehicle acoustic system shown may include a speaker array and a microphone array disposed at different locations within the vehicle. The method may include steps 110 to 140:

[0038] Step 110: Obtain audio control commands triggered by objects in different locations inside the vehicle. The audio control commands are used to indicate the audio playback location, audio content, and audio volume.

[0039] For example, the object could be a passenger. For instance, passengers in different positions within the vehicle can choose to listen to different audio content and / or different audio volumes according to their needs. Based on the audio control operations input by passengers in different positions within the vehicle at the audio control terminal, audio control instructions are generated, which are used to indicate the audio playback position, audio content, and audio volume.

[0040] For example, if a front passenger wants to listen to music while a rear passenger wants to sleep, the audio control commands triggered by objects in different locations within the vehicle can include a first audio control command triggered by the front passenger and a second audio control command triggered by the rear passenger. For instance, the first audio control command might indicate that the audio playback location is in the front, the audio content is the selected music to be played, and the audio volume is a specified first volume. Alternatively, the second audio control command might indicate that the audio playback location is in the rear, the audio content is empty, and the audio volume is zero. Or, for example, the second audio control command might indicate that the currently playing audio in the rear should be turned off.

[0041] For example, if a front-seat passenger wants to listen to music while a rear-seat passenger wants to listen to an audiobook, the audio control commands triggered by objects in different locations within the vehicle can include a first audio control command triggered by the front-seat passenger and a third audio control command triggered by the rear-seat passenger. For instance, the first audio control command might indicate that the audio playback location is in the front seat, the audio content is the music selected by the front-seat passenger, and the audio volume is a first volume specified by the front-seat passenger. Similarly, the third audio control command might indicate that the audio playback location is in the rear seat, the audio content is the audiobook selected by the rear-seat passenger, and the audio volume is a second volume specified by the rear-seat passenger. For example, the first and second volumes can be the same or different.

[0042] For example, if the same audio content is playing in the car, and the front passenger wants a very low volume while the rear passenger wants a normal volume, the audio control commands triggered by objects in different locations within the car can include a fourth audio control command triggered by the front passenger and a fifth audio control command triggered by the rear passenger. For instance, the fourth audio control command might indicate the audio playback location as the front row, the audio content as the currently playing first audio content, and the audio volume as the third volume specified by the front passenger. Similarly, the fifth audio control command might indicate the audio playback location as the rear row, the audio content as the currently playing first audio content, and the audio volume as the fourth volume specified by the rear passenger. For example, the third volume might be lower than the fourth volume.

[0043] For example, if the front and rear seats are currently playing different audio content, and the front passenger wants a very low volume while the rear passenger wants a normal volume, then the audio control commands triggered by objects in different locations within the vehicle can include a sixth audio control command triggered by the front passenger and a seventh audio control command triggered by the rear passenger. For instance, the sixth audio control command might indicate the audio playback location as the front seat, the audio content as the currently playing second audio content, and the audio volume as the fifth volume specified by the front passenger. Similarly, the seventh audio control command might indicate the audio playback location as the rear seat, the audio content as the currently playing third audio content, and the audio volume as the sixth volume specified by the rear passenger. For example, the fifth volume might be lower than the sixth volume.

[0044] Step 120: According to the audio control command, determine the bright area and dark area of ​​the in-vehicle sound field space. The bright area is used to characterize the position of the audio being played in the in-vehicle sound field space, and the dark area is used to characterize the position of the audio being suppressed in the in-vehicle sound field space.

[0045] For example, based on audio control commands triggered by objects in different locations within the vehicle, the bright and dark zones of the vehicle's sound field are determined. The bright zone represents the location where audio is played within the sound field, while the dark zone represents the location where audio is suppressed. These determined bright and dark zones are the targets for audio control. After clarifying these targets, the control signals corresponding to the bright and dark zones are subsequently adjusted by controlling the playback coefficients and acoustic contrast of the respective areas. This ensures that the audio outputs from the bright and dark zones, based on their respective control signals, exhibit a clear difference.

[0046] In some embodiments, determining the bright and dark areas of the in-vehicle sound field space according to the audio control command includes: determining the bright and dark areas of the in-vehicle sound field space according to the audio playback position, audio content and audio volume in the audio control command.

[0047] In some embodiments, the in-vehicle sound field space has multiple sound field zones; determining the bright and dark zones of the in-vehicle sound field space based on the audio playback position, audio content, and audio volume in the audio control command includes:

[0048] The sound field zone where the audio playback position corresponding to a non-empty value is located is defined as the bright zone of the in-vehicle sound field space; or

[0049] The sound field zone where the audio playback position corresponding to the null audio content is located is defined as the dark zone of the in-vehicle sound field space; or

[0050] The sound field zone where the audio playback position corresponds to an audio volume greater than a preset volume value is defined as the bright zone of the in-vehicle sound field space; or

[0051] The sound field zone where the audio playback position is located when the audio volume is less than or equal to a preset volume value is defined as the dark zone of the in-vehicle sound field space.

[0052] For example, the in-car sound field space can be pre-divided into multiple sound field zones; such as the front and rear zones; or the left front, right front, left rear, and right rear zones; or even more specific classifications of sound field zones based on the size of the in-car sound field space, which will not be listed here. Each sound field zone has a corresponding speaker and a corresponding microphone.

[0053] For example, the following example illustrates the division of the in-car sound field space into front and rear zones.

[0054] For example, if a front-seat passenger wants to listen to music while a rear-seat passenger wants to sleep, the audio control commands triggered by objects in different locations within the vehicle can include a first audio control command triggered by the front-seat passenger and a second audio control command triggered by the rear-seat passenger. For instance, the first audio control command might indicate that the audio playback location is in the front, the audio content is the selected music to be played, and the audio volume is a specified first volume. Conversely, the second audio control command might indicate that the audio playback location is in the rear, the audio content is empty, and the audio volume is zero. Alternatively, the second audio control command might indicate that the currently playing audio in the rear is turned off. Based on the first audio control command triggered by the front-seat passenger and the second audio control command triggered by the rear-seat passenger, the sound field zone where the front is located can be defined as the bright zone, and the sound field zone where the rear is located can be defined as the dark zone. The front is designated as the location for playing audio within the vehicle's sound field space, and the rear is designated as the location for suppressing audio within the vehicle's sound field space.

[0055] For example, if a front-seat passenger wants to listen to music while a rear-seat passenger wants to listen to an audiobook, the audio control commands triggered by objects in different locations within the vehicle can include a first audio control command triggered by the front-seat passenger and a third audio control command triggered by the rear-seat passenger. For instance, the first audio control command might indicate the audio playback location as the front seat, the audio content as the music selected by the front-seat passenger, and the audio volume as a first volume specified by the front-seat passenger. Conversely, the third audio control command might indicate the audio playback location as the rear seat, the audio content as the audiobook selected by the rear-seat passenger, and the audio volume as a second volume specified by the rear-seat passenger. The first and second volumes can be the same or different. Based on these two audio control commands, a design can be created where bright and dark zones intersect, effectively creating two bright zones and two dark zones. This allows the front-seat passenger to listen to music while the rear-seat passenger listens to an audiobook (simultaneously) without disturbing each other. For example, the acoustic field zone where the front row is located is divided into a first bright zone and a second dark zone, and the acoustic field zone where the back row is located is divided into a first dark zone and a second bright zone. The first bright zone is used to represent the position in the acoustic zone where the music to be played is played in the front row, the first dark zone is used to represent the position in the acoustic zone where the music to be played is suppressed in the back row, the second dark zone is used to represent the position in the acoustic zone where the novel to be played is suppressed in the front row, and the second bright zone is used to represent the position in the acoustic zone where the novel to be played is played in the back row.

[0056] For example, if the same audio content is currently playing in the car, and the front passenger wants a very low volume while the rear passenger wants a normal volume, the audio control commands triggered by objects in different locations within the car can include a fourth audio control command triggered by the front passenger and a fifth audio control command triggered by the rear passenger. For instance, the fourth audio control command might indicate the audio playback location as the front row, the audio content as the currently playing first audio content, and the audio volume as the third volume specified by the front passenger. Similarly, the fifth audio control command might indicate the audio playback location as the rear row, the audio content as the currently playing first audio content, and the audio volume as the fourth volume specified by the rear passenger. For example, the third volume might be lower than the fourth volume. Based on the fourth and fifth audio control commands triggered by the front and rear passengers, the sound field zone where the front row is located can be defined as a dark zone, and the sound field zone where the rear row is located can be defined as a bright zone. The front row is considered the location in the car's sound field space where the volume of the first audio content is suppressed by the third volume, and the rear row is considered the location in the car's sound field space where the volume of the first audio content is played by the fourth volume.

[0057] For example, if the front and rear seats are currently playing different audio content, and the front passenger wants a very low volume while the rear passenger wants a normal volume, then the audio control commands triggered by objects in different locations within the vehicle can include a sixth audio control command triggered by the front passenger and a seventh audio control command triggered by the rear passenger. For instance, the sixth audio control command might indicate the audio playback location as the front seat, the audio content as the currently playing second audio content, and the audio volume as the fifth volume specified by the front passenger. Similarly, the seventh audio control command might indicate the audio playback location as the rear seat, the audio content as the currently playing third audio content, and the audio volume as the sixth volume specified by the rear passenger. For example, the fifth volume might be lower than the sixth volume. Based on the sixth and seventh audio control commands triggered by the front and rear passengers, the sound field zone where the front seat is located can be defined as a dark zone, and the sound field zone where the rear seat is located can be defined as a bright zone. The front seat is considered the location in the vehicle's sound field space where the volume of the second audio content is suppressed at the fifth volume, and the rear seat is considered the location in the vehicle's sound field space where the volume of the third audio content is played at the sixth volume.

[0058] Step 130: Based on the bright area and the dark area, determine the first control signal corresponding to the bright area and the second control signal corresponding to the dark area.

[0059] For example, after identifying the bright and dark areas, and using them as the targets for audio control, the playback coefficients and acoustic contrast of the corresponding areas are then controlled to adjust the first control signal for the bright area and the second control signal for the dark area, so that the audio outputs of the bright and dark areas based on the corresponding control signals are significantly different.

[0060] In some embodiments, step 130 can be implemented by the following steps 131 to 132 (not shown in the figure), specifically:

[0061] Step 131: Determine the playback coefficient corresponding to each speaker in the speaker array based on the bright area and the dark area, and determine the acoustic contrast corresponding to the bright area and the dark area.

[0062] For example, the playback coefficient serves as the signal adjustment condition for the speakers corresponding to the bright and dark zones. Specifically, by controlling the speaker's playback coefficient, some speakers can be made to produce a bright zone, and some speakers a dark zone, achieving the effect that some speakers receive audio signals while others do not. Only after solving for q can the playback coefficient be controlled to determine which speakers need to play audio (bright zone), which do not (dark zone), or which speakers should have their volume increased (bright zone) and decreased (dark zone). The acoustic contrast ratio is controlled by the user at different frequencies for the bright and dark zones.

[0063] In some embodiments, the bright area includes L B A bright area control location, the bright area including L D One dark zone control location, L B ≥1, L D ≥1; Step 131 can be achieved through the following steps 1311 to 1317 (not shown in the figure), specifically:

[0064] Step 1311, measure the distance from each speaker in the speaker array to the L B The electroacoustic transfer function of each position in the bright area control position is obtained to obtain the bright area electroacoustic transfer function matrix.

[0065] In some embodiments, the in-vehicle acoustic system further includes a microphone array disposed at different locations within the vehicle; the measurement of each speaker in the speaker array to the L... B The electroacoustic transfer function is calculated for each position in the bright area control location to obtain the bright area electroacoustic transfer function matrix, including:

[0066] Through each microphone in the microphone array, to each speaker in the speaker array, to the L B The sound pressure at each control position in the bright area is measured to obtain the electroacoustic transfer function matrix of the bright area.

[0067] Step 1312, measure the distance from each speaker in the speaker array to the L D The electroacoustic transfer function of each position in the dark zone control position is obtained to obtain the dark zone electroacoustic transfer function matrix.

[0068] In some embodiments, the in-vehicle acoustic system further includes a microphone array disposed at different locations within the vehicle; the measurement of each speaker in the speaker array to the L... D The electroacoustic transfer function is calculated for each location in the dark zone control positions to obtain the dark zone electroacoustic transfer function matrix, including:

[0069] By measuring the sound pressure corresponding to each position in the LB dark zone control positions through each microphone in the microphone array, the dark zone electroacoustic transfer function matrix is ​​obtained.

[0070] For example, please combine Figure 1 and Figure 2 The speaker array 20 in the in-vehicle acoustic system 100 may include M speakers, and the playback coefficient from the main control module 41 to each speaker is denoted as q, where q is an M-dimensional vector.

[0071] For example, in step 1311, the bright zone control position for playing audio in the in-vehicle sound field space is L. B Each speaker was measured to L. B The electroacoustic transfer function at each control position in the bright area is used to obtain the electroacoustic transfer function matrix Z in the bright area. B Z B For L B A matrix of ×M dimensions This is the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the bright area.

[0072] For example, in step 1312, the location of the dark area in the in-vehicle sound field space where audio needs to be suppressed is L. D Each speaker was measured to L. D The electroacoustic transfer function at each control position in the dark zone is used to obtain the dark zone electroacoustic transfer function matrix Z. D Z D For L D A ×M dimensional matrix The recurring function matrix Z for the dark zone electroacoustic region D The corresponding Hermitian conjugate matrix.

[0073] For example, in steps 1311 and 1312, the bright-area electroacoustic transfer function matrix Z B and the dark area electroacoustic transfer function matrix Z D All of these can be obtained by measuring the sound pressure received by each microphone in the microphone array 30 inside the vehicle. Each microphone records the sound pressure signal from M speakers to obtain an M-dimensional vector, and the sound pressure detected by the microphone is distributed in L... B Individual control location and L DThe sound pressure signals from different locations within the dark zone control positions are combined to obtain L. B The ×M-dimensional bright-area electroacoustic transfer function matrix Z B and L D The ×M-dimensional dark area electroacoustic transfer function matrix Z D .

[0074] Step 1313: Construct a function for acoustic contrast based on the number of control positions in the bright area, the electroacoustic transfer function matrix in the bright area, the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the bright area, the number of control positions in the dark area, the electroacoustic transfer function matrix in the dark area, the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the dark area, the playback coefficients to be solved, and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved.

[0075] For example, the constructed acoustic contrast function can be expressed as the following formula (1):

[0076]

[0077] Where C represents acoustic contrast, p B Indicates the acoustic power in the bright region. p represents the Hermitian conjugate matrix corresponding to the acoustic power in the bright region. D Indicates the acoustic power of the dark area. L represents the Hermitian conjugate matrix corresponding to the acoustic power of the dark region. B Z represents the number of control positions in the bright area. B Represents the electroacoustic transfer function matrix in the bright area. L represents the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the bright area. D Z represents the number of dark area control locations. D Represents the electroacoustic transfer function matrix in the dark zone. Let q represent the Hermitian conjugate matrix corresponding to the dark zone electroacoustic transfer function matrix, and q represent the playback coefficients to be solved. H This represents the Hermitian conjugate matrix corresponding to the playback coefficients to be solved.

[0078] For example, the Lagrange operator can be used to optimize the loss function of acoustic contrast, which can be expressed as the following formula (2):

[0079]

[0080] Wherein, λ C λ represents the Lagrange operator used to control the distribution of acoustic power; B represents the output limit of the total acoustic power in the bright zone, determined by the maximum loudness that is subjectively acceptable; λ m This represents the positive Lagrange operator, used to control the distribution of electrical power; Em The power output limit of the in-vehicle acoustic system is determined by the maximum power that the in-vehicle audio system can output; M represents the total number of speakers in the speaker array; q m This represents the playback coefficient corresponding to the m-th speaker;

[0081] The above loss function J C By differentiating the playback coefficient q and taking the extreme value of 0, we obtain the following formula (3):

[0082]

[0083] Where, λ M Indicated by λ m The M-dimensional Lagrange operators, used to control the electrical power distribution of the signal, have a total sum less than E. m .

[0084] For example, to solve for the playback coefficient q, we need to obtain The smallest eigenvalue. It is a matrix that can be normally decomposed into multiple eigenvalues. The minimum value among these eigenvalues ​​is the smallest eigenvalue.

[0085] Step 1314: Construct a function of the array factor of the loudspeaker array based on the playback coefficients to be solved and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved.

[0086] For example, the playback coefficient q under power constraints is the variable that needs to be solved for in-vehicle acoustic system. It is usually represented by the array factor of the speaker array. The function of the array factor of the speaker array can be expressed as the following formula (4):

[0087] Array Effort = q H q (4);

[0088] Where q represents the playback coefficient to be solved, q H This represents the Hermitian conjugate matrix corresponding to the playback coefficients to be solved.

[0089] In particular, the lower the frequency of the sound wave and the longer its wavelength, the higher the array factor required for the enclosed space of a vehicle. For example, in scenarios with frequencies below 200Hz, the wavelength of the sound wave is greater than 1.7m, requiring more energy to control the array. Conversely, when the frequency of the sound wave is higher, the array spacing of the channel speakers is insufficient for effective sound field control, which can be compensated for by using headrest speakers. Table 1 below shows the minimum and maximum frequency ranges and acoustic contrast ratios for channel speakers and headrest speakers, respectively. For example, NdB is typically set to 15dB.

[0090] speaker <![CDATA[f min ]]> <![CDATA[f max ]]> Acoustic contrast Channel loudspeakers 20Hz 200Hz N dB Headrest Speakers 200Hz 20kHz N dB

[0091] Table 1

[0092] Step 1315: Combine the bright area electroacoustic transfer function matrix with the dark area electroacoustic transfer function matrix to obtain a combined matrix.

[0093] For example, when the condition of maximizing acoustic contrast C is met, the playback coefficient q often does not take into account the phase of the sound, which may cause damage to the sound quality. At the same time, the in-vehicle acoustic system also includes the different characteristics of channel speakers and headrest speakers, so the playback coefficient q needs to be optimized.

[0094] For example, the bright-area electroacoustic transfer function matrix Z B and the dark area electroacoustic transfer function matrix Z D The assemblage is an L×M assemblage matrix Z, where L = L B +L D The resulting combination matrix Z can be expressed as follows (5):

[0095]

[0096] The acoustic power control function at position L can then be expressed as the following formula (6):

[0097] P = Zq (6).

[0098] Among them, the optimization solution is used to determine the target sound pressure response p T Under the conditions, this p T The desired acoustic contrast ratio can be set, for example, a desired acoustic contrast ratio of 15 dB. The control error e can be defined as follows: (7)

[0099] e = p T -p; (7);

[0100] The objective function for the optimal solution can be expressed as the following formula (8):

[0101]

[0102] Among them, J LS Let e ​​represent the loss objective function; let e represent the control error. H The control error e represents the Hermitian conjugate matrix; W represents the weighting factor, used to control the residual sound pressure in the dark area. W is a preset value and can be adjusted for the light or dark areas as needed; e m The residual power can be adjusted according to the optimization target of the dark area. For example, the weight factor of the bright area or the dark area can be controlled within the range of [0,1]. When the weight of the dark area is large, the corresponding W is set to a larger value.

[0103] Among these methods, the optimization algorithm can reduce the output power requirements of the in-vehicle audio system.

[0104] Step 1316: Construct a function of playback coefficients based on the combined matrix, the Hermitian conjugate matrix corresponding to the combined matrix, the weighting factor, the Lagrange operator, and the target sound pressure response value.

[0105] Based on the objective function shown in formula (8) above, the optimal solution is obtained as shown in formula (9):

[0106] q = [Z H WZ+λ M ] -1 Z H p T (9);

[0107] Where q represents the playback coefficient; Z represents the binding matrix, Z H The matrix Z represents the Hermitian conjugate matrix; W represents the weighting factor; p T λ represents the target sound pressure response value, which plays a decisive role in the results. Limiting this value to a reasonable level can prevent divergence in the solution. M Indicated by λ m The M-dimensional Lagrange operators, used to control the electrical power distribution of the signal, have a total sum less than E. m .

[0108] Step 1317: Solve the functions of the acoustic contrast ratio, the array factor, and the playback coefficient based on preset constraints to determine the playback coefficient corresponding to each speaker in the speaker array, and to determine the acoustic contrast ratio corresponding to the bright area and the dark area.

[0109] In some embodiments, the preset constraints include:

[0110] The target sound pressure response value is less than or equal to 15 dB;

[0111] The array factor is less than or equal to 15 dB;

[0112] When the audio frequency band of the audio content indicated in the audio control command is outside the frequency band range of the speaker, the difference between the array factor and the regularization factor is less than or equal to 0.

[0113] By iteratively solving the constrained minimum inner product algorithm under all preset constraints, the optimal replay coefficient q can be obtained. The preset constraints can be:

[0114]

[0115] Constraint: p T ≤NdB;

[0116] q H q-ε≤0, for f <f min Or f>f max .

[0117] Where ε represents a very small regularization factor, indicating that the audio frequency band of the audio content specified in the audio control command is outside the frequency range of the speaker (in f). min and f max When outside the range, set to the minimum value to avoid wasting power.

[0118] For example, NdB can be 15dB p T ≤NdB indicates the target sound pressure response value p T Less than or equal to 15dB.

[0119] For example, an array factor of no more than 15dB across the entire frequency band is within a reasonable range of electrical power and is achievable for in-vehicle acoustic systems. Therefore, an array factor of less than or equal to 15dB can be set as one of the preset constraints.

[0120] For example, using Figure 1 The speaker array layout shown combines channel speakers and headrest speakers. Taking the front row as the bright area and the rear row as the dark area as an example, the array factor and acoustic contrast results obtained by optimizing the front bright area and the rear dark area are respectively... Figure 4 and Figure 5 .

[0121] For example, Figure 4 The horizontal axis represents the frequency range, and the vertical axis represents the array factor amplitude. An array factor not exceeding 15dB across the entire frequency range is within a reasonable power range and is achievable for in-vehicle acoustic systems.

[0122] For example, Figure 5 The horizontal axis represents the frequency range, and the vertical axis represents the acoustic contrast amplitude. Acoustic contrast achieves a certain difference across most frequency bands. For example, when the acoustic contrast (represented by the vertical axis) is ≥15dB, the human ear can hear a noticeable difference. Subjectively, this achieves isolation between bright and dark areas, meaning that audio content played in bright areas is not significantly perceived in dark areas, enabling a differentiated experience of listening to different content and volumes from different locations. Acoustic contrast represents the isolation between bright and dark areas; the greater the difference, the better the isolation.

[0123] In some embodiments, the method further includes: reacquiring the bright area electroacoustic transfer function matrix and the dark area electroacoustic transfer function matrix at preset time intervals; and updating the playback coefficients and the acoustic contrast based on the reacquiring bright area electroacoustic transfer function matrix and the reacquiring dark area electroacoustic transfer function matrix.

[0124] For example, the bright area electroacoustic transfer function matrix and the dark area electroacoustic transfer function matrix can be reacquired at preset time intervals, and then the playback coefficients and acoustic contrast can be updated based on the reacquired bright area electroacoustic transfer function matrix and the reacquired dark area electroacoustic transfer function matrix.

[0125] For example, when the acoustic environment inside the vehicle is relatively stable, a one-time initial measurement setting can be performed. When the acoustic environment inside the vehicle changes significantly, the real-time bright-area electroacoustic transfer function matrix Z can be obtained through real-time measurement feedback. B and the dark area electroacoustic transfer function matrix Z D The playback coefficient q and acoustic contrast C are updated in real time through calculation.

[0126] Step 132: Determine the first control signal corresponding to the bright area and the second control signal corresponding to the dark area based on the audio control command, the playback coefficient and the acoustic contrast.

[0127] In some embodiments, determining the first control signal corresponding to the bright area and the second control signal corresponding to the dark area based on the audio control command, the playback coefficient, and the acoustic contrast includes: determining the first control signal corresponding to the bright area based on at least one of the audio content and the audio volume in the audio control command, and the playback coefficient and the acoustic contrast; determining the second control signal corresponding to the dark area based on at least one of the audio content and the audio volume in the audio control command, and the playback coefficient and the acoustic contrast; wherein the audio content corresponding to the first control signal is different from the audio content corresponding to the second control signal, and / or the audio volume corresponding to the first control signal is different from the audio volume corresponding to the second control signal.

[0128] For example, the playback coefficient can be used to determine the speakers corresponding to the bright and dark areas, and then the acoustic contrast ratio can be used to control the speakers in the bright and dark areas to play audio signals of different frequency bands. For example, the greater the acoustic contrast ratio, the greater the difference in playback effect between the bright and dark areas. For example, the bright area can correspond to one playback content, and the dark area can correspond to another playback content. For example, when music is played in the bright area, because the acoustic contrast ratio is high enough, passengers in the dark area cannot hear this music, and then another content can be played in the dark area. Similarly, because the acoustic contrast ratio is high enough, the content played in the dark area cannot be heard by those in the bright area, thus achieving the effect of isolation between the bright and dark areas. For example, after generating audio control commands by having passengers in different positions in the vehicle select different content to listen to, the playback coefficient and acoustic contrast ratio are adjusted based on the audio control commands, and then the first control signal corresponding to the bright area and the second control signal corresponding to the dark area are determined based on the adjusted playback coefficient and acoustic contrast ratio.

[0129] Step 140: Control the speaker corresponding to the bright area to play audio according to the first control signal, and control the speaker corresponding to the dark area to suppress audio according to the second control signal, so as to play different audio content in the bright area and the dark area respectively, and / or play different audio volumes in the bright area and the dark area respectively.

[0130] In some embodiments, the speaker array includes channel speakers and headrest speakers, the channel speakers covering a frequency range of 20Hz to 200Hz, and the headrest speakers covering a frequency range of 200Hz to 20kHz; the method further includes:

[0131] Based on the audio frequency band of the audio content in the audio control command, determine the speaker type of the speaker corresponding to the bright area and the speaker type of the speaker corresponding to the dark area, and based on the speaker type of the speaker corresponding to the bright area and the speaker type of the speaker corresponding to the dark area, determine the speaker corresponding to the bright area and the speaker corresponding to the dark area.

[0132] Specifically, by using the audio frequency band of the audio content in the audio control commands, the speaker type corresponding to the bright and dark areas—whether it's a channel speaker or a headrest speaker—is determined, thus enabling the control range to cover the entire frequency range. For example, by controlling the entire frequency range from 20Hz to 20kHz, users can obtain an acoustic contrast listening experience that satisfies the differences between bright and dark areas.

[0133] For example, if a front passenger wants to listen to music and a rear passenger wants to sleep, based on the first audio control command triggered by the front passenger and the second audio control command triggered by the rear passenger, the sound field zone where the front passenger is located can be designated as the bright zone, and the sound field zone where the rear passenger is located can be designated as the dark zone. The front passenger becomes the location for playing audio within the vehicle's sound field space, and the rear passenger becomes the location for suppressing audio within the vehicle's sound field space. By adjusting the playback coefficient and acoustic contrast, the first control signal corresponding to the bright zone and the second control signal corresponding to the dark zone are determined. The speakers in the bright zone are then controlled to play audio according to the first control signal, and the speakers in the dark zone are controlled to suppress audio according to the second control signal, so that the rear passengers cannot hear the music played by the front passengers.

[0134] For example, if a front-seat passenger wants to listen to music while a rear-seat passenger wants to listen to an audiobook, the audio control commands triggered by the front and rear passengers can be designed to alternate between bright and dark zones, effectively creating two bright zones and two dark zones. This allows the front-seat passenger to listen to music while the rear-seat passenger listens to the audiobook simultaneously without disturbing each other. For instance, the sound field zone containing the front seats can be divided into a first bright zone and a second dark zone, and the sound field zone containing the rear seats can also be divided into a first dark zone and a second bright zone. The first bright zone represents the position in the front acoustic zone where the music is to be played, and the first dark zone represents the position in the rear acoustic zone where the music is to be suppressed. The second dark zone represents the position in the front acoustic zone where the audiobook is to be suppressed, and the second bright zone represents the position in the rear acoustic zone where the audiobook is to be played. Both the front and rear seats have bright zones, but the audio frequency bands output by the front and rear bright zones differ. This frequency band difference can be controlled by acoustic contrast. By adjusting the playback coefficient and acoustic contrast, the first control signal corresponding to the first bright zone and the second control signal corresponding to the first dark zone are determined, as are the first control signal corresponding to the second bright zone and the second control signal corresponding to the second dark zone. The speakers corresponding to the first and second bright zones are controlled to play audio according to the corresponding first control signals, and the speakers corresponding to the first and second dark zones are controlled to suppress audio according to the corresponding second control signals, so that front-seat passengers can listen to music but cannot hear audiobooks, while rear-seat passengers can listen to audiobooks but cannot hear music.

[0135] For example, if the same audio content is playing in the car, and the front passengers want it played at a very low volume while the rear passengers want it played at a normal volume, then based on the fourth audio control command triggered by the front passengers and the fifth audio control command triggered by the rear passengers, the sound field zone where the front seats are located can be designated as the dark zone, and the sound field zone where the rear seats are located can be designated as the bright zone. The front seats are designated as the position in the car's sound field space where the volume of the first audio content is suppressed with a third volume, and the rear seats are designated as the position in the car's sound field space where the first audio content is played with a fourth volume. By adjusting the playback coefficient and acoustic contrast, the first control signal corresponding to the bright zone and the second control signal corresponding to the dark zone are determined, and the speakers corresponding to the bright zone are controlled to play audio according to the first control signal, so that the front passengers hear the first audio content at a lower volume, and the rear passengers hear the first audio content at a normal volume.

[0136] For example, if the front and rear seats are playing different audio content, and the front passengers want a very low volume while the rear passengers want a normal volume, then based on the sixth audio control command triggered by the front passenger and the seventh audio control command triggered by the rear passenger, the sound field zone where the front seats are located can be designated as the dark zone, and the sound field zone where the rear seats are located can be designated as the bright zone. The front seats are designated as the position in the vehicle's sound field space where the volume of the second audio content is suppressed at the fifth volume level, and the rear seats are designated as the position in the vehicle's sound field space where the volume of the third audio content is played at the sixth volume level. By adjusting the playback coefficient and acoustic contrast, the first control signal corresponding to the bright zone and the second control signal corresponding to the dark zone are determined, and the speakers corresponding to the bright zone are controlled to play audio according to the first control signal, so that the front passengers hear the second audio content at a low volume, and the rear passengers hear the third audio content at a normal volume.

[0137] For example, passengers in different positions inside the vehicle can choose to listen to audio content at different volumes as needed, with the goal of achieving a certain acoustic contrast. This acoustic contrast is controlled by the playback coefficient q. For instance, with an acoustic contrast of 15dB, the bright area hears a louder sound, while the dark area is 15dB quieter, with a volume 15dB lower than the bright area, thus allowing different positions to hear different volumes.

[0138] This application proposes a scheme for personalized sound field control of in-vehicle audio, including a hardware system and a control method; it uses an in-vehicle acoustic system layout with multi-channel speakers and multi-channel microphones to measure and control the acoustic response at multiple locations; by using a combination of channel speakers and headrest speakers, the control range can cover the entire frequency range; by using the constraint of maximizing acoustic contrast, the sound pressure response difference at multiple locations is maximized, achieving acoustic isolation between different locations; and an optimization algorithm is used to minimize the consumption of playback coefficients to ensure that the power output is within an achievable range.

[0139] All of the above technical solutions can be combined in any way to form optional embodiments of this application, and will not be described in detail here.

[0140] This application embodiment applies to an in-vehicle acoustic system, which includes a speaker array disposed at different locations within the vehicle. It acquires audio control commands triggered by objects at different locations within the vehicle. These audio control commands indicate the audio playback location, audio content, and audio volume. Based on the audio control commands, it determines a bright zone and a dark zone within the in-vehicle sound field space. The bright zone characterizes the location where audio is played within the sound field space, and the dark zone characterizes the location where audio is suppressed within the sound field space. Based on the bright and dark zones, it determines a first control signal corresponding to the bright zone and a second control signal corresponding to the dark zone. It controls the speaker corresponding to the bright zone to play audio according to the first control signal and controls the speaker corresponding to the dark zone to suppress audio according to the second control signal, thereby playing different audio content in the bright and dark zones respectively, and / or playing different audio volumes in the bright and dark zones respectively. This application embodiment determines the bright and dark zones based on the needs of objects (passengers) in different positions inside the vehicle. Then, it generates a first control signal corresponding to the bright zone and a second control signal corresponding to the dark zone. Based on the first control signal, audio is played in the bright zone, and based on the second control signal, audio is suppressed in the dark zone. This allows for the playback of different audio content and different audio volumes in the bright and dark zones, enabling phase and amplitude control of the sound field at multiple points, multiple inputs, and multiple outputs. This achieves the effect of different audio content and volumes for different users, realizing directional acoustic beams and a personalized spatial sound field.

[0141] To facilitate better implementation of the audio control method for the in-vehicle acoustic system according to the embodiments of this application, the embodiments of this application also provide an audio control device for the in-vehicle acoustic system. Please refer to... Figure 6 , Figure 6 This is a schematic diagram of the structure of the audio control device for an in-vehicle acoustic system provided in an embodiment of this application. The in-vehicle acoustic system includes a speaker array disposed at different locations within the vehicle, and the audio control device 200 of the in-vehicle acoustic system may include:

[0142] The acquisition unit 210 is used to acquire audio control commands triggered by objects in different locations inside the vehicle. The audio control commands are used to indicate the audio playback position, audio content, and audio volume.

[0143] The first determining unit 220 is used to determine the bright area and dark area of ​​the in-vehicle sound field space according to the audio control command. The bright area is used to characterize the position of the audio being played in the in-vehicle sound field space, and the dark area is used to characterize the position of the audio being suppressed in the in-vehicle sound field space.

[0144] The second determining unit 230 is used to determine a first control signal corresponding to the bright area and a second control signal corresponding to the dark area based on the bright area and the dark area;

[0145] The control unit 240 is used to control the speaker corresponding to the bright area to play audio according to the first control signal, and to control the speaker corresponding to the dark area to suppress audio according to the second control signal, so as to play different audio content in the bright area and the dark area respectively, and / or play different audio volumes in the bright area and the dark area respectively.

[0146] In some embodiments, the second determining unit 230 is specifically used for:

[0147] Based on the bright area and the dark area, determine the playback coefficient corresponding to each speaker in the speaker array, and determine the acoustic contrast corresponding to the bright area and the dark area;

[0148] Based on the audio control command, the playback coefficient, and the acoustic contrast, a first control signal corresponding to the bright area and a second control signal corresponding to the dark area are determined.

[0149] In some embodiments, the bright area includes L B A bright area control location, the bright area including L D One dark zone control location, L B ≥1, L D ≥1;

[0150] The second determining unit 230, when determining the playback coefficient corresponding to each speaker in the speaker array based on the bright area and the dark area, and determining the acoustic contrast corresponding to the bright area and the dark area, can be used for:

[0151] Measuring the distance from each speaker in the speaker array to the L B The electroacoustic transfer function of each position in the bright area control position is obtained to obtain the bright area electroacoustic transfer function matrix;

[0152] Measuring the distance from each speaker in the speaker array to the L D The electroacoustic transfer function of each position in the dark zone control position is obtained to obtain the dark zone electroacoustic transfer function matrix;

[0153] Based on the number of control positions in the bright area, the electroacoustic transfer function matrix in the bright area, the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the bright area, the number of control positions in the dark area, the electroacoustic transfer function matrix in the dark area, the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the dark area, the playback coefficients to be solved, and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved, a function for acoustic contrast is constructed.

[0154] Based on the playback coefficients to be solved and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved, construct a function of the array factor of the loudspeaker array;

[0155] The bright area electroacoustic transfer function matrix and the dark area electroacoustic transfer function matrix are combined to obtain a combined matrix;

[0156] A function for constructing playback coefficients is derived from the combination matrix, the Hermitian conjugate matrix corresponding to the combination matrix, the weighting factor, the Lagrange operator, and the target sound pressure response value.

[0157] Based on preset constraints, the functions of acoustic contrast, array factor, and playback coefficient are solved to determine the playback coefficient corresponding to each speaker in the speaker array, and to determine the acoustic contrast corresponding to the bright area and the dark area.

[0158] In some embodiments, the preset constraints include: the target sound pressure response value is less than or equal to 15 dB; the array factor is less than or equal to 15 dB; and when the audio frequency band of the audio content indicated in the audio control command is outside the frequency band range of the speaker, the difference between the array factor and the regularization factor is less than or equal to 0.

[0159] In some embodiments, the in-vehicle acoustic system further includes a microphone array disposed at different locations within the vehicle;

[0160] The second determining unit 230 measures the distance from each speaker in the speaker array to the L. B When obtaining the bright-area electroacoustic transfer function matrix by calculating the electroacoustic transfer function at each position in the bright-area control position, it can be used for: through each microphone in the microphone array, for each speaker in the speaker array to the L B The sound pressure at each control position in the bright area is measured to obtain the electroacoustic transfer function matrix of the bright area.

[0161] The second determining unit 230 measures the distance from each speaker in the speaker array to the L. D The electroacoustic transfer function at each position in the dark zone control positions is used to obtain the dark zone electroacoustic transfer function matrix, which can be used to: transmit the signal from each microphone in the microphone array to each speaker in the speaker array to the L... B The sound pressure at each control position in the dark zone is measured to obtain the electroacoustic transfer function matrix of the dark zone.

[0162] In some embodiments, the second determining unit 230 is further configured to: reacquire the bright area electroacoustic transfer function matrix and the dark area electroacoustic transfer function matrix at preset time intervals; and update the playback coefficient and the acoustic contrast based on the reacquired bright area electroacoustic transfer function matrix and the reacquired dark area electroacoustic transfer function matrix.

[0163] In some embodiments, the second determining unit 230, in determining the first control signal corresponding to the bright area and the second control signal corresponding to the dark area based on the audio control command, the playback coefficient, and the acoustic contrast, can be used to: determine the first control signal corresponding to the bright area based on at least one of the audio content and the audio volume in the audio control command, and the playback coefficient and the acoustic contrast; determine the second control signal corresponding to the dark area based on at least one of the audio content and the audio volume in the audio control command, and the playback coefficient and the acoustic contrast; wherein the audio content corresponding to the first control signal is different from the audio content corresponding to the second control signal, and / or the audio volume corresponding to the first control signal is different from the audio volume corresponding to the second control signal.

[0164] In some embodiments, the first determining unit 220 may be used to: determine the bright and dark areas of the in-vehicle sound field space based on the audio playback position, audio content and audio volume in the audio control command.

[0165] In some embodiments, the in-vehicle sound field space has multiple sound field zones; the first determining unit 220 determines the bright and dark zones of the in-vehicle sound field space according to the audio playback position, audio content, and audio volume in the audio control command, which can be used to: determine the sound field zone where the audio playback position corresponding to the non-empty audio content is located as the bright zone of the in-vehicle sound field space; or determine the sound field zone where the audio playback position corresponding to the empty audio content is located as the dark zone of the in-vehicle sound field space; or determine the sound field zone where the audio playback position corresponding to the audio volume being greater than a preset volume value is located as the bright zone of the in-vehicle sound field space; or determine the sound field zone where the audio playback position corresponding to the audio volume being less than or equal to a preset volume value is located as the dark zone of the in-vehicle sound field space.

[0166] In some embodiments, the speaker array includes channel speakers and headrest speakers, the channel speakers covering a frequency range of 20Hz to 200Hz, and the headrest speakers covering a frequency range of 200Hz to 20kHz; the control unit 240 is further configured to:

[0167] Based on the audio frequency band of the audio content in the audio control command, determine the speaker type of the speaker corresponding to the bright area and the speaker type of the speaker corresponding to the dark area, and based on the speaker type of the speaker corresponding to the bright area and the speaker type of the speaker corresponding to the dark area, determine the speaker corresponding to the bright area and the speaker corresponding to the dark area.

[0168] Each unit in the audio control device of the aforementioned in-vehicle acoustic system can be implemented entirely or partially through software, hardware, or a combination thereof. These units can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can call and execute the corresponding operations of each unit.

[0169] The audio control device 200 of the in-vehicle acoustic system can be integrated into a terminal or server that has storage and a processor and thus computing power, or the audio control device 200 of the in-vehicle acoustic system can be the terminal or server.

[0170] Optionally, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.

[0171] Figure 3 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. The computer device can be a terminal, and the terminal can be a smart vehicle terminal. For example... Figure 3 As shown, the computer device 300 may include: a communication interface 301, a memory 302, a processor 303, and a communication bus 304. The communication interface 301, memory 302, and processor 303 communicate with each other via the communication bus 304. The communication interface 301 is used for data communication between the computer device 300 and external devices. The memory 302 can be used to store software programs and modules, and the processor 303 runs the software programs and modules stored in the memory 302, such as the software programs for the corresponding operations in the foregoing method embodiments.

[0172] Optionally, the processor 303 can invoke software programs and modules stored in the memory 302 to perform the following operations:

[0173] The system acquires audio control commands triggered by objects at different locations within the vehicle, the audio control commands indicating the audio playback location, audio content, and audio volume; based on the audio control commands, it determines the bright and dark zones of the vehicle's sound field space, the bright zone representing the location where audio is played within the sound field space, and the dark zone representing the location where audio is suppressed within the sound field space; based on the bright and dark zones, it determines a first control signal corresponding to the bright zone and a second control signal corresponding to the dark zone; it controls the speaker corresponding to the bright zone to play audio according to the first control signal, and controls the speaker corresponding to the dark zone to suppress audio according to the second control signal, so as to play different audio content in the bright and dark zones respectively, and / or play different audio volumes in the bright and dark zones respectively.

[0174] This application also provides a computer-readable storage medium for storing a computer program. This computer-readable storage medium can be applied to a computer device, and the computer program causes the computer device to execute the corresponding flow in the audio control method of the in-vehicle acoustic system in the embodiments of this application; for brevity, further details are omitted here.

[0175] This application also provides a computer program product including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the corresponding flow in the audio control method of the in-vehicle acoustic system in the embodiments of this application. For simplicity, further details are omitted here.

[0176] This application also provides a computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the corresponding flow in the audio control method of the in-vehicle acoustic system in the embodiments of this application. For simplicity, further details are omitted here.

[0177] It should be understood that the processor in the embodiments of this application may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method embodiments can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor described above can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.

[0178] It is understood that the memory in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory used in the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0179] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0180] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0181] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0182] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0183] In addition, the functional units in the embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0184] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer or a server) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0185] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An audio control method for an in-vehicle acoustic system, characterized in that, The in-vehicle acoustic system includes a speaker array disposed at different locations within the vehicle, and the method includes: The system acquires audio control commands triggered by objects in different locations within the vehicle. These audio control commands are used to indicate the audio playback location, audio content, and audio volume. Based on the audio playback position, audio content, and audio volume in the audio control command, the bright and dark areas of the in-vehicle sound field space are determined. The bright area is used to characterize the position where the audio is played in the in-vehicle sound field space, and the dark area is used to characterize the position where the audio is suppressed in the in-vehicle sound field space. Based on the bright area and the dark area, determine the first control signal corresponding to the bright area and the second control signal corresponding to the dark area; The speaker corresponding to the bright area is controlled to play audio according to the first control signal, and the speaker corresponding to the dark area is controlled to suppress audio according to the second control signal, so as to play different audio content in the bright area and the dark area respectively, and / or play different audio volumes in the bright area and the dark area respectively; The in-vehicle sound field space has multiple sound field zones; determining the bright and dark zones of the in-vehicle sound field space based on the audio playback position, audio content, and audio volume in the audio control command includes: The sound field zone where the audio playback position corresponding to a non-empty value is located is defined as the bright zone of the in-vehicle sound field space, and the sound field zone where the audio playback position corresponding to an empty value is located is defined as the dark zone of the in-vehicle sound field space; or The sound field zone where the audio playback position is located when the audio volume is greater than the preset volume value is defined as the bright zone of the in-vehicle sound field space, and the sound field zone where the audio playback position is located when the audio volume is less than or equal to the preset volume value is defined as the dark zone of the in-vehicle sound field space. The step of determining the first control signal corresponding to the bright area and the second control signal corresponding to the dark area based on the bright area and the dark area includes: Based on the bright area and the dark area, determine the playback coefficient corresponding to each speaker in the speaker array, and determine the acoustic contrast corresponding to the bright area and the dark area; Based on the audio control command, the playback coefficient, and the acoustic contrast, determine the first control signal corresponding to the bright area and the second control signal corresponding to the dark area; The bright area includes L B One bright area control position, the dark area includes L D One dark zone control location, L B ≥1, L D ≥1; The step of determining the playback coefficient corresponding to each speaker in the speaker array based on the bright area and the dark area, and determining the acoustic contrast corresponding to the bright area and the dark area, includes: Measuring the distance from each speaker in the speaker array to the L B The electroacoustic transfer function of each position in the bright area control position is obtained to obtain the bright area electroacoustic transfer function matrix; Measuring the distance from each speaker in the speaker array to the L D The electroacoustic transfer function of each position in the dark zone control position is obtained to obtain the dark zone electroacoustic transfer function matrix; Based on the number of control positions in the bright area, the electroacoustic transfer function matrix in the bright area, the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the bright area, the number of control positions in the dark area, the electroacoustic transfer function matrix in the dark area, the Hermitian conjugate matrix corresponding to the electroacoustic transfer function matrix in the dark area, the playback coefficients to be solved, and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved, a function for acoustic contrast is constructed. Based on the playback coefficients to be solved and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved, construct a function of the array factor of the loudspeaker array; The bright area electroacoustic transfer function matrix and the dark area electroacoustic transfer function matrix are combined to obtain a combined matrix; A function for constructing playback coefficients is derived from the combination matrix, the Hermitian conjugate matrix corresponding to the combination matrix, the weighting factor, the Lagrange operator, and the target sound pressure response value. Based on preset constraints, the functions of acoustic contrast, array factor, and playback coefficient are solved to determine the playback coefficient corresponding to each speaker in the speaker array, and to determine the acoustic contrast corresponding to the bright area and the dark area.

2. The audio control method for an in-vehicle acoustic system as described in claim 1, characterized in that, The preset constraints include: The target sound pressure response value is less than or equal to 15 dB; The array factor is less than or equal to 15 dB; When the audio frequency band of the audio content indicated in the audio control command is outside the frequency band range of the speaker, the difference between the array factor and the regularization factor is less than or equal to 0.

3. The audio control method for the in-vehicle acoustic system as described in claim 1, characterized in that, The in-vehicle acoustic system also includes microphone arrays located in different positions within the vehicle. The measurement of each speaker in the speaker array to the L B The electroacoustic transfer function is calculated for each position in the bright area control location to obtain the bright area electroacoustic transfer function matrix, including: Through each microphone in the microphone array, to each speaker in the speaker array, to the L B The sound pressure at each control position in the bright area is measured to obtain the electroacoustic transfer function matrix of the bright area. The measurement of each speaker in the speaker array to the L D The electroacoustic transfer function is calculated for each location in the dark zone control positions to obtain the dark zone electroacoustic transfer function matrix, including: Through each microphone in the microphone array, to each speaker in the speaker array, to the L D The sound pressure at each control position in the dark zone is measured to obtain the electroacoustic transfer function matrix of the dark zone.

4. The audio control method for the in-vehicle acoustic system as described in claim 1, characterized in that, The method further includes: Every preset time interval, the bright area electroacoustic transfer function matrix and the dark area electroacoustic transfer function matrix are reacquired. Based on the reacquired bright area electroacoustic transfer function matrix and the reacquired dark area electroacoustic transfer function matrix, the playback coefficients and the acoustic contrast are updated again.

5. The audio control method for an in-vehicle acoustic system as described in claim 1, characterized in that, The step of determining the first control signal corresponding to the bright area and the second control signal corresponding to the dark area based on the audio control command, the playback coefficient, and the acoustic contrast includes: The first control signal corresponding to the bright zone is determined based on at least one of the audio content and the audio volume in the audio control command, as well as the playback coefficient and the acoustic contrast. The second control signal corresponding to the dark area is determined based on at least one of the audio content and the audio volume in the audio control command, as well as the playback coefficient and the acoustic contrast. Wherein, the audio content corresponding to the first control signal is different from the audio content corresponding to the second control signal, and / or the audio volume corresponding to the first control signal is different from the audio volume corresponding to the second control signal.

6. The audio control method for an in-vehicle acoustic system as described in any one of claims 1-5, characterized in that, The speaker array includes channel speakers and headrest speakers, the channel speakers covering a frequency range of 20Hz to 200Hz, and the headrest speakers covering a frequency range of 200Hz to 20kHz; the method further includes: Based on the audio frequency band of the audio content in the audio control command, determine the speaker type of the speaker corresponding to the bright area and the speaker type of the speaker corresponding to the dark area, and based on the speaker type of the speaker corresponding to the bright area and the speaker type of the speaker corresponding to the dark area, determine the speaker corresponding to the bright area and the speaker corresponding to the dark area.

7. An audio control device for an in-vehicle acoustic system, characterized in that, The in-vehicle acoustic system includes a speaker array disposed at different locations within the vehicle, and the device includes: The acquisition unit is used to acquire audio control commands triggered by objects in different locations inside the vehicle. The audio control commands are used to indicate the audio playback position, audio content, and audio volume. The first determining unit is used to determine the bright area and dark area of ​​the in-vehicle sound field space according to the audio playback position, audio content and audio volume in the audio control command. The bright area is used to characterize the position of the audio being played in the in-vehicle sound field space, and the dark area is used to characterize the position of the audio being suppressed in the in-vehicle sound field space. The in-vehicle sound field space has multiple sound field zones; the first determining unit is further configured to determine the sound field zone where the audio playback position corresponding to the non-empty audio content is located as the bright zone of the in-vehicle sound field space, and the sound field zone where the audio playback position corresponding to the empty audio content is located as the dark zone of the in-vehicle sound field space; or to determine the sound field zone where the audio playback position corresponding to the audio volume being greater than a preset volume value is located as the bright zone of the in-vehicle sound field space, and the sound field zone where the audio playback position corresponding to the audio volume being less than or equal to a preset volume value is located as the dark zone of the in-vehicle sound field space. The second determining unit is configured to determine, based on the bright area and the dark area, a first control signal corresponding to the bright area and a second control signal corresponding to the dark area; based on the bright area and the dark area, determine the playback coefficient corresponding to each speaker in the speaker array, and determine the acoustic contrast corresponding to the bright area and the dark area; and based on the audio control command, the playback coefficient, and the acoustic contrast, determine the first control signal corresponding to the bright area and the second control signal corresponding to the dark area. The bright area includes L B One bright area control position, the dark area includes L D One dark zone control location, L B ≥1, L D ≥1; the second determining unit is also used to measure the distance from each speaker in the speaker array to the L B The electroacoustic transfer function at each position in the bright area control position is calculated to obtain the bright area electroacoustic transfer function matrix; the distance from each loudspeaker in the loudspeaker array to the L is measured. D The electroacoustic transfer function (EJF) at each of the dark zone control positions is used to obtain the dark zone EJF matrix. Based on the number of bright zone control positions, the bright zone EJF matrix, the Hermitian conjugate matrix corresponding to the bright zone EJF matrix, the number of dark zone control positions, the dark zone EJF matrix, the Hermitian conjugate matrix corresponding to the dark zone EJF matrix, the playback coefficients to be solved, and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved, an acoustic contrast function is constructed. Based on the playback coefficients to be solved and the Hermitian conjugate matrix corresponding to the playback coefficients to be solved, an acoustic contrast function is constructed. The following steps are taken: First, a function is constructed to determine the array factor of the loudspeaker array. Then, the electroacoustic transfer function matrix of the bright area and the electroacoustic transfer function matrix of the dark area are combined to obtain a combined matrix. Based on the combined matrix, the Hermitian conjugate matrix corresponding to the combined matrix, the weighting factor, the Lagrange operator, and the target sound pressure response value, a function for the playback coefficients is constructed. Finally, based on preset constraints, the functions for the acoustic contrast ratio, the array factor, and the playback coefficients are solved to determine the playback coefficients corresponding to each loudspeaker in the loudspeaker array, and to determine the acoustic contrast ratios corresponding to the bright and dark areas. The control unit is configured to control the speaker corresponding to the bright area to play audio according to the first control signal, and to control the speaker corresponding to the dark area to suppress audio according to the second control signal, so as to play different audio content in the bright area and the dark area respectively, and / or play different audio volumes in the bright area and the dark area respectively.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted for loading by a processor to perform the audio control method for an in-vehicle acoustic system as described in any one of claims 1-6.

9. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing a computer program, and the processor executing the audio control method of the in-vehicle acoustic system according to any one of claims 1-6 by calling the computer program stored in the memory.

10. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by the processor, they implement the audio control method of the in-vehicle acoustic system according to any one of claims 1-6.

Images