Vehicle cabin sound effect control method and device, storage medium and equipment

Abstract

The invention discloses a vehicle cabin sound effect control method and device, a storage medium and equipment. The method comprises the steps that firstly, driving operation information in the driving process of a target vehicle is acquired; the method comprises the following steps: acquiring running operation information of a target vehicle, determining a running state of the target vehicle based on the running operation information, and determining a preset vibration enhancement mode corresponding to the target vehicle in response to a sound effect request instruction sent by a vehicle-mounted user when the running state of the target vehicle is a static state; then, according to the sound effect request instruction and a preset vibration enhancement mode, command signals are sent to a vehicle audio system, a vehicle suspension control system, a vehicle seat system and a vehicle lighting system of the target vehicle, and the vehicle audio system, the vehicle suspension control system, the vehicle seat system and the vehicle lighting system are controlled to synchronously perform function linkage; therefore, multi-sensory immersive somatosensory acoustics such as visual sense, auditory sense and tactile sense are provided for the vehicle-mounted user, and the use experience of the vehicle-mounted user on the sound effect of the target vehicle cabin is improved.

Description

Technical Field

[0001] The present application relates to the field of audio technology, and in particular to a method, device, storage medium and equipment for controlling vehicle cabin sound effects. Background Art

[0002] With the improvement of people's living standards and the rapid development of social economy, the utilization rate of cars has gradually increased, and people's requirements for vehicle functions have become higher and higher. In addition to daily commuting, people have gradually paid more attention to in-vehicle entertainment and information products. For example, for the vehicle cockpit, it is necessary to continuously provide various practical new functions to meet user expectations and strive to provide users with a more immersive sound experience.

[0003] At present, in order to provide users with an immersive sound experience, the existing solutions for realizing vehicle cockpit sound effects usually add functions to the seats on the basis of creating an in-car atmosphere light. For example, an inflatable airbag is added to the seat to provide seat massage in the "nap mode" or "healing mode"; or an audio exciter is added to provide certain vibration feedback during the "listening to music function" and "K song function". However, these ways of providing vibration perception are not only costly, but also the areas where the inflatable airbags and audio exciters are arranged are limited. They are usually only installed in a few seats such as the main driver's seat, resulting in a poor vibration experience and failure to provide other passengers in the car with a vibration experience corresponding to the sound effect. It can be seen that the existing vehicle cockpit sound effect is not ideal, which will cause the car users to have a poor experience of the sound effects in the cockpit. Summary of the invention

[0004] The main purpose of the embodiments of the present application is to provide a method, device and equipment for vibration enhancement of vehicle cabin sound effects, which can provide vehicle users with an immersive cabin sound effect experience with multiple senses such as vision, hearing, and touch.

[0005] The present application provides a method for controlling vehicle cabin sound effects, including:

[0006] Acquiring driving operation information of the target vehicle during driving; and determining the driving state of the target vehicle based on the driving operation information;

[0007] When the driving state of the target vehicle is a stationary state, in response to a sound effect request instruction issued by a vehicle user, determining a preset vibration enhancement mode corresponding to the target vehicle;

[0008] According to the sound effect request instruction and the preset vibration enhancement mode, a command signal is sent to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle to control the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage to enhance the vehicle user's sound effect experience of the target vehicle cabin.

[0009] In a possible implementation, sending a command signal to a vehicle audio system, a vehicle suspension control system, a vehicle seat system, and a vehicle lighting system of the target vehicle according to the sound effect request instruction and the preset vibration enhancement mode, and controlling the vehicle audio system, the vehicle suspension control system, the vehicle seat system, and the vehicle lighting system to synchronously perform functional linkage, includes:

[0010] Sending a command signal to the vehicle audio system of the target vehicle according to the audio effect request instruction, and playing the audio content after confirming the initial phase of the vehicle audio effect system signal and completing the phase alignment;

[0011] After synchronizing an initial phase signal to a vehicle suspension control system through the vehicle audio system and completing signal phase alignment, determining the frequency and intensity of vibration enhancement that the target vehicle needs to compensate for according to the sound effect request instruction and the preset vibration enhancement mode, and performing vibration enhancement processing using the vehicle suspension control system according to the frequency and intensity of vibration enhancement that the target vehicle needs to compensate for;

[0012] After synchronizing the initial phase signal to the vehicle seat system through the vehicle audio system and completing the signal phase alignment, according to the sound effect request instruction, determining whether it is necessary to call the zero gravity seat function and / or the seat massage function to cooperate with the implementation of the corresponding sound effect function, and executing the corresponding seat function according to the determination result;

[0013] After synchronizing the initial phase signal to the vehicle lighting system through the vehicle audio system and completing the signal phase alignment, it is determined whether it is necessary to call the corresponding type of vehicle lights to cooperate in realizing the corresponding sound effect function according to the sound effect request instruction, and the corresponding lighting configuration is performed according to the determination result.

[0014] In a possible implementation, the audio playback system includes an in-vehicle microphone, an audio power amplifier, and an in-vehicle speaker; after confirming the initial phase of the in-vehicle sound system signal and completing the phase alignment, playing the audio content includes:

[0015] After confirming the initial phase of the vehicle audio system signal, collecting sound through the in-vehicle microphone, and sending the collected audio data to be played to the audio power amplifier;

[0016] Using a preset sound effect algorithm, the audio data to be played and the accompaniment audio data provided by the vehicle computer are fused and mixed through the audio power amplifier to complete phase alignment, and the processed audio data is sent to the vehicle speaker so that the processed audio data can be played through the vehicle speaker.

[0017] In a possible implementation, the sound effect request instruction is karaoke in the car; the preset vibration enhancement mode is a mode of following the audio rhythm; the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for is determined according to the sound effect request instruction and the preset vibration enhancement mode, and the vibration enhancement processing is performed by using the vehicle suspension control system according to the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for, including:

[0018] Obtain the audio data to be played and the accompaniment audio data provided by the vehicle computer;

[0019] Performing fast Fourier transform processing on the audio data to be played to obtain amplitude and phase information of each frequency component in the frequency domain signal corresponding to the audio data to be played; and performing fast Fourier transform processing on the accompaniment audio data to obtain amplitude and phase information of each frequency component in the frequency domain signal corresponding to the accompaniment audio data;

[0020] Extracting frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data;

[0021] According to the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data, a vibration height that changes with time is generated, and the front wheel suspension and the rear wheel suspension are controlled by the vehicle suspension control system to enhance the vibration so as to achieve their respective corresponding vibration heights; the vibration height is proportional to the frequency and amplitude.

[0022] In a possible implementation, the sound effect request instruction is a lullaby mode; the preset vibration enhancement mode is a constant simulation mode; determining the frequency and intensity of vibration enhancement that the target vehicle needs to compensate for according to the sound effect request instruction and the preset vibration enhancement mode, and performing vibration enhancement processing using the vehicle suspension control system according to the frequency and intensity of vibration enhancement that the target vehicle needs to compensate for, includes:

[0023] Constructing a periodic functional relationship between the vibration time and the vibration height of the left and right wheel suspensions of the target vehicle to characterize the frequency of the vibration enhancement that needs to be compensated for the target vehicle;

[0024] According to the vibration heights of the left and right wheel suspensions of the target vehicle, the intensity of the vibration enhancement that needs to be compensated for the target vehicle is determined, and the vehicle suspension control system is used to control the left wheel suspension and the right wheel suspension to perform vibration enhancement to achieve their respective corresponding vibration heights.

[0025] In a possible implementation, after determining the preset vibration enhancement mode corresponding to the target vehicle, the method further includes:

[0026] Using the algorithm central processing unit of the target vehicle, according to the preset vibration enhancement mode and the audio data to be played and the accompaniment audio data provided by the vehicle computer, the frequency and intensity of the active vibration enhancement required to be compensated for the linkage with the audio data to be played and the accompaniment audio data are calculated as the target vibration frequency and intensity corresponding to the target vehicle;

[0027] Acquiring the vibration frequency and intensity actually generated by the wheel suspension of the target vehicle during the vibration enhancement process;

[0028] Determine whether the difference between the actual vibration frequency and intensity generated by the wheel suspension and the target vibration frequency and intensity meets the preset conditions; if not, repeatedly learn and adjust the frequency and intensity of the active vibration enhancement until the actual vibration frequency and intensity generated by the wheel suspension and the target vibration frequency and intensity meet the preset conditions.

[0029] In a possible implementation, determining whether it is necessary to call a zero-gravity seat function and / or a seat massage function to cooperate with the corresponding sound effect function according to the sound effect request instruction, and executing the corresponding seat function according to the determination result, includes:

[0030] Determining whether a zero-gravity seat function needs to be called according to the sound effect request instruction;

[0031] If the zero-gravity seat function needs to be called, the zero-gravity seat is unfolded; if the zero-gravity seat function does not need to be called, or after the zero-gravity seat is fully unfolded, it is determined whether the seat massage function needs to be called;

[0032] If the seat massage function needs to be called, the seat massage function is turned on, and the execution and switching of different modes of seat massage functions are completed according to the parameters of the audio content transmitted by the sound effect request instruction.

[0033] In one possible implementation, the sound effect request instruction includes at least one of in-car karaoke, lullaby mode and outdoor singing; the preset vibration enhancement mode includes at least one of audio rhythm mode and constant simulation mode.

[0034] The present application also provides a device for controlling vehicle cabin sound effects, the device comprising:

[0035] A first acquisition unit is used to acquire driving operation information of a target vehicle during driving; and determine a driving state of the target vehicle based on the driving operation information;

[0036] a determination unit, configured to determine a preset vibration enhancement mode corresponding to the target vehicle in response to a sound effect request instruction issued by a vehicle user when the driving state of the target vehicle is a stationary state;

[0037] A control unit is used to send command signals to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle according to the sound effect request instruction and the preset vibration enhancement mode, and control the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage to enhance the sound effect experience of the vehicle user in the cabin of the target vehicle.

[0038] In a possible implementation, the control unit includes:

[0039] A playing subunit, configured to send a command signal to a vehicle audio system of the target vehicle according to the sound effect request instruction, and play the audio content after confirming the initial phase of the vehicle audio effect system signal and completing the phase alignment;

[0040] A vibration subunit, configured to determine the frequency and intensity of vibration enhancement required to be compensated for the target vehicle according to the sound effect request instruction and a preset vibration enhancement mode after synchronizing an initial phase signal to a vehicle suspension control system through the vehicle audio system and completing signal phase alignment, and perform vibration enhancement processing using the vehicle suspension control system according to the frequency and intensity of vibration enhancement required to be compensated for the target vehicle;

[0041] A first determination subunit is used for, after synchronizing an initial phase signal to a vehicle seat system through the vehicle audio system and completing signal phase alignment, determining whether it is necessary to call a zero-gravity seat function and / or a seat massage function to cooperate with the implementation of a corresponding sound effect function according to the sound effect request instruction, and executing a corresponding seat function according to a determination result;

[0042] The second determination subunit is used to determine whether it is necessary to call the corresponding type of vehicle lights to cooperate in realizing the corresponding sound effect function according to the sound effect request instruction after synchronizing the initial phase signal to the vehicle lighting system through the vehicle audio system and completing the signal phase alignment, and perform corresponding lighting configuration according to the determination result.

[0043] In a possible implementation, the audio playback system includes an in-vehicle microphone, an audio power amplifier, and an in-vehicle speaker; the playback subunit includes:

[0044] A sound receiving subunit, configured to receive sound through the in-vehicle microphone after confirming the initial phase of the in-vehicle sound system signal, and send the collected audio data to be played to the audio power amplifier;

[0045] The sending subunit is used to use a preset sound effect algorithm to fuse and mix the audio data to be played and the accompaniment audio data provided by the vehicle computer through the audio power amplifier, complete phase alignment, and send the processed audio data to the vehicle speaker so that the processed audio data can be played through the vehicle speaker.

[0046] In a possible implementation, the sound effect request instruction is karaoke in the car; the preset vibration enhancement mode is a mode of following the audio rhythm; and the vibration subunit includes:

[0047] The acquisition subunit is used to acquire the audio data to be played and the accompaniment audio data provided by the vehicle computer;

[0048] A transform subunit is used to perform fast Fourier transform processing on the audio data to be played to obtain the amplitude and phase information of each frequency component in the frequency domain signal corresponding to the audio data to be played; and to perform fast Fourier transform processing on the accompaniment audio data to obtain the amplitude and phase information of each frequency component in the frequency domain signal corresponding to the accompaniment audio data;

[0049] An extraction subunit, used to extract the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data;

[0050] A generating subunit is used to generate a vibration height that varies with time according to the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data, and to use the vehicle suspension control system to control the front wheel suspension and the rear wheel suspension to enhance the vibration so as to achieve the corresponding vibration heights; the vibration height is proportional to the frequency and amplitude.

[0051] In a possible implementation, the sound effect request instruction is a lullaby mode; the preset vibration enhancement mode is a constant simulation mode; and the vibration subunit includes:

[0052] A construction subunit is used to construct a periodic functional relationship between the vibration time and the vibration height of the left and right wheel suspensions of the target vehicle, so as to characterize the frequency of the vibration enhancement that needs to be compensated for the target vehicle;

[0053] The determination subunit is used to determine the intensity of vibration enhancement that needs to be compensated for the target vehicle according to the vibration height of the left and right wheel suspensions of the target vehicle, and use the vehicle suspension control system to control the left wheel suspension and the right wheel suspension to perform vibration enhancement to achieve their respective corresponding vibration heights.

[0054] In a possible implementation manner, the device further includes:

[0055] A calculation unit, used to calculate, using the algorithm central processing unit of the target vehicle, the frequency and intensity of active vibration enhancement required to be compensated for linkage with the audio data to be played and the accompaniment audio data according to the preset vibration enhancement mode and the audio data to be played and the accompaniment audio data provided by the vehicle computer, as the target vibration frequency and intensity corresponding to the target vehicle;

[0056] A second acquisition unit is used to acquire the vibration frequency and intensity actually generated by the wheel suspension of the target vehicle during the vibration enhancement process;

[0057] A judgment unit is used to judge whether the difference between the vibration frequency and intensity actually generated by the wheel suspension and the target vibration frequency and intensity meets the preset conditions. If not, the frequency and intensity of the active vibration enhancement are repeatedly learned and adjusted until the vibration frequency and intensity actually generated by the wheel suspension and the target vibration frequency and intensity meet the preset conditions.

[0058] In a possible implementation, the first determination subunit is specifically configured to:

[0059] According to the sound effect request instruction, determine whether it is necessary to call the zero-gravity seat function; if the zero-gravity seat function needs to be called, unfold the zero-gravity seat; if the zero-gravity seat function does not need to be called, or after the zero-gravity seat is fully unfolded, determine whether it is necessary to call the seat massage function; if the seat massage function needs to be called, turn on the seat massage function, and according to the parameters of the audio content transmitted by the sound effect request instruction, complete the execution and switching of different mode functions of the seat massage.

[0060] In one possible implementation, the sound effect request instruction includes at least one of in-car karaoke, lullaby mode and outdoor singing; the preset vibration enhancement mode includes at least one of audio rhythm mode and constant simulation mode.

[0061] The embodiment of the present application also provides a vehicle cabin sound control device, including: a processor, a memory, and a system bus;

[0062] The processor and the memory are connected via the system bus;

[0063] The memory is used to store one or more programs, and the one or more programs include instructions. When the instructions are executed by the processor, the processor executes any one of the implementations of the above-mentioned vehicle cabin sound control method.

[0064] An embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device executes any one of the implementations of the above-mentioned vehicle cabin sound effect control method.

[0065] An embodiment of the present application further provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute any one of the implementations of the above-mentioned vehicle cabin sound effect control method.

[0066] A method, device, storage medium and equipment for controlling vehicle cabin sound effects are provided in an embodiment of the present application. The method first obtains driving operation information of a target vehicle during driving; and based on the driving operation information, determines the driving state of the target vehicle. Then, when the driving state of the target vehicle is stationary, in response to a sound effect request instruction issued by an on-board user, determines a preset vibration enhancement mode corresponding to the target vehicle; then, according to the sound effect request instruction and the preset vibration enhancement mode, sends a command signal to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle, controls the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage, so as to enhance the on-board user's experience of the sound effects of the target vehicle cabin.

[0067] It can be seen that since the present application can actively apply somatosensory vibrations corresponding to the sound effect request instructions to the target vehicle and the vehicle users based on the vehicle suspension control system, and simultaneously control the vehicle audio system, vehicle seat system and vehicle lighting system to synchronize functional linkage, it provides the vehicle users with immersive somatosensory acoustics of multiple senses such as vision, hearing and touch, thereby enhancing the vehicle users' experience of the target vehicle's cabin sound effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0069] Figure 1 A flow chart of a method for controlling vehicle cabin sound effects provided in an embodiment of the present application;

[0070] Figure 2 A schematic diagram of a process of playing audio content through an audio playback system provided in an embodiment of the present application;

[0071] Figure 3 One of the example diagrams of the frequency and intensity of vibration enhancement provided in the embodiment of the present application;

[0072] Figure 4 The second example diagram of the frequency and intensity of vibration enhancement provided in the embodiment of the present application;

[0073] Figure 5 A schematic diagram of a process for repeatedly learning and adjusting the frequency and intensity of vibration enhancement provided in an embodiment of the present application;

[0074] Figure 6 A schematic diagram of a process of executing corresponding seat functions through a vehicle seat system provided in an embodiment of the present application;

[0075] Figure 7 A schematic diagram of a process for performing corresponding lighting configuration through a vehicle lighting system provided in an embodiment of the present application;

[0076] Figure 8 A schematic diagram of the composition of a vehicle cabin sound control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0077] With the popularization of automobiles, people have higher and higher requirements for vehicle intelligence, entertainment and comfort. For example, when it becomes relatively safe for passengers to relax for a long time in a closed cabin, how to create more interactive possibilities in the cabin has gradually become a research topic for the vehicle field. In other words, for the vehicle cabin, it needs to continuously provide various practical new functions to meet the expectations of passengers, such as in-car KTV, in-car lounge, in-car conference room and other functions.

[0078] However, the sound system configured in the traditional vehicle cockpit cannot meet the growing requirements for cockpit innovation. Specifically, at present, in order to provide users with an immersive sound experience, the existing solutions for realizing vehicle cockpit sound effects usually add functions to the seats on the basis of creating an in-car atmosphere light. For example, an inflatable airbag is added to the seat to provide seat massage in the "nap mode" or "healing mode"; or an audio exciter is added to provide certain vibration feedback during the "listening to music function" and "K song function". However, these ways of providing vibration perception are not only costly, but also the areas where the inflatable airbags and audio exciters are arranged are limited. They are usually only installed in a few seats such as the main driver's seat, resulting in a poor vibration experience and failure to provide other passengers in the car with a vibration experience corresponding to the sound effect.

[0079] It can be seen that the current methods for implementing vehicle cockpit sound effects do not produce satisfactory results, which will lead to poor experience of the sound effects in the cockpit for vehicle users. Therefore, how to improve the implementation of vehicle cockpit sound effects to provide vehicle users with an immersive sound experience of multiple senses such as vision, hearing, and touch is a technical problem that needs to be solved urgently.

[0080] To address the above-mentioned defects, the present application provides a method for controlling vehicle cabin sound effects, which first obtains driving operation information of a target vehicle during driving; and based on the driving operation information, determines the driving state of the target vehicle, and then, when the driving state of the target vehicle is stationary, responds to a sound effect request instruction issued by an on-board user, determines a preset vibration enhancement mode corresponding to the target vehicle; then, according to the sound effect request instruction and the preset vibration enhancement mode, sends a command signal to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle, controls the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage, so as to enhance the on-board user's experience of the sound effects of the target vehicle cabin.

[0081] It can be seen that since the present application can actively apply somatosensory vibrations corresponding to the sound effect request instructions to the target vehicle and the vehicle users based on the vehicle suspension control system, and simultaneously control the vehicle audio system, vehicle seat system and vehicle lighting system to synchronize functional linkage, it provides the vehicle users with immersive somatosensory acoustics of multiple senses such as vision, hearing and touch, thereby enhancing the vehicle users' experience of the target vehicle's cabin sound effects.

[0082] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0083] First embodiment

[0084] See also Figure 1 , is a flow chart of a method for controlling vehicle cabin sound effects provided in this embodiment, the method comprising the following steps:

[0085] S101: Acquire driving operation information of a target vehicle during driving; and determine a driving state of the target vehicle based on the driving operation information.

[0086] In this embodiment, any vehicle that realizes the control of the cockpit sound effect through this embodiment is defined as a target vehicle. In order to improve the effect of realizing the cockpit sound effect for the target vehicle, an immersive cockpit sound effect experience with multiple senses such as vision, hearing, and touch is provided to the vehicle user. First, during the driving process of the target vehicle, it is necessary to use various sensors pre-installed on the target vehicle to obtain the driving operation information of the target vehicle during the driving process, and determine the driving state of the target vehicle based on the obtained driving operation information, so as to execute the subsequent step S102.

[0087] Among them, the driving operation information of the target vehicle may include but is not limited to the opening of the ignition and brake pedal of the target vehicle, the speed, the acceleration and deceleration of the vehicle, the driving direction angle, the steering angle of the steering wheel, the mileage of the vehicle, the gear position of the vehicle and other key signals of supporting state information. The driving state of the target vehicle may include but is not limited to the vehicle driving at a constant speed, the vehicle accelerating, the vehicle decelerating, the vehicle turning left or right, the parking idle speed, the parking and parking, etc. In this way, by analyzing the driving operation information such as the speed and the gear position, it can be determined whether the target vehicle is in a constant speed driving, parking and parking, etc. For example, by judging whether the speed of the target vehicle transmitted by the speed sensor is zero and whether the gear position is P gear (i.e., parking gear) and other multi-channel signals, it can be fitted to determine whether the target vehicle is in a stationary state of parking and parking.

[0088] In addition, it should be noted that the present application does not limit the specific structure, quantity and installation position of each sensor on the target vehicle. For example, the target vehicle can be pre-installed with sensors such as vehicle speed sensor (VSS), deceleration sensor, angle sensor steering angle sensor (SAS) to obtain various driving operation information, and the number of each sensor can be one or more.

[0089] S102: When the driving state of the target vehicle is a stationary state, in response to a sound effect request instruction issued by a vehicle user, a preset vibration enhancement mode corresponding to the target vehicle is determined.

[0090] It should be noted that in order to ensure the driving safety of the target vehicle, the application scenario of the present application for providing an intelligent cockpit sound experience for the on-board users of the target vehicle needs to be limited to the driving state of the target vehicle being stationary, that is, only when the driving state of the target vehicle determined by step S101 is stationary, the subsequent steps S102-S103 can be executed to enhance the on-board users' sound experience of the target vehicle's cockpit.

[0091] Moreover, when the target vehicle is stationary, in order to improve the riding experience, the vehicle user usually issues various sound effect request instructions by voice or text input on the display screen, etc., to enable cockpit sound effect functions such as "Karaoke in the car" and "Add vibration mode experience". Among them, the specific content of the sound effect request instruction is not limited in this application, and can be set according to actual conditions and experience values. For example, the sound effect request instruction can include but is not limited to "Karaoke in the car", "Lullaby mode" and "Singing outside the car".

[0092] In this way, after the algorithm central processing unit of the target vehicle comprehensively determines whether the target vehicle is in a stationary state based on various driving operation information, such as whether the vehicle speed transmitted by the vehicle speed sensor is zero and whether the gear is in P gear, it can further respond to the sound effect request command issued by the on-board user and send corresponding feedback information to the on-board user. For example, when it is determined that the target vehicle is not in a stationary state, the on-board user can be prompted through voice broadcast or text output on the display screen that the vehicle vibration enhancement function has failed to be turned on.

[0093] Alternatively, when it is determined that the target vehicle is indeed in a stationary state, it can respond to sound effect request instructions such as "Karaoke in the car", "Lullaby mode" and "Singing outside the car" issued by the user in the car, and determine the various types of preset vibration enhancement modes corresponding to the target vehicle.

[0094] Among them, the present application does not limit the specific content of the preset vibration enhancement mode of the target vehicle, which can be set according to actual conditions and experience values. For example, the preset vibration enhancement mode of the target vehicle may include but is not limited to "audio rhythm mode" and "constant simulation mode".

[0095] It is understandable that in order to provide the vehicle user with a more realistic and reasonable vibration modal experience, the present application will construct the correspondence between different sound effect request instructions and various preset vibration enhancement modes in advance. For example, for the sound effect request instruction "Karaoke in the car" which will generate audio data with strong rhythmicity, the corresponding preset vibration enhancement mode is "audio rhythm mode", which is used to provide the vehicle user with the vibration enjoyment of K-singing in the car; and for the sound effect request instruction "lullaby mode", the corresponding supplementary vibration is gentle and constant, which needs to simulate the frequency of shaking the baby cradle by hand, so the corresponding preset vibration enhancement mode is "constant simulation mode", which is used to achieve an experience similar to the shaking of the baby cradle. In addition, the correspondence between the sound effect request instruction and the preset vibration enhancement mode is not fixed, and can be continuously updated and adjusted according to the actual situation, so as to determine a more accurate preset vibration enhancement mode of the target vehicle according to the sound effect request instruction issued by the vehicle user, so as to execute the subsequent step S103, and provide the vehicle user with an immersive cockpit sound effect experience of multiple senses such as vision, hearing, and touch.

[0096] S103: According to the sound effect request instruction and the preset vibration enhancement mode, a command signal is sent to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle to control the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to perform functional linkage synchronously, so as to enhance the vehicle user's sound effect experience of the target vehicle cabin.

[0097] In this embodiment, after receiving the sound effect request instruction issued by the vehicle user in step S102 and determining the preset vibration enhancement mode of the target vehicle in response to the instruction, the sound effect request instruction issued by the vehicle user can be further converted into a command signal in the preset vibration enhancement mode, and sent directly or indirectly to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle. The control, vehicle suspension control system, vehicle seat system and vehicle lighting system synchronously perform multi-system function intelligent linkage to provide the vehicle user with multi-modal content presentation and feedback of the sound effect function, thereby significantly improving the cabin sound effect experience of the vehicle user.

[0098] Specifically, an optional implementation method is that the specific implementation process of "sending a command signal to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle according to the sound effect request instruction and the preset vibration enhancement mode, and controlling the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage" in step S103 may include the following steps S1031-S1034:

[0099] S1031: Send a command signal to the vehicle audio system of the target vehicle according to the audio effect request instruction, and play the audio content after confirming the initial phase of the vehicle audio system signal and completing the phase alignment.

[0100] In this implementation, after determining the preset vibration enhancement mode of the target vehicle in response to the sound effect request instruction issued by the in-vehicle user, the sound effect request instruction can be further converted into a command signal and sent to the vehicle audio system of the target vehicle so that it can use the command signal to confirm the initial phase of the in-vehicle sound effect system signal and complete phase alignment, and at the same time synchronize it with the vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle to ensure the synchronization and consistency of the time and function of the multi-system linkage in the cockpit.

[0101] Furthermore, the audio playback system may include but is not limited to an in-vehicle microphone, an audio power amplifier, and an in-vehicle speaker. Thus, after receiving the command signal and confirming the initial phase, the vehicle audio system may call a preset audio command and send the audio command signal to the in-vehicle microphone, the audio power amplifier, the in-vehicle speaker, and other audio modules to complete the microphone sound reception and the speaker audio playback.

[0102] Specifically, first, it is possible to determine whether it is necessary to call the in-car microphone based on the sound effect request of the in-car user contained in the command signal. For example, when the command signal corresponding to the sound effect request instruction issued by the in-car user is "Karaoke in the car", it can be determined that the in-car microphone needs to be called to collect sound through the in-car microphone, and send the collected audio data to be played (i.e. the human voice audio data emitted by the in-car user) to the audio power amplifier. Then, a preset sound effect algorithm (the specific content is not limited and can be selected according to actual conditions and experience) can be used to fuse and mix the audio data to be played and the accompaniment audio data provided by the car computer through the audio power amplifier to complete phase alignment, and send the processed audio data to the in-car speakers (including in-car and outside-car speakers) so that the processed audio data can be played through the in-car speakers. Figure 2 As shown, the tuning process can be completed according to the different placement positions of the speakers inside and outside the target vehicle and the characteristics of the sounds in each frequency band, so as to achieve the goal of achieving an ideal and harmonious audio effect played by all speakers. Among them, the placement positions of the speakers inside and outside the target vehicle are not limited, and may include but are not limited to door speakers, speakers arranged in the dashboard (i.e., IP speakers), surround speakers, headrest speakers, subwoofers, and speakers outside the vehicle. Speakers can be divided into, but not limited to, tweeters, midrange speakers, woofers, and subwoofers according to the characteristics of the frequency band sounds.

[0103] S1032: After synchronizing the initial phase signal to the vehicle suspension control system through the vehicle audio system and completing the signal phase alignment, determine the frequency and intensity of the vibration enhancement that needs to be compensated for the target vehicle according to the sound effect request instruction and the preset vibration enhancement mode, and use the vehicle suspension control system to perform vibration enhancement processing according to the frequency and intensity of the vibration enhancement that needs to be compensated for the target vehicle.

[0104] In this implementation, after the vehicle suspension control system completes the signal phase alignment through the initial phase signal synchronized with the vehicle audio system, it can further determine the frequency and intensity of the vibration enhancement that needs to be compensated for the target vehicle based on the sound effect request of the in-car user contained in the command signal (such as "Karaoke in the car", "Lullaby mode" and "Singing outside the car", etc.) and the preset vibration enhancement mode of the target vehicle (such as audio rhythm mode and constant simulation mode, etc.), and use the vehicle suspension control system to perform vibration enhancement processing based on the frequency and intensity of the vibration enhancement.

[0105] Among them, the present application does not limit the specific structure of the vehicle suspension control system, which can be set according to actual conditions and experience values. An optional implementation method is to set the suspension control system to a variable damping suspension control system.

[0106] Specifically, on the one hand, when the sound effect request instruction is "Karaoke in the car" and the preset vibration enhancement mode is "audio rhythm mode", the vibration compensated by the target vehicle will be functionally matched and output with the frequency of the audio content. On this basis, the implementation process of "determining the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for according to the sound effect request instruction and the preset vibration enhancement mode, and using the vehicle suspension control system to perform vibration enhancement processing according to the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for" in this step S1032 can be: First, obtain the audio data to be played and the accompaniment audio data provided by the car computer, such as extracting the accompaniment and vocal parts from the original audio data composed of the audio data to be played (i.e., the vocal audio data emitted by the on-board user) and the accompaniment audio data. Then, the audio data to be played (i.e., the vocal part) is processed by Fast Fourier Transform (FFT) to obtain the amplitude and phase information of each frequency component in the frequency domain signal corresponding to the audio data to be played; and the accompaniment audio data is processed by Fast Fourier Transform to obtain the amplitude and phase information of each frequency component in the frequency domain signal corresponding to the accompaniment audio data.

[0107] Next, extract the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played (i.e., the human voice audio data emitted by the vehicle user) and the frequency domain signal corresponding to the accompaniment audio data. Then, based on the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data, generate the vibration height that changes with time, such as Figure 3 As shown, Figure 3 In the figure, the blue curve represents the original audio data composed of the audio data to be played (i.e., the human voice audio data emitted by the vehicle user) and the accompaniment audio data; the red curve represents the vibration height of the front wheel suspension of the target vehicle obtained after the algorithm processing (i.e., H mentioned in the following formula (1)); the green curve represents the vibration height of the rear wheel suspension of the target vehicle obtained after the algorithm processing (i.e., H mentioned in the following formula (2) 1 ).

[0108] Furthermore, the vehicle suspension control system can be used to control the front wheel suspension and the rear wheel suspension to enhance vibration, so as to achieve the corresponding vibration height. The vibration height is proportional to the frequency and amplitude, and the specific calculation formula is as follows:

[0109] H=f 1 (t) (1)

[0110] H 1 =f 2 (t) (2)

[0111] Where H represents the vibration height of the front wheel suspension of the target vehicle; t represents time; H 1 Indicates the vibration height of the rear wheel suspension of the target vehicle; f 1 (·) function represents the processing result obtained after fast Fourier transform of the audio data to be played (i.e., the human voice audio data emitted by the vehicle user); f 2 The (·) function represents the processing result obtained by performing fast Fourier transform on the accompaniment audio data.

[0112] On the other hand, when the sound effect request instruction is "lullaby mode" and the preset vibration enhancement mode is "constant simulation mode", the vibration compensated by the target vehicle is gentle and constant, simulating the frequency of human hands rocking a baby cradle. On this basis, the implementation process of "determining the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for according to the sound effect request instruction and the preset vibration enhancement mode, and using the vehicle suspension control system to perform vibration enhancement processing according to the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for" in the above step S1032 can be: First, construct a periodic function (such as sine and cosine functions, etc.) relationship between the vibration time and the vibration height of the left and right wheel suspensions of the target vehicle to characterize the frequency of the vibration enhancement that the target vehicle needs to compensate for. For example, a sine function can be used to construct the relationship between the vibration time and the vibration height of the left and right wheel suspensions of the target vehicle, such as Figure 4 Then, according to the vibration height of the left and right wheel suspensions of the target vehicle, the intensity of the vibration enhancement that the target vehicle needs to compensate is determined, and the vehicle suspension control system is used to control the left and right wheel suspensions to enhance the vibration to achieve their respective corresponding vibration heights.

[0113] like Figure 4 As shown, the position of height "0" indicates that the wheel suspension vibration height is in the middle gear of the variable total mileage. The orange curve indicates the target vehicle left wheel suspension vibration height obtained after algorithm processing and analysis; the blue curve indicates the target vehicle right wheel suspension vibration height obtained after algorithm processing and analysis. The specific calculation formula is as follows:

[0114]

[0115] Among them, H 2 represents the vibration height of the left wheel suspension or the right wheel suspension of the target vehicle; t represents time; A, ω, B respectively represent the known parameters preset in the algorithm. The specific values ​​are not limited and can be preset according to the actual situation and experience to adjust the period and constraint values. A and B work together to adjust and constrain the numerical range of the vibration height, while ω and By modifying the value, the vibration period can be adjusted.

[0116] In this way, through the active vibration enhancement of the vehicle suspension control system, the vibration modal experience of the cabin sound can be enhanced, and different vibration enhancement modes can be provided in combination with the driving environment and key vehicle parameters, thereby realizing vibration enhancement and simulation of the entire vehicle, providing a synchronized vibration experience for in-vehicle users such as drivers and passengers, thereby enhancing the immersion of in-vehicle users.

[0117] Furthermore, it should be noted that after determining the preset vibration enhancement mode corresponding to the target vehicle, an optional implementation method is to first use the algorithm central processing unit of the target vehicle to perform a comprehensive calculation based on the preset vibration enhancement mode (corresponding to a specific algorithm formula and related numerical constraints) and the audio data to be played and the accompaniment audio data provided by the vehicle computer, so as to obtain the frequency and intensity of the active vibration enhancement required to be compensated for the linkage with the audio data to be played and the accompaniment audio data, as the target vibration frequency and intensity corresponding to the target vehicle.

[0118] Then, due to the problem of center of gravity shift caused by different vehicle weights and distribution of vehicle users, it is also necessary to obtain the vibration frequency and intensity actually generated by the wheel suspension of the target vehicle during the vibration enhancement process. Next, it can be determined whether the difference between the actual vibration frequency and intensity generated by the wheel suspension and the target vibration frequency and intensity meets the preset conditions, wherein the specific content of the preset conditions is not limited and can be set according to actual conditions and experience values. For example, the preset conditions can be set to that the difference between the actual vibration frequency and intensity generated by the wheel suspension and the target vibration frequency and intensity is small enough to be negligible, etc. If not, the frequency and intensity of the active vibration enhancement (i.e., the target vibration frequency and intensity) are repeatedly learned and adjusted until the actual vibration frequency and intensity generated by the wheel suspension and the target vibration frequency and intensity meet the preset conditions, such as achieving the expected target vibration, such as. Figure 5 shown.

[0119] In this way, there is no need to add inflatable airbags, audio exciters and other equipment to the seats, which not only reduces the corresponding process steps and cost investment, but also completes the data accumulation, adaptive learning and effect improvement of the problem of center of gravity shift that may occur due to different vehicle weights and distribution of on-board users through the monitoring of actual vibration frequency and intensity and target vibration feedback (frequency and intensity), thereby realizing the continuous tuning process of vibration enhancement, and further improving the experience and immersion of on-board users.

[0120] S1033: After synchronizing the initial phase signal to the vehicle seat system through the vehicle audio system and completing the signal phase alignment, determine whether it is necessary to call the zero-gravity seat function and / or the seat massage function to cooperate with the implementation of the corresponding sound effect function based on the sound effect request instruction, and execute the corresponding seat function based on the determination result.

[0121] In the present implementation, after the vehicle seat system completes the signal phase alignment through the initial phase signal synchronized with the vehicle audio system, it can further call the preset command (specific content is not limited) according to the sound effect request of the vehicle user contained in the command signal (such as "Karaoke in the car", "Lullaby mode" and "Singing outside the car", etc.), and determine whether it is necessary to call the zero-gravity seat function. If it is necessary to call the zero-gravity seat function, the zero-gravity seat will be unfolded; if it is not necessary to call the zero-gravity seat function, or after the zero-gravity seat is fully unfolded, it is determined whether it is necessary to call the seat massage function. If it is necessary to call the seat massage function, turn on the seat massage function, and according to the parameters of the audio content transmitted by the sound effect request instruction, complete the execution and switching of different modes of seat massage functions. For example, different audio styles such as gentle and soothing and passionate and powerful can be defined and distinguished by analyzing the frequency of the audio, and the strength and technique combination of the seat massage can be adjusted; if it is not necessary to call the seat massage function, the determination command is terminated and the seat massage function is not turned on, such as Figure 6 shown.

[0122] S1034: After synchronizing the initial phase signal to the vehicle lighting system through the vehicle audio system and completing the signal phase alignment, determine whether it is necessary to call the corresponding type of vehicle lighting to cooperate in realizing the corresponding sound effect function according to the sound effect request instruction, and perform corresponding lighting configuration according to the determination result.

[0123] In this implementation, after the vehicle lighting system completes the signal phase alignment through the initial phase signal synchronized with the vehicle audio system, it can further call the preset command (specific content is not limited) according to the sound effect request of the vehicle user contained in the command signal (such as "Karaoke in the car", "Lullaby mode" and "Singing outside the car", etc.), and determine whether it is necessary to call the corresponding type of vehicle lights to cooperate in realizing the corresponding sound effect function, such as Figure 7 As shown, and further according to the determination result, corresponding lighting configuration is performed.

[0124] It should be noted that when most sound effects are enabled, the target vehicle's exterior lights are off by default. However, in a few specific sound effects, the exterior lights may be turned on and achieve lighting effects such as constant light, flashing, and switching between high and low lights. For example, in the "Singing outside the car" sound effect function command, the exterior lights will be turned on and flash at a certain frequency.

[0125] At the same time, the interior ambient light will be configured in color according to the matching related sound effect functions, and the rhythm mode and rhythm of the ambient light will be set according to the parameter signals such as the style and frequency of the sound effect audio content. For example, different colors of ambient lights correspond to music with different frequency rhythms, for example, red or purple ambient lights correspond to music with a sharp rhythm, and blue or green ambient lights correspond to music with a slow rhythm. In the "Karaoke in the car" sound effect function command, it can provide a pure color rhythm or multi-color alternating switching effect to match the vocal singing of the song.

[0126] In this way, by executing the above steps S101-S103, when it is determined that the target vehicle is in a stationary state, active vibration enhancement can be completed through the variable damping suspension, and the vibration acoustic experience of the vehicle sound effect can be supplemented, thereby adding a vibration modal experience to the passengers in the cabin. At the same time, the present application does not need to add additional inflatable airbags, vibration rotors, or audio exciters to the seats or frames, and the original vehicle's variable damping suspension system can be directly used to achieve vibration enhancement, which relatively reduces the process steps and additional cost investment. In addition, the present application combines the vehicle audio system, vehicle suspension control system, vehicle seat system, and vehicle lighting system of the target vehicle to complete the synchronous output of multi-system sound effect functions, providing immersive somatosensory acoustics for passengers in the cabin, thereby enhancing the cabin sound effect experience of passengers in the cabin.

[0127] In summary, the present embodiment provides a method for controlling vehicle cabin sound effects, which first obtains driving operation information of a target vehicle during driving; and based on the driving operation information, determines the driving state of the target vehicle, and then, when the driving state of the target vehicle is stationary, responds to a sound effect request instruction issued by an on-board user, determines a preset vibration enhancement mode corresponding to the target vehicle; then, according to the sound effect request instruction and the preset vibration enhancement mode, sends a command signal to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle, controls the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage, so as to enhance the on-board user's experience of the sound effects of the target vehicle cabin.

[0128] It can be seen that since the present application can actively apply somatosensory vibrations corresponding to the sound effect request instructions to the target vehicle and the vehicle users based on the vehicle suspension control system, and simultaneously control the vehicle audio system, vehicle seat system and vehicle lighting system to synchronize functional linkage, it provides the vehicle users with immersive somatosensory acoustics of multiple senses such as vision, hearing and touch, thereby enhancing the vehicle users' experience of the target vehicle's cabin sound effects.

[0129] Second embodiment

[0130] This embodiment will introduce a control device for vehicle cabin sound effects. For related content, please refer to the above method embodiment.

[0131] See also Figure 8 , is a schematic diagram of the composition of a vehicle cabin sound effect control device provided in this embodiment, the device 800 includes:

[0132] The first acquisition unit 801 is used to acquire the driving operation information of the target vehicle during the driving process; and determine the driving state of the target vehicle based on the driving operation information;

[0133] The determination unit 802 is used to determine a preset vibration enhancement mode corresponding to the target vehicle in response to a sound effect request instruction issued by a vehicle user when the driving state of the target vehicle is a stationary state;

[0134] The control unit 803 is used to send command signals to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle according to the sound effect request instruction and the preset vibration enhancement mode, and control the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage to enhance the sound effect experience of the vehicle user in the cabin of the target vehicle.

[0135] In an implementation of this embodiment, the control unit 803 includes:

[0136] A playing subunit, configured to send a command signal to a vehicle audio system of the target vehicle according to the sound effect request instruction, and play the audio content after confirming the initial phase of the vehicle audio effect system signal and completing the phase alignment;

[0137] A vibration subunit, configured to determine the frequency and intensity of vibration enhancement required to be compensated for the target vehicle according to the sound effect request instruction and a preset vibration enhancement mode after synchronizing an initial phase signal to a vehicle suspension control system through the vehicle audio system and completing signal phase alignment, and perform vibration enhancement processing using the vehicle suspension control system according to the frequency and intensity of vibration enhancement required to be compensated for the target vehicle;

[0138] A first determination subunit is used for, after synchronizing an initial phase signal to a vehicle seat system through the vehicle audio system and completing signal phase alignment, determining whether it is necessary to call a zero-gravity seat function and / or a seat massage function to cooperate with the implementation of a corresponding sound effect function according to the sound effect request instruction, and executing a corresponding seat function according to a determination result;

[0139] The second determination subunit is used to determine whether it is necessary to call the corresponding type of vehicle lights to cooperate in realizing the corresponding sound effect function according to the sound effect request instruction after synchronizing the initial phase signal to the vehicle lighting system through the vehicle audio system and completing the signal phase alignment, and perform corresponding lighting configuration according to the determination result.

[0140] In an implementation of this embodiment, the audio playback system includes an in-vehicle microphone, an audio power amplifier, and a vehicle-mounted speaker; the playback subunit includes:

[0141] A sound receiving subunit, configured to receive sound through the in-vehicle microphone after confirming the initial phase of the in-vehicle sound system signal, and send the collected audio data to be played to the audio power amplifier;

[0142] The sending subunit is used to use a preset sound effect algorithm to fuse and mix the audio data to be played and the accompaniment audio data provided by the vehicle computer through the audio power amplifier, complete phase alignment, and send the processed audio data to the vehicle speaker so that the processed audio data can be played through the vehicle speaker.

[0143] In one implementation of this embodiment, the sound effect request instruction is karaoke in the car; the preset vibration enhancement mode is a mode of following the audio rhythm; and the vibration subunit includes:

[0144] The acquisition subunit is used to acquire the audio data to be played and the accompaniment audio data provided by the vehicle computer;

[0145] A transform subunit is used to perform fast Fourier transform processing on the audio data to be played to obtain the amplitude and phase information of each frequency component in the frequency domain signal corresponding to the audio data to be played; and to perform fast Fourier transform processing on the accompaniment audio data to obtain the amplitude and phase information of each frequency component in the frequency domain signal corresponding to the accompaniment audio data;

[0146] An extraction subunit, used to extract the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data;

[0147] A generating subunit is used to generate a vibration height that varies with time according to the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data, and to use the vehicle suspension control system to control the front wheel suspension and the rear wheel suspension to enhance the vibration so as to achieve the corresponding vibration heights; the vibration height is proportional to the frequency and amplitude.

[0148] In one implementation of this embodiment, the sound effect request instruction is a lullaby mode; the preset vibration enhancement mode is a constant simulation mode; and the vibration subunit includes:

[0149] A construction subunit is used to construct a periodic functional relationship between the vibration time and the vibration height of the left and right wheel suspensions of the target vehicle, so as to characterize the frequency of the vibration enhancement that needs to be compensated for the target vehicle;

[0150] The determination subunit is used to determine the intensity of vibration enhancement that needs to be compensated for the target vehicle according to the vibration height of the left and right wheel suspensions of the target vehicle, and use the vehicle suspension control system to control the left wheel suspension and the right wheel suspension to perform vibration enhancement to achieve their respective corresponding vibration heights.

[0151] In an implementation of this embodiment, the device further includes:

[0152] A calculation unit, used to calculate, using the algorithm central processing unit of the target vehicle, the frequency and intensity of active vibration enhancement required to be compensated for linkage with the audio data to be played and the accompaniment audio data according to the preset vibration enhancement mode and the audio data to be played and the accompaniment audio data provided by the vehicle computer, as the target vibration frequency and intensity corresponding to the target vehicle;

[0153] A second acquisition unit is used to acquire the vibration frequency and intensity actually generated by the wheel suspension of the target vehicle during the vibration enhancement process;

[0154] A judgment unit is used to judge whether the difference between the vibration frequency and intensity actually generated by the wheel suspension and the target vibration frequency and intensity meets the preset conditions. If not, the frequency and intensity of the active vibration enhancement are repeatedly learned and adjusted until the vibration frequency and intensity actually generated by the wheel suspension and the target vibration frequency and intensity meet the preset conditions.

[0155] In an implementation of this embodiment, the first determination subunit is specifically configured to:

[0156] According to the sound effect request instruction, determine whether it is necessary to call the zero-gravity seat function; if the zero-gravity seat function needs to be called, unfold the zero-gravity seat; if the zero-gravity seat function does not need to be called, or after the zero-gravity seat is fully unfolded, determine whether it is necessary to call the seat massage function; if the seat massage function needs to be called, turn on the seat massage function, and according to the parameters of the audio content transmitted by the sound effect request instruction, complete the execution and switching of different mode functions of the seat massage.

[0157] In one implementation of this embodiment, the sound effect request instruction includes at least one of in-car karaoke, lullaby mode and outdoor singing; the preset vibration enhancement mode includes at least one of audio rhythm mode and constant simulation mode.

[0158] Furthermore, an embodiment of the present application also provides a vehicle cabin sound effect control device, including: a processor, a memory, and a system bus;

[0159] The processor and the memory are connected via the system bus;

[0160] The memory is used to store one or more programs, and the one or more programs include instructions. When the instructions are executed by the processor, the processor executes any one of the implementation methods of the above-mentioned vehicle cabin sound control method.

[0161] Furthermore, an embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device executes any one of the implementation methods of the above-mentioned vehicle cabin sound effect control method.

[0162] Furthermore, an embodiment of the present application also provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute any one of the implementation methods of the above-mentioned vehicle cabin sound effect control method.

[0163] It can be known from the description of the above implementation mode that those skilled in the art can clearly understand that all or part of the steps in the above-mentioned embodiment method can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., including several instructions for enabling a computer device (which can be a personal computer, a server, or a network communication device such as a media gateway, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0164] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0165] It should also be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0166] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for controlling vehicle cabin sound effects, characterized in that: include: Acquire driving operation information of the target vehicle during driving; and determining the driving state of the target vehicle based on the driving operation information; When the driving state of the target vehicle is a stationary state, in response to a sound effect request instruction issued by a vehicle user, determining a preset vibration enhancement mode corresponding to the target vehicle; According to the sound effect request instruction and the preset vibration enhancement mode, a command signal is sent to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle to control the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage to enhance the vehicle user's sound effect experience of the target vehicle cabin.

2. The method according to claim 1, characterized in that The method includes sending a command signal to a vehicle audio system, a vehicle suspension control system, a vehicle seat system, and a vehicle lighting system of the target vehicle according to the sound effect request instruction and the preset vibration enhancement mode, and controlling the vehicle audio system, the vehicle suspension control system, the vehicle seat system, and the vehicle lighting system to synchronously perform functional linkage, including: Sending a command signal to the vehicle audio system of the target vehicle according to the audio effect request instruction, and playing the audio content after confirming the initial phase of the vehicle audio effect system signal and completing the phase alignment; After synchronizing an initial phase signal to a vehicle suspension control system through the vehicle audio system and completing signal phase alignment, determining the frequency and intensity of vibration enhancement that the target vehicle needs to compensate for according to the sound effect request instruction and the preset vibration enhancement mode, and performing vibration enhancement processing using the vehicle suspension control system according to the frequency and intensity of vibration enhancement that the target vehicle needs to compensate for; After synchronizing the initial phase signal to the vehicle seat system through the vehicle audio system and completing the signal phase alignment, according to the sound effect request instruction, determining whether it is necessary to call the zero gravity seat function and / or the seat massage function to cooperate with the implementation of the corresponding sound effect function, and executing the corresponding seat function according to the determination result; After synchronizing the initial phase signal to the vehicle lighting system through the vehicle audio system and completing the signal phase alignment, it is determined whether it is necessary to call the corresponding type of vehicle lights to cooperate in realizing the corresponding sound effect function according to the sound effect request instruction, and the corresponding lighting configuration is performed according to the determination result.

3. The method according to claim 2, characterized in that The audio playback system includes an in-vehicle microphone, an audio power amplifier, and an in-vehicle speaker; after confirming the initial phase of the in-vehicle sound system signal and completing the phase alignment, playing the audio content includes: After confirming the initial phase of the vehicle audio system signal, collecting sound through the in-vehicle microphone, and sending the collected audio data to be played to the audio power amplifier; Using a preset sound effect algorithm, the audio data to be played and the accompaniment audio data provided by the vehicle computer are fused and mixed through the audio power amplifier to complete phase alignment, and the processed audio data is sent to the vehicle speaker so that the processed audio data can be played through the vehicle speaker.

4. The method according to claim 2, characterized in that: The sound effect request instruction is karaoke in the car; the preset vibration enhancement mode is a rhythmic mode with audio; the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for are determined according to the sound effect request instruction and the preset vibration enhancement mode, and the vibration enhancement processing is performed by using the vehicle suspension control system according to the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for, including: Obtain the audio data to be played and the accompaniment audio data provided by the vehicle computer; Performing fast Fourier transform processing on the audio data to be played to obtain amplitude and phase information of each frequency component in the frequency domain signal corresponding to the audio data to be played; and performing fast Fourier transform processing on the accompaniment audio data to obtain amplitude and phase information of each frequency component in the frequency domain signal corresponding to the accompaniment audio data; Extracting frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data; According to the frequency and amplitude information of each time window in the frequency domain signal corresponding to the audio data to be played and the frequency domain signal corresponding to the accompaniment audio data, a vibration height that changes with time is generated, and the front wheel suspension and the rear wheel suspension are controlled by the vehicle suspension control system to enhance the vibration so as to achieve their respective corresponding vibration heights; the vibration height is proportional to the frequency and amplitude.

5. The method according to claim 2, characterized in that: The sound effect request instruction is a lullaby mode; the preset vibration enhancement mode is a constant simulation mode; the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for are determined according to the sound effect request instruction and the preset vibration enhancement mode, and the vibration enhancement processing is performed by using the vehicle suspension control system according to the frequency and intensity of the vibration enhancement that the target vehicle needs to compensate for, including: Constructing a periodic functional relationship between the vibration time and the vibration height of the left and right wheel suspensions of the target vehicle to characterize the frequency of the vibration enhancement that needs to be compensated for the target vehicle; According to the vibration heights of the left and right wheel suspensions of the target vehicle, the intensity of the vibration enhancement that needs to be compensated for the target vehicle is determined, and the vehicle suspension control system is used to control the left wheel suspension and the right wheel suspension to perform vibration enhancement to achieve their respective corresponding vibration heights.

6. The method according to claim 4 or 5, characterized in that: After determining the preset vibration enhancement mode corresponding to the target vehicle, the method further includes: Using the algorithm central processing unit of the target vehicle, according to the preset vibration enhancement mode and the audio data to be played and the accompaniment audio data provided by the vehicle computer, the frequency and intensity of the active vibration enhancement required to be compensated for the linkage with the audio data to be played and the accompaniment audio data are calculated as the target vibration frequency and intensity corresponding to the target vehicle; Acquiring the vibration frequency and intensity actually generated by the wheel suspension of the target vehicle during the vibration enhancement process; Determine whether the difference between the actual vibration frequency and intensity generated by the wheel suspension and the target vibration frequency and intensity meets the preset conditions; if not, repeatedly learn and adjust the frequency and intensity of the active vibration enhancement until the actual vibration frequency and intensity generated by the wheel suspension and the target vibration frequency and intensity meet the preset conditions.

7. The method according to claim 2, characterized in that The step of determining, according to the sound effect request instruction, whether it is necessary to call a zero-gravity seat function and / or a seat massage function to cooperate with the corresponding sound effect function, and executing the corresponding seat function according to the determination result, includes: Determining whether a zero-gravity seat function needs to be called according to the sound effect request instruction; If the zero-gravity seat function needs to be called, the zero-gravity seat is unfolded; if the zero-gravity seat function does not need to be called, or after the zero-gravity seat is fully unfolded, it is determined whether the seat massage function needs to be called; If the seat massage function needs to be called, the seat massage function is turned on, and the execution and switching of different mode functions of the seat massage are completed according to the parameters of the audio content transmitted by the sound effect request instruction.

8. The method according to any one of claims 1 to 7, characterized in that: The sound effect request instruction includes at least one of in-car karaoke, lullaby mode and outdoor singing; the preset vibration enhancement mode includes at least one of audio rhythm mode and constant simulation mode.

9. A vehicle cabin sound control device, characterized in that: include: A first acquisition unit, used to acquire driving operation information of the target vehicle during driving; and determining the driving state of the target vehicle based on the driving operation information; a determination unit, configured to determine a preset vibration enhancement mode corresponding to the target vehicle in response to a sound effect request instruction issued by a vehicle user when the driving state of the target vehicle is a stationary state; A control unit is used to send command signals to the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system of the target vehicle according to the sound effect request instruction and the preset vibration enhancement mode, and control the vehicle audio system, vehicle suspension control system, vehicle seat system and vehicle lighting system to synchronously perform functional linkage to enhance the sound effect experience of the vehicle user in the cabin of the target vehicle.

10. A vehicle cabin sound control device, characterized in that: include: Processor, memory, system bus; The processor and the memory are connected via the system bus; The memory is used to store one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on a terminal device, the terminal device executes the method according to any one of claims 1 to 8.

Images