Audio visualization method, vehicle, storage medium and computer program product

Abstract

The present application discloses an audio visualization method, a vehicle, a storage medium, and a computer program product, relating to the technical field of vehicles. The audio visualization method of the present application is applied to a vehicle, and the vehicle includes a first display screen. Specifically, it includes: obtaining a plurality of real-time driving parameters of the vehicle; generating a plurality of first audio signals based on the plurality of real-time driving parameters, and determining first animation effects respectively matched with the plurality of first audio signals; determining first display areas respectively matched with the plurality of first animation effects on the first display screen; controlling a speaker to play the first audio signals, and controlling each first display area to play its corresponding first animation effect. By using the present application, the driver can more intuitively and comprehensively understand the changes occurring during the driving process of the vehicle through visual and auditory information, thereby enabling the driver to have a more immersive driving experience.

Description

Technical Field

[0001] This application relates to the technical field of vehicles, and particularly to an audio visualization method, a vehicle, a storage medium, and a computer program product. Background Art

[0002] With the continuous development of the automotive industry, new energy vehicles have become the preferred means of transportation for more and more users in their daily travels.

[0003] In the related art, in order to meet the need for audio-visual collaborative feedback of the driver during driving, the vehicle can detect hardware signals such as the steering wheel rotation angle, accelerator pedal opening degree, and gear position lamp generated by the driver during driving, and process the currently playing music file according to each hardware signal so that the sound effect of the music is dynamically adjusted with the change of the driving behavior, so that the driver can perceive the changes generated during the vehicle driving process through auditory information, giving the driver a more immersive driving experience.

[0004] However, although this method can modify the sound effect, it cannot enable the driver to intuitively feel the changes generated during the vehicle driving process through visual information. Summary of the Invention

[0005] The main purpose of this application is to provide an audio visualization method, a vehicle, a storage medium, and a computer program product, aiming to solve the technical problem that the driver in the related art cannot intuitively feel the changes in the vehicle driving state.

[0006] To achieve the above object, this application proposes an audio visualization method, which is applied to a vehicle. The vehicle includes a first display screen and a speaker. The method includes:

[0007] Obtain multiple real-time driving parameters of the vehicle;

[0008] Generate multiple first audio signals based on the multiple real-time driving parameters, and determine the first animation effects respectively matched with the multiple first audio signals;

[0009] Determine the first display areas respectively matched with the multiple first animation effects on the first display screen;

[0010] Control the speaker to play the first audio signal, and control each first display area to play its corresponding first animation effect.

[0011] In an embodiment, the step of generating multiple first audio signals based on the multiple real-time driving parameters includes:

[0012] Determine the preset track elements and preset parameter thresholds respectively matched with the multiple real-time driving parameters;

[0013] Adjust the sound effect parameters of each of the preset audio track elements based on the respective preset parameter thresholds to generate a first audio signal for each of the plurality of real-time driving parameters.

[0014] In one embodiment, the step of determining a first animation effect for each of the plurality of first audio signals includes:

[0015] Determine a first animation effect for each of the plurality of first audio signals based on a preset animation mapping relationship.

[0016] In one embodiment, the step of determining a first display area on the first display screen for each of the plurality of first animation effects includes:

[0017] Determine a first display area on the first display screen for each of the plurality of first animation effects based on a preset screen mapping relationship.

[0018] In one embodiment, after the step of controlling each of the first display areas to play a corresponding first animation effect, the method further includes:

[0019] Obtain the steering wheel rotation angle of the vehicle;

[0020] Determine animation movement parameters for the plurality of first animation effects based on the steering wheel rotation angle;

[0021] Control the plurality of first animation effects to move on the first display screen according to the respective animation movement parameters.

[0022] In one embodiment, the vehicle further includes an external speaker. After the step of controlling each of the first display areas to play a corresponding first animation effect, the method further includes:

[0023] Input the plurality of first audio signals into the external speaker and control the external speaker to play the plurality of first audio signals.

[0024] In one embodiment, after the step of controlling each of the first display areas to play a corresponding first animation effect, the method further includes:

[0025] Obtain the real-time environment parameters of the vehicle;

[0026] Generate a second audio signal based on the real-time environment parameters and determine a second animation effect for the second audio signal;

[0027] Determine a second display area on the first display screen for the second animation effect and control the second display area to play the second animation effect;

[0028] Obtain a third audio signal based on the second audio signal and the first audio signal, and control the built-in speaker to play the third audio signal.

[0029] In one embodiment, after the step of controlling each of the first display areas to play their respective corresponding first animation effects, the method further includes:

[0030] Capture target image data including the driver's face through an image acquisition module in the vehicle;

[0031] Determine the driver's emotional state parameter according to the target image data, and determine a first audio adjustment parameter and a first animation adjustment parameter based on the emotional state parameter;

[0032] Obtain a fourth audio signal based on the first audio adjustment parameter and the first audio signal, and play the fourth audio signal through the built-in speaker configured in the vehicle;

[0033] Adjust the first animation effect according to the first animation adjustment parameter to obtain a third animation effect, and control each of the first display areas to play their respective corresponding third animation effects.

[0034] In one embodiment, the vehicle further includes a second display screen. After the step of controlling each of the first display areas to play their respective corresponding first animation effects, the method further includes:

[0035] Receive an audio adjustment instruction sent by the second display screen;

[0036] Read a second audio adjustment parameter included in the audio adjustment instruction, and determine a second animation adjustment parameter based on the second audio adjustment parameter;

[0037] Obtain a fifth audio signal based on the second audio adjustment parameter and the first audio signal, and play the fifth audio signal through the built-in speaker configured in the vehicle;

[0038] Adjust the first animation effect according to the second animation adjustment parameter to obtain a fourth animation effect, and control each of the first display areas to play their respective corresponding fourth animation effects.

[0039] In addition, to achieve the above object, the present application further provides a vehicle, the vehicle includes: a plurality of display screens, a plurality of speakers, an image acquisition module, a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program is configured to implement the steps of the audio visualization method as described above.

[0040] In addition, to achieve the above object, the present application further provides a storage medium, which is a computer-readable storage medium. A computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the audio visualization method described above are implemented.

[0041] In addition, to achieve the above object, the present application further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the audio visualization method described above are implemented.

[0042] The audio visualization method provided by the embodiments of the present application is applied to a vehicle. The vehicle includes a first display screen and a speaker. By obtaining a plurality of real-time driving parameters of the vehicle; generating a plurality of first audio signals based on the plurality of real-time driving parameters, and determining a first animation effect respectively matched with each of the plurality of first audio signals; determining a first display area respectively matched with each of the plurality of first animation effects on the first display screen; controlling the speaker to play the first audio signal, and controlling each of the first display areas to play the corresponding first animation effect.

[0043] In this embodiment, when the vehicle is running, it first obtains a plurality of real-time driving parameters generated during its own driving process. After that, based on the obtained plurality of real-time driving parameters, the vehicle generates a first audio signal respectively matched with each of the plurality of real-time driving parameters. At the same time, the vehicle filters out a first animation effect respectively matched with each of the plurality of first audio signals. Then, the vehicle determines a first display area respectively matched with each of the plurality of first animation effects on the internally configured first display screen. Finally, the vehicle controls the speaker to play the first audio signal, and controls each of the first display areas to play the corresponding first animation effect.

[0044] In this way, the present application solves the technical problem in the related art that the driver cannot intuitively feel the change of the vehicle driving state, that is, the present application generates corresponding audio signals and animation effects based on the real-time driving parameters generated during the vehicle driving process, controls the speaker to play the audio signal, and controls different areas of the display screen to play the animation effects representing different driving parameters, so as to enable the driver to more intuitively and comprehensively understand the changes generated during the vehicle driving process through visual and auditory information, and further enable the driver to have a more immersive driving experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The drawings here are incorporated into the specification and form a part of this specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0046] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0047] Figure 1 It is a schematic flowchart provided for the first embodiment of the audio visualization method of the present application;

[0048] Figure 2 It is a schematic diagram of the animation effect involved in an embodiment of the audio visualization method of the present application;

[0049] Figure 3 It is a schematic diagram of the display area involved in an embodiment of the audio visualization method of the present application;

[0050] Figure 4 It is a schematic diagram of the audio signal involved in an embodiment of the audio visualization method of the present application;

[0051] Figure 5 It is a schematic diagram of the animation movement process within the area involved in an embodiment of the audio visualization method of the present application;

[0052] Figure 6 It is a schematic diagram of the animation movement process outside the area involved in an embodiment of the audio visualization method of the present application;

[0053] Figure 7 It is a schematic diagram of adding the animation effect involved in an embodiment of the audio visualization method of the present application;

[0054] Figure 8 It is a schematic diagram of modifying the animation effect involved in an embodiment of the audio visualization method of the present application;

[0055] Figure 9 It is a schematic diagram of the module structure of the audio visualization device in the embodiment of the present application;

[0056] Figure 10 It is a schematic diagram of the device structure of the hardware operating environment involved in the audio visualization method in the embodiment of the present application.

[0057] The implementation, functional features, and advantages of the purpose of the present application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0058] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0059] To better understand the technical solutions of the present application, the following will be described in detail with reference to the accompanying drawings of the specification and the specific implementation manners.

[0060] In this embodiment, for the convenience of description, the following takes a vehicle internally configured with a camera, built-in speakers, external speakers, and multiple display screens, or a mobile terminal, a data storage control terminal, a PC, etc. connected to an electronic control unit supporting the vehicle as the execution subject for elaboration.

[0061] Based on the above vehicle, the overall concept of the audio visualization method of this application is proposed here.

[0062] With the continuous development of the automotive industry, new energy vehicles have become the first choice of transportation for more and more users in their daily travel. In related technologies, in order to meet the needs of the driver for audiovisual collaborative feedback during driving, the vehicle can detect hardware signals such as the steering wheel rotation angle, accelerator pedal opening degree, and gear position lamp generated by the driver during driving, and process the currently playing music file according to each hardware signal, so that the sound effect of the music dynamically adjusts with the change of driving behavior, so that the driver can perceive the changes generated during the vehicle driving process through auditory information, giving the driver a more immersive driving experience. However, although this method can modify the sound effect, it cannot enable the driver to directly feel the changes generated during the vehicle driving process through visual information.

[0063] In view of the above phenomenon, this application provides an audio visualization method, which is applied to a vehicle, and the vehicle includes a first display screen and a speaker. The method includes: obtaining a plurality of real-time driving parameters of the vehicle; generating a plurality of first audio signals based on the plurality of real-time driving parameters, and determining a first animation effect respectively matched with each of the plurality of first audio signals; determining a first display area respectively matched with each of the plurality of first animation effects on the first display screen; controlling the speaker to play the first audio signal, and controlling each of the first display areas to play the corresponding first animation effect.

[0064] In this way, this application solves the technical problem that the driver in the related technology cannot directly feel the change of the vehicle driving state, that is, this application generates corresponding audio signals and animation effects based on the real-time driving parameters generated during the vehicle driving process, controls the speaker to play the audio signal, and controls different areas of the display screen to play animation effects representing different driving parameters, so as to enable the driver to more intuitively and comprehensively understand the changes generated during the vehicle driving process through visual and auditory information, and further give the driver a more immersive driving experience.

[0065] Based on the overall concept of the audio visualization method of this application, an embodiment of this application provides an audio visualization method, referring to Figure 1 , Figure 1The figure is a schematic flowchart of the first embodiment of the audio visualization method of this application. In this embodiment, the audio visualization method is applied to a vehicle, which includes a first display screen and a speaker. The audio visualization method includes steps S10 to S40:

[0066] Step S10: Obtain multiple real-time driving parameters of the vehicle;

[0067] It should be noted that in this embodiment, the real-time driving parameters are physical quantities generated during the driving process of the vehicle and can reflect the changes in driving behavior, including but not limited to: vehicle speed parameters, accelerator pedal opening degree, brake pedal opening degree, etc. It can be understood that this application does not limit the specific types that the real-time driving parameters can include.

[0068] In this embodiment, when the vehicle is running, the in-vehicle control module integrated in the vehicle first controls the sensor module configured in the vehicle to collect multiple real-time driving parameters such as real-time vehicle speed parameters, real-time accelerator pedal opening degree, and real-time brake pedal opening degree generated during the driving process of the vehicle through the sensor module.

[0069] Exemplarily, for example, during the driving process of the vehicle, the ECU (Electronic Control Unit) configured in the vehicle controls the sensor module, and then detects the wheels through the magneto-electric wheel speed sensor configured in the sensor module to determine the initial vehicle speed parameter. The ECU then performs denoising processing and normalization processing on the initial vehicle speed parameter to obtain the real-time vehicle speed parameter. At the same time, the ECU detects the accelerator pedal of the vehicle through the accelerator pedal sensor configured in the sensor module to obtain the initial accelerator pedal opening degree generated during the driving process of the vehicle, and performs denoising processing and normalization processing on the initial accelerator pedal opening degree to obtain the real-time accelerator pedal opening degree. At the same time, the ECU detects the initial brake pedal opening degree of the vehicle through the brake pedal sensor configured in the sensor module, and performs denoising processing and normalization processing on the initial brake pedal opening degree to obtain the real-time brake pedal opening degree.

[0070] In this way, the vehicle can quickly synchronize the generated driving parameters during the driving process and perform cleaning and denoising processing on each driving parameter to ensure the accuracy of the driving parameters.

[0071] Step S20: Generate multiple first audio signals based on the multiple real-time driving parameters, and determine the first animation effects respectively matched by the multiple first audio signals;

[0072] It should be noted that the audio signal is a track combination dynamically generated based on real-time driving parameters, including track elements and sound effect parameters. It can be understood that by adjusting the sound effect parameters, the generated audio signal can perform fade-in / fade-out operations, and different audio signals can be obtained through different combinations of sound effect parameters and track elements. In addition, the animation effect is a visual effect bound to the audio signal, including but not limited to: particle diffusion, displacement animation, color gradient and other animation effects. It can be understood that the amplitude, frequency, etc. of the animation effect have a non-linear mapping relationship with the driving parameters.

[0073] In this embodiment, after the vehicle-mounted control module obtains multiple real-time driving parameters such as real-time vehicle speed parameter, real-time accelerator pedal opening degree, and real-time brake pedal opening degree, it can determine the track elements and sound effect parameters corresponding to the real-time vehicle speed parameter, real-time accelerator pedal opening degree, and real-time brake pedal opening degree respectively, and combine the track elements and sound effect parameters corresponding to the real-time vehicle speed parameter, real-time accelerator pedal opening degree, and real-time brake pedal opening degree respectively to generate multiple first audio signals. At the same time, the vehicle-mounted control module reads the storage module configured in the vehicle to obtain a preset animation mapping relationship, and thus queries the animation mapping relationship based on the multiple first audio signals to determine the first animation effects respectively matched by the multiple first audio signals.

[0074] Exemplarily, for example, after the ECU obtains the real-time vehicle speed parameter, the real-time opening degree of the accelerator pedal, and the real-time opening degree of the brake pedal, it first processes the real-time vehicle speed parameter to determine that the track element corresponding to the real-time vehicle speed parameter is the keyboard track and determines the first sound effect parameter corresponding to the real-time vehicle speed parameter. The ECU then combines the keyboard track and the first sound effect parameter to obtain the first vehicle speed audio signal corresponding to the real-time vehicle speed parameter. At the same time, the ECU processes the real-time opening degree of the accelerator pedal to determine that the track element corresponding to the real-time opening degree of the accelerator pedal is the bass track and determines the second sound effect parameter corresponding to the real-time opening degree of the accelerator pedal. The ECU then combines the bass track and the second sound effect parameter to obtain the first accelerator audio signal corresponding to the real-time opening degree of the accelerator pedal. At the same time, the ECU processes the real-time opening degree of the brake pedal to determine that the track element corresponding to the real-time opening degree of the brake pedal is the DJ scratching track and determines the third sound effect parameter corresponding to the real-time opening degree of the brake pedal. The ECU then combines the DJ scratching track and the third sound effect parameter to obtain the first brake audio signal corresponding to the real-time opening degree of the brake pedal. After that, the ECU reads the storage module configured in the vehicle to obtain a preset animation effect query MAP (table). The ECU then queries the animation effect query MAP based on the first vehicle speed audio signal, the first accelerator audio signal, and the first brake audio signal to determine that the first animation effect corresponding to the first vehicle speed audio signal is the ripple animation effect, the first animation effect corresponding to the first accelerator audio signal is the particle ejection effect, and the first animation effect corresponding to the first brake audio signal is the line fade effect.

[0075] In this way, the vehicle can convert real-time driving parameters into audio signals and animation effects, enabling the driver to intuitively determine the changes occurring during vehicle driving through the information carried by the audio signals and animation effects, and thus obtaining a more immersive driving experience.

[0076] In a feasible implementation manner, the step of "generating a plurality of first audio signals based on a plurality of real-time driving parameters" in the above step S20 may specifically include steps S201 to S202:

[0077] Step S201: Determine the preset track elements and preset parameter thresholds respectively matched by the plurality of real-time driving parameters;

[0078] Step S202: Adjust the sound effect parameters of each of the preset track elements based on each of the preset parameter thresholds to generate a first audio signal respectively matched by the plurality of real-time driving parameters.

[0079] It should be noted that the preset track element is a track element pre-stored in a track database and bound to a certain driving parameter, including but not limited to: drum set, bass, keyboard, chord, DJ scratching and other track elements. It can be understood that the present application also does not limit the specific types included in the track element. In addition, the preset parameter threshold is a critical driving parameter for triggering audio adjustment, including: vehicle speed threshold (such as 50 km / h), throttle / brake opening degree threshold (such as 50%). It can be understood that through the preset parameter threshold, it can be determined how to modify the preset sound effect parameters corresponding to the preset track element.

[0080] In this embodiment, after the vehicle-mounted control module obtains multiple real-time driving parameters such as real-time vehicle speed parameter, real-time throttle pedal opening degree, and real-time brake pedal opening degree, it can first read the above storage module to obtain the preset track database, and read the track database to determine the preset track element and preset parameter threshold corresponding to each of the real-time vehicle speed parameter, real-time throttle pedal opening degree, and real-time brake pedal opening degree. Then, the vehicle-mounted electronic module compares the real-time vehicle speed parameter, real-time throttle pedal opening degree, and real-time brake pedal opening degree with the matching preset parameter thresholds respectively, so as to determine the sound effect adjustment parameters corresponding to each preset track element based on each comparison result. The vehicle-mounted electronic module adjusts the preset sound effect parameters corresponding to each preset track element according to each sound effect adjustment parameter to obtain the first sound effect parameters corresponding to the real-time vehicle speed parameter, real-time throttle pedal opening degree, and real-time brake pedal opening degree respectively, and combines the preset track elements and the first sound effect parameters corresponding to the real-time vehicle speed parameter, real-time throttle pedal opening degree, and real-time brake pedal opening degree respectively to obtain multiple first audio signals.

[0081] Exemplarily, for example, please refer to Figure 4 , Figure 4 is a schematic diagram of an audio signal related to an embodiment of the audio visualization method of the present application. As Figure 4As shown, after the ECU obtains the real-time vehicle speed parameter, the real-time opening degree of the accelerator pedal, and the real-time opening degree of the brake pedal, it first reads the above storage module to obtain the preset track database, and queries the track database to determine that the preset track element matching the real-time vehicle speed parameter is the keyboard track element, and the preset track element matching the real-time opening degree of the accelerator pedal is the bass track element, and the preset track element matching the real-time opening degree of the brake pedal is the DJ scratching track element. At the same time, the ECU determines through the track database that the vehicle speed threshold corresponding to the real-time vehicle speed parameter is 50 km / h, and the opening degree threshold corresponding to the real-time opening degree of the accelerator pedal is 50%, and the opening degree threshold corresponding to the real-time opening degree of the brake pedal is 50%. After that, the ECU compares the real-time vehicle speed parameter with the vehicle speed threshold, so that when it detects that the real-time vehicle speed parameter is greater than 50 km / h, it determines the first keyboard sound effect adjustment parameter that can increase the preset keyboard sound effect parameter corresponding to the keyboard track element, and adjusts the preset keyboard sound effect parameter according to the first keyboard sound effect adjustment parameter to generate the first sound effect parameter. Or, when it detects that the real-time vehicle speed parameter is less than or equal to 50 km / h, it determines the second keyboard sound effect adjustment parameter that can reduce the preset keyboard sound effect parameter corresponding to the keyboard track element, and adjusts the preset keyboard sound effect parameter according to the second keyboard sound effect adjustment parameter to generate the first sound effect parameter. The ECU then combines the keyboard track element and the corresponding first sound effect parameter to obtain the first vehicle speed audio signal corresponding to the real-time vehicle speed parameter and including the fade-in / fade-out effect for the keyboard sound effect; Similarly, the ECU compares the real-time opening degree of the accelerator pedal with the opening degree threshold, so that when it detects that the real-time opening degree of the accelerator pedal is greater than 50%, it determines the first bass sound effect adjustment parameter that can increase the preset bass sound effect parameter corresponding to the bass track element, and adjusts the preset bass sound effect parameter according to the first bass sound effect adjustment parameter to generate the second sound effect parameter. Or, when it detects that the real-time opening degree of the accelerator pedal is less than or equal to 50%, it determines the second bass sound effect adjustment parameter that can reduce the preset bass sound effect parameter corresponding to the bass track element, and adjusts the preset bass sound effect parameter according to the second bass sound effect adjustment parameter to generate the second sound effect parameter. The ECU then combines the bass track element and the corresponding second sound effect parameter to obtain the first throttle audio signal corresponding to the real-time opening degree of the accelerator pedal and including the fade-in / fade-out effect for the keyboard sound effect;Similarly, the ECU compares the real-time brake pedal opening degree with the opening degree threshold value. When it detects that the real-time brake pedal opening degree is greater than 50%, it determines the first DJ scratching sound effect adjustment parameter that can increase the preset DJ scratching sound effect parameter corresponding to the DJ scratching track element, and adjusts the preset DJ scratching sound effect parameter according to the first DJ scratching sound effect adjustment parameter to generate the third sound effect parameter. Or, when it detects that the real-time brake pedal opening degree is less than or equal to 50%, it determines the second DJ scratching sound effect adjustment parameter that can reduce the preset DJ scratching sound effect parameter corresponding to the DJ scratching track element, and adjusts the preset DJ scratching sound effect parameter according to the second DJ scratching sound effect adjustment parameter to generate the third sound effect parameter. Then, the ECU combines the DJ scratching track element and the corresponding third sound effect parameter to obtain the first brake audio signal of the keyboard sound effect with fade-in / fade-out effect corresponding to the real-time brake pedal opening degree.

[0082] In this way, the vehicle can convert the real-time driving parameters into audio signals, enabling the driver to intuitively determine the changes occurring during vehicle driving through the information carried by the audio signals, and thus obtain a more immersive driving experience.

[0083] In a feasible implementation manner, the step of "determining the first animation effect matched by each of the multiple first audio signals" in the above step S20 may specifically include step S203:

[0084] Step S203: Based on the preset animation mapping relationship, determine the first animation effect matched by each of the multiple first audio signals.

[0085] It should be noted that the animation mapping relationship is a mapping relationship including multiple preset animation effects and the preset audio signals respectively bound to the multiple preset animation effects. It can be understood that the preset animation effect is a visual effect, including but not limited to: particle diffusion, displacement animation, color fade, etc.

[0086] In this embodiment, after the in-vehicle control module determines the first audio signals corresponding to the real-time vehicle speed parameter, the real-time accelerator pedal opening degree, and the real-time brake pedal opening degree, it further reads the above storage module to obtain the animation mapping relationship including the multiple above preset audio signals and the preset animation effects respectively bound to the multiple preset audio signals. The in-vehicle control module queries the animation mapping relationship based on the multiple first audio signals to compare each of the multiple first audio signals with the multiple preset audio signals included in the animation mapping relationship respectively, so as to determine the preset audio signals matched by each of the multiple first audio signals within the animation mapping relationship. Finally, the in-vehicle control module determines the preset animation effects corresponding to each of the multiple preset audio signals in the animation mapping relationship as the first animation effects matched by each of the multiple first audio signals.

[0087] Exemplarily, for example, after the ECU determines the first vehicle speed audio signal, the first throttle audio signal, and the first brake audio signal, it further reads the above-mentioned storage module to obtain an animation effect query MAP (table) containing a plurality of preset audio signals and the preset animation effects respectively matched with the plurality of preset audio signals. After that, the ECU queries the animation effect query MAP based on the first vehicle speed audio signal to compare the first vehicle speed audio signal with the plurality of preset audio signals included in the animation effect query MAP, so as to determine the first preset audio signal containing the keyboard track element in the animation effect query MAP. The ECU determines that the preset animation effect corresponding to the first preset audio signal in the animation effect query MAP is the ripple animation effect, and the ECU thus determines the ripple animation effect as the first animation effect corresponding to the first vehicle speed audio signal; similarly, the ECU queries the animation effect query MAP based on the first throttle audio signal to compare the first throttle audio signal with the plurality of preset audio signals included in the animation effect query MAP, so as to determine the second preset audio signal containing the bass track element in the animation effect query MAP. The ECU determines that the preset animation effect corresponding to the second preset audio signal in the animation effect query MAP is the particle ejection effect, and the ECU thus determines the particle ejection effect as the first animation effect corresponding to the first throttle audio signal; similarly, after the ECU queries the animation effect query MAP based on the first brake audio signal, it compares the first brake audio signal with the plurality of preset audio signals included in the animation effect query MAP, so as to determine the third preset audio signal containing the DJ scratching track element in the animation effect query MAP. The ECU determines that the preset animation effect corresponding to the third preset audio signal in the animation effect query MAP is the line gradient effect, and the ECU thus determines the line gradient effect as the first animation effect corresponding to the first brake audio signal.

[0088] In this way, the vehicle can convert real-time driving parameters into audio signals and animation effects, so that the driver can intuitively determine the changes occurring during the driving process through the information carried by the audio signals and animation effects, and thus obtain a more immersive driving experience.

[0089] Step S30: Determine the first display areas respectively matched by the multiple first animation effects on the first display screen;

[0090] Step S40: Control the speaker to play the first audio signal, and control each first display area to play its corresponding first animation effect.

[0091] It should be noted that the display screen is a display device configured in the vehicle and supporting dynamic effect rendering, and specifically can be the HUD (Head-Up Display) corresponding to the driver's seat. In addition, the display area is a preset area in the display screen that can be independently rendered. Please refer toFigure 3 , Figure 3 is a schematic diagram of a display area involved in an embodiment of the audio visualization method of this application. The display screen includes multiple display areas (such as the core display area and multiple auxiliary display areas shown in Figure 3 ), and each display area can play different animation effects through independent rendering. It can be understood that the coverage area size and coverage position corresponding to each display area can be set for the display screen by those skilled in the art according to actual needs, and this application also does not limit this.

[0092] In this embodiment, after the vehicle control module determines the first animation effects respectively matched by multiple first audio signals, it further queries the first display areas corresponding to the multiple first animation effects on the first display screen. Finally, the vehicle control module controls the speakers configured in the vehicle to play the first audio signal, and performs independent rendering operations on each first display area to control each first display area to play its corresponding first animation effect.

[0093] Exemplarily, for example, after the ECU determines that the first animation effect corresponding to the first vehicle speed audio signal is a ripple animation effect, the first animation effect corresponding to the first throttle audio signal is a particle ejection effect, and the first animation effect corresponding to the first brake audio signal is a line gradient effect, it can first determine that the display areas included in the HUD are the core display area and multiple auxiliary display areas. The ECU then determines that the first display area corresponding to the ripple animation effect is the core display area of the HUD, the first display area corresponding to the particle ejection effect is the first auxiliary display area of the HUD, and the first display area corresponding to the line gradient effect is the second auxiliary display area of the HUD. Finally, the ECU calls the speaker to play the first audio signal. At the same time, it calls the GPU (Graphics Processing Unit) to perform independent rendering on the core display area to make the ripple animation shown on the core display area, so that the ripple special effect spreads on the core display area at a frequency matching the real-time vehicle speed parameter. Similarly, the ECU calls the GPU to perform independent rendering on the first auxiliary display area corresponding to the particle ejection effect to make the particle ejection special effect shown on the first auxiliary display area, so that the density of the particles is proportional to the throttle opening degree. Similarly, the ECU calls the GPU to perform independent rendering on the second auxiliary display area corresponding to the line gradient effect to make the line gradient effect shown on the second auxiliary display area, so that the color gradient degree is proportional to the brake opening degree.

[0094] In this way, the vehicle can perform partition-independent rendering on multiple areas of the display screen and play multiple animation effects through multiple display areas at the same time, so that the driver can more intuitively determine the changes occurring during the driving process based on the multiple animation effects, and thus obtain a more immersive driving experience.

[0095] In a feasible implementation manner, step S30 above may specifically include step S301:

[0096] Step S301: Based on a preset screen mapping relationship, determine the first display areas on the first display screen that each of the multiple first animation effects matches.

[0097] It should be noted that the screen mapping relationship is a mapping relationship including multiple preset animation effects and the preset display areas respectively bound to the multiple preset animation effects. It can be understood that the preset display areas are the display areas that are pre-divided in the vehicle display screen and can be independently rendered, and each preset display area is bound to a specific animation effect (for example, the ripple special effect corresponds to the core display area, the particle special effect corresponds to the first auxiliary display area, and the gradient special effect corresponds to the second auxiliary display area).

[0098] In this embodiment, after the vehicle-mounted control module determines the first animation effects that each of the multiple first audio signals matches, it may also first read the above storage module to obtain the screen mapping relationship including the multiple above preset animation effects and the preset display areas respectively matched by the multiple preset animation effects. The vehicle-mounted control module queries the screen mapping relationship based on the multiple first animation effects, so as to compare each of the multiple first animation effects with the multiple preset animation effects included in the screen mapping relationship to determine the preset display areas in the screen mapping relationship that each of the multiple first animation effects matches. Finally, the vehicle-mounted control module determines the first display areas that each of the multiple first animation effects matches based on the preset display areas corresponding to each of the multiple preset display areas in the screen mapping relationship.

[0099] Exemplarily, for example, please refer to Figure 2 , Figure 2 is a schematic diagram of an animation effect involved in an embodiment of the audio visualization method of the present application. After the ECU determines that the first animation effect corresponding to the first vehicle speed audio signal is the ripple animation effect, the first animation effect corresponding to the first throttle audio signal is the particle injection effect, and the first animation effect corresponding to the first brake audio signal is the line gradient effect, it may also first read the above storage module to obtain the rendering area mapping MAP including the multiple above preset animation effects and the preset display areas respectively matched by the multiple preset animation effects. The ECU queries the rendering area mapping MAP based on the ripple animation effect corresponding to the real-time vehicle speed parameter to determine that the preset display area corresponding to the ripple animation effect in the rendering area mapping MAP is the core display area. The ECU determines the core display area as the first display area for playing the animation effect representing the vehicle driving parameters. After that, the ECU controls the core display area of the first display screen to play the ripple animation effect so that the driver can Figure 2The generated ripple animation effect determines the real-time vehicle speed;

[0100] Similarly, the ECU queries the rendering area mapping MAP based on the particle injection effect corresponding to the real-time throttle pedal opening degree to determine the preset display area corresponding to the particle injection effect within the rendering area mapping MAP as the first auxiliary display area. The ECU determines the first auxiliary display area as the first display area for playing the animation effect representing the vehicle driving parameters. After that, the ECU controls the first auxiliary display area of the first display screen to play the particle injection effect, so that the driver can determine the opening degree of the vehicle's throttle pedal based on the particle injection effect as shown in Figure 2 the particle injection effect shown in;

[0101] Similarly, the ECU queries the rendering area mapping MAP based on the line gradient effect corresponding to the real-time brake pedal opening degree to determine the preset display area corresponding to the line gradient effect within the rendering area mapping MAP as the second auxiliary display area. The ECU determines the second auxiliary display area as the first display area for playing the animation effect representing the vehicle driving parameters. After that, the ECU controls the second auxiliary display area of the first display screen to play the line gradient effect, so that the driver can determine the opening degree of the vehicle's throttle pedal based on the line gradient effect as shown in Figure 2 the line gradient effect shown in.

[0102] In this embodiment, when the vehicle is running, the in-vehicle control module integrated in the vehicle first controls the sensor module configured in the vehicle to collect in real time multiple real-time driving parameters such as the real-time vehicle speed parameter, the real-time throttle pedal opening degree, and the real-time brake pedal opening degree generated during the vehicle's driving process through the sensor module. After that, the in-vehicle control module determines the audio track elements and audio effect parameters corresponding to the real-time vehicle speed parameter, the real-time throttle pedal opening degree, and the real-time brake pedal opening degree respectively, and combines the audio track elements and audio effect parameters corresponding to the real-time vehicle speed parameter, the real-time throttle pedal opening degree, and the real-time brake pedal opening degree respectively to generate multiple first audio signals. At the same time, the in-vehicle control module reads the storage module configured in the vehicle to obtain the preset animation mapping relationship, and thus queries the animation mapping relationship based on the multiple first audio signals to determine the first animation effects respectively matched by the multiple first audio signals. Then, the in-vehicle control module queries the first display areas corresponding to the multiple first animation effects on the first display screen respectively. Finally, the in-vehicle control module controls the speaker configured in the vehicle to play the first audio signal, and performs an independent rendering operation on each first display area to control each first display area to play its corresponding first animation effect.

[0103] Thus, the present application solves the technical problem in the related art that the driver cannot intuitively feel the changes in the driving state of the vehicle. That is, the present application generates corresponding audio signals and animation effects based on the real-time driving parameters generated during the driving process of the vehicle, controls the speaker to play the audio signals, and controls different areas of the display screen to play the animation effects representing different driving parameters, so as to enable the driver to more intuitively and comprehensively understand the changes generated during the driving process of the vehicle through visual and auditory information, and further enable the driver to have a more immersive driving experience.

[0104] Based on the first embodiment of the present application, the second embodiment of the present application is proposed here. In the second embodiment of the present application, the same or similar content as that in the above embodiments can be referred to the above introduction and will not be repeated hereinafter. On this basis, after the above step S40, the audio visualization method of the present application may further include steps A10 to A30:

[0105] Step A10: Obtain the steering wheel rotation angle of the vehicle;

[0106] Step A20: Determine the animation movement parameters matching the plurality of the first animation effects based on the steering wheel rotation angle;

[0107] Step A30: Control the plurality of the first animation effects to move on the first display screen according to the respective animation movement parameters.

[0108] It should be noted that the animation movement parameter is a quantization index for changing the display area where the above animation effect is located, including parameters such as horizontal displacement, vertical displacement, and movement speed.

[0109] In this embodiment, after the vehicle-mounted control module controls the first animation effects corresponding to the real-time vehicle speed parameter, the real-time throttle pedal opening degree, and the real-time brake pedal opening degree to be displayed on the first display screen, it can also detect the steering wheel to determine the steering wheel rotation angle generated during the driving process of the vehicle. Then, the vehicle-mounted control module determines the steering direction and the angle response interval corresponding to the steering wheel according to the steering wheel rotation angle, and further determines the animation movement parameters for adjusting the plurality of first animation effects according to the steering direction and the angle response interval. Finally, the vehicle-mounted control module controls the plurality of first animation effects to move on the first display screen respectively based on the respective animation movement parameters, so as to play the moved first animation effects on the first display screen.

[0110] Exemplarily, for example, please refer to Figure 5 , Figure 5This is a schematic diagram of the animation movement process in the area involved in an embodiment of the audio visualization method of this application. After the ECU displays the ripple animation effect, particle ejection effect, and line gradient effect on the first display screen, it can also call the above-mentioned sensor module to detect the steering wheel in the vehicle to determine the corresponding steering wheel rotation angle during vehicle driving. After that, if the ECU determines that the steering wheel rotation angle is 45°, it calculates the horizontal displacement amount and horizontal movement direction corresponding to each first animation effect based on the steering wheel rotation angle of 45° and the response coefficient of the steering wheel, and determines the horizontal displacement amount and horizontal movement direction as the animation movement parameters corresponding to each first animation effect. Then, as Figure 5 shown, the ECU determines the first display position of the above-mentioned ripple animation effect in the core display area, and determines the adjusted second display position of the ripple animation effect based on the first display position and the animation movement parameters corresponding to the ripple animation effect. Thus, the GPU independently renders the adjusted second display position of the ripple animation effect to control the movement of the ripple animation effect, and further makes the moved ripple animation effect play at the second display position.

[0111] In addition, please refer to Figure 6 , Figure 6 This is a schematic diagram of the animation movement process outside the area involved in an embodiment of the audio visualization method of this application. It can be understood that in addition to being able to be located inside the corresponding display area, the second display position where the ripple animation effect is located after moving can also be as Figure 6 shown, in other display areas on the first display screen.

[0112] Similarly, the ECU also determines the first display position of the above-mentioned particle ejection effect in the first auxiliary display area, and determines the adjusted second display position of the particle ejection effect based on the first display position and the animation movement parameters corresponding to the particle ejection effect. Thus, the GPU independently renders the adjusted second display position of the particle ejection effect to control the movement of the particle ejection effect, and further makes the moved particle ejection effect play at the corresponding second display position. It can be understood that as Figure 5 and Figure 6 shown, the second display position where the particle ejection effect is located after moving can be located in the above-mentioned first auxiliary display area, or in other auxiliary display areas or the core display area on the first display screen.

[0113] Similarly, the ECU also determines the first display position of the above line gradient effect within the second auxiliary display area, and determines the adjusted second display position of the line gradient effect based on the first display position corresponding to the line gradient effect and the animation movement parameter. The ECU then independently renders the adjusted second display position of the line gradient effect through the GPU to control the movement of the line gradient effect, and further makes the moved line gradient effect play at the corresponding second display position. It can be understood that, as Figure 5 and Figure 6 shown, the second display position where the line gradient effect is located after moving can be within the above-mentioned second auxiliary display area, or within other auxiliary display areas or the core display area on the first display screen.

[0114] In this way, the vehicle can synchronize the playing animation effect based on the driving operation issued by the driver, enabling the driver to more intuitively view the driving changes of the vehicle and giving the driver a more immersive driving experience.

[0115] Based on the first embodiment and / or the second embodiment of the present application, the third embodiment of the present application is proposed here. In the third embodiment of the present application, for the same or similar content as in the above embodiments, reference can be made to the above introduction and will not be repeated hereinafter. On this basis, the vehicle further includes an external speaker. After the above step S40, the audio visualization method of the present application may further include step B10:

[0116] Step B10: Input the multiple first audio signals into the external speaker and control the external speaker to play the multiple first audio signals.

[0117] It should be noted that the external speaker is an independent audio output device configured outside the vehicle, including but not limited to: roof speakers, chassis sound field diffusers, etc. It can be understood that the external speaker is used to externally play the above-mentioned audio signals that have been dynamically adjusted.

[0118] In this embodiment, after the in-vehicle control module controls the first animation effects corresponding to the real-time vehicle speed parameter, the real-time accelerator pedal opening degree, and the real-time brake pedal opening degree to be displayed on the first display screen, it can also input the generated first audio signals into the external speaker configured in the vehicle, so that the external speaker plays the multiple first audio signals.

[0119] In this way, the vehicle can transmit the generated sound effects to the external environment through the external player, enabling other users outside the vehicle to understand the driving state of the vehicle based on the audio signals, and enabling the vehicles to interact with each other, thereby giving the driver a more immersive driving experience.

[0120] Based on the embodiments of the present application, the fourth embodiment of the present application is proposed herein. In the fourth embodiment of the present application, for the same or similar content as in the above embodiments, reference can be made to the above introduction and will not be repeated hereinafter. On this basis, after the above step S40, the audio visualization method of the present application may further include steps C10 to C40:

[0121] Step C10: Obtain the real-time environmental parameters of the vehicle;

[0122] Step C20: Generate a second audio signal based on the real-time environmental parameters, and determine a second animation effect matched with the second audio signal;

[0123] Step C30: Determine a second display area on the first display screen that matches the second animation effect, and control the second display area to play the second animation effect;

[0124] Step C40: Obtain a third audio signal based on the second audio signal and the first audio signal, and control the built-in speaker to play the third audio signal.

[0125] It should be noted that the real-time environmental parameters are state data of the environment where the vehicle is located, including but not limited to: weather type, light intensity, road type, external noise level, etc.

[0126] In this embodiment, after the in-vehicle control module controls the first display screen to display the first animation effects corresponding to the real-time vehicle speed parameter, the real-time throttle pedal opening degree, and the real-time brake pedal opening degree respectively, it can also collect the real-time environmental parameters generated during the driving process of the vehicle through the above sensor module. Then, the in-vehicle control module determines the track elements and sound effect parameters corresponding to the real-time environmental parameters, and integrates the track elements and sound effect parameters corresponding to the real-time environmental parameters to generate a second audio signal matched with the real-time environmental parameters. At the same time, the in-vehicle control module queries the above-mentioned animation mapping relationship based on the second audio signal to determine the second animation effect matched with the second audio signal. Finally, the in-vehicle control module queries the above-mentioned screen mapping relationship to determine the second display area corresponding to the second animation effect on the first display screen, and performs an independent rendering operation on the second display area, so as to control the second display area to play the second animation effect. At the same time, the in-vehicle control module fuses the generated second audio signal and the above first audio signal to obtain a third audio signal, and controls the speaker to play the third audio signal.

[0127] Exemplarily, for example, please refer to Figure 7 , Figure 7 which is a schematic diagram of adding an animation effect involved in an embodiment of the audio visualization method of the present application. As shown in Figure 7As shown, after controlling the first display screen to display the ripple animation effect, particle injection effect, and line gradient effect, the ECU can also call the above-mentioned sensor module to detect the environment in which the vehicle is located, so as to obtain the real-time environmental parameters such as weather type, light intensity, road type, and external noise level corresponding to the environment in which the vehicle is located. After that, the ECU processes the real-time environmental parameters to determine that the audio track element corresponding to the real-time environmental parameters is a violin track, and integrates the violin track and the corresponding sound effect parameters to obtain a second audio signal that matches the real-time environmental parameters. At the same time, the ECU queries the above-mentioned animation effect query MAP based on the second audio signal to determine The second animation effect corresponding to the second audio signal is a raindrop animation effect. Finally, the ECU queries the above-mentioned rendering area mapping MAP to determine that the display area corresponding to the raindrop animation effect is the third auxiliary display area in the above-mentioned HUD. The ECU then determines the third auxiliary display area as the second display area for playing animation effects representing real-time environmental parameters. The ECU then calls the GPU to independently render the third auxiliary display area to display the raindrop animation effect on the third auxiliary area. At the same time, the ECU fuses the generated second audio signal with the above-mentioned first audio signal to generate a third audio signal, and controls the speaker to play the third audio signal.

[0128] In this way, the vehicle can enable the driver to more intuitively determine the specific changes in the external environment while the vehicle is driving based on the animation effects, thereby allowing the driver to obtain a more immersive driving experience.

[0129] Based on the various embodiments of the present application, a fifth embodiment of the present application is proposed here. In the fifth embodiment of the present application, the same or similar contents as the above embodiments can be referred to the above introduction, and will not be repeated later. On this basis, after the above step S40, the audio visualization method of the present application can also include steps D10~D40:

[0130] Step D10: capturing target image data including the driver's face through an image acquisition module in the vehicle;

[0131] Step D20: determining the driver's emotional state parameter according to the target image data, and determining a first audio adjustment parameter and a first animation adjustment parameter based on the emotional state parameter;

[0132] Step D30: obtaining a fourth audio signal based on the first audio adjustment parameter and the first audio signal, and playing the fourth audio signal through a built-in speaker configured in the vehicle;

[0133] Step D40: adjusting the first animation effect according to the first animation adjustment parameter to obtain a third animation effect, and controlling each of the first display areas to play the third animation effect corresponding to the first animation effect.

[0134] It should be noted that the emotional state parameter is a quantitative index capable of indicating the emotional characteristics of the driver, including but not limited to: stress index (0% - 100%), pleasure index (0% - 100%), concentration level (low / medium / high), etc. It can be understood that by adjusting the audio signal and animation effect, making the audio signal and animation effect more in line with the driver's emotional characteristics can further enhance the driver's immersion.

[0135] In this embodiment, after the vehicle-mounted control module displays the first animation effects corresponding to the real-time vehicle speed parameter, real-time accelerator pedal opening degree, and real-time brake pedal opening degree on the first display screen, it can first capture the driver's face through the image acquisition module in the vehicle to obtain target image data including the driver's face. Then, the vehicle-mounted control module extracts each facial feature included in the target image data and determines the emotional state parameter corresponding to the driver according to each facial feature. The vehicle-mounted control module queries the preset emotional sound effect database to determine the first audio adjustment parameter matching the emotional state parameter. At the same time, the vehicle-mounted control module queries the preset emotional animation database to determine the first animation adjustment parameter matching the emotional state parameter. Finally, the vehicle-mounted control module adjusts the track elements and / or sound effect parameters in the above first audio signal according to the first audio adjustment parameter to obtain a fourth audio signal, and plays the fourth audio signal through the built-in speaker of the vehicle. At the same time, the vehicle-mounted control module adjusts the above first animation effect according to the first animation adjustment parameter to obtain a third animation signal, and controls the above first display screen to continue playing multiple third animation effects.

[0136] Exemplarily, for example, please refer to Figure 8 , Figure 8 is a schematic diagram of the animation effect modification involved in an embodiment of the audio visualization method of the present application. As Figure 8As shown, after the ECU displays the ripple animation effect, particle ejection effect, and line gradient effect on the first display screen, it can also call the camera configured in front of the driver's seat to capture the driver's face to obtain target image data containing the driver's face. After that, the ECU inputs the target image data into the neural network model configured in itself. The neural network model extracts facial features such as eye, mouth corner, and eyebrow movements contained in the target image data, and identifies the emotional state parameters of the driver based on each facial feature. At this time, if the neural network model identifies that the emotional state parameter is a tense emotion, the vehicle control module queries the preset emotional sound effect database based on this tense emotion to determine that the first audio adjustment parameter matching the emotional state parameter is "increase the noise reduction sound track by 4 dB and reduce the keyboard element sound track by 8 dB". At the same time, the vehicle control module queries the preset animation effect database based on this tense emotion to determine the first animation background color adjustment parameter (i.e., Figure 8 the first animation adjustment parameter in

[0137] Finally, the ECU first adjusts each first audio signal according to the first audio adjustment parameter to reduce the keyboard sound track elements contained in each first audio signal and add white noise to each first audio signal to obtain the fourth audio signal. Then, the ECU plays the fourth audio signal through the vehicle's speakers to relieve the driver's tense emotion through the fourth audio signal. At the same time, the ECU adjusts each first animation effect according to the first animation background color adjustment parameter to adjust the background color of each first animation effect to a dark color, and plays the third animation effects such as the ripple animation, particle ejection, color gradient, and raindrop animation with a deeper background color through the above-mentioned first display screen, thereby reducing the driver's tense emotion through the third animation effects.

[0138] Based on the embodiments of the present application, the sixth embodiment of the present application is proposed here. In the sixth embodiment of the present application, for the same or similar content as in the above embodiments, reference can be made to the above introduction and will not be repeated hereinafter. On this basis, the vehicle further includes a second display screen. After the above step S30, the audio visualization method of the present application may further include steps E10 to E40:

[0139] Step E10: Receive the audio adjustment instruction sent by the second display screen;

[0140] Step E20: Read the second audio adjustment parameter included in the audio adjustment instruction, and determine the second animation adjustment parameter based on the second audio adjustment parameter;

[0141] Step E30: Obtain a fifth audio signal based on the second audio adjustment parameter and the first audio signal, and play the fifth audio signal through the built-in speaker configured in the vehicle;

[0142] Step E40: Adjust the first animation effect according to the second animation adjustment parameter to obtain a fourth animation effect, and control each of the first display areas to play its corresponding fourth animation effect.

[0143] It should be noted that the second display screen is a display device capable of interacting with the above-mentioned first display screen, including but not limited to: a rear-seat entertainment screen, a co-pilot screen, or a mobile terminal projection screen. It can be understood that the second display screen can receive an audio handover instruction input by the user.

[0144] In this embodiment, after the in-vehicle control module displays the ripple animation effect, the particle ejection effect, and the line gradient effect on the first display screen, it can also receive, through the second display screen configured in the vehicle, an audio adjustment instruction triggered by other users in the vehicle except the driver. After that, the in-vehicle control module analyzes the second audio adjustment parameter included in the audio adjustment instruction. At the same time, the in-vehicle control module determines the second animation adjustment parameter matching the second audio adjustment parameter. Finally, the in-vehicle control module adjusts the track elements and / or sound effect parameters in the above-mentioned first audio signal according to the second audio adjustment parameter to obtain a fifth audio signal, and plays the fifth audio signal through the built-in speaker of the vehicle. At the same time, the in-vehicle control module adjusts the above-mentioned first animation effect according to the second animation adjustment parameter to obtain a fourth animation signal, and controls the above-mentioned first display screen to continue playing multiple fourth animation effects.

[0145] Exemplarily, for example, after the ECU displays the ripple animation effect, the particle ejection effect, and the line gradient effect on the first display screen, it can also receive, through the CAN bus, an audio adjustment instruction sent by the second display screen. After that, the ECU analyzes the audio adjustment instruction to determine the second audio adjustment parameter included in the audio adjustment instruction. At the same time, the ECU reads the above-mentioned storage module to obtain a preset animation adjustment MAP, so as to determine the second animation adjustment parameter matching the second audio adjustment parameter based on the multiple preset audio adjustment parameters included in the animation adjustment MAP and the preset animation adjustment parameters respectively matching the multiple preset audio adjustment parameters. Finally, the ECU first adjusts each first audio signal according to the second audio adjustment parameter to obtain a fifth audio signal, and then the ECU plays the fifth audio signal through the speaker in the vehicle. At the same time, the ECU adjusts each first animation effect according to the second animation adjustment parameter to play each fourth animation effect through the above-mentioned first display screen.

[0146] In this way, other occupants in the vehicle can further modify the playing audio signal and animation effect to achieve customization of the audio signal and animation effect, thereby enhancing the interaction between the occupants and the vehicle.

[0147] This application also provides an audio visualization device. Please refer to Figure 9 , the audio visualization device is applied to a vehicle, the vehicle includes a first display screen and a speaker, and the device includes:

[0148] A parameter detection module 10, configured to obtain a plurality of real-time driving parameters of the vehicle;

[0149] An animation generation module 20, configured to generate a plurality of first audio signals based on the plurality of real-time driving parameters, and determine first animation effects respectively matched with the plurality of first audio signals;

[0150] A region screening module 30, configured to determine first display regions respectively matched with the plurality of first animation effects on the first display screen;

[0151] An animation playing module 40, configured to control the speaker to play the first audio signals, and control each of the first display regions to play the corresponding first animation effects.

[0152] In a feasible implementation manner, the above animation generation module 20 is further configured to:

[0153] Determine preset track elements and preset parameter thresholds respectively matched with the plurality of real-time driving parameters;

[0154] Adjust the sound effect parameters of each of the preset track elements based on each of the preset parameter thresholds to generate a plurality of first audio signals respectively matched with the plurality of real-time driving parameters.

[0155] In a feasible implementation manner, the above animation generation module 20 is further configured to:

[0156] Determine first animation effects respectively matched with the plurality of first audio signals based on a preset animation mapping relationship.

[0157] In a feasible implementation manner, the above region screening module 30 is further configured to:

[0158] Determine first display regions respectively matched with the plurality of first animation effects on the first display screen based on a preset screen mapping relationship.

[0159] In a feasible implementation manner, the above animation playing module 40 is further configured to:

[0160] Obtain the steering wheel rotation angle of the vehicle;

[0161] Determine animation movement parameters matching multiple of the first animation effects based on the steering wheel rotation angle;

[0162] Control the movement of multiple of the first animation effects on the first display screen according to each of the animation movement parameters.

[0163] In a feasible implementation manner, the vehicle further includes an external speaker, and the animation playback module 40 is further configured to:

[0164] Obtain the steering wheel rotation angle of the vehicle;

[0165] Input multiple of the first audio signals into the external speaker and control the external speaker to play multiple of the first audio signals.

[0166] In a feasible implementation manner, the animation playback module 40 is further configured to:

[0167] Obtain the real-time environmental parameters of the vehicle;

[0168] Generate a second audio signal based on the real-time environmental parameters and determine a second animation effect matching the second audio signal;

[0169] Determine a second display area on the first display screen that matches the second animation effect and control the second display area to play the second animation effect;

[0170] Obtain a third audio signal based on the second audio signal and the first audio signal and control the built-in speaker to play the third audio signal.

[0171] In a feasible implementation manner, the animation playback module 40 is further configured to:

[0172] Capture target image data including the driver's face through an image acquisition module in the vehicle;

[0173] Determine the emotional state parameters of the driver according to the target image data and determine a first audio adjustment parameter and a first animation adjustment parameter based on the emotional state parameters;

[0174] Obtain a fourth audio signal based on the first audio adjustment parameter and the first audio signal and play the fourth audio signal through the built-in speaker configured in the vehicle;

[0175] Adjust the first animation effect according to the first animation adjustment parameter to obtain a third animation effect and control each of the first display areas to play its corresponding third animation effect.

[0176] In a feasible implementation, the vehicle further includes a second display screen, and the above-mentioned animation playback module 40 is further configured to:

[0177] Receive an audio adjustment instruction sent by the second display screen;

[0178] Read the second audio adjustment parameter included in the audio adjustment instruction, and determine a second animation adjustment parameter based on the second audio adjustment parameter;

[0179] Obtain a fifth audio signal based on the second audio adjustment parameter and the first audio signal, and play the fifth audio signal through the built-in speaker configured in the vehicle;

[0180] Adjust the first animation effect according to the second animation adjustment parameter to obtain a fourth animation effect, and control each of the first display areas to play their respective corresponding fourth animation effects.

[0181] The audio visualization device provided by the present application adopts the audio visualization method in the above-mentioned embodiment, and can solve the technical problem that it is difficult for a vehicle to accurately identify the sitting posture of an occupant in the related art. Compared with the prior art, the beneficial effects of the audio visualization device provided by the present application are the same as those of the audio visualization method provided by the above-mentioned embodiment, and other technical features in the audio visualization device are the same as those disclosed in the method of the above-mentioned embodiment, and will not be elaborated here.

[0182] The present application provides a vehicle, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the audio visualization method in the first embodiment above.

[0183] Next, refer to Figure 10 , which shows a schematic structural diagram of a vehicle suitable for implementing the embodiments of the present application. The vehicle in the embodiments of the present application may include, but is not limited to, a vehicle internally configured with a camera, a built-in speaker, an external speaker, a plurality of display screens, or a mobile terminal, a data storage control terminal, a PC, etc. terminals connected to the electronic control unit supporting the vehicle. Figure 10 The vehicle shown is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present application.

[0184] As Figure 10As shown, the vehicle may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in the read-only memory 1002 or a program loaded from the storage device 1003 into the random access memory 1004. In the random access memory 1004, various programs and data required for vehicle operation are also stored. The processing device 1001, the read-only memory 1002, and the random access memory 1004 are connected to each other through a bus 1005. The input / output interface 1006 is also connected to the bus. Generally, the following systems may be connected to the input / output interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the vehicle to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows a vehicle having various systems, it should be understood that it is not required to implement or have all the shown systems. More or fewer systems may be implemented or had alternatively.

[0185] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device, or installed from the storage device 1003, or installed from the read-only memory 1002. When the computer program is executed by the processing device 1001, the above functions defined in the methods of the embodiments disclosed in the present application are executed.

[0186] The vehicle provided by the present application adopts the audio-visualization method in the above embodiments, and can solve the technical problem that the driver in the related art cannot intuitively feel the change of the vehicle driving state. Compared with the prior art, the beneficial effects of the vehicle provided by the present application are the same as those of the audio-visualization method provided by the above embodiments, and the other technical features in this vehicle are the same as those disclosed in the method of the previous embodiment, and will not be elaborated here.

[0187] It should be understood that the various parts disclosed in the present application may be implemented by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in a suitable manner in any one or more embodiments or examples.

[0188] As described above, it is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should all be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims described above.

[0189] The present application provides a computer-readable storage medium having computer-readable program instructions (i.e., computer programs) stored thereon, and the computer-readable program instructions are used to execute the audio visualization method in the above embodiments.

[0190] The computer-readable storage medium provided by the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0191] The above computer-readable storage medium may be included in a vehicle; or it may exist separately and not be assembled into a vehicle.

[0192] The above computer-readable storage medium carries one or more programs. When the one or more programs are executed by a vehicle, the vehicle is caused to: obtain a plurality of real-time driving parameters of the vehicle; generate a plurality of first audio signals based on the plurality of real-time driving parameters, and determine first animation effects respectively matched with the plurality of first audio signals; determine first display areas respectively matched with the plurality of first animation effects on the first display screen, and control each of the first display areas to play the corresponding first animation effect.

[0193] Computer program code for performing the operations of this application can be written in one or more programming languages or combinations thereof. The above-mentioned programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN: Local Area Network) or a wide area network (WAN: Wide Area Network), or it can be connected to an external computer (for example, by connecting through an Internet service provider using the Internet).

[0194] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and this module, program segment, or part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutively represented blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0195] The modules described in the embodiments of this application can be implemented in software or in hardware. Among them, the name of the module does not constitute a limitation to the unit itself in some cases.

[0196] The readable storage medium provided by this application is a computer-readable storage medium, and the computer-readable storage medium stores computer-readable program instructions (i.e., computer programs) for performing the above-mentioned audio visualization method, which can solve the technical problem that drivers in the related art cannot intuitively feel the changes in the vehicle driving state. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by this application are the same as those of the audio visualization method provided in the above embodiments, and will not be elaborated here.

[0197] The present application also provides a computer program product, including a computer program which, when executed by a processor, implements the steps of the audio visualization method as described above.

[0198] The computer program product provided by the present application can solve the technical problem that in the related art, the driver cannot intuitively feel the change of the vehicle driving state. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as those of the audio visualization method provided in the above embodiments, and will not be elaborated here.

[0199] The above are only some embodiments of the present application, and thus do not limit the patent scope of the present application. Any equivalent structural transformation made under the technical concept of the present application by using the content of the specification and drawings of the present application, or direct / indirect application in other related technical fields, is included in the patent protection scope of the present application.

Claims

1. An audio visualization method, characterized in that: The audio visualization method is applied to a vehicle, wherein the vehicle comprises a first display screen and a speaker, and the method comprises: Acquiring multiple real-time driving parameters of the vehicle; Determine preset audio track elements and preset parameter thresholds that match each of the plurality of real-time driving parameters, wherein the preset audio track element is an audio track element pre-stored in an audio track database and bound to a certain driving parameter, and the preset parameter threshold is a critical driving parameter that triggers an audio adjustment operation corresponding to the preset audio track element; Adjusting the sound effect parameters of each of the preset audio track elements based on each of the preset parameter thresholds to generate a plurality of first audio signals that respectively match the real-time driving parameters, and determining a first animation effect that respectively matches the plurality of first audio signals; Determine a first display area on the first display screen to which each of the plurality of first animation effects matches; The speaker is controlled to play the first audio signal, and each of the first display areas is controlled to play a first animation effect corresponding to the first display area.

2. The audio visualization method according to claim 1, characterized in that: The step of determining first animation effects that match each of the plurality of first audio signals comprises: Based on a preset animation mapping relationship, first animation effects that match each of the plurality of first audio signals are determined.

3. The audio visualization method according to claim 2, characterized in that: The step of determining a first display area on the first display screen to which each of the plurality of first animation effects matches includes: Based on a preset screen mapping relationship, first display areas matching each of the plurality of first animation effects on the first display screen are determined.

4. The audio visualization method according to claim 1, characterized in that: After the step of controlling each of the first display areas to play the first animation effects corresponding to each of the first display areas, the method further includes: Obtaining a steering wheel rotation angle of the vehicle; Determining a plurality of animation movement parameters matching the first animation effect based on the steering wheel rotation angle; The plurality of first animation effects are controlled to move on the first display screen according to the animation movement parameters.

5. The audio visualization method according to claim 1, characterized in that: The vehicle further includes an external speaker. After the step of controlling each of the first display areas to play the first animation effects corresponding to each other, the method further includes: Input the plurality of the first audio signals to the external speaker, and control the external speaker to play the plurality of the first audio signals.

6. The audio visualization method according to any one of claims 1 to 5, characterized in that: After the step of controlling each of the first display areas to play the first animation effects corresponding to each of the first display areas, the method further includes: Acquiring real-time environmental parameters of the vehicle; Generate a second audio signal based on the real-time environmental parameter, and determine a second animation effect matched by the second audio signal; Determine a second display area on the first display screen that matches the second animation effect, and control the second display area to play the second animation effect; A third audio signal is obtained based on the second audio signal and the first audio signal, and the built-in speaker is controlled to play the third audio signal.

7. The audio visualization method according to any one of claims 1 to 5, characterized in that: After the step of controlling each of the first display areas to play the first animation effects corresponding to each of the first display areas, the method further includes: Capturing target image data including the driver's face by an image acquisition module in the vehicle; determining an emotional state parameter of the driver according to the target image data, and determining a first audio adjustment parameter and a first animation adjustment parameter based on the emotional state parameter; obtaining a fourth audio signal based on the first audio adjustment parameter and the first audio signal, and playing the fourth audio signal through a built-in speaker configured in the vehicle; The first animation effect is adjusted according to the first animation adjustment parameter to obtain a third animation effect, and each of the first display areas is controlled to play the third animation effect corresponding to the first animation effect.

8. The audio visualization method according to any one of claims 1 to 5, characterized in that: The vehicle further includes a second display screen. After the step of controlling each of the first display areas to play the first animation effects corresponding to each other, the method further includes: receiving an audio adjustment instruction sent by the second display screen; Reading a second audio adjustment parameter included in the audio adjustment instruction, and determining a second animation adjustment parameter based on the second audio adjustment parameter; obtaining a fifth audio signal based on the second audio adjustment parameter and the first audio signal, and playing the fifth audio signal through a built-in speaker configured in the vehicle; The first animation effect is adjusted according to the second animation adjustment parameter to obtain a fourth animation effect, and each of the first display areas is controlled to play the fourth animation effect corresponding to the first display area.

9. A vehicle, characterized in that: The vehicle comprises: a plurality of display screens, a plurality of speakers, an image acquisition module, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the audio visualization method as described in any one of claims 1 to 8.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the audio visualization method according to any one of claims 1 to 8 are implemented.

11. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the audio visualization method according to any one of claims 1 to 8 are implemented.

Images