Vehicle ambient light music beat control method and system

Abstract

A vehicle ambient light music rhythm control method and system. The vehicle ambient light music rhythm control method is suitable for being implemented in a vehicle body control unit, and includes: obtaining a series of feature data of currently played music from a vehicle infotainment system, wherein each feature data corresponds to music data of a first cycle length; periodically determining a corresponding emotional color based on the series of feature data within a second time length; and determining an attribute of a vehicle ambient light based on the emotional color. The vehicle ambient light music rhythm control method and system have the advantages of low implementation cost, good ambient light music rhythm effect, etc.

Description

TECHNICAL FIELD

[0001] The present application relates to automotive electronics, in particular to a vehicle ambient light music rhythm control method, a vehicle body control unit, a method for extracting music feature data, a vehicle information entertainment system and a vehicle ambient light music rhythm control system. BACKGROUND

[0002] In order to improve user experience, more and more vehicles are now equipped with ambient lights. Some ambient lights on vehicles can change with music rhythm, that is, the music rhythm function of the ambient light of the vehicle. For the music rhythm function of the ambient light of the vehicle, the conventional method is: (1) collecting the voltage of the loudspeaker, and sending the collected data to the music rhythm algorithm box for processing through the audio analysis chip or directly, to generate corresponding control instructions and send them to the ambient light; (2) for a specific piece or several pieces of music, ambient light control instructions are designed by artificial means, so that the ambient light controller executes these control instructions to control the ambient light.

[0003] For the first method, it needs a specific music rhythm algorithm box, the implementation cost is high, and such architecture does not meet the trend of vehicle intelligence. In addition, since it collects the voltage of the loudspeaker as the input of the music rhythm control algorithm, it makes the ambient light rhythm and the music rhythm poor in synchronization.

[0004] For the second method, since it designs ambient light control instructions for specific music by artificial means, it has the disadvantages of limited use scene, inflexible function configuration, poor reusability, and cannot dynamically adjust the ambient light rhythm effect according to the type of music. SUMMARY

[0005] The present application solves the problem of providing a vehicle ambient light music rhythm control method, a vehicle body control unit, a method for extracting music feature data, a vehicle information entertainment system and a vehicle ambient light music rhythm control system, which has the advantages of low implementation cost, good ambient light music rhythm effect, etc.

[0006] In order to solve the above problems, one aspect of the present application provides a vehicle ambient light music rhythm control method, which is suitable for implementation in a vehicle body control unit, comprising: obtaining a series of feature data of currently played music from a vehicle information entertainment system, wherein each feature data corresponds to a first period length of music data; periodically determining the corresponding emotional color based on a series of feature data within a second time length; and determining the attribute of the vehicle ambient light based on the emotional color.

[0007] Another aspect of the present application provides a vehicle body control unit, comprising: one or more processors; and a computer readable storage medium having stored thereon a plurality of instructions that, in response to execution by the one or more processors, cause the one or more processors to implement the vehicle ambient light music beat control method as described above.

[0008] Still another aspect of the present application provides a method for extracting music feature data, suitable for implementation in a vehicle infotainment system, comprising: generating an audio waveform from a music file; performing discrete processing and time-frequency transformation on the audio waveform to obtain a series of spectrum data; and determining corresponding feature data based on each of the spectrum data.

[0009] Still another aspect of the present application provides a vehicle infotainment system, comprising: one or more processors; and a computer readable storage medium having stored thereon a plurality of instructions that, in response to execution by the one or more processors, cause the one or more processors to implement the method for extracting music feature data as described above.

[0010] Still another aspect of the present application provides a vehicle ambient light music beat control system, comprising: the vehicle body control unit as described above and the vehicle infotainment system as described above, the vehicle body control unit and the vehicle infotainment system being connected to each other through a vehicle bus.

[0011] Compared with the prior art, the above-mentioned scheme has the following advantages:

[0012] The vehicle ambient light music beat control method of the present application can be integrated in the vehicle body control unit in the form of software, and utilizes the redundant space and computing power of the vehicle body control unit to realize ambient light music beat control without additional hardware, thereby reducing hardware costs. In addition, the vehicle ambient light music beat control method of the present application can determine the properties of the vehicle ambient light in real time according to the played music, and has the advantages of good synchronization of ambient light beat with music beat and good beat effect. BRIEF DESCRIPTION OF DRAWINGS

[0013] Figure 1 A schematic diagram of a vehicle ambient light music beat control system according to one or more embodiments of the present application is illustrated;

[0014] Figure 2 A schematic diagram of a vehicle body control unit according to one or more embodiments of the present application is illustrated;

[0015] Figure 3 A flowchart of a vehicle ambient light music beat control method according to one or more embodiments of the present application is illustrated;

[0016] Figure 4A schematic diagram of an in-vehicle infotainment system according to one or more embodiments of the present application is illustrated;

[0017] Figure 5 A flowchart of a method of extracting music feature data according to one or more embodiments of the present application is illustrated. DETAILED DESCRIPTION

[0018] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. It will be apparent, however, to one skilled in the art that the present application can be practiced without some or all of these specific details. In other instances, well known process steps have not been described in detail in order not to unnecessarily obscure the present application. In addition, it will be appreciated that the present application is not limited in scope to the particular embodiments introduced in this document. On the contrary, it is contemplated that the present application will encompass any and all combinations of features and elements presented in the following detailed description and claims, whether directed to different embodiments or not. Accordingly, the following aspects, features, embodiments and advantages are merely illustrative and are not to be construed as limiting the scope of the application, unless described in the claims.

[0019] Figure 1 A schematic diagram of an in-vehicle ambient light music beat control system according to one or more embodiments of the present application is illustrated. Referring to FIG. 1, the in-vehicle ambient light music beat control system 100 comprises a body control unit 110, an in-vehicle infotainment system 120 and an in-vehicle bus 130. The body control unit 110 and the in-vehicle infotainment system 120 are connected to each other through the in-vehicle bus 130. The in-vehicle bus 130 can comprise one or more of the following buses, for example: an Ethernet bus, a CAN bus, a LIN bus, a FlexRay bus, etc. Based on the feature data 101 determined by the in-vehicle infotainment system 120 according to the music being played, the body control unit 110 is adapted to determine the properties 102 of the in-vehicle ambient light 10 to control the in-vehicle ambient light 10 to beat with the music.

[0020] In one or more embodiments, the in-vehicle ambient light music beat control system 100 can further comprise an in-vehicle ambient light control module 140. The in-vehicle ambient light control module 140 is adapted to receive the properties 102 of the in-vehicle ambient light 10 sent by the body control unit 110, and determine and send the in-vehicle ambient light control signals to the in-vehicle ambient light 10 based on the properties 102 of the in-vehicle ambient light 10. In one or more embodiments, the in-vehicle ambient light control module 140 and the in-vehicle ambient light 10 can be connected through one or more of the LIN bus, the PWM signal line and the Sel signal line. The LIN bus is used for the mutual communication between the in-vehicle ambient light control module 140 and the in-vehicle ambient light 10, the PWM signal line is used for transmitting the PWM signals to control the brightness, color, etc. of the in-vehicle ambient light 10, and the Sel signal line is used for transmitting the selection signals to select which area or areas of the in-vehicle ambient light 10 to control.

[0021] Figure 2 A schematic diagram of a body control unit according to one or more embodiments of the present application is illustrated. Referring to Figure 2 As shown, the body control unit 110 comprises one or more processors 111 and a computer readable storage medium 112. The computer readable storage medium 112 stores a plurality of instructions which can be executed by the processor 111 to implement the in-vehicle ambient light music beat control method to be described below.

[0022] Figure 3 A flowchart of an in-vehicle ambient light music beat control method according to one or more embodiments of the present application is illustrated. Referring to Figure 3 As shown, the in-vehicle ambient light music beat control method 200 comprises the following steps:

[0023] Step 210: obtaining a series of feature data of currently playing music from an in-vehicle infotainment system, wherein each feature data corresponds to a first period length of music data;

[0024] Step 220: periodically determining a corresponding emotional color based on the series of feature data within a second time length;

[0025] Step 230: determining a property of an in-vehicle ambient light based on the emotional color.

[0026] At step 210, the body control unit 110 obtains a series of feature data 101 of currently playing music from the in-vehicle infotainment system 120, wherein each feature data 101 corresponds to a first period length of music data. The feature data 101 can include one or more of an energy value, an amplitude and a frequency. In one or more embodiments, the feature data 101 includes one or more of an energy value, an amplitude and a frequency corresponding to a maximum energy point in an energy spectrum of the music data corresponding to the first period length. The first period length can be, for example, 20 milliseconds.

[0027] At step 220, the body control unit 110 periodically determines a corresponding emotional color based on the series of feature data 101 within a second time length. In one or more embodiments, the step of determining a corresponding emotional color based on the series of feature data 101 within a second time length comprises:

[0028] calculating a feature data average value for the series of feature data within the second time length;

[0029] determining a corresponding emotional color based on the feature data average value by an emotional color determination model.

[0030] In one or more embodiments, the average value of the feature data is calculated using an arithmetic mean or a weighted average. In one or more embodiments, the emotion determination model can be a model trained on a neural network. Specifically, the neural network can be trained using a large amount of manually labeled music data (average value of the feature data) as a training set. The trained model can output the corresponding emotion based on the average value of the feature data as input. In one or more embodiments, the emotion includes one or more of the following: joy, anger, sadness, fear, disgust, surprise, and envy.

[0031] In step 230, the vehicle body control unit 110 determines the attributes of the in-vehicle ambient lighting based on emotional color. In one or more embodiments, the emotional color is input to an ambient lighting music rhythm model, which determines the attributes 102 of the in-vehicle ambient lighting based on the emotional color. The ambient lighting music rhythm model may, for example, be a model trained by a neural network. In other embodiments, the ambient lighting music rhythm model may, for example, be a lookup table mapping emotional color to the attributes of the in-vehicle ambient lighting. In one or more embodiments, the attributes 102 of the in-vehicle ambient lighting include one or more of the following: light position, light color, and light brightness. In one embodiment, when the emotional color is anger, the ambient lighting music rhythm model may output a red light color. In one embodiment, when the emotional color is sadness, the ambient lighting music rhythm model may output a blue light color.

[0032] In one or more embodiments, the body control unit 110 may also obtain information 103 from other vehicle controllers via the vehicle bus 130 to determine the attributes 102 of the vehicle ambient lighting. The information 103 may include, for example, one or more of the following: weather information, rainfall information, user configuration, and vehicle speed information.

[0033] As described above, in the aforementioned embodiments, the in-vehicle ambient lighting music rhythm control method 200 is integrated into the vehicle body control unit (e.g., vehicle domain controller, vehicle high-performance computing unit, traditional vehicle body control unit (BCM, IGC, etc.)) in software form. This allows the use of the redundant space and computing power of the vehicle body control unit to achieve ambient lighting music rhythm control without requiring additional hardware, thus reducing hardware costs. Furthermore, the in-vehicle ambient lighting music rhythm control method 200 in the aforementioned embodiments can determine the attributes of the in-vehicle ambient lighting in real time based on the music being played, offering advantages such as good synchronization between the ambient lighting rhythm and the music beat, and excellent rhythmic effect.

[0034] Figure 4 A schematic diagram illustrating an in-vehicle infotainment system according to one or more embodiments of the present invention is shown. (See reference...) Figure 4As shown, the in-vehicle infotainment system 120 includes one or more processors 121 and a computer-readable storage medium 122. The computer-readable storage medium 122 stores a plurality of instructions that can be executed by the processor 121 to implement the method of extracting music feature data as will be described below.

[0035] Figure 5 A flowchart of the method of extracting music feature data according to one or more embodiments of the present application is illustrated. Referring to FIG. 3, the method of extracting music feature data 300 includes the following steps: Figure 5 As shown, the method of extracting music feature data 300 includes the following steps:

[0036] Step 310: generating an audio waveform according to a music file;

[0037] Step 320: performing discrete processing and time-frequency transformation on the audio waveform to obtain a series of spectral data;

[0038] Step 330: determining corresponding feature data based on each spectral data.

[0039] In step 310, the in-vehicle infotainment system 120 generates an audio waveform according to a music file. The music file may, for example, be a music file stored locally or a music file played online. In one or more embodiments, the in-vehicle infotainment system 120 can convert a music file in MP3 / WMA / ACC / FLAC format or the like into a WAV waveform file to obtain the audio waveform. The sampling frequency of the music file may, for example, be one or more of 22.05 KHz, 44.1 KHz, 48 KHz, etc.

[0040] In step 320, the in-vehicle infotainment system 120 performs discrete processing and time-frequency transformation on the audio waveform to obtain a series of spectral data. In one or more embodiments, the time-frequency transformation on the audio waveform includes a short-time Fourier transform with a first period length as the period. The first period length may, for example, be 20 milliseconds.

[0041] In step 330, the in-vehicle infotainment system 120 determines corresponding feature data based on each spectral data. In one or more embodiments, step 330 includes the following two sub-steps:

[0042] Sub-step one: calculating the power of the spectral data in each equidistant frequency band;

[0043] Sub-step two: determining the feature data based on the maximum energy point in the frequency band with the maximum power.

[0044] In sub-step one, the power can be obtained by squaring and integrating the spectrum data in the equal interval frequency band. In sub-step two, the maximum energy point is found in the frequency band with the maximum power, and the feature data is determined based on the maximum energy point. In this way, the feature data is determined, which can avoid that the noise with large energy is taken as the maximum energy point, and the feature data is determined by the noise, so as to ensure the accuracy of the feature data. In one or more embodiments, the feature data can include one or more of the energy value, the amplitude and the frequency.

[0045] Although the present application has been disclosed with reference to preferred embodiments, it is to be understood that various other adaptations and modifications are to be contemplated within the spirit and scope of the application. Therefore, it is intended that the true scope of the application be defined only by the scope of the claims.

Claims

1. A vehicle ambient light music beat control method, adapted to be implemented in a body control unit, characterized in that, The method comprises: obtaining a series of feature data of currently playing music from an in-vehicle infotainment system, wherein each of the feature data corresponds to a first period length of music data, and each of the feature data comprises one or more of an energy value, an amplitude, and a frequency corresponding to a maximum energy point in an energy spectrum of the music data corresponding to the first period length; periodically calculating a feature data average value of a series of the feature data within a second time length; determining a corresponding emotional color based on the feature data average value through an emotional color determination model; and inputting the emotional color into an ambient light music rhythm model, which determines an attribute of the in-vehicle ambient light based on the emotional color and one or more information, wherein the one or more information is weather information, rainfall information, user configuration, and vehicle speed information.

2. The vehicle ambient light music beat control method of claim 1, wherein, The feature data average value is calculated through arithmetic average or weighted average.

3. The method of claim 1, wherein the music beat is determined by using a beat detection algorithm. The emotional color comprises one or more of joy, anger, sadness, fear, disgust, surprise, and admiration.

4. The method of claim 1, wherein the music beat is determined by using a beat detection algorithm. The attribute of the in-vehicle ambient light comprises one or more of light position, light color, and light brightness.

5. A body control unit, characterized by The method comprises: one or more processors; and a computer readable storage medium having stored thereon a plurality of instructions that, in response to execution by the one or more processors, cause the one or more processors to implement the in-vehicle ambient light music rhythm control method according to any one of claims 1 to 4. The method comprises:

6. A vehicle-mounted atmosphere lamp music rhythm control system, characterized in that, The vehicle body control unit and the in-vehicle infotainment system are connected to each other through a vehicle bus; The in-vehicle infotainment system comprises: one or more processors; and a computer readable storage medium having stored thereon a plurality of instructions that, in response to execution by the one or more processors, cause the one or more processors to implement the method for extracting music feature data; The method for extracting music feature data comprises: generating an audio waveform according to a music file; performing discrete processing and time-frequency transformation on the audio waveform to obtain a series of spectrum data; and determining corresponding feature data based on each of the spectrum data. The method further comprises an in-vehicle ambient light control module adapted to receive the attribute of the in-vehicle ambient light sent by the vehicle body control unit, and determine and send an in-vehicle ambient light control signal to the in-vehicle ambient light based on the attribute of the in-vehicle ambient light.

7. The vehicle ambient lighting music beat control system of claim 6, wherein, The vehicle body control unit further obtains one or more of weather information, rainfall information, user configuration, and vehicle speed information through the vehicle bus.

8. The vehicle ambient lighting music beat control system of claim 6, wherein, ​

Images