Method for making music file based on vehicle body control and user behaviors

Abstract

The invention relates to the technical field of vehicle-mounted information entertainment systems, in particular to a method for making music files based on vehicle body control and user behaviors. Data are converted into music through a music making algorithm, brand new music experience is provided for a user, each journey can be converted into a personalized music work, data safety is protected through encryption processing, and the user experience is improved. Meanwhile, the generated music file can be played in the vehicle-mounted information entertainment system or uploaded to a cloud service platform, permanent storage and cross-device access of data are achieved, and the problem that in the prior art, music files cannot be dynamically generated based on vehicle body control and user behavior data, and the user experience is poor is solved. And the requirement of people on personalized experience is difficult to meet.

Description

Technical Field

[0001] The present invention relates to the technical field of in-vehicle infotainment systems, and in particular to a method for producing music files based on vehicle body control and user behavior. Background Art

[0002] The in-vehicle infotainment system, as a symbolic component of modern cars, is based on a dedicated in-vehicle central processor, and builds a highly integrated in-vehicle comprehensive information processing platform based on the body bus system and Internet services. This system not only integrates basic functions required for daily driving such as navigation, music playback, and communication, but also strives to bring unprecedented driving experience to drivers and passengers through technological innovation, making every trip full of fun and convenience;

[0003] However, existing in-vehicle infotainment systems mainly focus on basic functions such as navigation, music playback and communication; however, the two valuable information resources, body control data and user behavior data, have not been fully and deeply mined and utilized.

[0004] In summary, in the prior art, it is impossible to dynamically generate music files based on vehicle body control and user behavior data, which makes it difficult to meet people's needs for personalized experience. Summary of the invention

[0005] The purpose of the present invention is to provide a method for producing music files based on vehicle body control and user behavior, aiming to solve the technical problem in the prior art that music files cannot be dynamically generated based on vehicle body control and user behavior data, making it difficult to meet people's needs for personalized experience.

[0006] To achieve the above object, the present invention adopts a method for producing music files based on vehicle body control and user behavior, comprising the following steps:

[0007] Step 1: Based on vehicle-mounted sensors and user behavior monitoring equipment, real-time collection of vehicle body control data and user behavior data;

[0008] Step 2: Use the AES-256 encryption algorithm to encrypt the collected data and transmit it to the in-vehicle infotainment system for pre-processing;

[0009] Step 3: Map the pitch, rhythm, volume and timbre of the preprocessed data;

[0010] Step 4: Generate the corresponding music score according to the mapping result, and convert the music score into a regular audio format to obtain a music file;

[0011] Step 5: storing the obtained music file in the local in-vehicle infotainment system;

[0012] Step 6: At the same time, an authorization instruction is issued based on the in-vehicle infotainment system. If the user authorizes, the vehicle body data, user behavior data, and music files can be uploaded to the cloud server. If the user does not authorize, the upload will not be performed.

[0013] Among them, in step one:

[0014] The collected body control data includes vehicle speed, acceleration, steering angle, and braking force;

[0015] The collected user behavior data includes touch operation frequency, facial expression changes, and voice commands.

[0016] Among them, in step 2, the specific method of using the AES-256 encryption algorithm to encrypt the collected data and transmit it to the in-vehicle infotainment system for preprocessing is:

[0017] Generate a 256-bit key using a secure random number generator and store the key in a secure storage area of ​​the vehicle infotainment system;

[0018] The body control data and user behavior data are then converted into a byte sequence, and the byte sequence is encrypted using the AES-256 encryption algorithm to generate ciphertext;

[0019] When the ciphertext is transmitted to the pre-processing module of the in-vehicle infotainment system, the currently valid key is obtained from the secure storage area of ​​the in-vehicle infotainment system, and then the byte sequence is decrypted using the AES-256 decryption algorithm to restore it to the original data;

[0020] Finally, the preprocessing module of the in-vehicle infotainment system can preprocess the data.

[0021] Among them, the secure storage area of ​​the in-vehicle infotainment system is TPM or hardware security module.

[0022] Among them, the specific way in which the preprocessing module of the in-vehicle infotainment system preprocesses the data is as follows:

[0023] Normalize the body control data so that its value is within a specific range;

[0024] Categorize and encode user behavior data.

[0025] Wherein, in step 3, the pre-processed data is mapped with respect to pitch, rhythm, volume and timbre, including pitch mapping, rhythm mapping, volume mapping and timbre mapping;

[0026] Among them, pitch mapping: adjust the pitch according to the change of vehicle speed. The faster the speed, the higher the pitch. Linear or nonlinear function is used for mapping.

[0027] Rhythm mapping: adjust the rhythm according to the frequency of user touch operations. The more frequent the operation, the faster the rhythm. The weighted average method is used to calculate the rhythm value.

[0028] Volume mapping: adjust the volume according to the braking and acceleration status. The volume decreases when braking and increases when accelerating. The mapping is performed using a step function.

[0029] Tone mapping: Select different timbres or instrument sounds based on changes in the user's facial expressions, and use a classification algorithm for mapping.

[0030] The classification algorithm used for timbre mapping is, for example, a decision tree or a support vector machine.

[0031] Among them, according to the mapping result, the corresponding music score is generated, and the specific method of converting the music score into a conventional audio format to obtain a music file is as follows:

[0032] According to the timestamp or sampling rate of the data, the timeline is divided into a series of time points. At each time point, the corresponding notes are generated according to the mapping results, and the generated notes are encoded into a music score format (such as MIDI, MusicXML, etc.). Then, the audio synthesis library (such as PortAudio, FMOD, etc.) is used to convert the music score into audio data. Finally, the audio data is converted into a common audio format (such as WAV, MP3, etc.).

[0033] The specific method of storing the obtained music file in the local in-vehicle infotainment system is as follows:

[0034] Intelligently classify the generated music files based on cluster analysis (such as K-means), decision trees or support vector machines;

[0035] The music file is then compressed using a compression algorithm (such as MP3, AAC, etc.);

[0036] A hash algorithm is then used to generate a unique identifier for each music file, which is then encrypted and stored in the local in-vehicle infotainment system.

[0037] Among them, based on the authorization instruction issued by the in-vehicle infotainment system, if the user authorizes, the vehicle body data, user behavior data, and music files can be uploaded to the cloud server. If the user does not authorize, the upload will not be performed. The specific method is as follows:

[0038] The in-vehicle infotainment system sends an authorization request to the user;

[0039] The user confirms whether to authorize the upload through the in-vehicle infotainment system interface or voice command;

[0040] If the user chooses to authorize, the system will record this decision and prepare to upload the data; if the user chooses not to authorize, no subsequent operations will be performed;

[0041] When the user authorizes, the in-vehicle infotainment system will generate an authorization instruction containing the user's authorization information. After generating and encrypting the authorization instruction, the in-vehicle infotainment system will prepare the data to be uploaded, establish a connection with the cloud server, complete the upload, and perform encrypted storage.

[0042] The method for producing music files based on vehicle body control and user behavior of the present invention, when used specifically, firstly collects vehicle body control data and user behavior data in real time based on vehicle-mounted sensors and user behavior monitoring equipment, then encrypts the collected data using an AES-256 encryption algorithm and transmits the data to an in-vehicle infotainment system for preprocessing, and then maps the pitch, rhythm, volume and timbre of the preprocessed data; and generates corresponding music scores according to the mapping results, and converts the music scores into a conventional audio format to obtain a music file, and stores the obtained music file in a local in-vehicle infotainment system; at the same time, an authorization instruction is issued based on the in-vehicle infotainment system, and if the user authorizes, the vehicle body data, user behavior data and music files can be uploaded to a cloud server, and if the user does not authorize, the upload is not performed, in this way, data security is protected by encryption processing, and at the same time, the data is converted into music using a music production algorithm, providing users with a personalized music experience, providing users with a brand-new music experience, so that each journey can be converted into a personalized music work, and the technical problem that it is impossible to dynamically generate music files based on vehicle body control and user behavior data in the prior art, resulting in difficulty in meeting people's demand for personalized experience, is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1 It is a flow chart of the steps of the method for making music files based on vehicle body control and user behavior of the present invention. DETAILED DESCRIPTION

[0045] Embodiments of the present invention are described in detail below. Examples of the embodiments are shown in the accompanying drawings. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, but should not be construed as limiting the present invention.

[0046] See also Figure 1 , Figure 1 It is a flow chart of the steps of the method for making music files based on vehicle body control and user behavior of the present invention.

[0047] The present invention provides a method for producing music files based on vehicle body control and user behavior, comprising the following steps:

[0048] S101, based on vehicle-mounted sensors and user behavior monitoring equipment, collect vehicle body control data and user behavior data in real time;

[0049] For this specific implementation, the collected vehicle body control data includes vehicle speed, acceleration, steering angle, and braking force;

[0050] The collected user behavior data includes touch operation frequency, facial expression changes, and voice commands.

[0051] S102, encrypting the collected data using an AES-256 encryption algorithm and transmitting the data to the in-vehicle infotainment system for pre-processing;

[0052] For this specific implementation, a 256-bit key is generated using a secure random number generator and the key is stored in a secure storage area of ​​the in-vehicle infotainment system;

[0053] The body control data and user behavior data are then converted into a byte sequence, and the byte sequence is encrypted using the AES-256 encryption algorithm to generate ciphertext;

[0054] When the ciphertext is transmitted to the pre-processing module of the in-vehicle infotainment system, the currently valid key is obtained from the secure storage area of ​​the in-vehicle infotainment system, and then the byte sequence is decrypted using the AES-256 decryption algorithm to restore it to the original data;

[0055] Finally, the preprocessing module of the in-vehicle infotainment system can preprocess the data;

[0056] The secure storage area of ​​the in-vehicle infotainment system is the TPM or hardware security module.

[0057] The specific way in which the preprocessing module of the in-vehicle infotainment system preprocesses data is as follows:

[0058] Normalize the body control data so that its value is within a specific range;

[0059] Categorize and encode user behavior data.

[0060] S103, mapping the pre-processed data to pitch, rhythm, volume and timbre;

[0061] According to this specific implementation, the preprocessed data is mapped with respect to pitch, rhythm, volume and timbre, including pitch mapping, rhythm mapping, volume mapping and timbre mapping;

[0062] Among them, pitch mapping: adjust the pitch according to the change of vehicle speed. The faster the speed, the higher the pitch. Linear or nonlinear function is used for mapping.

[0063] Rhythm mapping: adjust the rhythm according to the frequency of user touch operations. The more frequent the operation, the faster the rhythm. The weighted average method is used to calculate the rhythm value.

[0064] Volume mapping: adjust the volume according to the braking and acceleration status. The volume decreases when braking and increases when accelerating. The mapping is performed using a step function.

[0065] Tone mapping: Select different timbres or instrument sounds based on changes in the user's facial expressions, and use a classification algorithm for mapping.

[0066] The classification algorithm used for timbre mapping is, for example, a decision tree or a support vector machine.

[0067] S104, generating corresponding music scores according to the mapping results, and converting the music scores into a conventional audio format to obtain a music file;

[0068] For this specific implementation, the time axis is divided into a series of time points according to the timestamp or sampling rate of the data. At each time point, the corresponding notes are generated according to the mapping results, and the generated notes are encoded into a music score format (such as MIDI, MusicXML, etc.), and then the music score is converted into audio data using an audio synthesis library (such as PortAudio, FMOD, etc.), and finally the audio data is converted into a common audio format (such as WAV, MP3, etc.);

[0069] At the same time, when generating music scores, machine learning models such as generative adversarial networks (GAN) or long short-term memory networks (LSTM) are used to generate fragments similar to real music based on learning existing music works, simulate various styles of music, and generate new music structures and forms.

[0070] S105, storing the obtained music file in the local in-vehicle infotainment system;

[0071] For this specific implementation, the generated music files are intelligently classified based on cluster analysis (such as K-means), decision trees or support vector machines;

[0072] The music file is then compressed using a compression algorithm (such as MP3, AAC, etc.);

[0073] A hash algorithm is then used to generate a unique identifier for each music file, which is then encrypted and stored in the local in-vehicle infotainment system.

[0074] S106. At the same time, an authorization instruction is issued based on the in-vehicle infotainment system. If the user authorizes, the vehicle body data, user behavior data, and music files can be uploaded to the cloud server. If the user does not authorize, the upload will not be performed.

[0075] For this specific implementation, the in-vehicle infotainment system sends an authorization request to the user;

[0076] The user confirms whether to authorize the upload through the in-vehicle infotainment system interface or voice command;

[0077] If the user chooses to authorize, the system will record this decision and prepare to upload the data; if the user chooses not to authorize, no subsequent operations will be performed;

[0078] When the user authorizes, the in-vehicle infotainment system will generate an authorization instruction containing the user's authorization information. After generating and encrypting the authorization instruction, the in-vehicle infotainment system will prepare the data to be uploaded, establish a connection with the cloud server, complete the upload, and perform encrypted storage.

[0079] At the same time, after receiving the uploaded data packet, the cloud server will store it in the designated storage area. At the same time, the cloud server will also manage and maintain the data, including data backup, recovery, security audit, etc.

[0080] In order to ensure data security, the cloud server will implement strict access control policies. Only authorized users or systems can access or operate data stored on the cloud server. By binding user accounts, encrypted information and music files can be permanently stored and easily retrieved.

[0081] Finally, after the data is uploaded and stored, the in-vehicle infotainment system will send a notification to the user to inform them that the data has been successfully uploaded to the cloud server. At the same time, the system can also provide a feedback mechanism to allow users to view the uploaded data and status.

[0082] A method for producing music files based on vehicle body control and user behavior of the present invention is used. When it is used specifically, vehicle body control data and user behavior data are first collected in real time based on vehicle-mounted sensors and user behavior monitoring equipment. Then, the collected data is encrypted using the AES-256 encryption algorithm and transmitted to the vehicle-mounted infotainment system for preprocessing. Then, the preprocessed data is mapped in terms of pitch, rhythm, volume and timbre. According to the mapping result, a corresponding music score is generated, and the music score is converted into a conventional audio format to obtain a music file, and the obtained music file is stored in the local vehicle-mounted infotainment system. At the same time, an authorization instruction is issued based on the vehicle-mounted infotainment system. If the user authorizes, the vehicle body data, user behavior data and music file can be uploaded to the cloud server. If the user does not authorize, the upload is not performed. In this way, data security is protected by encryption processing. At the same time, the data is converted into music using a music production algorithm to provide users with a personalized music experience. This provides users with a new music experience, so that each journey can be converted into a personalized music work, solving the technical problem that in the prior art, music files cannot be dynamically generated based on vehicle body control and user behavior data, resulting in difficulty in meeting people's demand for personalized experience.

[0083] The present invention can dynamically generate personalized music files according to vehicle body control data and user behavior data, thereby improving user experience.

[0084] The present invention uses the AES-256 encryption algorithm to encrypt data to ensure the security of data during transmission and storage.

[0085] The music files generated by the present invention can be played in the in-vehicle infotainment system or uploaded to the cloud service platform, so as to realize permanent storage of data and cross-device access.

[0086] What is disclosed above is only a preferred embodiment of the present invention, and it certainly cannot be used to limit the scope of rights of the present invention. Ordinary technicians in this field can understand that all or part of the processes of the above embodiment and equivalent changes made according to the claims of the present invention still fall within the scope of the invention.

Claims

1. A method for producing music files based on vehicle body control and user behavior, characterized in that: The following steps are involved: Step 1: Based on vehicle-mounted sensors and user behavior monitoring equipment, collect vehicle body control data and user behavior data in real time; Step 2: Use the AES-256 encryption algorithm to encrypt the collected data and transmit it to the in-vehicle infotainment system for pre-processing; Step 3: Map the pitch, rhythm, volume and timbre of the preprocessed data; Step 4: Generate the corresponding music score according to the mapping result, and convert the music score into a regular audio format to obtain a music file; Step 5: storing the obtained music file in the local in-vehicle infotainment system; Step 6: At the same time, an authorization instruction is issued based on the in-vehicle infotainment system. If the user authorizes, the vehicle body data, user behavior data, and music files can be uploaded to the cloud server. If the user does not authorize, the upload will not be performed.

2. The method for producing music files based on vehicle body control and user behavior as claimed in claim 1, characterized in that: In step one: The collected body control data includes vehicle speed, acceleration, steering angle, and braking force; The collected user behavior data includes touch operation frequency, facial expression changes, and voice commands.

3. The method for producing music files based on vehicle body control and user behavior as claimed in claim 2, characterized in that: In step 2, the collected data is encrypted using the AES-256 encryption algorithm and transmitted to the in-vehicle infotainment system for preprocessing. The specific method is as follows: Generate a 256-bit key using a secure random number generator and store the key in a secure storage area of ​​the vehicle infotainment system; The body control data and user behavior data are then converted into a byte sequence, and the byte sequence is encrypted using the AES-256 encryption algorithm to generate ciphertext; When the ciphertext is transmitted to the pre-processing module of the in-vehicle infotainment system, the currently valid key is obtained from the secure storage area of ​​the in-vehicle infotainment system, and then the byte sequence is decrypted using the AES-256 decryption algorithm to restore it to the original data; Finally, the preprocessing module of the in-vehicle infotainment system can preprocess the data.

4. The method for producing music files based on vehicle body control and user behavior as claimed in claim 3, characterized in that: The secure storage area of ​​the in-vehicle infotainment system is the TPM or hardware security module.

5. The method for producing music files based on vehicle body control and user behavior as claimed in claim 4, characterized in that: The specific way in which the preprocessing module of the in-vehicle infotainment system preprocesses data is as follows: Normalize the body control data so that its value is within a specific range; Categorize and encode user behavior data.

6. The method for producing music files based on vehicle body control and user behavior as claimed in claim 5, characterized in that: In step three, the pre-processed data is mapped with respect to pitch, rhythm, volume and timbre, including pitch mapping, rhythm mapping, volume mapping and timbre mapping; Among them, pitch mapping: adjust the pitch according to the change of vehicle speed. The faster the speed, the higher the pitch. Linear or nonlinear function is used for mapping. Rhythm mapping: adjust the rhythm according to the frequency of user touch operations. The more frequent the operation, the faster the rhythm. The weighted average method is used to calculate the rhythm value. Volume mapping: adjust the volume according to the braking and acceleration status. The volume decreases when braking and increases when accelerating. The mapping is performed using a step function. Tone mapping: Select different timbres or instrument sounds based on changes in the user's facial expressions, and use a classification algorithm for mapping.

7. The method for producing music files based on vehicle body control and user behavior as claimed in claim 6, characterized in that: The classification algorithm used for timbre mapping is, for example, a decision tree or a support vector machine.

8. The method for producing music files based on vehicle body control and user behavior as claimed in claim 7, characterized in that: According to the mapping results, the corresponding music score is generated, and the specific method of converting the music score into a conventional audio format to obtain a music file is as follows: According to the timestamp or sampling rate of the data, the timeline is divided into a series of time points. At each time point, the corresponding notes are generated according to the mapping results, and the generated notes are encoded into the music score format. Then the audio synthesis library is used to convert the music score into audio data, and finally the audio data is converted into a common audio format.

9. The method for producing music files based on vehicle body control and user behavior as claimed in claim 8, characterized in that: The specific method of storing the obtained music file in the local in-vehicle infotainment system is as follows: Intelligently classify the generated music files based on cluster analysis, decision tree or support vector machine; The music file is then compressed using a compression algorithm; A hash algorithm is then used to generate a unique identifier for each music file, which is then encrypted and stored in the local in-vehicle infotainment system.

10. The method for producing music files based on vehicle body control and user behavior as claimed in claim 9, characterized in that: Based on the authorization command issued by the in-vehicle infotainment system, if the user authorizes, the vehicle body data, user behavior data, and music files can be uploaded to the cloud server. If the user does not authorize, the upload will not be performed. The specific method is as follows: The in-vehicle infotainment system sends an authorization request to the user; The user confirms whether to authorize the upload through the in-vehicle infotainment system interface or voice command; If the user chooses to authorize, the system will record this decision and prepare to upload the data; if the user chooses not to authorize, no subsequent operations will be performed; When the user authorizes, the in-vehicle infotainment system will generate an authorization instruction containing the user's authorization information. After generating and encrypting the authorization instruction, the in-vehicle infotainment system will prepare the data to be uploaded, establish a connection with the cloud server, complete the upload, and perform encrypted storage.

Images