Bluetooth audio processing method and processing device
By detecting the connection between car audio equipment and Bluetooth equipment, and using machine learning models to dynamically optimize sound effects parameters, the problem of users in the existing technology that frequently manually adjust sound effects is solved, and the audio experience and security of the automotive system are improved.
Patent Information
- Application Number
- CN202411563856.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-05
- Publication Date
- 2024-12-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
During the Bluetooth music playback in existing automotive systems, users need to frequently manually adjust the sound effects, resulting in inappropriate volume or sudden changes, affecting the user experience and possibly causing traffic accidents.
By detecting the connection between car audio equipment and Bluetooth equipment, obtaining identification information, extracting and adjusting sound effect parameters, and dynamically optimizing sound effects based on driving speed and in-car noise to achieve automatic adjustment.
It improves the user's audio experience and driving safety, reduces the need for manual adjustment, and ensures the best sound effect in different driving scenarios.
Smart Images

Figure CN119094957A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of Bluetooth audio technology, and in particular to a Bluetooth audio processing method and a processing device. Background Art
[0002] At present, the most commonly used entertainment function in car systems is Bluetooth music playback. Among them, car audio equipment is usually set up in the car cab so that the best sound effect can be obtained in the car cab. After the user turns on the car audio equipment, the system defaults to the sound effect setting value saved last time. However, the audio data output by different mobile phones is different, which makes the system unable to automatically obtain the best car Bluetooth playback sound effect according to user needs. In addition, the sound effect adjustment operation is always inevitable during Bluetooth music playback. A common scenario in life is that users manually adjust the sound effect through the mobile phone connected to the car Bluetooth or the car interface, but when adjusting, there will be problems such as low volume or sudden change of volume, which cannot meet the user's use needs and reduce the user experience. If the user adjusts it while driving, it is more likely to cause a traffic accident. Summary of the invention
[0003] The main purpose of this application is to provide a Bluetooth audio processing method and a processing device, aiming to achieve dynamic adjustment of the sound effects of vehicle-mounted audio equipment.
[0004] To achieve the above object, the present application proposes a Bluetooth audio processing method, the method comprising: In response to detecting that the vehicle audio device and the Bluetooth device establish a connection, acquiring identification information of the Bluetooth device; Extracting a first sound effect parameter value in the vehicle audio device based on the identification information; Acquire first data of the vehicle terminal to which the vehicle audio device belongs to adjust the first sound effect parameter value to obtain a second sound effect parameter value; Adjusting the sound effect currently being played by the in-vehicle audio device based on the second sound effect parameter value; The first data of the target vehicle, as well as the second sound effect parameter value and the user-defined sound effect parameter value corresponding to the first data of the target vehicle are acquired in real time. In response to detecting that the absolute value of the difference between the user-defined sound effect parameter value and the second sound effect parameter value is not within a first preset range, the user-defined sound effect parameter value is determined as the second sound effect parameter value of the target vehicle.
[0005] In one embodiment, before the step of extracting the first sound effect parameter value in the vehicle audio device based on the identification information, the method further includes: It is determined whether the vehicle audio device and the Bluetooth device are connected for the first time according to the identification information of the Bluetooth device.
[0006] In one embodiment, the step of determining whether the vehicle audio device and the Bluetooth device are connected for the first time according to the identification information of the Bluetooth device includes: Query and match the identification information of the Bluetooth device with the Bluetooth device data in the database of the in-vehicle audio device; If the matching is successful, it is determined that the vehicle audio device and the Bluetooth device are not connected for the first time; if the matching is unsuccessful, it is determined that the vehicle audio device and the Bluetooth device are connected for the first time.
[0007] In one embodiment, the step of extracting the first sound effect parameter value in the vehicle audio device based on the identification information includes: If the vehicle audio device and the Bluetooth device are not connected for the first time, obtaining a historical sound effect parameter value corresponding to the Bluetooth device when the vehicle audio device and the Bluetooth device were last disconnected and stored in the vehicle audio device, and determining the historical sound effect parameter value as the first sound effect parameter value; If the vehicle audio device and the Bluetooth device are connected for the first time, the recommended sound effect parameter value corresponding to the Bluetooth device is obtained from the sound effect parameter information stored in the vehicle audio device according to the identification information of the Bluetooth device, and the recommended sound effect parameter value is determined as the first sound effect parameter value.
[0008] In one embodiment, the first data includes at least one of the following: a driving speed of the target vehicle and an in-vehicle sound signal, and the step of obtaining the first data of the in-vehicle terminal to which the in-vehicle audio device belongs to adjust the first sound effect parameter value to obtain the second sound effect parameter value includes: Inputting the driving speed of the target vehicle and the in-vehicle sound signal into a machine learning model; The machine learning model outputs a sound effect parameter adjustment value according to the driving speed and the in-vehicle sound signal; The first sound effect parameter value is dynamically adjusted according to the sound effect parameter adjustment value to generate the second sound effect parameter value.
[0009] In one embodiment, the machine learning model is established using the following steps: Acquiring the driving speed of the target vehicle and the in-vehicle sound signal, wherein the in-vehicle sound signal includes a music signal and environmental noise; Extracting features of the music signal and the ambient noise to obtain sound features; Label the sound effect parameters for each set of speed and noise feature data to generate a training data set; Inputting the training data set into a convolutional neural network to extract spatial features; The spatial features are input into a multi-output regression model for training to obtain the machine learning model.
[0010] In one embodiment, the feature extraction of the music signal and the ambient noise is specifically performed as follows: The sound signal is converted into the frequency domain through short-time Fourier transform to obtain the spectrum of the sound signal; According to the spectrum graph, the Mel scale is applied to perform frequency mapping to obtain the spectrum data; The spectrum data is logarithmically compressed and Mel-frequency cepstral coefficients are generated by discrete cosine transformation.
[0011] In addition, to achieve the above purpose, the present application also proposes a Bluetooth audio processing device, including: an identification information acquisition module, configured to acquire identification information of the Bluetooth device in response to detecting that the vehicle audio device and the Bluetooth device have established a connection; A first sound effect parameter value acquisition module, used to extract a first sound effect parameter value in the vehicle audio device based on the identification information; A second sound effect parameter value acquisition module, used for acquiring first data of the vehicle terminal to which the vehicle audio device belongs to adjust the first sound effect parameter value to obtain a second sound effect parameter value; An adjustment module is used to adjust the sound effect currently played by the in-vehicle audio device based on the second sound effect parameter value.
[0012] The Bluetooth audio processing method proposed in the present application obtains the identification information of the Bluetooth device in response to detecting that a connection is established between the in-vehicle audio device and the Bluetooth device; extracts the first sound effect parameter value in the in-vehicle audio device based on the identification information; obtains the first data of the in-vehicle terminal to which the in-vehicle audio device belongs to adjust the first sound effect parameter value to obtain the second sound effect parameter value; and adjusts the sound effect currently being played by the in-vehicle audio device based on the second sound effect parameter value. The present application dynamically optimizes and adjusts the sound effect of the in-vehicle audio device through intelligent means, and the user does not need to manually adjust the in-vehicle audio settings frequently, freeing their hands, thereby improving the audio experience and driving safety of the vehicle drivers and passengers. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0014] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0015] Figure 1 A flowchart of an embodiment of a Bluetooth audio processing method provided in this application; Figure 2 A flowchart diagram of another embodiment of the Bluetooth audio processing method of the present application; Figure 3 A schematic diagram of a sub-flow chart of step S010 provided in another embodiment of the Bluetooth audio processing method of the present application; Figure 4 A schematic diagram of a sub-flow chart of step S200 provided in an embodiment of the Bluetooth audio processing method of the present application; Figure 5 A schematic diagram of a sub-flow chart of step S300 provided in an embodiment of the Bluetooth audio processing method of the present application; Figure 6 A schematic diagram of a sub-flow chart of step S310 provided in an embodiment of the Bluetooth audio processing method of the present application; Figure 7 A schematic diagram of a sub-flow chart of step S312 provided in an embodiment of the Bluetooth audio processing method of the present application; Figure 8 A schematic diagram of a sub-flow chart of step S500 provided in an embodiment of the Bluetooth audio processing method of the present application; Fig. 9 A structural diagram of an embodiment of an automatic adjustment device for audio equipment provided in the present application.
[0016] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0017] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0018] It should be noted that all directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.
[0019] In addition, the descriptions of "first", "second", etc. in the present invention are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.
[0020] At present, the most commonly used entertainment function in car systems is Bluetooth music playback. Among them, car audio equipment is usually set up in the car cab so that the best sound effect can be obtained in the car cab. After the user turns on the car audio equipment, the system defaults to the sound effect setting value saved last time. However, the audio data output by different mobile phones is different, which makes the system unable to automatically obtain the best car Bluetooth playback sound effect according to user needs. In addition, the sound effect adjustment operation is always inevitable during Bluetooth music playback. A common scenario in life is that users manually adjust the sound effect through the mobile phone connected to the car Bluetooth or the car interface, but when adjusting, there will be problems such as low volume or sudden change of volume, which cannot meet the user's use needs and reduce the user experience. If the user adjusts it while driving, it is more likely to cause a traffic accident.
[0021] To solve the above problems, the present invention proposes a method and a device for processing Bluetooth audio, which are mainly intended to achieve dynamic adjustment of the sound effects of vehicle-mounted audio equipment.
[0022] Please refer to Figure 1 , Figure 1 This is a flowchart of an embodiment of a Bluetooth audio processing method of the present application. The Bluetooth audio processing method proposed in the present application includes steps S100 to S400, wherein: Step S100, in response to detecting that the vehicle audio device and the Bluetooth device are connected, obtaining identification information of the Bluetooth device; Step S200, extracting a first sound effect parameter value in the vehicle audio device based on the identification information; Step S300, obtaining first data of the vehicle terminal to which the vehicle audio device belongs to adjust the first sound effect parameter value to obtain a second sound effect parameter value; Step S400: adjusting the sound effect currently being played by the in-vehicle audio device based on the second sound effect parameter value.
[0023] In this embodiment, when the vehicle audio device and the Bluetooth device establish a connection, the two can send data to each other. The above-mentioned Bluetooth device can be a current Bluetooth playback device on the market, such as a mobile phone, a notebook, etc. The vehicle audio device is an audio device inside the vehicle, which can provide vehicle users with high-quality music and / or voice experience. When the vehicle audio device and the Bluetooth device are connected, the vehicle audio device actively obtains the identification information of the Bluetooth device, wherein the identification information of the Bluetooth device may include the type of the Bluetooth device (such as iPhone, Huawei mobile phone, HP computer, etc.), name (such as user-defined name, factory-provided name, etc.), address (each Bluetooth device will be assigned a unique 48-bit Bluetooth address (BD_ADDR), also known as Bluetooth MAC address, used to identify a unique Bluetooth device) and communication protocol (such as HFP, A2DP, etc.).
[0024] In this embodiment, when a Bluetooth device is connected to a vehicle audio device, a historical sound effect parameter value corresponding to the Bluetooth device when the vehicle audio device and the Bluetooth device were last disconnected and stored in the vehicle audio device can be obtained based on the identification information, and the historical sound effect parameter value can be determined as the first sound effect parameter value, or the factory-preset recommended sound effect parameter value can be synchronized to the vehicle audio device according to the identification and / or type of the Bluetooth device and the recommended sound effect parameter value can be determined as the first sound effect parameter value, thereby improving the efficiency of sound effect parameter selection.
[0025] Among them, the above-mentioned first sound parameter value may include volume value, sound field position, frequency band and gain, and the recommended sound parameter value corresponding to the Bluetooth device is the adaptive sound parameter value preset by the manufacturer in the networked database according to the performance of each Bluetooth device when leaving the factory.
[0026] In this embodiment, since the vehicle user is in different scenarios during driving, the volume of the vehicle audio device has different requirements, and it needs to be adjusted according to actual needs. For example: when the vehicle is driving too fast, the volume of the vehicle audio device needs to be turned down so that the vehicle user can drive more attentively to prevent safety accidents.
[0027] When a vehicle is traveling on a city road, the speed is slow and the external noise is relatively less. Car users can usually keep the volume high to enjoy music or other audio content.
[0028] When the vehicle is traveling at a low speed or in a traffic jam, the user in the vehicle may need to keep the volume lower so as to better pay attention to the surrounding environment and traffic conditions.
[0029] If there are passengers in the car who need to have a conversation, they usually lower the volume or pause the audio device to allow better communication.
[0030] When driving at night, car users may prefer to keep the volume lower to create a quiet environment while reducing distractions to driving.
[0031] In this embodiment, after determining the first sound effect parameter value, the first sound effect parameter value is adjusted according to the first data of the vehicle terminal to which the vehicle audio device belongs to obtain a second sound effect parameter value. Based on the second sound effect parameter value, the sound effect currently played by the vehicle audio device is adjusted to automatically optimize the in-vehicle audio environment, thereby improving the vehicle user's car experience while ensuring driving safety.
[0032] In this embodiment, the first data of the vehicle terminal is used to reflect the current driving environment. The first data of the vehicle terminal to which the vehicle audio device belongs can be: the driving speed of the target vehicle, the driving route, the flatness of the road surface of the target vehicle, the obstacles encountered by the target vehicle body within a preset range, the temperature and noise inside the target vehicle, wherein the driving route is the data derived from the user's vehicle-mounted map, the flatness of the road surface of the target vehicle and the obstacles encountered by the target vehicle body within a preset range are data obtained by image recognition calculation, and the image recognition method used in this application is a commonly used image recognition technology, which will not be repeated here. The temperature, noise and driving speed inside the target vehicle are data collected by the vehicle's built-in sensors. During the vehicle's driving process, each factor included in the above first data may cause different interference to the vehicle user. For example, when the vehicle is driving too fast, the volume of the vehicle audio device needs to be turned down so that the vehicle user can drive more attentively to prevent safety accidents. Therefore, by adjusting the sound effect parameters according to multi-dimensional data, the optimal sound effect parameters can be obtained more accurately.
[0033] In this embodiment, when the second sound effect parameter value is obtained, the second sound effect parameter value is synchronously saved in the Bluetooth device and the car audio device. When data is accidentally deleted at either end, resulting in data loss, when the Bluetooth device and the car audio device are successfully connected, the historically saved data can be directly called from the other end. At the same time, the sound effect currently played by the car audio device is adjusted based on the second sound effect parameter value, and the in-car audio environment is automatically optimized, thereby improving the vehicle user's car experience while ensuring driving safety.
[0034] In one possible implementation, reference Figure 2 , Figure 2 A flowchart diagram of another embodiment of the Bluetooth audio processing method of the present application is provided. Step S100, in response to detecting that a vehicle audio device and a Bluetooth device are connected, the step of obtaining the identification information of the Bluetooth device includes: Step S010: determining whether the vehicle audio device and the Bluetooth device are connected for the first time according to the identification information of the Bluetooth device.
[0035] In this embodiment, by determining whether the vehicle audio device and the Bluetooth device are connected for the first time, a selection basis can be provided for extracting the first sound effect parameter value in the vehicle audio device.
[0036] In one possible implementation, reference Figure 3 , Figure 3 A schematic diagram of a sub-flow of step S010 provided for another embodiment of the Bluetooth audio processing method of the present application. Step S010, the step of determining whether the vehicle audio device and the Bluetooth device are connected for the first time according to the identification information of the Bluetooth device includes steps S011 to S012, wherein: Step S011, querying and matching the identification information of the Bluetooth device with the Bluetooth device data in the database of the vehicle audio device; Step S012: if the matching is successful, it is determined that the vehicle audio device and the Bluetooth device are not connected for the first time; if the matching is unsuccessful, it is determined that the vehicle audio device and the Bluetooth device are connected for the first time.
[0037] In this embodiment, after obtaining the identification information of the Bluetooth device, it is determined whether the vehicle audio device and the Bluetooth device are connected for the first time based on the identification information of the Bluetooth device. In this application, the address and communication protocol are mainly used to determine whether it is the first time to connect. Specifically, the identification information of the Bluetooth device is queried and matched with the Bluetooth device data in the database of the vehicle audio device. If the match is successful, it is determined that the vehicle audio device and the Bluetooth device are not connected for the first time. If the match is unsuccessful, it is determined that the vehicle audio device and the Bluetooth device are connected for the first time. Among them, the relevant data in the database is the data that was read, backed up and saved when the vehicle audio device was used before.
[0038] In this embodiment, specifically, the address of the current Bluetooth device is first matched with the data in the database. If the address of the current Bluetooth device matches the data in the database successfully, it is determined that the current Bluetooth device and the vehicle terminal where the vehicle audio device is located are not connected for the first time. On this basis, the communication protocol of the current Bluetooth device is further matched with the data in the database. If the communication protocol of the current Bluetooth device matches the data in the database successfully, it is determined that the current Bluetooth device and the vehicle audio device are not connected for the first time.
[0039] In this embodiment, specifically, based on the successful matching of the address of the current Bluetooth device with the data in the database, if the communication protocol of the current Bluetooth device does not match the data in the database, it can be determined that the current Bluetooth device and the vehicle audio device are connected for the first time.
[0040] In one possible implementation, reference Figure 4 , Figure 4 A schematic diagram of a sub-flow of step S200 provided in an embodiment of the Bluetooth audio processing method of the present application. Step S200, the step of extracting the first sound effect parameter value in the vehicle audio device based on the identification information includes: steps S210 to S220, wherein: Step S210, if the vehicle audio device and the Bluetooth device are not connected for the first time, obtaining a historical sound effect parameter value corresponding to the Bluetooth device when the vehicle audio device and the Bluetooth device were last disconnected and stored in the vehicle audio device, and determining the historical sound effect parameter value as the first sound effect parameter value; Step S220: If the vehicle audio device and the Bluetooth device are connected for the first time, the recommended sound effect parameter value corresponding to the Bluetooth device is obtained from the sound effect parameter information stored in the vehicle audio device according to the identification information of the Bluetooth device, and the recommended sound effect parameter value is determined as the first sound effect parameter value.
[0041] In this embodiment, if it is detected that the current Bluetooth device and the vehicle audio device are not connected for the first time, the historical sound effect parameter value corresponding to the Bluetooth device when the vehicle audio device and the Bluetooth device were last disconnected and stored in the vehicle audio device is obtained, and the historical sound effect parameter value is determined as the first sound effect parameter value. If the name of the current Bluetooth device has changed, the name of the current Bluetooth device saved in the vehicle audio device is synchronously modified, and other parameter values remain unchanged.
[0042] In this embodiment, if it is detected that the current Bluetooth device and the vehicle audio device are connected for the first time, the factory preset recommended sound effect parameter value is synchronized to the vehicle audio device based on the type of the Bluetooth device, and the recommended sound effect parameter value is determined as the first sound effect parameter value.
[0043] In this embodiment, by matching the address and communication protocol of the Bluetooth device, it can be accurately determined whether the current Bluetooth device and the vehicle audio device are connected for the first time. If it is not the first connection, the historical sound effect parameter values corresponding to the current Bluetooth device can be directly retrieved as the current sound effect parameter values without repeatedly adjusting the sound effect parameters. If it is the first connection, the recommended sound effect parameter values corresponding to the Bluetooth device type can be synchronized on the vehicle audio device end according to the type of the Bluetooth device, thereby improving the efficiency of sound effect parameter selection.
[0044] In one possible implementation, Figure 5A schematic diagram of a sub-flow of step S300 provided for an embodiment of the Bluetooth audio processing method of the present application. The first data includes at least one of the following: the driving speed noise of the target vehicle. The step S300, obtaining the first data of the vehicle terminal to which the vehicle audio device belongs to adjust the first sound effect parameter value, and the step of obtaining the second sound effect parameter value includes: steps S310 to S330, wherein: Step S310, inputting the driving speed of the target vehicle and the in-vehicle sound signal into a machine learning model; Step S320, the machine learning model outputs a sound effect parameter adjustment value according to the driving speed and the in-vehicle sound signal; Step S330: dynamically adjust the first sound effect parameter value according to the sound effect parameter adjustment value to generate the second sound effect parameter value.
[0045] In this embodiment, the first data of the vehicle terminal to which the vehicle audio device belongs includes the driving speed and noise of the target vehicle. The noise and driving speed are data collected by the vehicle's built-in sensors. During the vehicle's driving, each factor contained in the above first data may cause different interference to the vehicle user. For example, when the vehicle is driving too fast, the volume of the vehicle audio device needs to be turned down so that the vehicle user can drive more attentively to prevent safety accidents. When driving on urban roads, the driving speed is less than 60km / h, and tire noise and engine noise are the main noise sources; when the vehicle is driving at a higher speed in scenes such as highways, exceeding 80km / h, wind noise gradually becomes the main noise source. Therefore, by adjusting the sound effect parameters according to the driving speed and vehicle noise data, the optimal sound effect parameters can be obtained more accurately.
[0046] When the vehicle is driving, environmental noises such as engine noise, wind noise, and tire noise will mix with the music signal, reducing the details and clarity of the music. In a noisy environment, passengers may have difficulty hearing the soft or subtle parts of the music. In particular, in certain frequency ranges, the noise is stronger than the music signal, resulting in a frequency masking effect, that is, the noise masks the corresponding frequency components in the music, causing the music details of these frequencies to be lost.
[0047] The presence of noise may cause passengers to feel that the volume of the music is not enough, so they may tend to increase the volume to cover the noise. This will further compress the dynamic range of the music, making the music sound bland. Passengers may feel auditory fatigue after listening to music in a noisy environment for a long time, because they need more attention to distinguish the content of the music, and the high volume will also cause pressure on the ears.
[0048] External noise will also interfere with the establishment of the sound field inside the car, affect the stereo effect, and reduce the spatial sense and positioning of the music.
[0049] In order to improve the quality of the sound heard, in this embodiment, the driving speed of the target vehicle is first obtained through the vehicle's built-in speed sensor, and the sound signal inside the vehicle, including background noise and music signals, is collected through a microphone or other audio sensor. Then, the collected driving speed and in-car sound signal are input into a pre-trained machine learning model. The machine learning model outputs the sound effect parameter adjustment value based on the input driving speed and in-car sound signal. These adjustment values include volume adjustment, frequency response adjustment, dynamic range adjustment, and stereo effect adjustment to ensure that the music can maintain the best effect under different driving speeds and noise environments.
[0050] In this embodiment, when driving on urban roads (speed less than 60km / h), the main noise sources are tire noise and engine noise. The current first sound effect parameter value of the vehicle audio device can be dynamically adjusted according to the sound effect parameter adjustment value output by the machine learning model, and a new second sound effect parameter value can be generated. The gain of the low and medium frequency bands is appropriately increased, and the bass part of the music is enhanced to counter these noises, and the volume is appropriately adjusted to ensure that the music is clear but not too noisy. When driving on highways (speeds exceeding 80km / h), the main noise source is wind noise. The current first sound effect parameter value of the vehicle audio device can be dynamically adjusted according to the sound effect parameter adjustment value output by the machine learning model, and a new second sound effect parameter value can be generated. The gain of the high frequency band is appropriately increased, and the treble part of the music is enhanced to counter wind noise, and the volume is appropriately reduced to avoid the driver's attention being distracted by the high volume. This intelligent audio processing method not only improves the clarity and detail performance of the music, but also ensures driving safety and comfort.
[0051] In one possible implementation, reference Figure 6 , Figure 6 A schematic diagram of a sub-process of step S310 provided in an embodiment of the Bluetooth audio processing method of the present application. The machine learning model is established by the following steps: Step S311, obtaining the driving speed of the target vehicle and the in-vehicle sound signal, wherein the in-vehicle sound signal includes a music signal and environmental noise; Step S312, extracting features from the music signal and the ambient noise to obtain sound features; Step S313, annotating sound effect parameters for each set of speed and noise feature data to generate a training data set; Step S314, inputting the training data set into a convolutional neural network to extract spatial features; Step S315: input the spatial features into a multi-output regression model for training to obtain the machine learning model.
[0052] In this embodiment, by installing sound sensors at different locations inside the vehicle, the sound signals inside the vehicle are collected at different vehicle speeds (low speed, high speed), different road conditions (flat, bumpy) and different driving conditions (such as when the window is open or closed), where the sound signals inside the vehicle include music signals and environmental noise such as engine noise, wind noise, tire noise, etc. Multi-point recording ensures that the model can identify noise characteristics at different locations and from different sources.
[0053] Record at different vehicle speeds (slow, high), different road conditions (flat, bumpy), and different driving conditions (such as with windows open or closed). Each situation may affect the noise characteristics, which can provide rich data for the model.
[0054] In this embodiment, the target vehicle's driving speed and in-vehicle sound signals are first collected, which include music signals and environmental noise, to build a machine learning model. Next, the music signals and environmental noise are feature extracted to generate sound features. Afterwards, each set of speed and noise feature data is annotated with sound effect parameters to form a training data set.
[0055] Specifically, the in-car sound signals can be manually or semi-automatically labeled and classified into music, engine noise, wind noise, tire noise, etc. Automatic classification can also be performed based on known audio characteristics (such as frequency range).
[0056] Multi-dimensional audio collection and annotation enables the model to learn and distinguish various noises, which have specific frequency ranges and time characteristics. Engine noise is usually concentrated in the low frequency range, while wind noise and tire noise are distributed in the mid-frequency and high-frequency ranges.
[0057] The constructed training data set is input into the convolutional neural network to extract spatial features, which reflect the characteristics of the audio signal in time and frequency. Finally, the extracted spatial features will be sent to the multi-output regression model for training, so that the model can learn to predict the corresponding sound effect parameter adjustment value based on the input sound features, so as to realize the function of automatically optimizing the audio playback effect according to the vehicle driving status and the in-car environment.
[0058] In one possible implementation, reference Figure 7 , Figure 7 The schematic diagram of step S312 sub-flow provided in the embodiment of the Bluetooth audio processing method of the present application. The feature extraction of the music signal and the ambient noise is specifically as follows: Step S312a, converting the sound signal into the frequency domain through short-time Fourier transform to obtain a spectrum diagram of the sound signal; Step S312b, applying Mel scale to perform frequency mapping according to the spectrum diagram to obtain spectrum data; Step S312c: logarithmically compressing the spectrum data and generating Mel-frequency cepstral coefficients through discrete cosine transform.
[0059] In this embodiment, the sound signal is converted to the frequency domain through short-time Fourier transform (STFT) to obtain the frequency distribution characteristics of the sound signal, that is, the spectrum. The spectrum obtained by short-time Fourier transform (STFT) can show the intensity of the sound signal at different frequencies. Different noise sources will show different energy distributions within a specific frequency range. For example, tire noise mostly appears between 100 Hz and 500 Hz, while wind noise is often in the mid-to-high frequency band.
[0060] According to the frequency distribution characteristics of the noise, the Mel scale is used for frequency mapping. Then, the spectrum data is logarithmically compressed and the Mel frequency cepstral coefficients (MFCC) are generated through discrete cosine transform (DCT). The Mel frequency cepstral coefficients (MFCC) can remove unimportant frequency components and retain the main features related to the timbre to obtain the noise characteristics.
[0061] A label is set for each set of speed and noise feature data. The label can be the equalizer parameter that needs to be adjusted, such as the gain value and bandwidth of a specific frequency band, to generate a training data set.
[0062] By processing the spectrogram or MFCC features through a convolutional neural network (CNN), spatial features (the relationship between frequency and time) are automatically extracted from the image data, so that the model can learn the energy distribution of different types of noise on the spectrogram and identify specific patterns within certain frequency ranges.
[0063] After CNN extracts features, in order to predict specific equalizer adjustment parameters, the present application also adds a multi-output regression model based on CNN. The spectrogram or MFCC features output by CNN become the input of the regression model after dimension reduction and processing. These features represent the energy distribution and characteristics of different frequency bands in the audio. Through training, the regression model learns how to map the input audio features to the gain adjustment value of each frequency band. For example, for a high-energy area in a frequency band in the spectrogram, the regression model may predict that the equalizer gain of the frequency band needs to be reduced to reduce the noise interference in this frequency band. Multi-output regression ensures that the adjustment of each frequency band is independent, so that it can adapt to complex audio environments more accurately. For example, when driving on a low-speed highway, the model may prioritize reducing the gain in the low-frequency range to reduce the impact of engine noise on audio quality.
[0064] When noise covers certain frequencies in the music, making the music sound unclear or uncomfortable, the equalizer can be dynamically adjusted to increase the relative strength of important frequency components in the music, making the music clearer and more comfortable.
[0065] In this embodiment, by combining the spatial feature extraction capability of the convolutional neural network and the prediction capability of the regression model, the driving speed and noise data are input into the trained model in real time, and the model outputs the adjustment value of the sound effect parameter, so that the equalizer parameters can be automatically adjusted according to the vehicle speed and the noise inside the car. This not only improves the intelligent level of audio processing, but also greatly improves the audio experience quality of users in different driving situations.
[0066] In one possible implementation, reference Figure 1 , Figure 1 A flowchart diagram of an embodiment of the Bluetooth audio processing method of the present application. The Bluetooth audio processing method further includes: step S500, obtaining in real time the second sound effect parameter value and the user-defined sound effect parameter value corresponding to the first data of the target vehicle, and in response to detecting that the absolute value of the difference between the user-defined sound effect parameter value and the second sound effect parameter value is outside a first preset range, determining the user-defined sound effect parameter value as the second sound effect parameter value of the target vehicle.
[0067] By setting a first preset range for each different type of parameter in the sound effect, when it is detected that the deviation between the sound effect parameters adjusted by the machine learning model and the user's customized sound effect parameters exceeds the preset threshold, the system gives priority to the user's customized sound effect parameters, determines the user's customized sound effect parameter value as the second sound effect parameter value of the target vehicle, and saves it to the vehicle audio device. When it is detected that the vehicle audio device and the Bluetooth device are connected again, the historical sound effect data stored in the Bluetooth device is updated synchronously for subsequent calls. In this way, the user's personalized settings can be respected to ensure that users can hear the sound effects they are accustomed to and like. In specific implementation, the system will detect the difference between the sound effect parameters adjusted by AI and the user's customized parameters. If the difference exceeds the preset threshold (for example, the volume difference exceeds 10%, the frequency response difference exceeds 5dB, etc.), the user's customized sound effect parameters are used immediately.
[0068] In some embodiments, if the deviation is large, a gradual adjustment strategy can be adopted instead of immediately switching to user-defined parameters. Gradual adjustment can avoid the discomfort caused by sudden sound effect changes to the user, and gradually guide the user to accept the recommended optimization settings. The specific steps can be that when a large deviation is detected, the system first moves the sound effect parameters closer to the user-defined parameters, and the amplitude of each adjustment is small, to ensure that the user gradually adapts to the new sound effect settings.
[0069] In addition, when a large deviation is detected, the system can prompt the user of the current sound effect parameter adjustment status through the vehicle display or voice, and ask the user whether to restore to the custom settings. This method increases the user's sense of control over the system and improves user satisfaction. The specific steps include: when a large deviation is detected, the system prompts the user of the current sound effect parameter adjustment status through the vehicle display or voice, and provides the user with the option to choose whether to restore to the custom settings. If the user chooses to restore, the system immediately switches to the user-defined sound effect parameters.
[0070] Finally, the system can record the sound parameters selected by the user in different situations, and continuously optimize the recommended sound parameters through machine learning algorithms. This method enables the system to better understand and predict the user's sound preferences through long-term learning, and provide more personalized sound settings. The specific steps include: recording the user's sound parameter selections under different driving speeds and noise environments, and using this data to train the machine learning model so that the model can better predict the user's sound preferences in similar situations. In future adjustments, the optimized recommended parameters will be given priority, but the option of user-defined priority will still be retained.
[0071] In one possible implementation, reference Figure 8 , Figure 8 A schematic diagram of a sub-flow of step S500 provided for an embodiment of the Bluetooth audio processing method of the present application. In step S500, in response to detecting that the absolute value of the difference between the first data acquired in real time by the target vehicle and the preset value of the corresponding first data under the user-defined sound effect parameter value is within a first preset range, and the second sound effect parameter value corresponding to the first data acquired in real time is different from the user-defined sound effect parameter value, the step of determining the user-defined sound effect parameter value as the second sound effect parameter value of the target vehicle also includes: Step S510, in response to the vehicle audio device not being connected to the Bluetooth device, acquiring in real time the second sound effect parameter value and the user-defined sound effect parameter value corresponding to the first data of the target vehicle; Step S520: If the absolute value of the difference between the user-defined sound effect parameter value and the second sound effect parameter value is outside a first preset range, the user-defined sound effect parameter value is saved in the vehicle audio device.
[0072] Among them, the user-defined sound parameter value refers to the sound parameter value obtained by the vehicle user adjusting the vehicle audio device according to his or her own preferences under the state corresponding to the preset values of the above-mentioned different first data.
[0073] In this embodiment, the first preset range can be set corresponding to different parameter types in the user-defined sound effect parameter value and the second sound effect parameter value, such as the first preset range of the volume difference between the two is 10%, and the first preset range of the frequency response difference is 5dB. It can be understood that the gain of the sound field and different frequencies can also be set according to the same principle.
[0074] In the above implementation, the user-defined sound effect parameter value can be updated to the target sound effect parameter value according to the actual situation to adjust the current sound effect, so that the played sound effect is more in line with the vehicle user's expectations and further enhances the user's car experience.
[0075] It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.
[0076] This application also provides a Bluetooth audio processing device, please refer to Fig. 9 , Fig. 9 A schematic diagram of a structure provided for an embodiment of an automatic adjustment device for audio equipment of the present application. The Bluetooth audio processing device comprises: an identification information acquisition module, a first sound effect parameter value acquisition module, a second sound effect parameter value acquisition module and an adjustment module, wherein: The identification information acquisition module 10 is used to acquire the identification information of the Bluetooth device in response to detecting that the vehicle audio device and the Bluetooth device are connected; A first sound effect parameter value acquisition module 20, configured to extract a first sound effect parameter value in the vehicle-mounted audio device based on the identification information; A second sound effect parameter value acquisition module 30 is used to acquire first data of the vehicle terminal to which the vehicle audio device belongs to adjust the first sound effect parameter value to obtain a second sound effect parameter value; The adjustment module 40 is used to adjust the sound effect currently played by the in-vehicle audio device based on the second sound effect parameter value.
[0077] The Bluetooth audio processing device provided by the present application adopts the method for automatically adjusting the sound effects of the vehicle-mounted audio device in the above-mentioned embodiment, which can solve the technical problem in the prior art that the sound effects need to be manually adjusted after the mobile phone or vehicle-mounted interface connected to the vehicle-mounted Bluetooth is connected. Compared with the prior art, the beneficial effects of the Bluetooth audio processing device provided by the present application are the same as the beneficial effects of the method for automatically adjusting the sound effects of the vehicle-mounted audio device provided by the above-mentioned embodiment, and the other technical features in the Bluetooth audio processing device are the same as the features disclosed in the above-mentioned embodiment method, which will not be repeated here.
[0078] The present application also provides a car, which utilizes the Bluetooth audio processing method and / or includes the Bluetooth audio processing device. Since the present car adopts all technical solutions of all embodiments of the Bluetooth audio processing method and / or Bluetooth audio processing device, it at least has all the beneficial effects brought by the technical solutions of the above embodiments, which will not be described one by one here.
[0079] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0080] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0081] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, including a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0082] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A Bluetooth audio processing method, It is characterized in that The method comprises: In response to detecting that the vehicle audio device and the Bluetooth device establish a connection, acquiring identification information of the Bluetooth device; Extracting a first sound effect parameter value in the vehicle audio device based on the identification information; Acquire first data of the vehicle terminal to which the vehicle audio device belongs to adjust the first sound effect parameter value to obtain a second sound effect parameter value; Adjusting the sound effect currently being played by the in-vehicle audio device based on the second sound effect parameter value; The second sound effect parameter value and the user-defined sound effect parameter value corresponding to the first data of the target vehicle are acquired in real time, and in response to detecting that the absolute value of the difference between the user-defined sound effect parameter value and the second sound effect parameter value is outside a first preset range, the user-defined sound effect parameter value is determined as the second sound effect parameter value of the target vehicle.
2. The Bluetooth audio processing method according to claim 1, It is characterized in that Before the step of extracting the first sound effect parameter value in the vehicle audio device based on the identification information, the method further includes: It is determined whether the vehicle audio device and the Bluetooth device are connected for the first time according to the identification information of the Bluetooth device.
3. The Bluetooth audio processing method according to claim 2, It is characterized in that The step of judging whether the vehicle audio device and the Bluetooth device are connected for the first time according to the identification information of the Bluetooth device comprises: Query and match the identification information of the Bluetooth device with the Bluetooth device data in the database of the in-vehicle audio device; If the matching is successful, it is determined that the vehicle audio device and the Bluetooth device are not connected for the first time; if the matching is unsuccessful, it is determined that the vehicle audio device and the Bluetooth device are connected for the first time.
4. The Bluetooth audio processing method according to claim 3, It is characterized in that The step of extracting the first sound effect parameter value in the vehicle audio device based on the identification information comprises: If the vehicle audio device and the Bluetooth device are not connected for the first time, obtaining a historical sound effect parameter value corresponding to the Bluetooth device when the vehicle audio device and the Bluetooth device were last disconnected and stored in the vehicle audio device, and determining the historical sound effect parameter value as the first sound effect parameter value; If the vehicle audio device and the Bluetooth device are connected for the first time, the recommended sound effect parameter value corresponding to the Bluetooth device is obtained from the sound effect parameter information stored in the vehicle audio device according to the identification information of the Bluetooth device, and the recommended sound effect parameter value is determined as the first sound effect parameter value.
5. The Bluetooth audio processing method according to claim 4, It is characterized in that The first data includes at least one of the following: the driving speed of the target vehicle and the in-vehicle sound signal. The step of obtaining the first data of the in-vehicle terminal to which the in-vehicle audio device belongs to adjust the first sound effect parameter value to obtain the second sound effect parameter value includes: Inputting the driving speed of the target vehicle and the in-vehicle sound signal into a machine learning model; The machine learning model outputs a sound effect parameter adjustment value according to the driving speed and the in-vehicle sound signal; The first sound effect parameter value is dynamically adjusted according to the sound effect parameter adjustment value to generate the second sound effect parameter value.
6. The Bluetooth audio processing method according to claim 5, It is characterized in that The machine learning model is built using the following steps: Acquiring the driving speed of the target vehicle and the in-vehicle sound signal, wherein the in-vehicle sound signal includes a music signal and environmental noise; Extracting features of the music signal and the ambient noise to obtain sound features; Label the sound effect parameters for each set of speed and noise feature data to generate a training data set; Inputting the training data set into a convolutional neural network to extract spatial features; The spatial features are input into a multi-output regression model for training to obtain the machine learning model.
7. The Bluetooth audio processing method according to claim 6, It is characterized in that The feature extraction of the music signal and the ambient noise is specifically as follows: The sound signal is converted into the frequency domain through short-time Fourier transform to obtain the spectrum of the sound signal; According to the spectrum graph, the Mel scale is applied to perform frequency mapping to obtain the spectrum data; The spectrum data is logarithmically compressed and Mel-frequency cepstral coefficients are generated by discrete cosine transformation.
8. A Bluetooth audio processing device, It is characterized in that Based on the Bluetooth audio processing method according to any one of claims 1 to 7, the device comprises: an identification information acquisition module, configured to acquire identification information of the Bluetooth device in response to detecting that the vehicle audio device and the Bluetooth device have established a connection; A first sound effect parameter value acquisition module, used to extract a first sound effect parameter value in the vehicle audio device based on the identification information; A second sound effect parameter value acquisition module, used for acquiring first data of the vehicle terminal to which the vehicle audio device belongs to adjust the first sound effect parameter value to obtain a second sound effect parameter value; An adjustment module is used to adjust the sound effect currently played by the in-vehicle audio device based on the second sound effect parameter value.
Citation Information
Patent Citations
Environment sound control method and system for automobile intelligent cabin
CN111816199A
Vehicle-mounted audio equipment automatic adjusting method, computer equipment and storage medium
CN116801164A
Model training method, vehicle-mounted audio parameter prediction method, equipment and medium
CN118175478A
Audio processing device
CN212569744U
Vehicle and controlling method thereof
KR101814977B1
Cited By
Optimized audio acquisition method and device based on Bluetooth headset, equipment and medium
CN119521113A
