Audio playing system and method based on vehicle Bluetooth communication

Abstract

The invention relates to the technical field of audio playing, and is used for solving the problem that a traditional vehicle-mounted audio playing mode generally depends on a fixed playing list or manual setting of a user, and audio playing content and volume cannot be dynamically adjusted according to a real-time driving environment and a driving behavior. The audio playing system comprises a connection sensing module, an initial recommendation analysis module, an influence monitoring analysis module, a final regulation and control analysis module and a display terminal, according to the method, the Bluetooth connection state is monitored, if the connection is successful, the recommendation instruction is triggered, so that the historical audio playing data is analyzed, the personalized intelligent recommendation audio is generated, then the driving behavior state and the driving environment state in the driving process are monitored and analyzed, and the comprehensive influence coefficient is calculated; and the personalized intelligent recommendation audio is dynamically regulated and controlled based on the comprehensive influence coefficient to adapt to different driving states and environmental conditions, so that the driving safety and the user experience are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of audio playback, and specifically to an audio playback system and method based on in-vehicle Bluetooth communication. Background Art

[0002] With the continuous development of automotive intelligent technologies, in-vehicle entertainment systems have become an important part of enhancing the driving experience. Among them, the audio playback function not only enriches the entertainment during driving but also affects the driver's attention and mood to a certain extent. However, most current in-vehicle audio playback methods are still relatively traditional, mainly relying on fixed playlists or manual settings by users, which makes the playback content lack flexibility and intelligence and is difficult to optimize according to the personalized needs of different users. In addition, environmental factors and driving behaviors during driving will have an important impact on the audio playback experience. For example, when driving at high speed or in a noisy environment, if the playback content is soothing and the volume is too low, it is easy for the driver to have difficulty clearly hearing the audio content. While in a quiet environment or when driving at low speed, if the playback content is dynamic and the volume is too high, it may interfere with the driver's attention and affect driving safety. However, most existing in-vehicle audio playbacks lack an intelligent adjustment mechanism and cannot dynamically adjust the audio playback content and volume according to the real-time driving environment and driving behaviors, making the overall auditory experience difficult to match the actual driving situation, thus affecting driving comfort and safety.

[0003] To solve the above defects, a technical solution is provided now. Summary of the Invention

[0004] The purpose of the present invention is to solve the problem that traditional in-vehicle audio playback methods usually rely on fixed playlists or manual settings by users and cannot dynamically adjust the audio playback content and volume according to the real-time driving environment and driving behaviors, and to propose an audio playback system and method based on in-vehicle Bluetooth communication.

[0005] The purpose of the present invention can be achieved by the following technical solutions: An audio playback system based on in-vehicle Bluetooth communication, comprising: A connection perception module, used to monitor the Bluetooth connection status, and when it monitors that the Bluetooth connection is successful, it triggers a recommendation instruction; A preliminary recommendation analysis module, used to receive the recommendation instruction, and thereby analyze the historical audio playback status to generate personalized intelligent recommended audio; The driving influence monitoring and analysis module is used to monitor and analyze the driving behavior status during the driving process through the driving influence unit. If the driving behavior status is in an intense state, the intense driving state is monitored. If the driving behavior status is in a stable state, the driver status is monitored, and thus the driving influence coefficient in the driving process is analyzed to obtain the driving influence coefficient; The driving environment status during the driving process is monitored and analyzed through the environment influence unit to obtain the environment influence coefficient, where the environment influence coefficient is determined by the influence coefficients of the in-vehicle environment and the out-of-vehicle environment; The final regulation and analysis module is used to perform regulation and analysis processing on the personalized intelligent recommended audio based on the comprehensive influence coefficient to obtain the regulated personalized intelligent recommended audio, where the comprehensive influence coefficient is determined by the driving influence coefficient and the environment influence coefficient.

[0006] Furthermore, the historical audio playback status is analyzed, and the specific analysis is as follows: Extract the audio played within the set time period from the historical audio playback information of the mobile device, and thereby count the playback times of each audio within the set time period, and calculate the playback rate of each audio within the set time period; Classify each audio within the set time period according to the audio type to obtain each audio type within the set time period, and calculate the average value of the playback rates of each audio in each audio type within the set time period to obtain the average playback rate of each audio type within the set time period, which is used as the playback trend value of each audio type within the set time period; Extract the audio parameter ratios of the audio played within the set time period from the historical audio playback information of the mobile device, thereby obtaining the audio parameter ratios of each audio within the set time period, and performing comprehensive sorting and analysis to obtain the audio parameter ratio set of the audio within the set time period; Extract the playback volume, playback timbre, and playback rhythm of each audio from the audio parameter ratio set of the audio within the set time period, and screen out the modal playback volume, modal playback timbre, and modal playback rhythm from them, which are used as the playback trend volume, playback trend timbre, and playback trend rhythm of the audio within the set time period, and obtain the playback trend parameter ratio of the audio within the set time period; Arrange the playback trend values of each audio type within the set time period in descending order to obtain the order of the playback audio types corresponding to the in-vehicle terminal; Send the playback trend parameter ratio of the audio within the set time period into the order of the playback audio types corresponding to the in-vehicle terminal to construct the personalized intelligent recommended audio of the in-vehicle terminal.

[0007] Furthermore, the driving behavior status during the driving process is monitored and analyzed, and the specific analysis is as follows: Monitor and analyze the amplitude of driving actions at each monitoring point during the current monitoring period in real time for the driving process. Among them, the amplitude of driving actions includes the amplitude of steering wheel rotation, pedal pressing, and vehicle body roll, obtain the driving amplitude values at each monitoring point during the current monitoring period for the driving process, and thereby construct a driving amplitude waveform diagram for the current monitoring period of the driving process; Overlay and compare the driving amplitude waveform diagram for the current monitoring period of the driving process with the driving amplitude waveform diagrams corresponding to each driving state set, obtain the overlapping lengths of the driving amplitude waveform diagrams in each driving state, and calculate their means to obtain the overlapping lengths of the driving amplitude waveforms in each driving state, and compare the overlapping lengths of the driving amplitude waveforms in each driving state with each other. Among them, each driving state includes an intense state and a stable state; If the overlapping length of the driving amplitude waveform in the intense state is greater than or equal to the overlapping length of the driving amplitude waveform in the stable state, then determine that the driving behavior state is the intense state; If the overlapping length of the driving amplitude waveform in the intense state is less than the overlapping length of the driving amplitude waveform in the stable state, then determine that the driving behavior state is the stable state.

[0008] Furthermore, if the driving behavior state is the intense state, then monitor the intense driving state. The specific monitoring is as follows: Obtain the driving intense parameters for the current monitoring period of the driving process, extract the number of hard accelerations, the number of hard brakes, and the number of sharp turns from the driving intense parameters, and calculate the driving influence coefficient.

[0009] Furthermore, if the driving behavior state is the stable state, then monitor the driver's state. The specific monitoring is as follows: By obtaining the driver's head image for the current monitoring period of the driving process, extracting the eye image from the driver's head image, and sequentially combining the eye images according to the time frame order, thereby obtaining each eye video; Extract the duration between adjacent blinking actions in each eye video to obtain the duration of each blinking interval in each eye video, and compare and analyze it with the set reference duration; If the duration of a certain blinking interval in each eye video is greater than the set reference duration, then mark a certain blinking interval in each eye video as an abnormal interval period, thereby obtaining each abnormal interval period; Extract the eye images of each abnormal interval period and match them with the reference eye images. The reference eye images include open-eye images and closed-eye images, thereby obtaining each abnormal open-eye period and each abnormal closed-eye period respectively; Integrate each abnormal closed-eye period to obtain the closed-eye duration value; Extract the number of eye rotations in each abnormal eye-opening period, and compare it with the set reference number of eye rotations for analysis. If the number of eye rotations in a certain abnormal eye-opening period is less than the set reference number of eye rotations, then determine this abnormal eye-opening period as a fatigue period, integrate the determined fatigue periods to obtain a fatigue duration value; Calculate the driving influence coefficient based on the closed-eye duration value and the fatigue duration value.

[0010] Further, the specific process for solving the influence coefficient of the vehicle interior environment is as follows: During driving, in real-time collect the noise decibels at each monitoring point in the current monitoring period of the vehicle interior environment; Take the monitoring time as the abscissa and the noise decibels as the ordinate, and based on this establish a two-dimensional coordinate system of noise decibels, thereby obtaining a noise decibel line graph, calculate the angle between the noise decibel line and the horizontal reference line, and count the number of line segments with an angle greater than 45 degrees. Use this statistical value as the influence coefficient of the vehicle interior environment.

[0011] Further, the specific process for solving the influence coefficient of the vehicle exterior environment is as follows: During driving, in real-time collect the traffic light passing value, vehicle density value, and speed limit value in the current monitoring period of the vehicle exterior environment, and calculate the influence coefficient of the vehicle exterior environment; Among them, the traffic light passing value refers to the total number of traffic lights passed by the vehicle; The vehicle density value refers to the number of surrounding vehicles per unit distance of the road section where the vehicle is located; The speed limit value refers to the legal speed limit value for the vehicle to pass through the current road section.

[0012] Further, the specific process for regulating and analyzing the personalized intelligent recommended audio is as follows: Retrieve the driving influence coefficient S during driving δ and the environmental influence coefficient H δ , and based on the formula: , calculate the comprehensive influence coefficient Z δ , where η3 and η4 respectively represent the correction factors corresponding to the driving influence coefficient and the environmental influence coefficient; Match and analyze the comprehensive influence coefficient during driving with the preset influence status table to generate an influence level, and at the same time match it with the audio regulation parameters corresponding to the influence level, thereby obtaining the audio regulation parameters, regulate the personalized intelligent recommended audio based on the audio regulation parameters, and display and notify the regulated personalized intelligent recommended audio on the display terminal.

[0013] Further, an audio playback method based on in-vehicle Bluetooth communication includes the following steps: Monitor the Bluetooth connection status, and when a successful Bluetooth connection is detected, trigger the recommended instruction; Based on the recommendation instructions, the historical audio playback status is analyzed to generate personalized intelligent recommended audio; The driving behavior state during the driving process is monitored and analyzed. If the driving behavior state is an intense state, the intense driving state is monitored. If the driving behavior state is a stable state, the driver state is monitored, thereby analyzing the driving influence coefficient during the driving process to obtain the driving influence coefficient; Monitor and analyze the driving environment during driving to obtain an environmental impact coefficient, where the environmental impact coefficient is determined by the impact coefficients of the in-vehicle environment and the external environment; Determine the comprehensive impact coefficient based on the driving impact coefficient and the environmental impact coefficient; Based on the comprehensive influence coefficient, the personalized intelligent recommended audio is regulated and analyzed to obtain the personalized intelligent recommended audio after regulation.

[0014] Compared with the prior art, the technical solution provided by the present invention has the following beneficial effects: 1. The present invention stores historical paired device information through the vehicle system. When Bluetooth is turned on, the vehicle terminal can automatically search for paired mobile devices and automatically connect to them once the devices enter the Bluetooth range of the vehicle terminal, without the need for manual user operation. After a successful connection, historical audio playback data is analyzed to intelligently generate personalized audio recommendations, ensuring that the playback content is more in line with user habits, thereby improving the intelligent experience and personalized adaptability of audio playback. 2. The present invention monitors and analyzes driving behavior during driving. If it is determined to be an aggressive driving state, the driving intensity is further monitored. If it is determined to be a stable driving state, the driver's state is monitored to calculate the driving impact coefficient. At the same time, the driving environment state (including the in-vehicle environment and the external environment) is monitored and analyzed to obtain the environmental impact coefficient. Finally, the driving impact coefficient and the environmental impact coefficient are integrated to calculate the comprehensive impact coefficient, thereby providing accurate data support for dynamically adjusting in-vehicle audio playback, enabling audio content to match different driving states, and enhancing the intelligent and humanized driving experience. 3. The present invention determines the current impact level based on the comprehensive impact coefficient and matches the audio control parameters according to the impact level to control the personalized intelligent recommended audio, thereby realizing intelligent audio adaptive control based on driving behavior and environmental conditions, thereby improving driving safety and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0016] Figure 1 It is the overall module block diagram of the present invention; Figure 2 It is the overall process block diagram of the present invention. Detailed implementation manners

[0017] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the scope of protection of the present invention.

[0018] As Figure 1 shown, the audio playback system based on in-vehicle Bluetooth communication includes: a connection perception module, a preliminary recommendation analysis module, an influence monitoring analysis module, a final regulation analysis module, and a display terminal; Among them, the influence monitoring analysis module includes a driving influence unit and an environmental influence unit; The connection perception module is used to monitor the Bluetooth connection status between the in-vehicle terminal and the mobile device. When it detects a successful Bluetooth connection, it triggers a recommendation instruction and sends it to the preliminary recommendation analysis module. Among them, the mobile device includes a mobile phone, a tablet, and a smart watch; It should be noted that the Bluetooth connection process between the in-vehicle terminal and the mobile device is as follows: The in-vehicle terminal turns on Bluetooth and enters the discoverable mode so that the mobile device can search for the device. After the mobile device searches for nearby Bluetooth devices, the user selects the in-vehicle terminal for pairing. After successful pairing, both parties establish a security authentication to ensure the stability and security of the connection. The in-vehicle terminal and the mobile device negotiate communication protocols (such as A2DP for audio stream transmission, HFP for hands-free calls, etc.) and confirm the supported codec formats (such as SBC, AAC, aptX) to optimize the audio transmission quality. After the connection is successful, the in-vehicle terminal stores the Bluetooth information of the mobile device for subsequent quick automatic connection. In the Bluetooth-on state, the in-vehicle terminal will automatically search for paired mobile devices and attempt to establish a connection. When the mobile device enters the Bluetooth range of the in-vehicle terminal, the connection will be automatically completed without manual operation by the user.

[0019] The initial recommendation analysis module is used to receive a recommendation instruction, thereby analyzing the historical audio playback status on the mobile device side and generating personalized intelligent recommended audio for the in-vehicle terminal. The specific analysis is as follows: Based on the recommendation instruction, extract the audio played within a set period from the historical audio playback information on the mobile device side, and thereby count the playback times of each audio within the set period, denoted as Y p , where p represents the number of each audio, and p = 1, 2, 3…m; According to the formula: , calculate the playback rate Bfc of each audio within the set period p , where λ represents the influence factor of the set audio playback times; Classify each audio within the set period according to the audio type to obtain each audio type within the set period, and calculate the average value of the playback rates of each audio in each audio type within the set period to obtain the average playback rate of each audio type within the set period, which is used as the playback trend value of each audio type within the set period; Extract the audio parameter ratio of the audio played within the set period from the historical audio playback information on the mobile device side, thereby obtaining the audio parameter ratio of each audio within the set period, and conduct comprehensive sorting and analysis to obtain the audio parameter ratio set of the audio within the set period; Extract the playback volume, playback tone color, and playback rhythm of each audio from the audio parameter ratio set of the audio within the set period, and screen out the mode playback volume, mode playback tone color, and mode playback rhythm from them, which are used as the playback trend volume, playback trend tone color, and playback trend rhythm of the audio within the set period to obtain the audio parameter ratio of the playback trend of the audio within the set period; Arrange the playback trend values of each audio type within the set period in descending order to obtain the order of the playback audio types corresponding to the in-vehicle terminal; Send the audio parameter ratio of the playback trend of the audio within the set period to the order of the playback audio types corresponding to the in-vehicle terminal to construct personalized intelligent recommended audio for the in-vehicle terminal; It should be noted that the audio refers to the music content transmitted and played through the car Bluetooth, including locally stored music, online streaming media music, and user personalized playlists, etc. The set period is one week or one year (if the mobile device side is a high-frequency playback user, the set period is one week; if the mobile device side is a low-frequency playback user, the set period is one year).

[0020] The influence monitoring analysis module includes a driving influence unit and an environmental influence unit; Monitor and analyze the driving behavior status during driving through the driving influence unit, where the driving behavior status includes a fierce state and a stable state. The specific monitoring and analysis process is as follows: During the driving process, monitor and analyze the amplitude of driving actions at each monitoring point during the current monitoring period in real time, obtain the driving amplitude values at each monitoring point during the current monitoring period corresponding to the driving process, and construct a driving amplitude waveform diagram corresponding to the driving process during the current monitoring period; Among them, the specific process of monitoring the amplitude of driving actions is as follows: collect the steering wheel angle data at consecutive moments through a steering wheel angle sensor, and calculate the amplitude F of the steering wheel rotation from this. θ The specific calculation formula is: , where θ t represents the steering wheel angle at the current moment t, θ t-1 represents the steering wheel angle at the previous moment t - 1, and Δt represents the acquisition time interval; Collect the acceleration data of the vehicle in the X (front - rear), Y (left - right), and Z (up - down) directions at consecutive moments through an acceleration sensor, and calculate the amplitude F of the pedal pressing from this. A The specific calculation formula is: , where A t represents the combined acceleration at the current moment t. The specific calculation formula for the combined acceleration is: , where α x , α y and α z are the acceleration components in the x, y, and z axis directions respectively, and A t-1 represents the combined acceleration at the previous moment t - 1; Collect the vehicle body roll angle data at consecutive moments through a gyroscope sensor, and calculate the amplitude F of the vehicle body roll from this. k The specific calculation formula is: , where k t represents the vehicle body roll angle at the current moment t, and k t-1 represents the vehicle body roll angle at the previous moment t - 1; Multiply the amplitudes of the steering wheel rotation, pedal pressing, and vehicle body roll by their corresponding weight coefficients respectively and then add them up to obtain the driving amplitude value; Overlay and compare the driving amplitude waveform diagram corresponding to the driving process during the current monitoring period with the driving amplitude waveform diagrams corresponding to each driving state set, obtain the overlay length of each driving amplitude waveform diagram in each driving state during the current monitoring period corresponding to the driving process, and calculate its average value to obtain the driving amplitude waveform overlay length in each driving state during the current monitoring period corresponding to the driving process; Compare the driving amplitude waveform overlay lengths in each driving state during the current monitoring period corresponding to the driving process with each other. The specific analysis steps are as follows: If the overlapping length of the driving amplitude waveforms corresponding to the intense state during the current monitoring period of the driving process is greater than or equal to the overlapping length of the driving amplitude waveforms corresponding to the stable state during the current monitoring period of the driving process, it is determined that the driving behavior state of the driving process corresponding to the current monitoring period is in an intense state; If the overlapping length of the driving amplitude waveforms corresponding to the intense state during the current monitoring period of the driving process is less than the overlapping length of the driving amplitude waveforms corresponding to the stable state during the current monitoring period of the driving process, it is determined that the driving behavior state of the driving process corresponding to the current monitoring period is in a stable state; If the driving behavior state of the driving process corresponding to the current monitoring period is in an intense state, then monitor the driving intense state of the driving process corresponding to the current monitoring period, and thus analyze the driving influence coefficient of the driving process corresponding to the current monitoring period. The specific analysis process is as follows: By obtaining the driving intense parameters of the driving process corresponding to the current monitoring period, the driving intense parameters of the driving process corresponding to the current monitoring period are obtained. Extract the number of hard accelerations, the number of hard brakes, and the number of sharp turns from the driving intense parameters, and mark them as Lsz, Lcz, and Lwz respectively. According to the formula: , calculate the driving influence coefficient S δ , where Lsz * , Lcz * , and Lwz * respectively represent the set reference number of hard accelerations, the set reference number of hard brakes, and the set reference number of sharp turns. a1, a2, and a3 respectively represent the influence factors of the set number of hard accelerations, the set number of hard brakes, and the set number of sharp turns; If the driving behavior state of the driving process corresponding to the current monitoring period is in a stable state, then monitor the driver state of the driving process corresponding to the current monitoring period, and thus analyze the driving influence coefficient of the driving process corresponding to the current monitoring period. The specific analysis process is as follows: The head video of the driver corresponding to the current monitoring period during the driving process is captured by an intelligent camera to obtain the head video of the driver corresponding to the current monitoring period during the driving process, and it is analyzed to obtain the head image of the driver corresponding to the current monitoring period during the driving process. The eye images are extracted from the head image of the driver, and the eye images are combined in sequence according to the time frame to obtain the eye videos of the driver. The duration of the interval between adjacent blinking actions in each eye video is extracted, and thus the duration of each blinking interval in each eye video is obtained. The duration of each blinking interval in each eye video is compared and analyzed with the set reference duration. If the duration of a certain blinking interval in each eye video is greater than the set reference duration, the certain blinking interval in each eye video is marked as an abnormal interval period, and thus each abnormal interval period is obtained. The eye images of each abnormal interval period are extracted and matched with the reference eye images stored in the cloud database. The reference eye images include open-eye images and closed-eye images, and thus each abnormal open-eye period and each abnormal closed-eye period are obtained respectively. The abnormal closed-eye periods are integrated to obtain the closed-eye duration value, which is marked as Pby; The number of eyeball rotations in each abnormal open-eye period is extracted and compared and analyzed with the set reference number of eyeball rotations. If the number of eyeball rotations in a certain abnormal open-eye period is less than the set reference number of eyeball rotations, the certain abnormal open-eye period is determined as a fatigue period. The fatigue periods determined are integrated to obtain the fatigue duration value, which is marked as Pbz; According to the formula: the driving influence coefficient S is calculated δ where a4 and a5 respectively represent the influence factors of the set closed-eye duration value and fatigue duration value; The driving environment state during the driving process is monitored and analyzed by the environmental influence unit. The driving environment state includes the in-vehicle environment state and the out-of-vehicle environment state. The specific monitoring and analysis process is as follows: During the driving process, the noise decibels at each monitoring point within the current monitoring period of the in-vehicle environment are collected in real time to obtain the noise decibels at each monitoring point within the current monitoring period of the in-vehicle environment. With the monitoring time as the abscissa and the noise decibels as the ordinate, a noise decibel two-dimensional coordinate system is established accordingly. The noise decibels at each monitoring point are plotted on the noise decibel two-dimensional coordinate system by point plotting, and each plotted point is connected by a line segment to obtain a noise decibel line graph. The angle between the noise decibel line and the horizontal reference line is calculated, and the number of line segments with an angle greater than 45 degrees is counted. This statistical value is used as the influence coefficient of the in-vehicle environment and is marked as Hn δ ; During driving, the passing light value, vehicle density value, and speed limit value within the current monitoring period of the external vehicle environment are collected in real time to obtain the passing light value, vehicle density value, and speed limit value within the current monitoring period of the external vehicle environment, which are respectively marked as Wgd, Wcm, and Wsz. According to the formula: calculate the influence coefficient Hw of the external vehicle environment δ where u represents a set natural constant, and a6, a7, and a8 respectively represent the influence factors of the set passing light value, vehicle density value, and speed limit value; It should be noted that the passing light value refers to the total number of traffic lights passed by the vehicle (specifically, the vehicle where the in-vehicle terminal is located), including red lights, yellow lights, and green lights; The vehicle density value refers to the number of surrounding vehicles per unit distance (such as per kilometer) of the road section where the vehicle is located; The speed limit value refers to the legal speed limit value for the vehicle to pass through the current road section, which can be obtained through high-precision maps, GPS positioning, or traffic sign recognition, etc.; According to the influence coefficients of the internal vehicle environment and the external vehicle environment, calculate the environmental influence coefficient H δ The calculation formula is: where η1 and η2 respectively represent the correction factors corresponding to the influence coefficient of the internal vehicle environment and the influence coefficient of the external vehicle environment.

[0021] The final regulation analysis module is used to perform regulation analysis and processing on the personalized intelligent recommended audio of the in-vehicle terminal based on the comprehensive influence coefficient. The specific analysis process is as follows: Retrieve the driving influence coefficient S during driving δ and the environmental influence coefficient H δ According to the formula: calculate the comprehensive influence coefficient Z δ where η3 and η4 respectively represent the correction factors corresponding to the driving influence coefficient and the environmental influence coefficient; Match and analyze the comprehensive influence coefficient during driving with the preset influence status table to generate an influence level. Each comprehensive influence coefficient during driving corresponds to an influence level, and at the same time, match it with the audio regulation parameters corresponding to the influence level, thereby obtaining the audio regulation parameters during driving. Based on the audio regulation parameters during driving, regulate the personalized intelligent recommended audio of the in-vehicle terminal, and display and notify the regulated personalized intelligent recommended audio on the display terminal.

[0022] For example Figure 2 As shown, the audio playback method based on in-vehicle Bluetooth communication includes the following steps: A1. Monitor the Bluetooth connection status between the in-vehicle terminal and the mobile device. When it is detected that the Bluetooth connection is successful, trigger the recommendation instruction and execute A2; A2. Analyze the historical audio playback status on the mobile device side to generate personalized intelligent recommended audio for the in-vehicle terminal. The specific analysis is as follows: Extract the audio played within a set time period from the historical audio playback information on the mobile device side, and thereby count the number of plays of each audio within the set time period, and calculate the playback rate of each audio within the set time period; Classify the audio within the set time period according to the audio type to obtain the audio types within the set time period, and calculate the average value of the playback rates of the audio in each audio type within the set time period to obtain the average playback rate of each audio type within the set time period, which is used as the playback trend value of each audio type within the set time period; Extract the audio parameter ratios of the audio played within a set time period from the historical audio playback information on the mobile device side, thereby obtaining the audio parameter ratios of each audio within the set time period, and conduct comprehensive sorting and analysis to obtain the audio parameter ratio set of the audio within the set time period; Extract the playback volume, playback timbre, and playback rhythm of each audio from the audio parameter ratio set of the audio within the set time period, and screen out the modal playback volume, modal playback timbre, and modal playback rhythm from them, which are used as the playback trend volume, playback trend timbre, and playback trend rhythm of the audio within the set time period, and obtain the playback trend parameter ratio of the audio within the set time period; Arrange the playback trend values of each audio type within the set time period in descending order to obtain the order of the playback audio types corresponding to the in-vehicle terminal; Send the playback trend parameter ratio of the audio within the set time period into the order of the playback audio types corresponding to the in-vehicle terminal to construct personalized intelligent recommended audio for the in-vehicle terminal.

[0023] A3. Monitor and analyze the driving behavior status during driving, where the driving behavior status includes intense status and stable status. The specific monitoring and analysis process is as follows: Monitor and analyze the amplitude of the driving actions at each monitoring point during the current monitoring time period corresponding to the driving process in real time. Among them, the amplitude of the driving actions includes the amplitude of the steering wheel rotation, pedal stepping, and vehicle body roll, to obtain the driving amplitude values at each monitoring point during the current monitoring time period corresponding to the driving process, and thereby construct a driving amplitude waveform diagram during the current monitoring time period corresponding to the driving process; Overlay and compare the driving amplitude waveform diagram during the current monitoring time period corresponding to the driving process with the driving amplitude waveform diagrams corresponding to each driving state set, to obtain the overlapping length of each driving amplitude waveform diagram in each driving state, and calculate its average value to obtain the overlapping length of the driving amplitude waveforms in each driving state, and compare the overlapping lengths of the driving amplitude waveforms in each driving state with each other. Among them, each driving state includes intense status and stable status; If the overlapping length of the driving amplitude waveforms in the intense state is greater than or equal to the overlapping length of the driving amplitude waveforms in the stable state, the driving behavior state is determined to be the intense state; If the overlapping length of the driving amplitude waveforms in the intense state is less than the overlapping length of the driving amplitude waveforms in the stable state, the driving behavior state is determined to be the stable state.

[0024] A4. If the driving behavior state is the intense state, monitor the intense driving state. The specific monitoring is as follows: Obtain the driving intensity parameters corresponding to the current monitoring period during the driving process, extract the number of hard accelerations, the number of hard brakes, and the number of sharp turns from the driving intensity parameters, and calculate the driving impact coefficient.

[0025] A5. If the driving behavior state is the stable state, monitor the driver's state. The specific monitoring is as follows: Obtain the head image of the driver corresponding to the current monitoring period during the driving process, extract the eye image from the head image of the driver, and combine the eye images in sequence according to the time frame to obtain each eye video; Extract the duration between adjacent blinking actions in each eye video to obtain the duration of each blinking interval in each eye video, and compare and analyze it with the set reference duration; If the duration of a certain blinking interval in each eye video is greater than the set reference duration, mark the certain blinking interval in each eye video as an abnormal interval period, and thus obtain each abnormal interval period; Extract the eye images of each abnormal interval period and match them with the reference eye images. The reference eye images include open-eye images and closed-eye images, and thus obtain each abnormal open-eye period and each abnormal closed-eye period respectively; Integrate each abnormal closed-eye period to obtain the closed-eye duration value; Extract the number of eye rotations in each abnormal open-eye period and compare and analyze it with the set reference number of eye rotations. If the number of eye rotations in a certain abnormal open-eye period is less than the set reference number of eye rotations, determine the certain abnormal open-eye period as a fatigued period, and integrate the determined fatigued periods to obtain the fatigued duration value; Calculate the driving impact coefficient based on the closed-eye duration value and the fatigued duration value.

[0026] A6. Monitor and analyze the driving environment state during the driving process. The driving environment state includes the in-vehicle environment state and the out-of-vehicle environment state. The specific monitoring and analysis process is as follows: During the driving process, collect the noise decibels of each monitoring point in the in-vehicle environment in real time during the current monitoring period; Taking the monitoring time as the abscissa and the noise decibel as the ordinate, a two-dimensional coordinate system of noise decibels is established accordingly, and a line graph of noise decibels is obtained. Calculate the angle between the noise decibel line graph and the horizontal reference line, and count the number of line segments with an angle greater than 45 degrees. Use this statistical value as the influence coefficient of the vehicle interior environment; During driving, the traffic light passing value, vehicle density value, and speed limit value within the current monitoring period of the vehicle exterior environment are collected in real time, and the influence coefficient of the vehicle exterior environment is calculated; Among them, the traffic light passing value refers to the total number of traffic lights passed by the vehicle; The vehicle density value refers to the number of surrounding vehicles per unit distance of the road section where the vehicle is located; The speed limit value refers to the legal speed limit value for the vehicle to pass through the current road section; Based on the influence coefficients of the vehicle interior environment and the vehicle exterior environment, the environmental influence coefficient is calculated.

[0027] A7. Retrieve the driving influence coefficient and the environmental influence coefficient during driving to determine the comprehensive influence coefficient; Match and analyze the comprehensive influence coefficient during driving with the preset influence status table to generate an influence level. At the same time, match it with the audio adjustment parameters corresponding to the influence level to obtain the audio adjustment parameters during driving. Based on the audio adjustment parameters during driving, adjust the personalized intelligent recommended audio of the in-vehicle terminal, and display and notify the adjusted personalized intelligent recommended audio on the display terminal.

[0028] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the present invention to only the specific implementation manners. Obviously, many modifications and changes can be made according to the content of this specification. These embodiments are selected and specifically described in this specification to better explain the principles and practical applications of the present invention, so that those skilled in the art in the relevant technical field can understand and utilize the present invention well. The present invention is only limited by the claims and their full scope and equivalents.

Claims

1. An audio playback system based on in-vehicle Bluetooth communication, including a connection awareness module for monitoring the Bluetooth connection status. When it detects a successful Bluetooth connection, it triggers a recommendation instruction, characterized in that, It further includes: An initial recommendation analysis module, which is used to receive a recommendation instruction, analyze the historical audio playback status accordingly, and generate personalized intelligent recommended audio; An influence monitoring analysis module, which is used to monitor and analyze the driving behavior status during driving through a driving influence unit. If the driving behavior status is in an intense state, monitor the intense driving state. If the driving behavior status is in a stable state, monitor the driver's status, and accordingly analyze the driving influence coefficient during driving to obtain the driving influence coefficient; Monitor and analyze the driving environment status during driving through an environmental influence unit to obtain an environmental influence coefficient, where the environmental influence coefficient is determined by the influence coefficients of the in-vehicle environment and the out-of-vehicle environment; A final regulation analysis module, which is used to perform regulation analysis and processing on the personalized intelligent recommended audio based on the comprehensive influence coefficient to obtain the regulated personalized intelligent recommended audio, where the comprehensive influence coefficient is determined by the driving influence coefficient and the environmental influence coefficient.

2. The audio playback system based on in-vehicle Bluetooth communication according to claim 1, wherein, Analyze the historical audio playback status. The specific analysis is as follows: Extract the audio played within a set time period from the historical audio playback information of the mobile device, and accordingly count the playback times of each audio within the set time period, and calculate the playback rate of each audio within the set time period; Classify each audio within the set time period according to the audio type to obtain each audio type within the set time period, and calculate the average value of the playback rates of each audio in each audio type within the set time period to obtain the average playback rate of each audio type within the set time period, which is used as the playback trend value of each audio type within the set time period; Extract the audio parameter ratios of the audio played within a set time period from the historical audio playback information of the mobile device, accordingly obtain the audio parameter ratios of each audio within the set time period, and perform comprehensive sorting and analysis to obtain the audio parameter ratio set of the audio within the set time period; Extract the playback volume, playback timbre, and playback rhythm of each audio from the audio parameter ratio set of the audio within the set time period, and screen out the mode playback volume, mode playback timbre, and mode playback rhythm from them, which are used as the playback trend volume, playback trend timbre, and playback trend rhythm of the audio within the set time period, and obtain the audio parameter ratio of the playback trend of the audio within the set time period; Arrange the playback trend values of each audio type within the set time period in descending order to obtain the order of the playback audio types corresponding to the in-vehicle terminal; Transmit the audio parameter ratio of the playback trend of the audio within the set time period into the order of the playback audio types corresponding to the in-vehicle terminal to construct the personalized intelligent recommended audio of the in-vehicle terminal.

3. The audio playback system based on in-vehicle Bluetooth communication according to claim 1, characterized in that, Monitor and analyze the driving behavior status during driving. The specific analysis is as follows: Monitor and analyze the amplitude of the driving actions at each monitoring point corresponding to the current monitoring time period during driving in real time. Among them, the amplitude of the driving actions includes the amplitude of steering wheel rotation, pedal pressing, and vehicle body roll, obtain the driving amplitude values at each monitoring point corresponding to the current monitoring time period during driving, and accordingly construct a driving amplitude waveform diagram of the current monitoring time period during driving; Compare the driving amplitude waveform corresponding to the current monitoring period during the driving process with the driving amplitude waveforms corresponding to each set driving state, obtain the overlapping lengths of the driving amplitude waveforms in each driving state, calculate their means to obtain the driving amplitude waveform overlapping lengths in each driving state, and compare the driving amplitude waveform overlapping lengths in each driving state with each other. Among them, each driving state includes a fierce state and a stable state; If the overlapping length of the driving amplitude waveform in the fierce state is greater than or equal to the overlapping length of the driving amplitude waveform in the stable state, then determine that the driving behavior state is the fierce state; If the overlapping length of the driving amplitude waveform in the fierce state is less than the overlapping length of the driving amplitude waveform in the stable state, then determine that the driving behavior state is the stable state.

4. The audio playback system based on in-vehicle Bluetooth communication according to claim 3, characterized in that, If the driving behavior state is the fierce state, then monitor the fierce driving state. The specific monitoring is as follows: Obtain the driving fierce parameters corresponding to the current monitoring period during the driving process, extract the number of hard accelerations, the number of hard brakes, and the number of sharp turns from the driving fierce parameters, and calculate the driving influence coefficient.

5. The audio playback system based on in-vehicle Bluetooth communication according to claim 3, wherein If the driving behavior state is the stable state, then monitor the driver's state. The specific monitoring is as follows: Obtain the driver's head image corresponding to the current monitoring period during the driving process, extract the eye image from the driver's head image, and combine the eye images in sequence according to the time frame to obtain each eye video; Extract the duration between adjacent blinking actions in each eye video to obtain the duration of each blinking interval in each eye video, and compare and analyze it with the set reference duration; If the duration of a certain blinking interval in each eye video is greater than the set reference duration, then mark the certain blinking interval in each eye video as an abnormal interval period, and thus obtain each abnormal interval period; Extract the eye images of each abnormal interval period and match them with the reference eye images. The reference eye images include open-eye images and closed-eye images, and thus obtain each abnormal open-eye period and each abnormal closed-eye period respectively; Integrate each abnormal closed-eye period to obtain the closed-eye duration value; Extract the number of eyeball rotations in each abnormal open-eye period and compare and analyze it with the set reference number of eyeball rotations. If the number of eyeball rotations in a certain abnormal open-eye period is less than the set reference number of eyeball rotations, then determine that the certain abnormal open-eye period is a tired period, and integrate the periods determined to be tired periods to obtain the tired duration value; Calculate the driving influence coefficient based on the closed-eye duration value and the tired duration value.

6. The audio playing system based on in-vehicle Bluetooth communication according to claim 1, wherein, The specific process for solving the influence coefficient of the in-vehicle environment is as follows: During the driving process, collect the noise decibels at each monitoring point in the in-vehicle environment during the current monitoring period in real time; Take the monitoring time as the abscissa and the noise decibels as the ordinate, and accordingly establish a two-dimensional coordinate system of noise decibels to obtain a noise decibel line graph. Calculate the angle between the noise decibel line and the horizontal reference line, and count the number of line segments with an angle greater than 45 degrees. Use this statistical value as the influence coefficient of the in-vehicle environment.

7. The audio playback system based on in-vehicle Bluetooth communication according to claim 1, characterized in that, The specific process for solving the influence coefficient of the out-of-vehicle environment is as follows: During driving, the number of traffic lights passed, the vehicle density, and the speed limit value within the current monitoring period of the external environment of the vehicle are collected in real time, and the influence coefficient of the external environment of the vehicle is calculated; Among them, the number of traffic lights passed refers to the total number of traffic lights passed by the vehicle; The vehicle density refers to the number of surrounding vehicles per unit distance of the road section where the vehicle is located; The speed limit value refers to the legal speed limit value for the vehicle to pass through the current road section.

8. The audio playback system based on in-vehicle Bluetooth communication according to claim 1, wherein The specific process of regulating and analyzing the personalized intelligent recommended audio is as follows: Retrieve the driving influence coefficient S during the driving process δ and the environmental influence coefficient H δ , and according to the formula: , calculate the comprehensive influence coefficient Z δ , where η3 and η4 respectively represent the correction factors corresponding to the driving influence coefficient and the environmental influence coefficient; The comprehensive influence coefficient during driving is matched and analyzed with the preset influence status table to generate an influence level. At the same time, it is matched with the audio regulation parameters corresponding to the influence level to obtain the audio regulation parameters. Based on the audio regulation parameters, the personalized intelligent recommended audio is regulated, and the regulated personalized intelligent recommended audio is displayed and notified on the display terminal.

9. An audio playing method based on in-vehicle Bluetooth communication, applied to the audio playing system based on in-vehicle Bluetooth communication according to claim 1, characterized in that, It includes the following steps: Monitor the Bluetooth connection status. When it is detected that the Bluetooth connection is successful, the recommendation instruction is triggered; Based on the recommendation instruction, the historical audio playback status is analyzed to generate a personalized intelligent recommended audio; Monitor and analyze the driving behavior status during driving. If the driving behavior status is a fierce state, monitor the fierce driving state. If the driving behavior status is a stable state, monitor the driver's status. Thus, analyze the driving influence coefficient during driving to obtain the driving influence coefficient; Monitor and analyze the driving environment status during driving to obtain the environmental influence coefficient. Among them, the environmental influence coefficient is determined by the influence coefficients of the vehicle interior environment and the vehicle exterior environment; Determine the comprehensive influence coefficient based on the driving influence coefficient and the environmental influence coefficient; Based on the comprehensive influence coefficient, regulate and analyze the personalized intelligent recommended audio to obtain the regulated personalized intelligent recommended audio.

Images