Method for controlling the playing of a prompt tone and vehicle

Abstract

The application discloses a playing control method of a prompt tone and a vehicle, and the method comprises the following steps: determining an audio feature and an audio type according to an audio signal collected by the vehicle; determining a driving scene of the vehicle according to the audio feature, the audio type and running information of the vehicle; determining an audio influence weight of different types of prompt tones according to the driving scene; determining a target priority of a prompt tone to be played according to the audio influence weight corresponding to the prompt tone to be played; and playing the prompt tone to be played according to the target priority. The technical scheme provided by the application can adjust the priority of the prompt tone according to the driving scene of the vehicle in real time, thereby improving the driving experience of the user.

Description

Technical Field

[0001] This application belongs to the field of vehicle control technology, and in particular relates to a method for controlling the playback of prompt sounds and a vehicle. Background Technology

[0002] Vehicle alerts play a crucial role, providing drivers with essential driving information and ensuring they can react quickly in emergencies. With the continuous development of vehicle electronics technology, the types of vehicle alerts have become increasingly diverse, including collision warnings, lane departure warnings, turn signals, navigation announcements, and entertainment audio.

[0003] In related technologies, when different types of warning sounds need to be played simultaneously while the vehicle is in motion, the warning sounds are usually played in a priority order pre-set in the vehicle. The priority order is usually: collision warning > lane departure warning > turn signal > navigation broadcast > entertainment audio.

[0004] While this fixed priority setting ensures the transmission of key information to a certain extent, the operating environment of the vehicle is constantly changing during actual driving. Using a fixed priority for the playback of prompts is not flexible enough and may affect the user's driving experience. Summary of the Invention

[0005] The embodiments of this application provide a method for controlling the playback of prompt sounds and a vehicle, thereby enabling the priority of prompt sounds to be adjusted in real time, at least to a certain extent, according to the driving scenario of the vehicle, thereby improving the user's driving experience.

[0006] Other features and advantages of this application will become apparent from the following detailed description, or may be learned in part from practice of this application.

[0007] According to a first aspect of the embodiments of this application, a method for controlling the playback of prompt sounds is provided, comprising: determining audio features and audio types based on audio signals collected by a vehicle; determining the driving scenario of the vehicle based on the audio features, audio types, and vehicle operating information; determining the audio influence weights of different types of prompt sounds based on the driving scenario; determining the target priority of the prompt sound to be played based on the audio influence weights corresponding to the prompt sound to be played; and playing the prompt sound to be played according to the target priority.

[0008] In some embodiments, determining audio features and audio type based on audio signals collected by the vehicle includes: performing beamforming and reverberation suppression processing on the audio signals collected by the vehicle to obtain processed audio signals; performing short-time Fourier transform on the processed audio signals to obtain audio features; and inputting the audio features into an audio classification model to obtain the audio type output by the audio classification model.

[0009] In some embodiments, the audio type includes wind noise, the audio features include the intensity of wind noise, the operating information includes vehicle speed and window status, and the driving scenario includes high-speed driving. Based on the audio features, audio type, and vehicle operating information, the driving scenario of the vehicle is determined, including: when the vehicle speed exceeds a first preset threshold, the window status is closed, and the intensity of wind noise exceeds a second preset threshold, the driving scenario of the vehicle is determined to be high-speed driving.

[0010] In some embodiments, the types of prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, navigation announcement, fatigue alert, and entertainment audio source. Based on the driving scenario, the audio influence weight of different types of prompts is determined, including: when the driving scenario is high-speed driving, increasing the audio influence weight of five types of prompts such as collision warning, lane departure warning, turn signal, navigation announcement, and fatigue alert, and decreasing the audio influence weight of prompts of the entertainment audio source type.

[0011] In some embodiments, determining the target priority of a notification tone to be played based on the audio influence weight corresponding to the notification tone to be played includes: determining the initial priority of the notification tone to be played; determining the speed influence weight corresponding to the notification tone to be played based on the vehicle speed; determining the weather influence weight corresponding to the notification tone to be played based on the weather information of the vehicle; determining the user influence weight corresponding to the notification tone to be played based on the user preference mode; and determining the target priority of the notification tone to be played by summing the initial priority, speed influence weight, weather influence weight, user influence weight, and audio influence weight corresponding to the notification tone to be played.

[0012] In some embodiments, the types of prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, navigation announcement, fatigue alert, and entertainment audio sources. Based on the vehicle speed, the speed influence weights corresponding to the prompts to be played are determined, including: when the vehicle speed is within a first preset range, determining that the speed influence weights corresponding to each prompt to be played are all initial values; when the vehicle speed is within a second preset range, increasing the speed influence weights corresponding to the collision warning and lane departure warning types; when the vehicle speed is within a third preset range, increasing the speed influence weights corresponding to the collision warning, lane departure warning, turn signal, and navigation announcement types, and decreasing the speed influence weight of the entertainment audio source type prompts; wherein the upper limit of the first preset range is less than or equal to the lower limit of the second preset range, and the upper limit of the second preset range is less than or equal to the lower limit of the third preset range.

[0013] In some embodiments, the types of prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, fatigue alert, and entertainment audio. Based on the weather information where the vehicle is located, the weather impact weights corresponding to the prompts to be played are determined, including: when the weather information is clear, determining that the weather impact weights corresponding to each prompt to be played are all initial values; when the weather information is cloudy, increasing the weather impact weights corresponding to the three types of prompts to be played (collision warning, lane departure warning, and fatigue alert); and when the weather information is nighttime, increasing the weather impact weights corresponding to the two types of prompts to be played (collision warning and fatigue alert) and decreasing the weather impact weights corresponding to the two types of prompts to be played (turn signal and entertainment audio).

[0014] In some embodiments, the method for controlling the playback of a prompt sound further includes: inputting a driving scenario into a volume learning model to obtain the volume of the prompt sound to be played output by the volume learning model; wherein the volume learning model is trained based on historical driving scenarios, historical user adjustment times, and historical user satisfaction scores.

[0015] According to a second aspect of the embodiments of this application, a vehicle is provided, including a processor and a memory, the memory storing computer program instructions executable by the processor, wherein when the processor executes the computer program instructions, it implements the steps of the method as described in any of the first aspects above.

[0016] According to a third aspect of the embodiments of this application, a computer-readable storage medium is provided, which stores computer program instructions that, when executed by a processor, cause the processor to perform the steps of the method as described in any of the first aspects above.

[0017] In this application, audio features and types are determined based on audio signals collected from the vehicle; the vehicle's driving scenario is determined based on the audio features, audio type, and vehicle operating information; the audio influence weight of different types of prompts is determined based on the driving scenario; the target priority of the prompt to be played is determined based on the audio influence weight corresponding to the prompt to be played; and the prompt to be played is played according to the target priority. The technical solution provided by this application enables real-time adjustment of the priority of prompts based on the vehicle's driving scenario, improving the user's driving experience.

[0018] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0019] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0020] Figure 1 A flowchart illustrating a method for controlling the playback of prompt sounds according to some embodiments of this application is shown;

[0021] Figure 2 A block diagram of a playback control device for prompt sounds according to some embodiments of this application is shown;

[0022] Figure 3 A schematic diagram of the structure of a vehicle according to some embodiments of this application is shown. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0024] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this application. However, those skilled in the art will recognize that the technical solutions of this application can be practiced without one or more of the specific details, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, apparatuses, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this application.

[0025] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0026] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0027] It should also be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such uses of these terms can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described.

[0028] Figure 1 A flowchart illustrating a method for controlling the playback of prompt sounds according to some embodiments of this application is shown. Figure 1 As shown, a method for controlling the playback of a prompt sound is provided, which may include the following steps 101 to 105.

[0029] In step 101, the audio characteristics and audio type are determined based on the audio signals collected by the vehicle.

[0030] The audio signals can include audio signals inside the vehicle and audio signals outside the vehicle, such as audio signals emitted by the driver, audio signals played inside the vehicle, and audio signals of ambient noise.

[0031] In the implementation process, microphones and sensors can be placed in multiple locations such as the roof, center console, or A-pillar. The microphone array can capture audio signals inside the vehicle, while the sensors can collect audio signals from outside the vehicle, such as wind noise and sudden sirens.

[0032] By extracting and classifying features from audio signals, audio characteristics and audio types can be determined.

[0033] In some embodiments, beamforming and reverberation suppression processing can be performed on the audio signal collected by the vehicle to obtain a processed audio signal; a short-time Fourier transform is performed on the processed audio signal to obtain audio features; the audio features are input into an audio classification model to obtain the audio type output by the audio classification model.

[0034] During beamforming, algorithms such as DAS (Delay-and-Sum) or MVDR (Minimum Variance Distortionless Response) can be used. Taking the DAS algorithm as an example, it can perform time delay correction and superposition on audio signals, enhancing signals from the main direction and weakening signals from interference directions, thereby reducing background interference.

[0035] The confined space inside a car makes it easy for sound to echo. In the process of reverberation suppression, an indoor reverberation model or the WPE (Weighted Prediction Error) algorithm can be used. Taking the WPE algorithm as an example, it can estimate and eliminate early reflections and reverberation components through linear prediction.

[0036] During beamforming and reverberation suppression, processing latency also needs to be controlled. Typically, the processing latency can be set to tens of milliseconds to ensure no significant delay to real-time vehicle requirements (such as collision warning).

[0037] It is understandable that performing a short-time Fourier transform on the processed audio signal can extract the Mel spectrum or MFCC (Mel-Frequency Cepstral Coefficients) from the audio signal and use it as an audio feature.

[0038] Audio classification models can employ CNN (Convolutional Neural Networks), DNN (Deep Neural Networks), or Transformer networks. In some embodiments, Transformer networks can process variable-length sequences based on a self-attention mechanism, which can enhance the capture of audio features such as sudden sirens and improve classification accuracy.

[0039] During the training of the audio classification model, real in-vehicle / out-of-vehicle scene samples (different car models, speeds, roads) can be collected as training sets, and mixed data augmentation (adding background music, human voices, sirens, etc.) can be performed to improve robustness.

[0040] Audio types can include music, dialogue, wind noise, sirens, etc.

[0041] In step 102, the driving scenario of the vehicle is determined based on the audio characteristics, audio type, and vehicle operating information.

[0042] The operational signals can include vehicle speed, turn signals, window status, and air conditioning status. Vehicle operational information can be obtained from the CAN bus or OBD (On-Board Diagnostics). Driving scenarios can include highway driving, urban traffic congestion, and nighttime driving.

[0043] During implementation, the driving scenario of the vehicle can be determined by combining audio characteristics, audio type, and operational information, and the priority of the prompts to be played can be dynamically adjusted under different driving scenarios.

[0044] In some embodiments, the audio type includes wind noise, the audio features include the intensity of wind noise, the operating information includes vehicle speed and window status, and the driving scenario includes high-speed driving. Based on the audio features, audio type, and vehicle operating information, the driving scenario of the vehicle is determined, including: when the vehicle speed exceeds a first preset threshold, the window status is closed, and the intensity of wind noise exceeds a second preset threshold, the driving scenario of the vehicle is determined to be high-speed driving.

[0045] For example, when the vehicle speed is 120km / h, the windows are closed, the background music volume inside the vehicle is moderate, and the wind noise outside the vehicle is about 70dB(A), the driving scenario of the vehicle is determined to be high-speed driving.

[0046] For example, when the vehicle speed is 20 km / h, the vehicle is in an urban area, and the horn and human voices are about 65 dB(A), the driving scenario is determined to be urban congestion.

[0047] The above scheme can distinguish the audio types of different audio signals, and is superior to the traditional scheme that classifies based solely on thresholds in terms of real-time performance and accuracy. It also helps to maintain the clarity of prompts such as collision warnings and navigation announcements even in high noise conditions.

[0048] In step 103, the audio influence weights of different types of prompts are determined based on the driving scenario.

[0049] The types of alert sounds include multiple options such as collision warning, lane departure warning, turn signal, navigation announcement, fatigue alert, and entertainment audio sources.

[0050] In some embodiments, when the driving scenario is high-speed driving, the audio influence weight of five types of prompt sounds—collision warning, lane departure warning, steering prompt, navigation broadcast, and fatigue reminder—is increased, while the audio influence weight of prompt sounds from entertainment audio sources is decreased.

[0051] Understandably, based on the vehicle's operating information, the type of prompt tone to be played can be determined. If multiple prompt tones need to be played, a priority strategy for the prompt tones needs to be set.

[0052] In high-speed driving scenarios, wind noise increases significantly. Increasing the audio impact weight of five types of warning sounds—collision warning, lane departure warning, steering prompt, navigation broadcast, and fatigue reminder—while decreasing the audio impact weight of entertainment audio sources can improve driving safety and reduce interference with the driver.

[0053] In step 104, the target priority of the prompt tone to be played is determined according to the audio influence weight corresponding to the prompt tone to be played.

[0054] Understandably, vehicle alerts are usually pre-set with different priorities. Typically, collision warnings have a priority of 5, lane departure warnings have a priority of 4, turn signals have a priority of 3, navigation announcements have a priority of 2, and entertainment audio sources have a priority of 1. By using these pre-set priorities as the initial priorities and adjusting them using audio influence weights, the target priorities can be obtained.

[0055] In some embodiments, the initial priority of the prompt tone to be played can be determined; the speed influence weight of the prompt tone to be played can be determined based on the vehicle speed; the weather influence weight of the prompt tone to be played can be determined based on the weather information of the vehicle; the user influence weight of the prompt tone to be played can be determined based on the user preference mode; and the sum of the initial priority, speed influence weight, weather influence weight, user influence weight, and audio influence weight of the prompt tone to be played can be determined as the target priority of the prompt tone to be played.

[0056] Taking the types of prompts to be played as collision warning, lane departure warning, turn signal, navigation announcement, fatigue reminder, and entertainment audio as examples, the corresponding initial priorities are 5, 4, 3, 2, 2, and 1, respectively.

[0057] When the vehicle speed is within the first preset range, the speed influence weight of each prompt tone to be played is set to the initial value. When the vehicle speed is within the second preset range, the speed influence weight of the prompt to be played for collision warning and lane departure warning is increased. When the vehicle speed is within the third preset range, the speed influence weight of the prompt to be played for collision warning, lane departure warning, turn signal, and navigation broadcast is increased, while the speed influence weight of the prompt to be played for entertainment audio sources is decreased. The upper limit of the first preset range is less than or equal to the lower limit of the second preset range, and the upper limit of the second preset range is less than or equal to the lower limit of the third preset range.

[0058] In the implementation process, the first preset range can be 0 to 30 km / h, at which point the vehicle speed is low; the second preset range can be 30 to 60 km / h, at which point the vehicle speed is medium; the third preset range is greater than 60 km / h, and according to actual needs, the third preset range can be further subdivided into 60 to 120 km / h, corresponding to high speed, and greater than 120 km / h, corresponding to ultra-high speed.

[0059] When the vehicle speed is in different ranges, the weight of the speed influence can be determined by referring to Table 1 below:

[0060] Table 1

[0061] Speed ​​range Collision warning Lane departure Turning prompts Navigation broadcast Fatigue reminder Entertainment Music Sources low speed +0 +0 +0 +0 +0 +0 medium speed +1 +1 +0 +0 +0 +0 high speed +2 +1 +1 +1 +0 -1 ultra-high speed +3 +2 +1 +1 +1 -2

[0062] At high or ultra-high speeds, the speed-related weighting of collision warning audible alerts is significantly increased (+2 or +3), and the speed-related weighting of lane departure warning audible alerts is also increased to prevent vehicles from ignoring safety warnings at high speeds. The speed-related weighting of entertainment audio audible alerts is appropriately reduced (-1 or -2) to prevent excessively loud music from masking safety information.

[0063] In some embodiments, when the weather information of the vehicle is clear, the weather impact weights of each prompt tone to be played are determined to be initial values; when the weather information of the vehicle is not clear, the weather impact weights of the three types of prompt to be played (collision warning, lane departure, and fatigue reminder) are increased; when the weather information of the vehicle is at night, the weather impact weights of the two types of prompt to be played (collision warning and fatigue reminder) are increased, while the weather impact weights of the two types of prompt to be played (turning prompt and entertainment sound source) are decreased.

[0064] During implementation, weather information can include sunny, cloudy (e.g., rainy, snowy / foggy), and nighttime conditions. When weather information differs, the weight of weather impact can be determined by referring to Table 2 below:

[0065] Table 2

[0066] Weather information Collision warning Lane departure Turning prompts Navigation broadcast Fatigue reminder Entertainment Music Sources sunny +0 +0 +0 +0 +0 +0 rain +1 +1 +0 +0 +1 +0 Snow / Fog +2 +2 +0 +0 +1 -1 at night +1 +0 -1 +0 +2 -1

[0067] In rainy, snowy, or foggy weather, the weather impact weight of collision warning and lane departure warning audio will be increased. Fatigue alerts are especially needed at night, so the weather impact weight of fatigue alert audio will be increased by 2 from the initial value. The weather impact weight of turn signal and entertainment audio audio will be appropriately reduced to avoid excessive noise in the late night.

[0068] During implementation, user preference modes can include quiet mode, normal mode, loud mode, and custom mode. When different user preference modes are used, the user influence weight can be determined with reference to Table 3 below:

[0069] Table 3

[0070]

[0071] In Quiet Mode, the user impact weight of core safety prompts such as collision warnings remains at the default level or increases slightly, while the user impact weight of turn prompts, navigation announcements, and entertainment audio sources may be reduced. In Loud Mode, the user impact weight of all types of prompts to be played will be increased. In Custom Mode, users can manually set the + / - range for the user impact weight of different types of prompts to be played.

[0072] While the vehicle is in motion, whenever the driving scenario, speed range, weather information, or user preference pattern changes, the target priority can be recalculated in real time or periodically (e.g., every second / every 5 seconds) to keep up with the actual situation.

[0073] In step 105, the prompt tone to be played is played according to the target priority.

[0074] When there are multiple types of notification sounds to be played, the lower priority notification sounds can be dynamically delayed or attenuated based on the target priority.

[0075] During the playback of the prompt tone, the volume of the prompt tone can also be controlled. In some embodiments, the driving scenario can be input into the volume learning model to obtain the volume of the prompt tone to be played, which is output by the volume learning model; wherein, the volume learning model is trained based on historical driving scenarios, historical user adjustment times, and historical user satisfaction scores.

[0076] In implementation, the volume learning model can be trained based on reinforcement learning, defining a reward function as user satisfaction score minus the number of user adjustments. It iterates the Q-value of the driving scenario-volume pair decision, gradually converging to a strategy that maximizes user satisfaction. Alternatively, the volume learning model can be trained based on supervised learning, directly using historical data of "driving scenario - final volume adjustment by the user" for regression fitting. The model is updated every N driving cycles, making the automatic adjustment strategy more closely aligned with user habits.

[0077] By combining users' actual operating behavior and subjective feedback to optimize and adjust the volume of the notification sound to be played, users' satisfaction with the notification sound can be improved, and users can avoid being distracted or inconvenienced by frequent manual operation.

[0078] This application's embodiments determine audio characteristics and types based on audio signals collected from the vehicle; determine the vehicle's driving scenario based on the audio characteristics, audio type, and vehicle operating information; determine the audio influence weights of different types of prompts based on the driving scenario; determine the target priority of the prompts to be played based on their corresponding audio influence weights; and play the prompts to be played according to their target priority. The technical solution provided by this application enables real-time adjustment of the priority of prompts based on the vehicle's driving scenario, improving the user's driving experience.

[0079] The following describes an embodiment of the apparatus described in this application, which can be used to execute the playback control method for prompt sounds in the above embodiments of this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the playback control method for prompt sounds described above.

[0080] See Figure 2This diagram illustrates a block diagram of a prompt sound playback control device according to an embodiment of this application. Figure 2 As shown, the prompt tone playback control device of this application embodiment includes: an audio analysis module 201, a driving scenario determination module 202, a weight determination module 203, a priority determination module 204, and a prompt tone playback module 205. The audio analysis module 201 is used to determine audio features and audio types based on audio signals collected by the vehicle; the driving scenario determination module 202 is used to determine the vehicle's driving scenario based on the audio features, audio types, and vehicle operating information; the weight determination module 203 is used to determine the audio influence weights of different types of prompt tones based on the driving scenario; the priority determination module 204 is used to determine the target priority of the prompt tone to be played based on the audio influence weight corresponding to the prompt tone to be played; and the prompt tone playback module 205 is used to play the prompt tone to be played according to the target priority.

[0081] In some embodiments, the audio analysis module 201 is further configured to perform beamforming and reverberation suppression processing on the audio signal collected by the vehicle to obtain the processed audio signal; perform short-time Fourier transform on the processed audio signal to obtain audio features; and input the audio features into the audio classification model to obtain the audio type output by the audio classification model.

[0082] In some embodiments, the audio type includes wind noise, the audio features include the intensity of wind noise, the operating information includes vehicle speed and window status, the driving scenario includes high-speed driving, and the driving scenario determination module 202 is further configured to determine that the driving scenario of the vehicle is high-speed driving when the vehicle speed exceeds a first preset threshold, the window status is closed, and the intensity of wind noise exceeds a second preset threshold.

[0083] In some embodiments, the types of prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, navigation broadcast, fatigue reminder, and entertainment audio source. The weight determination module 203 is also used to increase the audio influence weight of the five types of prompts such as collision warning, lane departure warning, turn signal, navigation broadcast, and fatigue reminder, and decrease the audio influence weight of the prompts of the entertainment audio source type when the driving scenario is high-speed driving.

[0084] In some embodiments, the priority determination module 204 is further configured to determine the initial priority of the prompt tone to be played; determine the speed influence weight corresponding to the prompt tone to be played based on the vehicle speed; determine the weather influence weight corresponding to the prompt tone to be played based on the weather information of the vehicle; determine the user influence weight corresponding to the prompt tone to be played based on the user preference mode; and determine the target priority of the prompt tone to be played by summing the initial priority, speed influence weight, weather influence weight, user influence weight, and audio influence weight corresponding to the prompt tone to be played.

[0085] In some embodiments, the types of prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, navigation announcement, fatigue alert, and entertainment audio source. The priority determination module 204 is further configured to determine that the speed influence weights corresponding to each prompt to be played are all initial values ​​when the vehicle speed is within a first preset range; when the vehicle speed is within a second preset range, increase the speed influence weights corresponding to the two types of prompts to be played, collision warning and lane departure warning; when the vehicle speed is within a third preset range, increase the speed influence weights corresponding to the four types of prompts to be played, collision warning, lane departure warning, turn signal, and navigation announcement, and decrease the speed influence weights corresponding to the prompts to be played, such as entertainment audio source; wherein, the upper limit of the first preset range is less than or equal to the lower limit of the second preset range, and the upper limit of the second preset range is less than or equal to the lower limit of the third preset range.

[0086] In some embodiments, the types of prompts to be played include multiple types such as collision warning, lane departure warning, steering prompt, fatigue reminder, and entertainment audio sources. The priority determination module 204 is also used to determine that the weather influence weights corresponding to each prompt to be played are all initial values ​​when the weather information of the vehicle is sunny; and to increase the weather influence weights corresponding to the three types of prompts to be played, namely collision warning, lane departure warning, and fatigue reminder, when the weather information of the vehicle is not sunny.

[0087] When the weather information for the vehicle is nighttime, increase the weather impact weight of the two types of alert sounds to be played: collision warning and fatigue reminder, and decrease the weather impact weight of the two types of alert sounds to be played: turn signal and entertainment audio.

[0088] In some embodiments, the prompt sound playback module 205 is further configured to input the driving scenario into the volume learning model to obtain the volume of the prompt sound to be played output by the volume learning model; wherein, the volume learning model is trained based on historical driving scenarios, historical user adjustment times, and historical user satisfaction scores.

[0089] Based on the same inventive concept, this application also provides a vehicle, see reference. Figure 3 The diagram shows a structural schematic of a vehicle according to an embodiment of this application. The vehicle includes one or more memories 304, one or more processors 302, and at least one computer program (computer program instructions) stored in the memory 304 and executable on the processor 302. When the processor 302 executes the computer program, it implements the method described above.

[0090] Among them, Figure 3In this document, a bus architecture (represented by bus 300) is used. Bus 300 may include any number of interconnected buses and bridges, linking various circuits including one or more processors represented by processor 302 and memory represented by memory 304. Bus 300 may also link various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described further herein. Bus interface 305 provides an interface between bus 300 and receiver 301 and transmitter 303. Receiver 301 and transmitter 303 may be the same element, i.e., a transceiver, providing a unit for communicating with various other devices over a transmission medium. Processor 302 is responsible for managing bus 1200 and general processing, while memory 304 can be used to store data used by processor 302 during operation.

[0091] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing computer program instructions, which, when executed by a processor, cause the processor to perform the steps of the method described above.

[0092] Based on the same inventive concept, embodiments of this application provide a computer program product, including a computer program, which, when executed by a processor, causes the processor to perform the steps of the method described above.

[0093] The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored as one or more instructions or codes on or transmitted via a computer-readable medium. Other examples and embodiments are within the scope and spirit of this application and the appended claims. For example, due to the nature of software, the functions described above may be implemented using software executed by a processor, hardware, firmware, hardwired, or any combination thereof. Furthermore, the functional units may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit.

[0094] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0095] The units described as separate components may or may not be physically separate. Similarly, the components of the control device may or may not be physical units; they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0096] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing computer program instructions, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0097] The above description is merely an embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for controlling the playback of a notification tone, characterized in that, include: Based on the audio signals collected by the vehicle, determine the audio characteristics and audio type; The driving scenario of the vehicle is determined based on the audio characteristics, the audio type, and the vehicle's operating information. Based on the driving scenario, determine the audio influence weights of different types of prompt sounds; The target priority of the prompt tone to be played is determined based on the audio influence weight corresponding to the prompt tone to be played. The prompt tone to be played is played according to the target priority.

2. The method for controlling the playback of prompt sounds according to claim 1, characterized in that, The step of determining audio characteristics and audio type based on the audio signals collected by the vehicle includes: The audio signal collected by the vehicle is subjected to beamforming and reverberation suppression processing to obtain the processed audio signal; The processed audio signal is subjected to a short-time Fourier transform to obtain the audio features; The audio features are input into an audio classification model to obtain the audio type output by the audio classification model.

3. The method for controlling the playback of prompt sounds according to claim 1, characterized in that, The audio type includes wind noise, the audio feature includes wind noise intensity, the operating information includes vehicle speed and window status, the driving scenario includes high-speed driving, and determining the vehicle's driving scenario based on the audio feature, the audio type, and the vehicle's operating information includes: If the vehicle speed exceeds a first preset threshold, the windows are closed, and the wind noise intensity exceeds a second preset threshold, the driving scenario of the vehicle is determined to be high-speed driving.

4. The method for controlling the playback of prompt sounds according to claim 1, characterized in that, The types of prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, navigation announcement, fatigue alert, and entertainment audio sources. The step of determining the audio influence weight of different types of prompts based on the driving scenario includes: When the driving scenario is high-speed driving, the audio influence weight of five types of prompts—collision warning, lane departure warning, steering prompt, navigation broadcast, and fatigue reminder—is increased, while the audio influence weight of prompts from entertainment audio sources is decreased.

5. The method for controlling the playback of prompt sounds according to claim 1, characterized in that, The step of determining the target priority of the prompt tone to be played based on the audio influence weight corresponding to the prompt tone to be played includes: Determine the initial priority of the prompt tone to be played; Based on the vehicle's speed, determine the speed influence weight of the prompt tone to be played; Based on the weather information of the vehicle's location, determine the weather impact weight corresponding to the prompt tone to be played; Based on user preference patterns, determine the user influence weight corresponding to the prompt tone to be played; The target priority of the prompt tone to be played is determined by summing the initial priority, the speed influence weight, the weather influence weight, the user influence weight, and the audio influence weight corresponding to the prompt tone to be played.

6. The method for controlling the playback of prompt sounds according to claim 5, characterized in that, The types of prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, navigation announcement, fatigue alert, and entertainment audio sources. The determination of the speed influence weight corresponding to the prompt to be played based on the vehicle's speed includes: When the vehicle speed is within a first preset range, the speed influence weight of each prompt tone to be played is determined to be an initial value. When the vehicle speed is within the second preset range, the speed influence weight of the two types of warning sounds to be played, namely collision warning and lane departure warning, is increased. When the vehicle speed is within the third preset range, the speed influence weight of the four types of prompts to be played (collision warning, lane departure, turn prompt, and navigation broadcast) is increased, while the speed influence weight of the prompts to be played (entertainment audio source type) is decreased; wherein, the upper limit of the first preset range is less than or equal to the lower limit of the second preset range, and the upper limit of the second preset range is less than or equal to the lower limit of the third preset range.

7. The method for controlling the playback of prompt sounds according to claim 5, characterized in that, The types of the prompts to be played include multiple types such as collision warning, lane departure warning, turn signal, fatigue alert, and entertainment audio sources. The step of determining the weather impact weight corresponding to the prompts to be played based on the weather information of the vehicle's location includes: If the weather information for the vehicle is clear, the weather influence weights for each prompt tone to be played are determined to be initial values. When the weather information for the vehicle is not clear, the weather impact weights for the three types of warning sounds to be played—collision warning, lane departure warning, and fatigue reminder—are increased. When the weather information for the vehicle is nighttime, the weather impact weights for the two types of alert sounds to be played (collision warning and fatigue reminder) are increased, while the weather impact weights for the two types of alert sounds to be played (turn signal and entertainment audio) are decreased.

8. The method for controlling the playback of prompt sounds according to any one of claims 1 to 7, characterized in that, Also includes: The driving scenario is input into the volume learning model to obtain the volume of the prompt tone to be played, which is output by the volume learning model; wherein, the volume learning model is trained based on historical driving scenarios, historical user adjustment times, and historical user satisfaction scores.

9. A vehicle comprising a processor and a memory, characterized in that, The memory stores computer program instructions that can be executed by the processor, and when the processor executes the computer program instructions, it implements the steps of the method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processor, cause the processor to perform the steps of the method as described in any one of claims 1 to 8.

Images