Vehicle-mounted audio adjusting system and method
Through the on-board audio adjustment system, the use of microphone and processor to monitor and adjust audio data, the problem of traditional systems being unable to cope with changes in the car's noise and road conditions is solved, and high-quality audio experience and driving safety are improved in the car.
Patent Information
- Application Number
- CN202411187270.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-27
- Publication Date
- 2024-12-06
AI Technical Summary
Traditional audio systems cannot effectively deal with changes in the environmental noise in the car and road conditions, resulting in inconsistent user auditory experience under different driving conditions, affecting driving safety.
A vehicle-mounted audio adjustment system is designed to monitor the ambient audio data in the vehicle using a microphone. The processor determines the ambient noise characteristics and dynamically adjusts the audio setting parameters based on these characteristics to optimize the audio playback effect.
It realizes a high-quality audio experience that always maintains a high-quality audio experience under different interior environments and road conditions, reduces user adjustment operations, and improves driving safety and auditory comfort.
Smart Images

Figure CN119094956A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of audio adjustment, and in particular to a vehicle-mounted audio adjustment system and method. Background Art
[0002] In modern automotive technology, the improvement of driving experience is not limited to the vehicle's power performance and handling, the acoustic environment inside the car is also crucial. As users' requirements for driving comfort and entertainment experience continue to increase, the vehicle's audio system has also become one of the important indicators for measuring vehicle quality. However, the complexity of the in-car ambient noise and road conditions makes the optimization of audio playback a challenge.
[0003] Traditional audio systems are often unable to effectively cope with these changes, resulting in uneven listening experiences for users under different driving conditions. At the same time, due to the complex and changing noise levels in the car and road conditions, users often need to adjust the audio system in order to hear the audio clearly, which greatly reduces the safety of driving.
[0004] Therefore, it is desirable to provide an in-vehicle audio adjustment system and method that can dynamically adjust the audio playback effect in the vehicle according to the ambient noise in the vehicle and the road conditions, thereby providing the driver and passengers with a consistent high-quality acoustic experience. Summary of the invention
[0005] One or more embodiments of the present specification provide a vehicle-mounted audio adjustment system, the system comprising at least one microphone and a processor, the microphone being configured to monitor ambient audio data within the vehicle; the processor being configured to: determine ambient noise characteristics based on the ambient audio data acquired by the microphone; determine audio setting parameters based on the ambient noise characteristics; and adjust the vehicle-mounted audio system based on the audio setting parameters.
[0006] One or more embodiments of the present specification provide a method for adjusting an in-vehicle audio system, the method comprising: acquiring ambient audio data in a vehicle; determining ambient noise characteristics based on the ambient audio data; determining audio setting parameters based on the ambient noise characteristics; and adjusting the in-vehicle audio system based on the audio setting parameters.
[0007] One or more embodiments of the present specification provide a vehicle-mounted audio adjustment device, including a processor, wherein the processor is used to execute a vehicle-mounted audio system adjustment method.
[0008] One or more embodiments of the present specification provide a computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes a method for adjusting a vehicle audio system. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:
[0010] Figure 1 is a schematic diagram of an application scenario of a vehicle audio adjustment system according to some embodiments of this specification;
[0011] Figure 2 is an exemplary module diagram of a vehicle audio adjustment system according to some embodiments of this specification;
[0012] Figure 3 is an exemplary flow chart of a method for adjusting a vehicle audio system according to some embodiments of this specification;
[0013] Figure 4 is an exemplary flow chart of initially configuring a vehicle audio adjustment system according to some embodiments of this specification;
[0014] Figure 5 The present invention is an exemplary schematic diagram of determining audio setting parameters based on positioning data according to some embodiments of the present specification.
[0015] Figure 6 It is an exemplary schematic diagram of determining audio setting parameters according to some embodiments of this specification. DETAILED DESCRIPTION
[0016] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.
[0017] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.
[0018] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.
[0019] Flowcharts are used in this specification to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed precisely in order. Instead, the steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.
[0020] Figure 1 It is an exemplary schematic diagram of the application scenario of the vehicle audio adjustment system shown in some embodiments of this specification. The application scenario 100 of the vehicle audio adjustment system involved in the embodiments of this specification will be described in detail below. It should be noted that the following embodiments are only used to explain this application and do not constitute a limitation on this application.
[0021] like Figure 1 As shown, the application scenario 100 of the in-vehicle audio adjustment system may include a vehicle 110 , a user 120 , a microphone device 130 , a processing device 140 , a storage device 150 and an audio device 160 .
[0022] The vehicle 110 refers to a vehicle for carrying the vehicle audio tuning system. For example, the vehicle may be a car, an engineering vehicle, a truck, a passenger car, etc.
[0023] The vehicle 110 may be provided with a microphone device 130 and a vehicle positioning device (not shown). In some embodiments, the microphone device may be one or more. As an example, the microphone device may be placed at a preset position in the vehicle 110. For example, the microphone device may be installed at a preset position of the vehicle in an embedded or external manner. The preset position may be a central control roof, next to a navigation screen, next to a Save Our Ship (SOS) switch, next to a rearview mirror, etc.
[0024] In some embodiments, microphone device 130 may monitor ambient audio data from the interior and exterior environments of vehicle 110 .
[0025] The vehicle positioning device refers to a device used to determine the location of the vehicle. For example, the vehicle positioning device can be a GPS system, a Beidou positioning system, etc.
[0026] The user 120 refers to a person who uses the vehicle audio adjustment system. The user may include a user who starts and drives the vehicle 110, and other users who ride in the vehicle 110. In some embodiments, the user 120 may interact with other components in the vehicle audio adjustment system. For example, the user 120 may input the audio setting parameters that he likes into the vehicle audio adjustment system through a touch screen.
[0027] The processing device 140 can process data and / or information in the vehicle audio adjustment system 200. In some embodiments, the processing device 140 can be a computer, a user console, a single processor or a processor group, etc. The processor group can be centralized or distributed. In some embodiments, the processing device 140 can be local or remote. For example, the processing device 140 can access information and / or data stored in the storage device 150 via a network (not shown).
[0028] As another example, processing device 140 may be directly connected to storage device 150 to access stored information and / or data. In some embodiments, processing device 140 may be implemented on a cloud platform. By way of example only, a cloud platform may include a private cloud, a public cloud, or any combination thereof, etc.
[0029] The storage device 150 may store data, parameters, instructions and / or any other information. For example, the stored information may include, but is not limited to, data samples, audio setting parameters, user information, etc. In some embodiments, the storage device 150 may store data obtained from the microphone device 130 and / or the processing device 140. For example, ambient audio data, driving section characteristics, etc.
[0030] In some embodiments, storage device 150 may store data and / or instructions that processing device 140 may execute or use to execute the exemplary methods described in this disclosure. In some embodiments, storage device 150 may include a mass storage device, a removable storage device, or any combination thereof. In some embodiments, storage device 150 may be disposed on processing device 140.
[0031] The audio device 160 can play audio files. In some embodiments, the audio device can be one or more. As an example, the audio device can be placed in a preset position in the vehicle 110. The processing device 140 can adjust the parameters of the audio device playing audio based on the audio setting parameters.
[0032] It should be noted that the application scenario 100 of the vehicle audio adjustment system is provided for illustrative purposes only and is not intended to limit the scope of this specification. For those of ordinary skill in the art, various modifications or variations can be made based on the description of this specification. For example, the application scenario 100 of the vehicle audio adjustment system can be implemented on other devices to achieve similar or different functions. However, the changes and modifications will not deviate from the scope of this specification.
[0033] Figure 2 is an exemplary module diagram of a vehicle audio adjustment system according to some embodiments of this specification. Figure 2 As shown, the in-vehicle audio adjustment system 200 may include a microphone 210 and a processor 220 .
[0034] In some embodiments, microphone 210 is configured to monitor ambient audio data inside the vehicle. The microphone may be embedded. The microphone may be based on Figure 1 The microphone device 130 is shown implemented.
[0035] In some embodiments, the vehicle audio adjustment system 200 may further include a user preference module 230. In some embodiments, the user preference module 230 may be configured to obtain user preference parameters, determine the enabled user information in response to vehicle activation, retrieve the enabled user's preference parameters according to the enabled user information, and initially configure the vehicle audio system based on the enabled user's preference parameters.
[0036] Figure 3 FIG. 1 is an exemplary flow chart of a method for adjusting in-vehicle audio according to some embodiments of this specification. Figure 3 As shown, the process 300 includes the following steps. In some embodiments, the process 300 may be executed by a processor.
[0037] Step 310, obtaining ambient audio data in the vehicle.
[0038] In-vehicle refers to the environment inside the vehicle. In some embodiments, at least one microphone and at least one audio device may be provided inside the vehicle.
[0039] Ambient audio data refers to audio data that reflects the sound environment inside the car, such as audio data of passengers talking inside the car, audio data of air conditioning noise, audio data of engine noise, etc.
[0040] In some embodiments, the ambient audio data may be collected by a microphone disposed inside the vehicle.
[0041] In some embodiments, the microphone may acquire ambient audio data in real time.
[0042] Step 320 , determining the ambient noise characteristics based on the ambient audio data.
[0043] Environmental noise characteristics refer to the characteristics of environmental audio. For example, environmental noise characteristics may include environmental noise type and environmental noise intensity. In some embodiments, the processor may analyze environmental audio data and identify environmental noise type and environmental noise intensity based on the environmental audio data. Among them, environmental noise type refers to the type of noise identified by the processor based on environmental audio data, and environmental noise intensity refers to the intensity of the identified environmental noise. For example, environmental noise types may include engine noise, suspension system noise, air conditioning system noise, electronic equipment noise, and in-car conversation noise, and environmental noise intensity may include noise decibels, noise sound pressure level, noise intensity, and noise power level.
[0044] In some embodiments, the type of environmental noise may be determined based on statistics of all types of environmental noise inside the vehicle, and the intensity of environmental noise may be determined based on statistics of intensities of all environmental noise sources inside the vehicle.
[0045] Exemplarily, the processor may identify the type of ambient noise and the intensity of ambient noise for the ambient audio data based on a noise recognition algorithm, and determine the type of ambient noise and the intensity of ambient noise based on the statistical value of the ambient noise type of the recognized ambient audio data. For example, the processor may determine the mode of the recognized ambient noise type as the ambient noise type as the ambient noise characteristic, and the mean of the noise intensity of the ambient noise type as the ambient noise characteristic as the ambient noise intensity of the ambient noise characteristic.
[0046] In some embodiments, the noise recognition algorithm may include a support vector machine, a Gaussian mixture model, a convolutional neural network, or the like.
[0047] In some embodiments, the processor can also determine the environmental noise characteristics based on other methods. For example, the processor can also retrieve and determine the environmental noise characteristics based on vector retrieval technology. As an example only, the processor can extract key features (such as frequency, rhythm, sound source, etc.) from the collected environmental audio data, convert the extracted key features into feature vectors, and match the vectors similar to the feature vector in the noise feature database through vector retrieval technology (such as nearest neighbor search, cluster analysis, etc.) based on the feature vector, and determine the noise characteristics corresponding to the matched similar vectors as environmental noise characteristics. Among them, the noise feature database refers to a database containing environmental noise feature vectors, and the environmental noise feature vectors can be constructed based on historical environmental audio data. One environmental noise feature vector corresponds to a label, and the label can be used to represent the actual environmental noise characteristics corresponding to the environmental noise feature vector, etc.
[0048] Step 330: Determine audio setting parameters based on the environmental noise characteristics.
[0049] Audio setting parameters refer to the setting parameters of the vehicle audio system. For example, audio setting parameters may include volume setting parameters and sound effect setting parameters of the vehicle audio equipment. Among them, sound effect setting parameters may include audio clarity setting parameters, equalizer parameters, stereo effect setting parameters, reverberation setting parameters, etc. For more information about equalizer parameters, please refer to Figure 6 and its related description.
[0050] In some embodiments, the audio setting parameters may change in real time based on the environmental noise characteristics, and the processor may update the audio setting parameters accordingly based on the real-time changing environmental noise characteristics to achieve dynamic adjustment of the vehicle audio system.
[0051] In some embodiments, the processor may determine the audio setting parameters in a variety of ways based on the environmental noise characteristics. For example, the processor may determine the audio setting parameters by looking up a table based on the environmental noise characteristics.
[0052] As an example only, the processor may query the audio setting table for audio setting parameters corresponding to the ambient noise type and ambient noise intensity of the ambient noise characteristics; and determine the queried audio setting parameters as the audio setting parameters of the vehicle audio system.
[0053] Among them, the audio setting table can be a data table, including fields such as environmental noise type, environmental noise intensity, volume setting parameters, sound effect setting parameters, etc. The audio setting table records the mapping relationship between different environmental noise types, environmental noise intensities and corresponding volume setting parameters, and sound effect setting parameters.
[0054] In some embodiments, the audio setting table can be generated based on the historical adjustment data of the vehicle audio system by the user. For example, the processor can count the majority of the audio setting parameters actually confirmed or actually set by the user under different environmental noise characteristics into the audio setting table to generate a mapping relationship between different environmental noise characteristics and corresponding audio setting parameters. Among them, the actually confirmed audio setting parameters refer to the audio setting parameters that the user has not changed after the system generates them, or the audio setting parameters that the user has continuously used for more than a preset threshold after the audio setting parameters are determined. Among them, the preset threshold can be a time period, for example, 3 days, 2 hours, etc.
[0055] In some embodiments, the processor may also determine the audio setting parameters based on other methods. For example, the processor may determine the audio setting parameters based on an adaptive adjustment algorithm. As an example only, the processor may integrate an adaptive filter (e.g., an adaptive linear filter, an adaptive nonlinear filter, etc.), an adaptive adjustment algorithm (e.g., a minimum mean square error (LMS) algorithm, a recursive least squares (RLS) algorithm, etc.), etc., to dynamically adjust the audio setting parameters based on the environmental noise characteristics.
[0056] In some embodiments, the processor may also determine the audio setting parameters based on the user's preference parameters or the driving route characteristics. For more information about preference parameters and driving route characteristics, see Figure 4-Figure 5 Detailed description.
[0057] Step 340 , adjusting the vehicle audio system based on the audio setting parameters.
[0058] In some embodiments, the processor may adjust the relevant parameters of the vehicle audio system accordingly based on the audio setting parameters. For example, the processor may identify the volume setting parameters and the sound effect setting parameters that need to be adjusted based on the audio setting parameters, and adjust the vehicle audio system based on the volume setting parameters and the sound effect setting parameters.
[0059] In some embodiments of this specification, the processor determines audio setting parameters based on the acquired environmental noise characteristics, and automatically and dynamically adjusts the vehicle audio system based on the audio setting parameters, which can assist the user in realizing the self-update of the audio effect of the vehicle audio system, so as to reduce the user's adjustment operations and improve the user's driving safety. At the same time, it can enhance the user's listening experience, ensure that the audio playback of the audio equipment of the vehicle audio system is always at the best level, and realize that no matter how the environmental noise changes, the user can enjoy clear and high-quality audio playback.
[0060] Figure 4 FIG. 1 is an exemplary flow chart for determining an initial configuration of a vehicle audio adjustment system according to some embodiments of this specification. Figure 4 As shown, the process 400 may include the following steps 410 to 440. In some embodiments, the process 400 may be executed by the user preference module 230 or a processing device.
[0061] Step 410, obtaining user preference parameters.
[0062] A user refers to a person related to the vehicle audio adjustment system. In some embodiments, the user can be a driver or a passenger of the vehicle.
[0063] The preference parameters refer to the audio setting parameters that the user is most inclined to use when listening to the in-car audio. Different users may correspond to different preference parameters.
[0064] In some embodiments, the preference parameters may be expressed in a variety of ways. For example, the preference parameters may include volume preference, sound effect preference, etc. As an example only, the volume preference may be expressed as a volume preference range or a volume preference value, etc. For example, the volume preference range may be [30dB, 60dB].
[0065] In some embodiments, the audio setting parameters may also include other parameters, such as equalizer parameters, etc. For example, the preference parameters may also include an equalizer parameter preference range or an equalizer parameter preference value, etc. For more information about the equalizer parameters, see Figure 6 Relevant part.
[0066] In some embodiments, the user preference module 230 may obtain the preference parameters in a variety of ways. For example, the user preference module 230 may determine the preference parameters by obtaining user input.
[0067] In some embodiments, the user preference module 230 may also obtain the user's historical usage data; and determine the user's preference parameters based on the user's historical usage data.
[0068] The historical usage data refers to the audio setting parameters used by the user within a historical time range. In some embodiments, the user preference module 230 can obtain the historical usage data based on log data of a database.
[0069] In some embodiments, for a user, the user preference module 230 may determine the audio setting parameters that the user uses most frequently within a historical time range as the user's preference parameters.
[0070] In some embodiments of the present specification, preference parameters are determined based on historical usage data, and the user's preference parameters can be obtained without manual input by the user, which can improve the intelligence level of the vehicle audio adjustment system and enhance the user's experience.
[0071] Step 420 , in response to the vehicle being enabled, determining enabled user information.
[0072] Vehicle activation means that the user starts to use the vehicle. When the vehicle is activated, the vehicle audio system may need to provide the user with relevant audio playback services, and the vehicle audio adjustment system may prepare to adjust the vehicle audio system in advance.
[0073] In some embodiments, the user preference module 230 may determine whether the vehicle is in an enabled state based on a variety of methods. For example, the user preference module 230 may determine whether the vehicle is in an enabled state based on whether a preset event is triggered. As an example only, the preset event may be when a user starts the vehicle accelerator, when a user starts playing audio, when a user fastens a seat belt, or when a user unlocks the vehicle.
[0074] The enabled user information refers to the user information of the user served by the vehicle audio system after the vehicle enters the enabled state. In some embodiments, the enabled user may be a user in the vehicle after the vehicle enters the enabled state. For example, when the vehicle enters the enabled state, if there is one user in the vehicle, the user is the enabled user. If there are multiple users in the vehicle, the enabled user may be determined based on a pre-set determination rule. As an example only, the determination rule may be to determine that the driver is the enabled user.
[0075] In some embodiments, the enabled user may also be other users, such as a logged-in user of the vehicle audio adjustment system.
[0076] User information refers to information that reflects the basic characteristics of a user. In some embodiments, the user information may include the user's name, gender, age, etc. The user preference module 230 may obtain the enabled user information in a variety of ways. For example, the user preference module 230 may obtain the user information input by the user as the enabled user information through the interactive interface. For another example, the user preference module 230 may also obtain the relevant information filled in by the logged-in user of the vehicle audio adjustment system when registering the vehicle audio adjustment system to determine the enabled user information.
[0077] In some embodiments, the user preference module 230 may also obtain an image of the driver's seat occupant and determine the enabled user information based on the image of the driver's seat occupant.
[0078] The driver's seat occupant image refers to the driver's image collected by the vehicle. In some embodiments, the user preference module 230 can collect the driver's seat occupant image through a camera located inside the vehicle.
[0079] In some embodiments, the user preference module 230 can determine the enabled user information based on the driver's seat occupant image in a variety of ways. For example, the user preference module 230 can determine the enabled user information based on the driver's seat occupant image through an image database. The image database may include multiple reference user images and corresponding reference enabled user information. The image database may be constructed based on historical data.
[0080] Just as an example, the user preference module 230 may use the historical user image recorded in advance as the reference user image, and use the historical enabled user information corresponding to the reference user image as the reference enabled user information corresponding to the reference user image.
[0081] In some embodiments, the user preference module 230 may determine the enabled user information based on the similarity between the driver's seat occupant image and a plurality of reference user images in the image database. For example, a reference user image whose similarity with the driver's seat occupant image satisfies a preset similarity condition is used as the target user image, and the reference enabled user information corresponding to the target user image is used as the final enabled user information. The similarity comparison method may include but is not limited to the mean square error (MSE) method, the histogram comparison method, etc.; the similarity preset condition may be set according to the situation. For example, the similarity is maximum, or the similarity is greater than a preset threshold, etc.
[0082] In some embodiments of the present specification, determining the enabled user information through the image of the driver's seat occupant can further reduce the operations required by the user, thereby obtaining the enabled user information conveniently and quickly, which helps to improve the intelligence level of the vehicle audio adjustment system and enhance the user experience.
[0083] Step 430, retrieve the preference parameters of the enabled user according to the enabled user information.
[0084] In some embodiments, the user preference module 230 can retrieve the preference parameters of the enabled user in a variety of ways. For example, the user preference module 230 can also establish a first preset table based on the enabled user information and the preference parameters of the enabled user. The first preset table includes the correspondence between different enabled user information and preference parameters. The processor can retrieve the preference parameters of the currently enabled user according to the current enabled user information by referring to the first preset table. For how to determine the preference parameters of the enabled user, please refer to the relevant description above.
[0085] In some embodiments, the user preference module 230 can also perform similarity matching in historical data based on the current enabled user information, select historical enabled user information whose similarity meets the preset similarity condition as the reference enabled user information, and determine the historical preference parameters corresponding to the reference enabled user information as the preference parameters of the current enabled user. The preset similarity condition can be set according to the situation. For example, the similarity is the maximum, or the similarity is greater than a preset threshold, etc.
[0086] Step 440 , initially configure the vehicle audio system based on the preferred parameters of the enabled user.
[0087] Initial configuration refers to the operation of initializing the audio setting parameters of the vehicle audio system. In some embodiments, the user preference module 230 can use the preference parameters to update the original audio setting parameters of the vehicle audio system, thereby achieving the initial configuration of the vehicle audio system.
[0088] In some embodiments of the present specification, after the vehicle is started, the vehicle audio system is initially configured using preference parameters to ensure that the vehicle audio system can remember the user's audio setting parameters and provide a customized audio listening experience; when the audio setting parameters need to be adjusted, the vehicle audio adjustment system can also respond in a timely manner and update the adjusted audio setting parameters in a short time.
[0089] It should be noted that the above description of process 400 is only for example and explanation, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to process 400 under the guidance of this specification. However, these modifications and changes are still within the scope of this specification.
[0090] Figure 5 The present invention is an exemplary schematic diagram of determining audio setting parameters based on positioning data according to some embodiments of the present specification.
[0091] In some embodiments, the processor may determine the driving segment characteristics 520 based on the vehicle positioning data 510 .
[0092] Vehicle positioning data 510 refers to data reflecting the location of the vehicle. In some embodiments, the vehicle positioning data may include vehicle location coordinates, etc. The processor may obtain the vehicle positioning data through a positioning module installed on the vehicle. The positioning module may include but is not limited to a satellite positioning system, an inertial navigation system, etc.
[0093] The driving segment feature 520 may reflect the relevant features of the vehicle driving segment. In some embodiments, the driving segment feature may include the segment noise feature and the road type of the segment.
[0094] The road section noise characteristics can reflect the environmental noise related properties of the road section where the vehicle is traveling. In some embodiments, the road section noise characteristics can include the road section noise volume, the road section noise frequency distribution, etc. As an example only, the road section noise characteristics can be represented by a road section noise spectrum, where the horizontal axis of the road section noise spectrum is the frequency and the vertical axis is the volume.
[0095] In some embodiments, the processor may obtain the environmental noise of the road section where the vehicle is traveling through a vehicle microphone or other device, and obtain the road section noise spectrum through a frequency analysis method, wherein the frequency analysis method may include a short-time Fourier transform (STFT) method, a wavelet transform (Wavelet Transform) method, and the like.
[0096] The road type may reflect the attribute characteristics of the road on which the vehicle is traveling. In some embodiments, the road type may include residential roads, industrial roads, rural roads, highways, etc. The processor may determine the road type in a variety of ways. For example, the road type corresponding to different vehicle driving sections may be obtained from a third-party platform (e.g., a navigation map, a road query website, etc.). For another example, the processor may also determine the manually selected road type as the road type corresponding to the vehicle driving section.
[0097] In some embodiments, the processor may also determine the road type based on querying a preset road type table. The processor may construct a preset road type table based on the road section and the road type. The preset road type table contains the correspondence between different road sections and different road types. The processor may determine the road section on which the current vehicle is traveling based on the current vehicle positioning information, and then determine the current road type by querying the preset road type table.
[0098] In some embodiments, the processor may determine the road segment noise stability 530 based on the driving segment characteristics 520 .
[0099] The road section noise stability 530 can measure the fluctuation of the road section noise characteristics of the road section. In some embodiments, the road section noise stability can be characterized based on multiple methods. For example, the road section noise stability can be represented based on a numerical value. As an example only, the road section noise stability can be represented as a numerical value of 0 or 1. When the road section noise stability is 1, it means that the road section noise characteristics are stable. When the road section noise stability is 0, it means that the road section noise characteristics are unstable.
[0100] In some embodiments, the processor can determine the road section noise stability 530 in a variety of ways. For example, the processor can determine the road section noise stability based on a second preset table. The second preset table contains a correspondence between driving section characteristics and noise stability of different sections. The processor can determine the current road section noise stability by querying the second preset table based on the current driving section characteristics.
[0101] In some embodiments, the processor can construct a second preset table based on historical driving section features collected historically and the corresponding historical section noise stability. Among them, for a road type, the processor can obtain at least one group of historical section noise features of the same road type based on historical data. The processor can count the environmental noise fluctuation range of each group of historical section noise features. When the environmental noise fluctuation range is greater than the preset environmental noise fluctuation threshold, it means that the section noise stability of the road section is unstable, and the historical section noise stability corresponding to the historical driving section feature is 0. Otherwise, the historical section noise stability is 1. The processor can obtain the historical section noise stability corresponding to each historical driving section feature through the above method, thereby constructing a second preset table.
[0102] In some embodiments, for a section of a vehicle driving road, the processor may also determine the maximum noise volume and the minimum noise volume of the section based on the road noise volume of the section. When the difference between the maximum noise volume and the minimum noise volume is greater than a preset difference threshold, the processor may set the road noise stability of the road section feature to 0. Otherwise, the road noise stability of the road section is set to 1. The preset difference threshold may be determined based on prior experience.
[0103] In some embodiments, in response to the road section noise stability 530 satisfying a preset condition, the processor may determine the audio setting parameter 540 based on the driving section feature 520 and the vehicle type.
[0104] The preset condition refers to a judgment condition for judging whether the road section noise stability is stable. In some embodiments, the preset condition may be: the evaluation result of the road section noise stability is stable.
[0105] The vehicle type can be characterized based on the model of the vehicle. For example, vehicles of the same model can be considered as the same vehicle type.
[0106] In some embodiments, the processor may determine the audio setting parameters based on a variety of methods. For example, the processor may obtain the audio setting parameters of vehicles of the same vehicle type when traveling on a road section with the same driving section characteristics based on historical data. The processor may count the audio setting parameters that appear most frequently and determine them as the currently required audio setting parameters.
[0107] In some embodiments, the processor may also obtain, in real time based on the network, audio setting parameters of vehicles of the same type of vehicle when traveling on a road section with the same driving section characteristics. The processor may count the audio setting parameters that appear most frequently and determine them as the currently required audio setting parameters.
[0108] In some embodiments of the present specification, since the noise characteristics of the external environment are relatively stable in some driving sections, and the amplitude of fluctuation over time is small, when the vehicle is driving on a section where the noise stability is relatively stable, the audio setting parameters of the current vehicle can be directly referenced to the audio setting parameters of the same type of vehicle, thereby simplifying the relevant steps of analyzing and processing the environmental noise characteristics, helping to reduce the amount of data calculation for determining the audio setting parameters and reducing power consumption.
[0109] In some embodiments, the processor may also determine audio setting parameters 540 based on the preference parameters of the enabled user, driving segment characteristics 520 , and vehicle type.
[0110] In some embodiments, the processor may obtain multiple groups of historical data from a historical database and construct corresponding historical vectors, and determine the audio setting parameters of the enabled user by means of vector matching.
[0111] In some embodiments, the processor can construct a corresponding history vector based on the history preference parameters of the history-enabled user, the history driving section characteristics, and the history vehicle type. For example, if the history preference parameters of the history-enabled user are A, the history driving section characteristics are B, and the history vehicle type is C, then the corresponding history vector is [A, B, C].
[0112] The processor may cluster the historical vectors in the historical data by a clustering algorithm to obtain a plurality of cluster centers. The processor may determine the historical vectors corresponding to the cluster centers as standard vectors. There may be multiple types of clustering algorithms, for example, the clustering algorithm may include K-Means clustering, density-based clustering method (DBSCAN), etc. There is no limitation on the types of clustering algorithms herein.
[0113] When it is necessary to determine the audio setting parameters of the currently enabled user, the processor can construct a vector to be matched based on the preference parameters of the currently enabled user, the characteristics of the driving section, and the type of vehicle, and calculate the similarity between the vector to be matched and different standard vectors, and use the standard vector that meets the preset similarity conditions as the target vector. The processor can query the historical data corresponding to the target vector, and determine the historical audio setting parameters corresponding to the target vector as the audio setting parameters of the currently enabled user. The preset similarity conditions can be the highest similarity or the similarity is greater than a preset threshold, etc. The similarity between vectors can be determined based on the distance between vectors, and the distance between vectors is inversely proportional to the similarity between vectors. The distance between vectors can be a cosine distance, etc.
[0114] In some embodiments, when there are multiple historical audio setting parameters corresponding to the target vector, the processor may select the historical audio setting parameter with the longest actual usage time as the audio setting parameter of the currently enabled user.
[0115] In some embodiments of the present specification, audio setting parameters 540 are determined based on the preference parameters of the enabled user, the driving section characteristics 520, and the vehicle type. The influence of the user preference, the vehicle sound insulation performance, and the environmental noise of different types of sections on the audio setting parameters can be comprehensively considered, so as to obtain audio setting parameters that are closer to the actual usage scenario of the enabled user, thereby improving the user's usage experience.
[0116] In some embodiments, the processor may also determine the audio setting parameters 540 based on the preference parameters of the enabled user, the driving segment characteristics 520 , and the vehicle type through a parameter determination model.
[0117] The parameter determination model is a prediction model for determining audio setting parameters. In some embodiments, the parameter determination model can be a machine learning model. For example, any one or combination of a neural network (NN) model or other customized model structures.
[0118] In some embodiments, the input of the parameter determination model may include driving segment characteristics 520 , vehicle type, and preferred audio setting parameters of an enabled user, and the output may include audio setting parameters 540 .
[0119] The parameter determination model can be obtained by training a large number of first training samples with first labels. In some embodiments, the first training sample may include sample driving section features, sample vehicle types, and sample preferred audio setting parameters of enabled users. The first training sample can be obtained based on historical data. The first label can be a historical audio setting parameter corresponding to the first training sample. When there are multiple historical audio setting parameters, the processor can select a historical audio setting parameter whose actual usage time exceeds a preset time threshold as the audio setting parameter corresponding to the first training sample.
[0120] In some embodiments, the processor can perform training based on the first training sample and the first label by various methods. For example, training can be performed based on the gradient descent method. As an example only, multiple first training samples with first labels can be input into the initial parameter determination model, a loss function can be constructed by the first label and the result of the initial parameter determination model, and the parameters of the initial parameter determination model can be iteratively updated based on the loss function. When the loss function of the initial parameter determination model meets the preset conditions, the model training is completed, and a trained parameter determination model is obtained. Among them, the preset conditions can be that the loss function converges, the number of iterations reaches a threshold, etc.
[0121] In some embodiments of the present specification, by using the parameter determination model to determine the audio setting parameters 540, the data processing capability and data analysis capability of the model can be fully utilized to obtain the audio setting parameter results accurately and reliably in a short time.
[0122] Figure 6 It is an exemplary schematic diagram of determining audio setting parameters according to other embodiments of this specification.
[0123] In some embodiments, audio setting parameters 540 also include equalizer parameters.
[0124] The equalizer parameters are control parameters used to adjust the audio frequency response. By setting different equalizer parameters, the sound effect of the played audio can be adjusted. In some embodiments, the equalizer parameters may include adjustment amplitudes corresponding to different frequencies.
[0125] In some embodiments, the processor may determine at least one candidate parameter 620 .
[0126] Candidate parameter 620 refers to candidate audio setting parameter 540. The composition of candidate parameter 620 is similar to that of audio setting parameter 540, which can be seen in Figure 3 Relevant part.
[0127] In some embodiments, the processor may determine at least one candidate parameter 620 in a variety of ways. For example, the processor may select a preset number of historical audio setting parameters that were last used most recently from the historical data and determine them as candidate parameters. For another example, the processor may count all historical audio setting parameters that have been used by the vehicle in the historical data and sort them from high to low according to the frequency of use. A preset number of historical audio setting parameters that are ranked top are selected and determined as candidate parameters.
[0128] In some embodiments, the processor may evaluate the volume comfort 630 and / or the sound effect comfort 640 of at least one candidate parameter 620 based on the environmental noise feature 610 .
[0129] The volume comfort 630 of the candidate parameters can evaluate the listening comfort related to the volume of the enabled user under the corresponding candidate parameters. In some embodiments, since different users have different perceptions of volume, and different users also have different preferred volume, determining the audio setting parameters 540 based on the volume comfort 630 can better meet the actual audio playback needs of the user.
[0130] In some embodiments, the volume comfort level 630 of the candidate parameter may be expressed as a numerical value. The larger the numerical value, the higher the listening comfort level of the enabled user when listening to audio with the candidate parameter.
[0131] In some embodiments, the processor may evaluate the volume comfort level 630 and / or the sound effect comfort level 640 of the candidate parameter 620 in a variety of ways.
[0132] In some embodiments, the volume comfort level 630 may be related to the volume level of the candidate parameter 620 , the volume level of the ambient noise, and a preset volume range.
[0133] For ease of description and illustration purposes only, the processor may determine the volume comfort level 630 based on formula (1):
[0134]
[0135] Among them, L is the volume comfort, S Y is the candidate parameter volume size, S Zis the volume of the ambient noise, A is the upper limit of the preset volume range, B is the lower limit of the preset volume range, k1 and k2 are coefficients greater than 0. The values of coefficients k1 and k2 can be determined based on prior experience; A>B≥0. The preset volume range [B, A] can be a system default value or can be determined based on user input; the candidate parameter volume size S Y The volume of the ambient noise S can be determined based on the candidate parameters. Z It can be determined based on the environmental noise characteristics. For more information about environmental noise characteristics, see Figure 3 part.
[0136] In some embodiments, the processor may also evaluate the volume comfort 630 and / or the sound comfort 640 of at least one candidate parameter 620 based on the ambient noise characteristics 610, the vehicle type, the preference parameters, and the preset volume range through a parameter evaluation model.
[0137] The parameter evaluation model is an evaluation model for determining the volume comfort 630 and / or the sound effect comfort 640 of the candidate parameter 620. In some embodiments, the parameter evaluation model may be a machine learning model. For example, the parameter evaluation model may include any one or combination of a NN model or other customized model structures.
[0138] In some embodiments, the input of the parameter evaluation model may include environmental noise characteristics 610, vehicle type, at least one candidate parameter 620, preference parameters, and a preset volume range, and the output may include volume comfort 630 and / or sound comfort 640 of at least one candidate parameter 620. For more information about environmental noise characteristics 610 and vehicle type, see Figure 3 and Figure 5 For more information about preference parameters, see Figure 4 More information about preset volume ranges and volume / sound comfort levels can be found above.
[0139] In some embodiments, the processor may train the parameter evaluation model based on a large number of second training samples with second labels. In some embodiments, the second training samples may include sample environmental noise characteristics, sample vehicle types, at least one sample parameter, sample preference parameters, and sample preset volume ranges. The second label may be a sample volume comfort level and / or a sample sound effect comfort level of the sample parameter.
[0140] In some embodiments, the second training sample can be obtained based on historical data, and the second label corresponding to the second training sample can be negatively correlated to the number of volume parameter adjustments and / or equalizer parameter adjustments made by the user within a preset time range after using the sample parameters. For example, the sample volume comfort level can be 1 / (volume parameter adjustment number + α), and the sample sound effect comfort level can be 1 / (equalizer parameter adjustment number + α). Where α is a coefficient greater than 0. The coefficient α and the preset time range can be determined based on prior experience.
[0141] The specific steps for training the parameter evaluation model are similar to the steps for training the parameter determination model. Figure 5 Related content.
[0142] In some embodiments of the present specification, by using a parameter evaluation model to evaluate the volume comfort 630 and / or sound effect comfort 640 of at least one candidate parameter, the data processing capability and data analysis capability of the model can be fully utilized to accurately and reliably obtain the volume comfort and / or sound effect comfort in a short time, thereby laying the foundation for quickly and accurately determining the audio setting parameters 540.
[0143] In some embodiments, the parameter evaluation model may include a volume comfort evaluation layer and a sound effect comfort evaluation layer.
[0144] The volume comfort evaluation layer is an evaluation model for determining the volume comfort 630 of the candidate parameter 620. The sound effect comfort evaluation layer is an evaluation model for determining the sound effect comfort 640 of the candidate parameter 620. In some embodiments, the volume comfort evaluation layer and the sound effect comfort evaluation layer can be machine learning models, such as any one or combination of NN models or other customized model structures.
[0145] In some embodiments, the input of the volume comfort evaluation layer may include environmental noise characteristics, vehicle type, at least one candidate parameter 620 , preference parameters, and a preset volume range, and the output may include the volume comfort 630 of the at least one candidate parameter 620 .
[0146] In some embodiments, the input of the acoustic comfort evaluation layer may include environmental noise characteristics, vehicle type, at least one candidate parameter 620 and a preference parameter, and the output may include the acoustic comfort 640 of the at least one candidate parameter 620 .
[0147] In some embodiments, the volume comfort evaluation layer and the sound effect comfort evaluation layer can be acquired through separate training.
[0148] In some embodiments, the processor may train the volume comfort evaluation layer based on a large number of third training samples with third labels. The third training samples may include sample environmental noise characteristics, sample vehicle types, at least one sample parameter, sample preference parameters, and sample preset volume ranges. The third label may include sample volume comfort and sample sound effect comfort of the sample parameter.
[0149] In some embodiments, the sample environmental noise characteristics, sample vehicle type, at least one sample parameter, sample preference parameter, and sample preset volume range included in the third training sample may be the same as those in the second training sample, and the sample volume comfort level included in the third label may be the same as that included in the second label. For more information about the second training sample and the second label, please refer to the relevant description above.
[0150] In some embodiments, the processor may train the sound effect comfort evaluation layer based on a large number of fourth training samples with fourth labels. The fourth training samples may include sample environmental noise characteristics, sample vehicle types, at least one sample parameter, and sample preference parameters. The fourth label may include sample sound effect comfort of the sample parameter.
[0151] In some embodiments, the sample environmental noise characteristics, sample vehicle type, at least one sample parameter, and sample preference parameter included in the fourth training sample may be the same as those in the second training sample, and the sample sound comfort included in the fourth label may be the same as the sample sound comfort included in the second label. For more information about the second training sample and the second label, please refer to the relevant description above.
[0152] In some embodiments of the present specification, by splitting the parameter evaluation model into a volume comfort evaluation layer and a sound effect comfort evaluation layer, each evaluation layer can be focused on evaluating a specific comfort level, which can effectively speed up the training of the parameter evaluation model and improve the accuracy of the parameter evaluation model in evaluating volume comfort and sound effect comfort.
[0153] In some embodiments, the processor may determine the audio setting parameter 540 based on the volume comfort level 630 and / or the sound effect comfort level 640 of at least one candidate parameter.
[0154] In some embodiments, for a candidate parameter, the processor may determine the comfort score of the candidate parameter based on the weighted sum of the volume comfort and the sound effect comfort of the candidate parameter. The processor may count the comfort scores of all candidate parameters and determine the candidate parameter with the highest comfort score as the audio setting parameter 540. The weights of the volume comfort and the sound effect comfort may be preset.
[0155] In some embodiments of the present specification, by making the audio setting parameter 540 also include an equalizer parameter, and determining the audio setting parameter 540 based on the volume comfort 630 and the sound effect comfort 640, the equalizer parameter can be adjusted while adjusting the volume, thereby achieving functions such as enhancing speech clarity or strengthening low-frequency effects. The versatility of the vehicle audio adjustment system can be improved, ensuring that the vehicle can provide users with clear and high-quality audio playback on different driving sections, thereby improving the user's audio listening experience.
[0156] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.
[0157] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.
[0158] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.
[0159] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.
[0160] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values is as accurate as possible within the feasible range.
[0161] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.
[0162] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.
Claims
1. A vehicle audio adjustment system, characterized in that: The system includes at least one microphone and a processor, the microphone being configured to monitor ambient audio data within a vehicle; The processor is configured to: Determining environmental noise characteristics based on the environmental audio data acquired by the microphone; Determining audio setting parameters based on the environmental noise characteristics; The vehicle audio system is adjusted based on the audio setting parameters.
2. The system according to claim 1, characterized in that The system also includes a user preference module configured to: Get the user's preference parameters; In response to vehicle activation, determining activation user information; Retrieving the preference parameters of the enabled user according to the enabled user information; The in-vehicle audio system is initially configured based on the preference parameters of the enabled user.
3. The system according to claim 1, characterized in that The processor is further configured to: Determine the characteristics of the driving section based on the vehicle positioning data; Determining the road section noise stability based on the driving road section characteristics; In response to the road section noise stability satisfying a preset condition, the audio setting parameters are determined based on the driving road section characteristics and the vehicle type.
4. The system according to claim 1, characterized in that The audio setting parameters also include equalizer parameters; The processor is further configured to: determining at least one candidate parameter; Based on the environmental noise characteristics, evaluating the volume comfort and / or sound effect comfort of the at least one candidate parameter; The audio setting parameter is determined based on the volume comfort level and / or the sound effect comfort level of at least one candidate parameter.
5. A method for adjusting a vehicle audio system, characterized in that: include: Get the ambient audio data inside the car; determining an ambient noise characteristic based on the ambient audio data; Determine audio setting parameters based on environmental noise characteristics; The vehicle audio system is adjusted based on the audio setting parameters.
6. The method according to claim 5, characterized in that The method further comprises: Get the user's preference parameters; In response to vehicle activation, determining activation user information; Retrieving the preference parameters of the enabled user according to the enabled user information; The in-vehicle audio system is initially configured based on the preference parameters of the enabled user.
7. The method according to claim 5, characterized in that The method further comprises: Determine the characteristics of the driving section based on the vehicle positioning data; Determining the road section noise stability based on the driving road section characteristics; In response to the road section noise stability satisfying a preset condition, the audio setting parameters are determined based on the driving road section characteristics and the vehicle type.
8. The method according to claim 5, characterized in that The determining of the audio setting parameters based on the environmental noise characteristics includes: determining at least one candidate parameter; Based on the environmental noise characteristics, evaluating the volume comfort and / or sound effect comfort of the at least one candidate parameter; The audio setting parameter is determined based on the volume comfort level and / or the sound effect comfort level of at least one candidate parameter. 9 . An in-vehicle audio adjustment device, comprising a processor, wherein the processor is used to execute the in-vehicle audio system adjustment method according to any one of claims 5 to 8.
10. A computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes the method for adjusting the vehicle audio system according to any one of claims 5 to 8.
