Method for adjusting sound in vehicle and vehicle

Abstract

The invention discloses a method for adjusting sound in a vehicle and the vehicle. The method can comprise the steps that in the vehicle driving process, audio data output by a vehicle and state information of the vehicle are obtained, and the state information is used for representing the driving state of the vehicle; based on the state information, sound parameters corresponding to the audio data are determined, and the sound parameters are used for representing the intensity and / or loudness of sound corresponding to the audio data; based on the sound parameters, the sound dosage of the sound is determined, and the sound dosage is used for representing the influence degree of the sound on the hearing of a driving object in the vehicle; and in response to the fact that the sound dosage is larger than the sound dosage threshold value, the vehicle is controlled to execute first adjustment operation on the sound, and the adjusted sound dosage of the sound is smaller than or equal to the sound dosage threshold value. The technical problem of low adjustment accuracy of the sound in the vehicle is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle electronics, in particular to a sound adjustment method in a vehicle and a vehicle. BACKGROUND

[0002] At present, the vehicle-mounted media system (entertainment system) of the current vehicle generally adopts a linear gain control mechanism in terms of volume adjustment. A user adjusts the loudness of audio output by setting a volume level (Level). However, the above adjustment method does not fully consider the dynamic characteristics of the audio signal and the real loudness change thereof in different vehicle environments, resulting in inaccurate assessment of the risk of hearing impairment. Therefore, the current vehicle-mounted media hearing protection scheme has technical problems in accurately assessing the risk of hearing impairment and implementing dynamic volume adjustment to protect hearing health. The above method still has the technical problem of low accuracy of sound adjustment in a vehicle.

[0003] At present, no effective solution has been proposed for the above technical problems. SUMMARY

[0004] The embodiments of the present application provide a sound adjustment method in a vehicle and a vehicle to at least solve the technical problem of low accuracy of sound adjustment in a vehicle.

[0005] According to an aspect of an embodiment of the present application, a sound adjustment method in a vehicle is provided. The method can include: obtaining audio data output by a vehicle and state information of the vehicle during driving of the vehicle, wherein the state information is used to indicate a driving state of the vehicle; determining a sound parameter corresponding to the audio data based on the state information, wherein the sound parameter is used to indicate an intensity and / or a loudness of a sound corresponding to the audio data; determining a sound dose of the sound based on the sound parameter, wherein the sound dose is used to indicate an influence degree of the sound on hearing of a driver or passenger in the vehicle; and in response to the sound dose being greater than a sound dose threshold, controlling the vehicle to perform a first adjustment operation on the sound, wherein a sound dose of the adjusted sound is less than or equal to the sound dose threshold.

[0006] Optionally, determining the sound parameter corresponding to the audio data based on the state information includes: determining a root mean square value of the audio data, wherein the root mean square value is used to indicate an average intensity of the audio data; determining actual output decibel information of the audio data based on the root mean square value and the state information, wherein the actual output decibel information is used to indicate a size of an effective sound pressure level of the audio data reaching the driver or passenger; and determining the sound parameter based on the actual output decibel information.

[0007] Optionally, the audio data is a pulse code modulation stream, a sample value of the pulse code modulation stream is used to represent an instantaneous amplitude of the audio data, and the determining the root mean square value of the audio data comprises: converting the sample value from an integer to a floating point number, and obtaining a total number of samples of the sample value; determining a sum of squares of the converted floating point number of the total number of samples; and determining a square root of a quotient between the sum and the total number of samples as the root mean square value.

[0008] Optionally, the state information comprises vehicle speed information, and the determining the actual output decibel information of the audio data based on the root mean square value and the state information comprises: determining full scale decibel information of the audio data based on the root mean square value, wherein the full scale decibel information is used to represent loudness and / or level intensity of the audio data relative to a full scale of the entertainment system in the vehicle; and determining the actual output decibel information based on the full scale decibel information and the vehicle speed information.

[0009] Optionally, the actual output decibel information is a sound pressure level used to represent a size of a sound relative to a reference sound pressure, and the sound parameter is a root mean square sound pressure, and the determining the sound parameter based on the actual output decibel information comprises: determining the root mean square sound pressure based on the sound pressure level and the reference sound pressure.

[0010] Optionally, the method further comprises: determining a safe sound dose of the occupant in the target period based on a hearing safety strategy of the occupant; and determining the safe sound dose as a sound dose threshold.

[0011] Optionally, the determining the sound dose of the sound based on the sound parameter comprises: determining sound sub-doses of the sound in different time segments in the target period based on the sound parameter; and determining the sound dose of the target period based on the sound sub-doses corresponding to the different time segments respectively.

[0012] Optionally, in response to the sound dose being greater than the sound dose threshold, the controlling the vehicle to perform a first adjustment operation on the sound comprises: in response to the sound dose of the target period being greater than the sound dose threshold of the target period, sending prompt information to the occupant; in response to the occupant performing a confirmation adjustment operation on the prompt information, controlling the entertainment system in the vehicle to perform the first adjustment operation on the sound at a current time; and the method further comprises at least one of the following: in response to the occupant performing a cancellation adjustment operation on the prompt information, controlling the entertainment system not to perform the first adjustment operation on the sound at the current time, and re-sending the prompt information to the occupant after a first target time length after the current time; and in response to the occupant not performing the confirmation adjustment operation and the cancellation adjustment operation on the prompt information, controlling the entertainment system not to perform the first adjustment operation on the sound after a second target time length after the current time, and canceling sending the prompt information to the occupant.

[0013] Optionally, the method further comprises: in response to the second adjustment operation performed by the occupant on the sound, outputting the sound at a volume indicated by the second adjustment operation at the current time, wherein the sound dose of the adjusted sound is greater than the sound dose threshold; and sending prompt information to the occupant after an interval of a second target time length after the current time.

[0014] According to another aspect of the embodiments of the present application, a device for adjusting sound in a vehicle is further provided. The device can include: an acquisition unit configured to acquire audio data output by the vehicle and state information of the vehicle during driving of the vehicle, wherein the state information is configured to indicate a driving state of the vehicle; a first determination unit configured to determine a sound parameter corresponding to the audio data based on the state information, wherein the sound parameter is configured to indicate an intensity and / or loudness of sound corresponding to the audio data; a second determination unit configured to determine a sound dose of the sound based on the sound parameter, wherein the sound dose is configured to indicate an influence degree of the sound on hearing of an occupant in the vehicle; and a control unit configured to control the vehicle to perform a first adjustment operation on the sound in response to the sound dose being greater than a sound dose threshold, wherein the sound dose of the adjusted sound is less than or equal to the sound dose threshold.

[0015] According to another aspect of the embodiments of the present application, a computer readable storage medium is further provided. The computer readable storage medium includes a stored program, wherein the program, when executed, controls a device in which the computer readable storage medium is located to perform the above-mentioned method according to the embodiments of the present application.

[0016] According to another aspect of the embodiments of the present application, a processor is further provided. The processor is configured to execute a program, wherein the program, when executed, performs the above-mentioned method according to the embodiments of the present application.

[0017] According to another aspect of the embodiments of the present application, an electronic device is further provided. The electronic device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to perform the above-mentioned method according to the embodiments of the present application.

[0018] According to another aspect of the embodiments of the present application, a computer program product is further provided. The computer program product includes a computer program, and the computer program, when executed by a processor, implements the above-mentioned method according to the embodiments of the present application.

[0019] According to another aspect of the embodiments of the present application, a vehicle is further provided. The vehicle includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to perform the above-mentioned method according to the embodiments of the present application.

[0020] In the embodiment of the present application, during the driving of the vehicle, audio data output by the vehicle and state information of the vehicle are acquired, wherein the state information is used to represent the driving state of the vehicle; based on the state information, a sound parameter corresponding to the audio data is determined, wherein the sound parameter is used to represent the intensity and / or loudness of the sound corresponding to the audio data; based on the sound parameter, a sound dose of the sound is determined, wherein the sound dose is used to represent the degree of influence of the sound on the hearing of the occupant in the vehicle; in response to the sound dose being greater than a sound dose threshold, the vehicle is controlled to perform a first adjustment operation on the sound, wherein the sound dose of the adjusted sound is less than or equal to the sound dose threshold. That is, in this embodiment, by collecting audio data and vehicle state information in real time, the real loudness and intensity of the audio are accurately calculated, so as to evaluate the sound dose to quantify the potential impact on the hearing of the occupant (user). When it is detected that the sound dose is about to exceed the safety threshold, the first adjustment operation can be autonomously performed to ensure that the hearing health of the occupant is not damaged. The above method greatly improves the accuracy and timeliness of the sound dose control by deeply understanding and responding to the dynamic changes of the audio signal and the complexity of the in-vehicle environment, solves the technical problem of low adjustment accuracy of the sound in the vehicle, and achieves the technical effect of improving the adjustment accuracy of the sound in the vehicle. BRIEF DESCRIPTION OF DRAWINGS

[0021] The accompanying drawings, which are included to provide a further understanding of the present application and are incorporated in and constitute a part of this application, illustrate embodiments of the present application and serve to explain the present application. In the drawings: Figure 1 is a flowchart of a sound adjustment method in a vehicle according to an embodiment of the present application; Figure 2 is a schematic diagram of a vehicle hearing protection architecture based on the World Health Organization and International Telecommunication Union standards according to an embodiment of the present application; Figure 3 is a schematic diagram of a sound adjustment device in a vehicle according to an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order for those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should be within the scope of protection of the present application.

[0023] It is to be understood that the terms "first", "second", and the like, used in the description and the claims of the application, as well as the above-described drawings, are used to distinguish similar objects and are not necessarily used to describe a particular sequential or chronological order. It is to be understood that the use of data so designated is not to be construed as limiting of the embodiments of the application described herein to only those embodiments absolutely recited in the specification and claims. Moreover, the terms "comprises", "comprising", "has", "having", "includes", "including", and the like, are intended to cover a non-exclusive inclusion such that a process, method, system, product, or apparatus that comprises, has, includes, or the like, those listed steps or elements but is not limited to those only, but can include other steps or elements not expressly listed or inherent to such process, method, system, product, or apparatus.

[0024] According to an embodiment of the application, there is provided an embodiment of a method for adjusting sound in a vehicle. It is to be understood that the steps illustrated in the flowcharts of the drawings can be performed in a computer system such as a set of computer-executable instructions, and while the logical flow of the steps is shown in the order presented, in some cases, the steps illustrated or described can be performed in a different order than presented.

[0025] Figure 1 is a flowchart of a method for adjusting sound in a vehicle according to an embodiment of the application, as shown in Figure 1 may include the following steps: Step S102, obtaining audio data output by the vehicle and state information of the vehicle during driving of the vehicle.

[0026] In the technical solution provided by step S102 of the application, the state information can be used to represent the driving state of the vehicle.

[0027] Optionally, the audio data can refer to a digital representation of an audio signal output by an entertainment system on board the vehicle. For example, the data format of the audio data can be a pulse code modulation (PCM) stream. The audio data can also be referred to as real-time audio.

[0028] Optionally, the state information can refer to a set of operating parameters and other environmental variables of the vehicle that can affect the perceived quality of the audio data output. The above-mentioned state information can include but is not limited to vehicle speed (such as vehicle speed compensation curve), in-vehicle loudness curve, etc. The above-mentioned vehicle speed can be used to represent the change of external noise of the vehicle during driving and the need for speed-dependent volume compensation, to ensure that the volume is appropriate at different speeds and will not become too loud or too light due to the external environment. The above-mentioned in-vehicle loudness curve can be used to reflect the characteristics of sound propagation in the vehicle cabin and the perception of sound by the occupants, taking into account the cabin resonance effect and acoustic characteristics, to help more accurately estimate the actual received sound pressure level in a closed cabin environment.

[0029] In this embodiment, during the driving of the vehicle, the audio data output by the vehicle and the state information of the vehicle can be acquired in real time.

[0030] Optionally, during the driving of the vehicle, if the vehicle-mounted entertainment system is turned on, the vehicle-mounted sensors can be started, including but not limited to a vehicle speed sensor, an ambient noise sensor, and any device capable of monitoring the vehicle condition.

[0031] Optionally, during the real-time acquisition of the audio data, the audio output interface of the vehicle-mounted entertainment system can be listened to. For example, PCM stream audio data is continuously captured at a preset frame rate (such as every 100 ms). The captured audio data is stored in a buffer for subsequent processing.

[0032] Optionally, during the real-time monitoring of the state information, the current driving speed of the vehicle can be read. The in-vehicle loudness curve database is called to obtain the corresponding vehicle speed compensation curve according to the current vehicle speed. The ambient noise level in the vehicle is monitored to evaluate the influence of background noise on audio perception. The set of state information is updated in real time in combination with the vehicle speed, ambient noise and other related parameters.

[0033] Step S104, determining a sound parameter corresponding to the audio data based on the state information.

[0034] In the technical solution provided by the above step S104 of the present application, the sound parameter can be used to represent the intensity and / or loudness of the sound corresponding to the audio data. The above sound parameter can be sound pressure level information, such as root mean square (RMS) and sound pressure level (SPL). The above root mean square can be a statistical method for measuring the intensity of sound, especially suitable for describing the fluctuation of sound pressure over time, such as music, language and other non-constant sound sources. The above sound pressure level is a sound intensity measurement in decibels (dB), which is based on the logarithmic perception characteristics of the human ear to sound intensity.

[0035] In this embodiment, after the audio data output by the vehicle and the state information of the vehicle are acquired, the sound parameter corresponding to the audio data can be determined based on the state information.

[0036] Optionally, the RMS value of the audio data is calculated as the basis of the intensity indicator. According to the vehicle speed, a corresponding loudness gain curve is selected to compensate for the sound environment in the vehicle that changes with speed. The loudness perception of the audio signal is adjusted using the background noise data to ensure that the sound parameter reflects the true auditory experience. The RMS value of the processed audio data is combined with the vehicle speed compensation curve to calculate the loudness perception value under the current condition. The loudness perception value is converted into a sound pressure level using an acoustic conversion formula.

[0037] Optionally, the calculated sound pressure level and loudness information are integrated into the sound parameter. The correlation between the sound parameter and the vehicle state is evaluated to ensure that the sound parameter can reflect the true intensity and loudness of the sound. A final sound parameter report is generated for subsequent safety threshold judgment and sound reduction strategy reference.

[0038] In the embodiments of the present application, through the above steps, the vehicle-mounted system can accurately determine the sound intensity and loudness parameters of the audio data based on the dynamic environment during vehicle driving, which is the premise and foundation for implementing effective hearing protection strategies. The above method fully utilizes real-time state information, realizes intelligent detection of audio output, and ensures that it still meets the hearing safety standards under dynamic driving conditions.

[0039] Step S106, determining the sound dose of the sound based on the sound parameter.

[0040] In the technical solution of step S106 of the present application, the sound dose can be used to represent the degree of influence of the sound on the hearing of the occupants in the vehicle.

[0041] Optionally, the sound dose can be used to quantify the degree of exposure of an individual to a noisy environment within a certain time period to assess the potential risk of hearing damage. In the embodiments of the present application, the sound dose can refer to the total sound dose, which is a comprehensive consideration of the intensity and duration of the audio signal, to measure the auditory impact on the occupants (occupants) in the vehicle due to audio output. The calculation of the sound dose can be based on the sound pressure level and combined with the time factor to reflect the cumulative effect of sound energy on the ear. When the sound pressure level of the sound is higher and the duration is longer, the total sound dose is also larger, and accordingly, the risk of hearing damage will also increase.

[0042] In this embodiment, after determining the sound parameter corresponding to the audio data based on the state information, the sound dose of the sound can be determined based on the sound parameter.

[0043] Optionally, during the process of determining the sound dose based on the sound parameter, the initial total sound dose can be set to zero, and a variable for recording each calculation result can be created. Convert the sound pressure level to sound pressure. Ensure that the minimum amplitude limit is considered during conversion to avoid numerical instability in calculation. Calculate the single sound dose value according to the converted sound pressure value and the duration. Add the single sound dose value to the total sound dose.

[0044] Optionally, periodically reset the sound dose record according to the time window length (such as 24 hours) to ensure that the total sound dose within the most recent time window is calculated.

[0045] In the embodiments of the present application, by the above method, the influence degree of audio output on the hearing of the driver and passenger in the vehicle, i.e., the sound dose, can be accurately calculated based on the obtained sound parameters (mainly sound pressure level and duration). The above method ensures that the potential hearing damage risk can be identified and handled in time according to the safety standards of the World Health Organization-International Telecommunication Union (WHO-ITU), and a safer and healthier sound environment is provided for the driver and passenger.

[0046] In step S108, in response to the sound dose being greater than the sound dose threshold, the vehicle is controlled to perform a first adjustment operation on the sound.

[0047] In the technical solution of step S108 of the present application, the sound dose of the adjusted sound is less than or equal to the sound dose threshold.

[0048] Optionally, the sound dose threshold can refer to a preset safety limit, which is used to define the demarcation line of whether the audio output constitutes a potential risk to hearing health. The above sound dose threshold can be set according to the WHO-ITU standard or other hearing safety specifications, and reflects the sound dose level that the human ear can safely withstand within a certain period of time. When the cumulative sound dose equals or exceeds this threshold, it indicates that the combination of output intensity and duration of the audio poses a threat to hearing health, and measures need to be taken to reduce the sound dose to avoid hearing damage. For example, the sound dose threshold can be set to 0.036 Pa²h (pascal square hour), which is obtained by tightening the WHO-ITU standard, indicating the upper limit of safe exposure of the user to the sound environment within 24 hours.

[0049] Optionally, the above first adjustment operation can be used to represent the audio output control measures taken by the system in response to the sound dose being greater than the sound dose threshold, the main goal of which is to reduce the sound dose below the safety threshold to protect the hearing health of the driver and passenger. For example, the above first adjustment operation can include but is not limited to: automatic volume reduction, automatically reducing the volume of the audio playback device to reduce the sound pressure level and thus the sound dose. Intelligent volume reduction strategy, intelligently adjusting the degree of volume reduction according to the difference between the current sound dose and the threshold, ensuring that the sound dose is smoothly reduced to the safe range, avoiding abrupt volume changes affecting the hearing experience. Pop-up prompt and user confirmation, before automatically adjusting the volume, prompting the user through a pop-up that the current sound dose exceeds the safety threshold, and providing options for the user to confirm the volume reduction operation or choose to skip this warning. Sound dose reset, after performing the adjustment operation, the sound dose record within a period of time can be reset to ensure that the algorithm can re-evaluate according to the latest audio output state.

[0050] In this embodiment, after determining the sound dose based on the sound parameters, if the sound dose is greater than the sound dose threshold, the vehicle can be controlled to perform a first adjustment operation on the sound so that the sound dose of the adjusted sound is less than or equal to the sound dose threshold.

[0051] Optionally, it is checked in real time whether the total sound dose exceeds a preset safety threshold (0.036 Pa²h). Once the total sound dose exceeds the threshold, an alarm mechanism is triggered to prepare for protective measures. A warning popup is displayed to the user, explicitly informing that the current sound dose has exceeded the safety range. User options are provided to allow the user to choose immediate sound reduction or delayed sound reduction operation.

[0052] Optionally, if the user chooses immediate sound reduction, or the system automatically performs sound reduction after the default time ends, the sound reduction strategy adjustment phase is entered. If the user chooses delayed sound reduction, the system will check again whether the sound dose is still above the safety threshold after a specified time. The first adjustment operation, i.e., reducing the output volume of the audio playback device to a safe level, is automatically performed. The sound reduction operation needs to be smooth to avoid sudden and large volume changes that negatively affect the user experience.

[0053] Optionally, after performing the first adjustment operation, the adjusted sound dose can be recalculated to ensure that the adjusted sound dose is less than or equal to the sound dose threshold.

[0054] In the embodiments of the present application, the above method can effectively respond to the situation where the sound dose exceeds the threshold. Not only can the sound dose be reduced to a safe level in a timely manner, but also through user interaction and algorithm optimization, the hearing health of the driver and passengers can be maximally protected while enjoying audio entertainment.

[0055] The above steps S102 to S108 of the application, in the process of vehicle driving, acquire audio data output by the vehicle and state information of the vehicle, wherein the state information is used to represent the driving state of the vehicle; based on the state information, determine the sound parameter corresponding to the audio data, wherein the sound parameter is used to represent the intensity and / or loudness of the sound corresponding to the audio data; based on the sound parameter, determine the sound dose of the sound, wherein the sound dose is used to represent the degree of influence of the sound on the hearing of the occupant in the vehicle; in response to the sound dose being greater than a sound dose threshold, control the vehicle to perform a first adjustment operation on the sound, wherein the sound dose of the adjusted sound is less than or equal to the sound dose threshold. That is, in this embodiment, by collecting audio data and vehicle state information in real time, the real loudness and intensity of the audio are accurately calculated, so as to evaluate the sound dose to quantify the potential impact on the hearing of the occupant (user). When it is detected that the sound dose is about to exceed the safety threshold, the first adjustment operation can be autonomously performed to ensure that the hearing health of the occupant is not damaged. The above method deeply understands and responds to the dynamic changes of the audio signal and the complexity of the in-vehicle environment, greatly improves the accuracy and timeliness of the sound dose control, solves the technical problem of low adjustment accuracy of the sound in the vehicle, and achieves the technical effect of improving the adjustment accuracy of the sound in the vehicle.

[0056] The above method of this embodiment will be further introduced below.

[0057] As an optional embodiment, in step S104, based on the state information, the sound parameter corresponding to the audio data is determined, including: determining the root mean square value of the audio data, wherein the root mean square value is used to represent the average intensity of the audio data; based on the root mean square value and the state information, determining the actual output decibel information of the audio data, wherein the actual output decibel information is used to represent the size of the effective sound pressure level of the audio data reaching the occupant; based on the actual output decibel information, determining the sound parameter.

[0058] In this embodiment, the root mean square value can be used to describe the average energy level of the audio signal, which is the arithmetic square root of the square average value of the audio sample value. The RMS value is very useful for evaluating the sustained intensity of the audio signal, because not only the peak value of the signal is considered, but also the fluctuation and stability of the signal, which makes the RMS value a more comprehensive and accurate average intensity measure.

[0059] Optionally, the actual output decibel information can refer to the sound pressure level size of the audio data reaching the ear of the occupant when the audio data is actually played in the vehicle, which is measured in decibels (dB).

[0060] Optionally, in the process of determining the sound parameter based on the state information, the root mean square value of the audio data can be determined. The actual output decibel information can be determined based on the root mean square value and the state information. Thus, the sound parameter is determined based on the actual output decibel information.

[0061] Optionally, the audio data stream being played is acquired in real time from the vehicle audio system. The audio data stream is properly formatted and pre-processed, such as extracting sample values from the PCM stream. The pre-processed audio samples are squared. The average of the squared sample values is calculated to form the average energy. The square root of the average energy value is taken to obtain the root mean square value (RMS) of the audio data. The RMS value represents the average intensity of the audio signal and is the basis for subsequent calculation of the actual output decibel information.

[0062] Optionally, according to the RMS value and the state information, a specific acoustic model and algorithm are applied to estimate the actual sound pressure level of the audio data inside the vehicle. The estimated sound pressure value is converted to decibel units to obtain the actual output decibel information (Lp). The Lp value reflects the effective sound pressure level of the audio data reaching the driver and passenger, which takes into account the intensity of the audio signal itself and the influence of the vehicle environment. The Lp value is centered to determine the sound parameter, including the intensity and duration of the sound, to provide accurate data for subsequent sound dose calculation. The Lp value and other related parameters are packaged to form a complete sound parameter set, which is used for subsequent dose threshold comparison and control strategy formulation.

[0063] Optionally, as the audio data continues to play and the vehicle state changes, the above steps are repeated periodically or in real time to ensure the timeliness and accuracy of the sound parameter. The updated sound parameter is stored and managed to provide continuous data support for the calculation of the sound dose in subsequent step S106.

[0064] In the embodiments of the present application, the sound parameter can be accurately determined according to the audio data and real-time vehicle state information by the above method, and the sound dose and the hearing protection needs of the driver and passenger can be more scientifically and accurately evaluated. It is ensured that timely and effective hearing protection measures can be provided for the driver and passenger in the complex and variable vehicle environment.

[0065] As an optional embodiment, the audio data is a pulse code modulation stream, and the sample value of the pulse code modulation stream is used to represent the instantaneous amplitude of the audio data. The root mean square value of the audio data is determined by converting the sample value from an integer to a floating point number, obtaining the total number of samples of the sample value, determining the sum of the squares of the converted floating point numbers of the total number of samples, and taking the square root of the quotient between the sum and the total number of samples as the root mean square value.

[0066] In this embodiment, a sample value (PCM sample value) can refer to a numerical value of an audio signal after being sampled and quantized during the process of digitization, representing the instantaneous amplitude of the audio signal at a certain time point. In a PCM stream, sample values capture the instantaneous state of the audio signal at certain time intervals (sampling frequency). Sample values can be stored in integer form according to the number of quantization bits (e.g., 8 bits, 16 bits, etc.).

[0067] Optionally, an integer is a data type used to represent numerical values without a fractional part. In a PCM stream, audio sample values can be quantized as integers for ease of storage and processing. For example, each sample value in a 16-bit PCM stream can be any integer between -32768 and 32767, reflecting the instantaneous intensity of the audio signal at this sampling point. A floating-point number can be a data type capable of representing decimals, used for more accurate calculations in digital signal processing. Converting integer sample values in a PCM stream to floating-point numbers can improve the accuracy of numerical values. For example, a 16-bit PCM sample value may, when converted to a floating-point number, be divided by 32768, thereby normalizing its range to -1 to 1.

[0068] Optionally, the total number of samples can refer to the total number of sample values in a PCM stream in a segment of audio signal, which is a key parameter in calculating the root mean square value. N reflects the length of the signal and the integrity of the sample data used to calculate the root mean square value. The size of the total number of samples is related to the sampling frequency and the length of the calculation window, and a suitable window length needs to be selected when calculating RMS to ensure the accuracy and representativeness of the result.

[0069] Optionally, in the process of determining the root mean square value of the audio data, the sample values of the pulse code modulation stream can be converted from integers to floating-point numbers, and the total number of sample values can be obtained. The sum of the squares of the floating-point sample values of the total number of samples can be determined, and the square root of the quotient of the sum and the total number of samples is determined as the root mean square value.

[0070] Optionally, a series of PCM sample values are obtained from an audio signal stream, which represent the instantaneous amplitudes of the audio signal at different time points. The obtained PCM sample values are converted from integer format to floating-point format, aiming to improve the numerical accuracy in subsequent calculations. For example, 16-bit integer sample values (range -32768 to 32767) are converted to floating-point numbers with a range of -1.0 to 1.0. The converted floating-point sample values are squared, and the sum of all squared sample values is calculated. The above steps prepare for the calculation of the root mean square value (RMS). The sum of squares is divided by the total number of samples N to obtain the average square value. Then, the square root of the average square value is taken to finally obtain the root mean square value of the audio data. The RMS value can more accurately reflect the average energy level of the audio signal within the time window, and is the basis for subsequent calculation of the actual output decibel information.

[0071] For example, the root mean square value can be determined by the following formula:

[0072] Where N can be used to represent the total number of samples; may be used to represent the i-th PCM sample value (converted to floating point representation, usually in the range [-1, 1]).

[0073] In the embodiments of the present application, by the above method, the sample values in the PCM stream can be effectively utilized, and the root mean square value of the audio data can be obtained through high-precision floating point calculation. Not only embodies the in-depth understanding of the quantization and numerical processing of the audio signal, but also ensures the accuracy and reliability of the system in evaluating the audio intensity.

[0074] As an optional embodiment, the state information includes vehicle speed information, and based on the root mean square value and the state information, the actual output decibel information of the audio data is determined, including: based on the root mean square value, the full-scale decibel information of the audio data is determined, wherein the full-scale decibel information is used to represent the loudness and / or level intensity of the audio data relative to the full-scale of the entertainment system in the vehicle; based on the full-scale decibel information and the vehicle speed information, the actual output decibel information is determined.

[0075] In this embodiment, the full-scale decibel (Decibels Full Scale, abbreviated as dBFS) can be a measurement unit used to express the loudness or level intensity of an audio signal relative to the maximum possible amplitude of a digital audio system. In digital audio processing, dBFS can be used to describe the level intensity of a signal, with particular attention to the relative position of the audio signal relative to the "full scale" of the system (i.e. the highest peak value that the system can represent). Because the signal processing and output capabilities of a digital audio system (such as the media source module of a vehicle entertainment system) are limited, dBFS provides a standardized method to measure the intensity of the signal within this range. Wherein the above full scale (Full Scale) can be the maximum amplitude that can be processed, representing the upper limit of the system dynamic range. In a 16-bit PCM system, the numerical amplitude of the full scale is 32767 (for positive numbers) or -32768 (for negative numbers), and in a floating point system, the full scale can be defined as 1.0 (for non-normalized systems) or 0 dBFS (for normalized systems).

[0076] Optionally, in the process of determining the actual output decibel information of the audio data, the full-scale decibel information of the audio data can be determined based on the root mean square value. The actual output decibel information can be determined based on the full-scale decibel information and the vehicle speed information.

[0077] Optionally, the calculation of dBFS is based on the ratio of the root mean square value (RMS) of the signal to the full scale, expressed in logarithmic scale. The dBFS measures the signal level intensity, but in audio processing, it is also indirectly related to the loudness perceived by the human ear, because the loudness is proportional to the signal level intensity. Through dBFS, the "loudness" of the audio signal in the full scale range can be understood.

[0078] For example, the full scale decibel information can be determined by the following formula:

[0079] In the embodiments of the present application, the full scale decibel information (dBFS) is used as an intermediate step to estimate the actual output decibel information of the audio data, reflecting the loudness or level intensity of the audio signal in the full scale range of the in-vehicle entertainment system. The above-mentioned dBFS information is combined with the vehicle speed information to further calibrate the actual output decibel information (Lp) of the audio data, so as to more accurately reflect the actual listening experience at a specific vehicle speed.

[0080] As an optional embodiment, the actual output decibel information is sound pressure level, and the sound parameter is root mean square sound pressure, and based on the actual output decibel information, the sound parameter is determined, including: based on the sound pressure level and the reference sound pressure, the root mean square sound pressure is determined.

[0081] In this embodiment, the actual output decibel information (sound pressure level) can be a standard unit for measuring the size of sound relative to the reference sound pressure, usually expressed in decibels (dB). It is used to describe the logarithmic value of the pressure of sound at a certain point compared with the reference pressure, and is used to intuitively reflect the loudness or intensity of the sound.

[0082] Optionally, the reference sound pressure (reference sound pressure) is a reference standard in sound pressure level measurement, which is usually defined as 2×10^-5 pascal (Pa) in air, equivalent to the lowest sound pressure value that the human ear can just hear. In the calculation of sound pressure level, the sound pressure level of any sound is calculated relative to this reference sound pressure. By comparing the currently measured sound pressure with the reference sound pressure, we can express the size of the sound in decibels, which is a logarithmic unit, so that a large range of sound intensity changes can be expressed by a smaller value, which is more intuitive and consistent with the human ear's perception of sound intensity.

[0083] Optionally, in the process of determining the sound parameter based on the actual output decibel information, the root mean square sound pressure can be determined based on the sound pressure level and the reference sound pressure.

[0084] For example, the root mean square sound pressure can be determined by the following formula:

[0085] wherein the above may be used to represent the root mean square sound pressure; may be used to represent the reference sound pressure; may be used to represent the sound pressure level.

[0086] As an optional embodiment, the method further comprises: determining a safe sound dose of the occupant in the target period based on a hearing safety policy of the occupant; and determining the safe sound dose as the sound dose threshold.

[0087] In this embodiment, the hearing safety policy can refer to a set of scientific guidelines or standards designed to protect people's hearing health and prevent hearing damage caused by long-term or high-intensity sound exposure. These policies are usually based on extensive scientific research and data analysis, taking into account factors such as sound intensity, exposure time, and individual differences. For example, the above hearing safety policy can be a specific technical specification, such as the WHO-ITU standard, hearing safety guidelines, etc.

[0088] Optionally, the target period can refer to a time period defined in the hearing safety policy, during which the sound dose is evaluated and controlled. The selection of the target period is based on the risk assessment model of hearing loss, and is usually to monitor and evaluate the impact of sound exposure on individual hearing health within a certain period of time. For example, the target period can be set to one day, one week, or any other reasonable evaluation period, to ensure that the cumulative sound dose within this period does not exceed the recommended safe level.

[0089] Optionally, the safe sound dose can refer to the total amount of sound that an individual can safely be exposed to within a specific target period, which can be expressed in terms of the product of sound pressure squared and time (Pa²h). Combining the intensity and exposure time of the sound, it is set according to the hearing safety policy (such as the WHO-ITU standard) to avoid hearing damage. In a vehicle environment, the safe sound dose is the core data of the hearing protection algorithm, which is used to judge whether the audio output exceeds the upper limit of the safety of the occupants.

[0090] Optionally, based on the safety policy, the target period, for example, one day (24 hours), is determined as the time window for evaluating the sound dose of the occupant. According to the WHO-ITU standard, combined with the length of the target period, the maximum total sound dose that the occupant can safely withstand within this period is calculated. This dose is usually expressed in Pa²h (product of sound pressure squared and time). The calculated safe sound dose value is directly set as the sound dose threshold, which is the basis for subsequent judgment of whether the audio output poses a hearing risk to the occupant.

[0091] Optionally, based on the hearing safety strategy of the occupant, the safe sound dose of the occupant in the target period can be determined, so that the safe sound dose can be determined as the sound dose threshold.

[0092] For example, using the data in the WHO-ITU standard, the total sound dose of the safe exposure in the target period (for example, one week) is divided by 7 to obtain the safe sound dose per day (Daily, 0.036 Pa²h) by using the data in the WHO-ITU standard.

[0093] In the embodiments of the present application, by using the above method, not only the sound intensity and exposure time in the vehicle environment can be monitored in real time, but also a scientific safe sound dose threshold in the target period can be set based on a solid hearing safety strategy. The determination of the safe sound dose threshold is a key step to realize effective hearing protection, which ensures the practicability and safety of the vehicle hearing protection algorithm.

[0094] As an optional embodiment, in step S106, the sound dose of the sound is determined based on the sound parameter, including: determining the sound sub-dose of the sound in different time segments in the target period based on the sound parameter; and determining the sound dose of the sound in the target period based on the sound sub-doses corresponding to the different time segments.

[0095] In this embodiment, the sound sub-dose can refer to the dose unit in each time segment under the overall strategy of continuous monitoring and evaluation of sound exposure. Each sound sub-dose corresponds to a quantitative indicator of the potential impact of sound on the hearing health of the listener in a specific time segment in the target period.

[0096] Optionally, the sound dose in the target period can be calculated based on a series of sound sub-doses, which is a comprehensive evaluation of the potential impact of sound exposure on hearing health in all time segments in the target period (such as one day, one week, etc.). The sound dose in the target period is determined by adding the sound sub-dose corresponding to each time segment, which reflects the cumulative sound dose in the period.

[0097] Optionally, a target period (for example, one day) is set, and the total sound dose is initialized to 0. The target period is divided into multiple time segments, each time segment having a specific duration (T) (for example, each segment is 100 ms, i.e., (T=0.0001) hours). For the first time segment, the sound parameter pRMS1 in the time segment is obtained. The calculated sound sub-dose is added to the total sound dose.

[0098] For example, the total sound dose can be determined by the following formula: Etotal=(pRMS1)²*T+(pRMS2)²*T+...(pRMSn)²*T Wherein, Etotal can be used to represent the total sound dose; pRMS1 can be used to represent the sound sub-dose under the first time segment; pRMS2 can be used to represent the sound sub-dose under the second time segment; pRMSn can be used to represent the sound sub-dose under the nth time segment; T can be used to represent the duration of each time segment.

[0099] In the embodiments of the present application, through the above method, the cumulative sound dose of the driver or passenger at different time segments in the target period can be accurately evaluated, and corresponding protection measures can be taken. This process embodies the dynamics and real-time nature of the algorithm, ensuring the effectiveness and flexibility of the vehicle hearing protection scheme.

[0100] As an optional embodiment, in step S108, in response to the sound dose being greater than the sound dose threshold, the vehicle is controlled to perform a first adjustment operation on the sound, including: in response to the sound dose of the target period being greater than the sound dose threshold of the target period, sending a prompt information to the passenger; in response to the passenger performing a confirmation adjustment operation on the prompt information, controlling the entertainment system in the vehicle to perform a first adjustment operation on the sound at the current time; the method further includes at least one of the following: in response to the passenger performing a cancellation adjustment operation on the prompt information, controlling the entertainment system not to perform a first adjustment operation on the sound at the current time, and re-sending the prompt information to the passenger after a first target time interval after the current time; in response to the passenger not performing a confirmation adjustment operation and a cancellation adjustment operation on the prompt information, controlling the entertainment system not to perform a first adjustment operation on the sound after a second target time interval after the current time, and canceling the sending of the prompt information to the passenger.

[0101] In this embodiment, the prompt information can be a notification and warning sent by the vehicle entertainment system to the passenger when it is monitored that the sound dose may exceed the threshold. The above prompt information can include the current sound dose state, the potential hearing health risk and the recommended sound reduction operation suggestion, aiming to improve the passenger's awareness of hearing protection and encourage them to take action to reduce the risk. The sending and processing of the prompt information is a key link in the implementation of the hearing protection decision in the present application.

[0102] Optionally, the confirmation adjustment operation can refer to the passenger's explicit user interface operation to confirm that the system should perform the first adjustment operation to protect hearing after receiving the prompt information. In this embodiment, the confirmation adjustment operation specifically manifests as the passenger clicking on the confirmation, indicating the willingness to perform the sound reduction operation, i.e. to reduce the sound volume or intensity output by the in-vehicle entertainment system to reduce the current sound dose and prevent hearing damage. That is, the above first adjustment operation can include the sound reduction operation.

[0103] Optionally, the cancel adjustment operation can be a user feedback from the occupant who chooses not to perform the hearing protection operation such as reducing the sound volume after receiving the prompt information. The cancel adjustment operation can be implemented by clicking cancel, which means the occupant currently chooses to ignore the prompt and the first adjustment operation should not be performed immediately, but the system retains the right to re-evaluate and prompt after the first target duration.

[0104] Optionally, the first target duration can refer to the time period to wait before re-evaluating the sound dose and re-sending the prompt information after the occupant performs the cancel adjustment operation. For example, the above-mentioned first target duration can be set to one hour, aiming to give the occupant a reasonable buffer period to allow self-adjustment of the volume or change of the environmental conditions within this hour to avoid the adverse experience that may be caused by immediate forced volume reduction.

[0105] Optionally, the second target duration can be the time period to wait in the case that the occupant does not make any operation (neither confirmation nor cancellation) on the prompt information, after which the prompt information will be automatically stopped from being sent and the action will be taken after the second target duration. The above-mentioned second target duration can be set to 8 seconds as the time window to wait for the occupant's response, and if there is no response within this time, the protection measure will be automatically executed.

[0106] Optionally, during the process of controlling the vehicle to perform the first adjustment operation on the sound, if the sound dose of the target period is greater than the sound dose threshold of the target period, a prompt information can be sent to the occupant. If the occupant performs the confirmation adjustment operation on the prompt information, at the current time, the entertainment system can be controlled to perform the first adjustment operation on the sound. If the occupant performs the cancel adjustment operation on the prompt information, at the current time, the entertainment system can be controlled not to perform the first adjustment operation on the sound, and the prompt information can be re-sent to the occupant after the current time interval of the first target duration. If the occupant does not perform the confirmation adjustment operation and the cancel adjustment operation on the prompt information, the entertainment system can be controlled not to perform the first adjustment operation on the sound after the current time interval of the second target duration. And the prompt information sent to the occupant is canceled.

[0107] Optionally, the total sound dose in the target period is continuously monitored and compared with the set sound dose threshold. When the total sound dose in the target period exceeds the sound dose threshold, the next step is entered. If the sound dose does not exceed the threshold, the monitoring continues until the end of the target period or the sound dose changes.

[0108] Optionally, a prompt information is sent to the occupant to inform that the sound dose has exceeded the standard and to warn the possible hearing risk. The prompt information should contain the operation options of confirmation adjustment and cancel adjustment for the occupant to choose. The occupant clicks the confirmation adjustment operation. The system responds to immediately perform the first adjustment operation at the current time, such as automatically reducing the volume of the entertainment system until reaching the safe level.

[0109] Optionally, the occupant clicks the cancel adjustment operation. The first adjustment operation is not performed at the current time. A first target duration (e.g., 1 hour) is started, and after the first target duration ends, the sound dose is re-evaluated and a prompt message is sent to the occupant.

[0110] Optionally, the occupant does not respond to the prompt message within a limited time (a second target duration, e.g., 8 seconds), neither confirming nor canceling the adjustment operation. After the second target duration, the first adjustment operation is automatically performed to ensure the hearing safety of the occupant. At the same time, the sending of the prompt message is stopped to avoid unnecessary interference, but in necessary cases, the prompt system can be reactivated through other mechanisms.

[0111] Optionally, the sound dose continues to be monitored, and the actions of S301 to S308 are repeated in a target period until the target period ends or the sound dose falls below the safety threshold.

[0112] In the embodiments of the present application, through the above method, the situation of excessive sound dose in the cockpit environment can be flexibly dealt with, real-time feedback and operation selection are given to the occupant, and at the same time, necessary measures are automatically taken to protect the hearing health, which embodies the humanized design and intelligent decision-making ability of the scheme. This flow ensures a good balance between the experience of the occupant and the system protection function.

[0113] As an optional embodiment, the method further includes: in response to the occupant performing a second adjustment operation on the sound, outputting the sound at a volume indicated by the second adjustment operation at the current time, wherein the sound dose of the adjusted sound is greater than the sound dose threshold; and sending a prompt message to the occupant after a second target duration after the current time.

[0114] In this embodiment, the second adjustment operation can refer to an operation initiated by the occupant to change the sound output setting of the entertainment system, especially when this operation causes the sound dose to exceed the preset safety threshold. In the embodiments of the present application, the above-mentioned second adjustment operation can be that the occupant actively increases the volume, so that the current sound dose exceeds the recommended safety level for hearing health.

[0115] Optionally, if the occupant performs a second adjustment operation on the sound, the sound can be output at a volume indicated by the second adjustment operation at the current time. The sending of the prompt message to the occupant starts after a second target duration after the current time.

[0116] Optionally, the current volume setting and actual output sound dose of the entertainment system are monitored. When the occupant performs a second adjustment operation, i.e. actively increases the volume, the system responds immediately. The sound is output at the new volume indicated by the second adjustment operation. At this stage, the sound dose can be greater than the sound dose threshold. At the current time, i.e. after the volume is increased, the system starts timing a second target duration (e.g. 8 seconds). When the second target duration expires, the system sends a prompt message to the occupant, informing them that the sound dose has exceeded the safety threshold and emphasizing the potential hearing risk.

[0117] Optionally, the sound dose is continuously monitored, and the prompt message is repeatedly sent after each end of the second target duration. This mechanism ensures that the occupant will not ignore the risk of excessively high volume. Unless the occupant takes action (e.g. reduces the volume) or the sound dose naturally falls below the safety threshold, the prompt message will be repeated periodically.

[0118] In the embodiments of the present application, the above-mentioned method can effectively handle the situation where the sound dose exceeds the safety threshold due to the occupant's active adjustment of the volume. By temporarily allowing high-volume playback and timely issuing a warning message, both the occupant's personalized audio experience and the reminder of the occupant's attention and management of their hearing health are ensured, reflecting the intelligent and humanized design of the algorithm.

[0119] The technical solutions of the embodiments of the present application will be illustrated below in conjunction with preferred embodiments.

[0120] Currently, vehicle entertainment systems based on the Android platform usually only remind users that excessively high volume may cause hearing loss when the user adjusts the media volume to exceed a certain level. This static, advisory reminder mechanism has significant limitations, and the main problems include: the decibel value output by the media music at a certain volume level is not fixed. Media music is constantly changing in rhythm, and the output decibel value is also constantly changing. During driving, the opening of the speed compensation also increases the actual output loudness of the music. When the amplitude of the media source data itself is very high, even if the media volume level is not large, the decibel value heard by the human ear can be very large. The risk of hearing loss does not depend solely on the intensity of the sound, but also on the duration. The higher the intensity of the sound, the shorter the duration of safe exposure to the sound. A simple prompt pop-up window can only serve as a notification. It cannot actually reduce the risk of hearing loss for the user.

[0121] This application aims to overcome the limitations of existing technologies and provide a hearing protection algorithm based on WHO-ITU standards to reduce the risk of hearing damage during daily in-car listening. The method can: monitor the actual decibel output of media volume in real time; calculate whether the total safe sound dose exceeds the limit by combining the monitored dynamic decibel value and duration; and proactively implement sound reduction strategies for the user to reduce potential hearing damage.

[0122] The embodiments of the present invention will be further described below.

[0123] Figure 2 This is a schematic diagram of a vehicle-mounted hearing protection architecture based on stricter WHO-ITU standards according to an embodiment of the present invention, as shown below. Figure 2 As shown, the architecture may include a perception layer 201, a processor 202, a control layer 203, and an application layer 204. The perception layer 201 can be used for audio monitoring and vehicle condition monitoring. The processor 202 can be used for decibel calculation and threshold determination. The controller 203 can be used for protection switch control and noise reduction strategy control. The application layer 204 can be used for the user settings interface and protection notification pop-ups.

[0124] Optionally, the system includes: Audio monitoring: directly acquiring the media audio PCM stream through the audio system output interface; Vehicle condition monitoring: directly acquiring the current vehicle speed through the vehicle communication system output interface; Decibel calculation: calculating the RMS value to estimate decibels based on the media PCM stream, combined with the in-vehicle loudness curve, vehicle speed compensation curve, etc.; Threshold judgment: calculating the total sound metering threshold that the user can safely consume according to the WHO-ITU standard with stricter requirements; Protection switch control: hearing protection will only take effect if the user selects to activate it; Volume reduction strategy control: achieving smooth volume adjustment by controlling the power amplifier chip through the in-vehicle audio system. By monitoring the audio output decibel value in real time, the system automatically reduces the volume to a safe range when continuous high decibel output is detected, thereby protecting the user's hearing health and improving the safety and comfort of cabin sound use.

[0125] Optionally, RMS is the root mean square value of the audio samples, calculated using the following formula:

[0126] Where N can be used to represent the total number of samples; It can be used to represent the i-th PCM sample value (which needs to be converted to floating-point representation, typically in the range of [-1, 1]).

[0127] Convert the PCM sample to a floating-point number (e.g., divide the 16-bit PCM sample value by 32768).

[0128] Calculate the average of the squares of all samples, and then take the square root.

[0129] The RMS of real-time audio can be calculated in frames (e.g., once every 100 ms, the specific time length is adjusted in combination with system performance and load of computing power).

[0130] Decibel is a relative unit, which needs to specify a reference value. In audio, dBFS (Full Scale dB) is commonly used, and the reference value is the maximum amplitude (1.0). The formula is:

[0131] 0 dB of dBFS corresponds to full amplitude (1.0), and the actual volume is usually negative (e.g., -12 dB indicates 12 dB lower than the maximum value).

[0132] In combination with the volume curve of the vehicle-mounted system and the speed compensation curve, as well as the gain system of the power amplifier, the actual output decibel value of the current sound source output is calculated.

[0133] Convert the output volume decibel to sound pressure by the following formula:

[0134] Among them, the above can be used to represent the root mean square sound pressure; can be used to represent the reference sound pressure; can be used to represent the sound pressure level.

[0135] For example, when the sound pressure level is 80 dB SPL, the calculated root mean square sound pressure is 0.2 Pa.

[0136] Dose measurement: the level and cumulative duration of continuous 1-day (24-hour) exposure to sound (also known as the user's "sound allowance"), that is, the total sound dose that the user can safely consume. Adopt Table 2: Weekly (0.51 Pa²h) / 7 plus strict, threshold is the total sound dose Daily (0.036 Pa²h).

[0137] Etotal = (pRMS1)²*T + (pRMS2)²*T +... (pRMSn)²*T Among them, Etotal can be used to represent the total sound dose, that is, the total sound dose that the user has consumed; pRMS1 can be used to represent the sound sub-dose under the first time segment; pRMS2 can be used to represent the sound sub-dose under the second time segment; pRMSn can be used to represent the sound sub-dose under the nth time segment; T can be used to represent the duration of each time segment.

[0138] When Etotal ≥ 0.036 Pa²h, it means that the threshold has been exceeded.

[0139] When the threshold is exceeded, a pop-up prompt is given, and the pop-up supports user operation. Clicking cancel, this time does not reduce the sound, and after one hour of accumulation, the pop-up prompt continues; clicking confirm, the sound reduction strategy is executed; no operation is performed, and the sound reduction strategy is executed after 8 seconds by default, and the pop-up is closed.

[0140] Sound reduction strategy: if the user actively adjusts the volume to exceed the safety threshold, the system temporarily allows it for 8 seconds and continues to prompt the risk. When the trigger condition is met, the system automatically reduces the volume to 50% of the current volume.

[0141] According to the embodiments of the present application, a sound adjustment device in a vehicle is also provided. It should be noted that the sound adjustment device in the vehicle can be used to execute the sound adjustment method in the vehicle in the above embodiments.

[0142] Figure 3 is a schematic diagram of a sound adjustment device in a vehicle according to an embodiment of the present application, as shown in Figure 3 The sound adjustment device 300 in the vehicle can include an acquisition unit 302, a first determination unit 304, a second determination unit 306, and a control unit 308.

[0143] The acquisition unit 302 is configured to acquire audio data output by the vehicle and state information of the vehicle during driving of the vehicle, wherein the state information is used to indicate a driving state of the vehicle.

[0144] The first determination unit 304 is configured to determine a sound parameter corresponding to the audio data based on the state information, wherein the sound parameter is used to indicate an intensity and / or loudness of a sound corresponding to the audio data.

[0145] The second determination unit 306 is configured to determine a sound dose of the sound based on the sound parameter, wherein the sound dose is used to indicate an influence degree of the sound on hearing of a driver or passenger in the vehicle.

[0146] The control unit 308 is configured to control the vehicle to perform a first adjustment operation on the sound in response to the sound dose being greater than a sound dose threshold, wherein a sound dose of the adjusted sound is less than or equal to the sound dose threshold.

[0147] In the embodiment of the present application, the audio data output by the vehicle and the state information of the vehicle are acquired by the acquisition unit 302 during the driving of the vehicle. The sound parameter corresponding to the audio data is determined based on the state information by the first determination unit 304. The sound dose of the sound is determined based on the sound parameter by the second determination unit 306, wherein the sound dose is used to represent the influence degree of the sound on the hearing of the occupants in the vehicle. The first adjustment operation is performed on the sound by the control unit 308 in response to the sound dose being greater than the sound dose threshold, thereby solving the technical problem of low adjustment accuracy of the sound in the vehicle and achieving the technical effect of improving the adjustment accuracy of the sound in the vehicle.

[0148] According to the embodiment of the present application, a computer readable storage medium is also provided, which includes a stored program, wherein the program executes the above-mentioned method in the embodiment of the present application.

[0149] According to the embodiment of the present application, a processor is also provided, which is used to run a program, wherein the program runs to execute the above-mentioned method in the embodiment of the present application.

[0150] According to another aspect of the embodiment of the present application, an electronic device is also provided. The electronic device includes a memory and a processor, the memory stores a computer program, and the processor is configured to run the computer program to execute the above-mentioned method in the embodiment of the present application.

[0151] According to another aspect of the embodiment of the present application, a computer program product is also provided. The computer program product includes a computer program, and the computer program realizes the above-mentioned method in the embodiment of the present application when executed by a processor.

[0152] According to another aspect of the embodiment of the present application, a computer program product is also provided. The computer program product includes a computer program, and the computer program realizes the above-mentioned method in the embodiment of the present application when executed by a processor.

[0153] According to another aspect of the embodiment of the present application, a vehicle is also provided. The vehicle includes a memory and a processor, the memory stores a computer program, and the processor is configured to run the computer program to execute the above-mentioned method in the embodiment of the present application.

[0154] In the above-mentioned embodiments of the present application, the description of each embodiment has its own focus, and the part not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0155] In several embodiments provided in the present application, it should be understood that the disclosed technology can be implemented by other means. Among them, the above-mentioned device embodiments are only schematic, for example, the division of the units can be a logical function division, and actual implementation can have another division mode, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed units can be indirect coupling or communication connection through some interfaces, units or modules, which can be electrical or other forms.

[0156] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or they can be distributed to multiple units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0157] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of an application function unit.

[0158] The integrated unit, if realized in the form of an application function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of an application program product, which is stored in a storage medium and includes a plurality of instructions for making a computer device (which can be a personal computer, a server or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application. The foregoing storage medium includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, magnetic disk or optical disk and various program code storage media.

[0159] The above is only the preferred embodiment of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the principles of the present application, a number of improvements and refinements can be made, which should be considered as the protection scope of the present application.

Claims

1. A method for adjusting sound in a vehicle, characterized in that, include: During vehicle operation, audio data output by the vehicle and vehicle status information are acquired, wherein the status information is used to indicate the vehicle's driving status. Based on the state information, the sound parameters corresponding to the audio data are determined, wherein the sound parameters are used to represent the intensity and / or loudness of the sound corresponding to the audio data; Based on the sound parameters, the sound dose of the sound is determined, wherein the sound dose is used to represent the degree of influence of the sound on the hearing of the occupants in the vehicle; In response to the sound dose being greater than a sound dose threshold, the vehicle is controlled to perform a first adjustment operation on the sound, wherein the sound dose of the adjusted sound is less than or equal to the sound dose threshold.

2. The method according to claim 1, characterized in that, Based on the state information, the sound parameters corresponding to the audio data are determined, including: Determine the root mean square value of the audio data, wherein the root mean square value is used to represent the average intensity of the audio data; Based on the root mean square value and the state information, the actual output decibel information of the audio data is determined, wherein the actual output decibel information is used to represent the effective sound pressure level of the audio data reaching the driver / passenger. The sound parameters are determined based on the actual output decibel information.

3. The method according to claim 2, characterized in that, The audio data is a pulse code modulation stream, and the sample values ​​of the pulse code modulation stream are used to represent the instantaneous amplitude of the audio data. Determining the root mean square value of the audio data includes: Convert the sample value from an integer to a floating-point number, and obtain the total number of samples for the sample value; Determine the sum of the squares of the sample values ​​converted to floating-point numbers from the total number of samples; The square root of the quotient between the sum and the total number of samples is determined as the root mean square value.

4. The method according to claim 2, characterized in that, The status information includes vehicle speed information. Based on the root mean square value and the status information, the actual output decibel information of the audio data is determined, including: Based on the root mean square value, the full-range decibel information of the audio data is determined, wherein the full-range decibel information is used to represent the loudness and / or level intensity of the audio data relative to the full-range of the entertainment system in the vehicle. The actual output decibel information is determined based on the full-range decibel information and the vehicle speed information.

5. The method according to claim 4, characterized in that, The actual output decibel information is a sound pressure level, which represents the magnitude of the sound relative to a reference sound pressure level. The sound parameters are root-mean-square sound pressure levels. Based on the actual output decibel information, the sound parameters are determined, including: The root mean square sound pressure is determined based on the sound pressure level and the reference sound pressure.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Based on the hearing safety strategy of the driver and passengers, the safe sound dose for the driver and passengers within the target period is determined; The safe sound dose is determined as the sound dose threshold.

7. The method according to claim 6, characterized in that, Determining the sound dose based on the sound parameters includes: Based on the sound parameters, determine the sound sub-dose of the sound at different time segments within the target period; The sound dose of the target period is determined based on the sound sub-dose corresponding to different time segments.

8. The method according to claim 7, characterized in that, In response to the sound dose being greater than a sound dose threshold, the vehicle is controlled to perform a first adjustment operation on the sound, including: In response to the sound dose during the target period being greater than the sound dose threshold during the target period, a prompt message is sent to the driver / passenger. In response to the confirmation and adjustment operation performed by the driver / passenger on the prompt information, at the current moment, the vehicle's entertainment system is controlled to perform the first adjustment operation on the sound; The method further includes at least one of the following: In response to the driver / passenger's cancellation adjustment operation on the prompt message, at the current moment, the entertainment system is controlled not to perform the first adjustment operation on the sound, and after a first target duration after the current moment, the prompt message is resent to the driver / passenger; In response to the driver / passenger not performing the confirmation adjustment operation and the cancellation adjustment operation on the prompt message, after a second target time interval after the current time, the system controls the entertainment system not to perform the first adjustment operation on the sound, and cancels sending the prompt message to the driver / passenger.

9. The method according to claim 8, characterized in that, The method further includes: In response to the driver / passenger's request for a second adjustment operation on the sound, at the current moment, the sound is output at the volume indicated by the second adjustment operation, wherein the sound dose of the adjusted sound is greater than the sound dose threshold. After the current time and the second target time interval, the prompt message is sent to the driver / passenger.

10. A vehicle, characterized in that, The method includes a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 9.

Images