Vehicle sound effect adjustment method and system, electronic device and storage medium

By collecting in-vehicle audio and image data, identifying passenger information, and adjusting acoustic parameters, the problem of in-vehicle sound effect algorithms being unable to automatically adapt to changes in passenger behavior has been solved, achieving optimal sound output and improving the riding experience.

CN116095596BActive Publication Date: 2026-07-24IFLYTEK CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
IFLYTEK CO LTD
Filing Date
2022-12-29
Publication Date
2026-07-24

AI Technical Summary

Technical Problem

In existing technologies, in-vehicle sound effect algorithms cannot automatically adjust based on factors such as the number of passengers, their positions, and seat angles, resulting in poor sound output and failing to provide the best riding experience.

Method used

By collecting in-vehicle audio and image data, the system identifies passenger location distribution and vital signs, and uses acoustic and compensation parameters to adjust sound effect modes and optimize sound output.

Benefits of technology

The sound effects have been improved to better suit passengers, enhancing the riding experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116095596B_ABST
    Figure CN116095596B_ABST
Patent Text Reader

Abstract

The application discloses a vehicle sound effect adjustment method and system, an electronic device and a storage medium. The method comprises the following steps: collecting audio data and images in a vehicle; identifying position distribution information, body sign information and vehicle space occupation information of a person in the vehicle from the images; determining acoustic parameters by using the vehicle space occupation information and the audio data; determining a sound effect mode by using the position distribution information and the body sign information; determining compensation parameters by using the acoustic parameters; and adjusting the acoustic parameters corresponding to the sound effect mode by using the compensation parameters. In this way, the adaptation of the output sound effect to the person in the vehicle is improved, and the riding experience of the person in the vehicle is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of sound effect processing technology, and in particular to vehicle sound effect adjustment methods, systems, electronic devices and storage media. Background Technology

[0002] With the upgrading of car consumption, passengers can enjoy a feature-rich and immersive sound space in the vehicle environment. However, sound effect algorithms deteriorate in the complex, irregular, and variable acoustic space inside the car, and the current drawbacks are as follows:

[0003] 1) Factors such as the number of passengers, seating position, seat angle, size, volume, and surface material of items stored in the passenger compartment cause changes in the refraction and reflection of sound inside the vehicle, ultimately preventing the sound effect algorithm from achieving its best effect.

[0004] 2) Users cannot automatically adjust the optimal output of the sound effect algorithm based on the above changes, and cannot fully enjoy the high-quality experience brought by the sound effect function.

[0005] 3) Due to the condition of vehicle components, the noise level inside the vehicle changes, making it impossible for passengers to experience the best standard sound at any stage of the vehicle operation. Summary of the Invention

[0006] This application provides a method, system, electronic device, and storage medium for adjusting vehicle sound effects, thereby improving the compatibility of the output sound effects with the occupants of the vehicle and enhancing their riding experience.

[0007] To address the aforementioned technical problems, this application adopts the following technical solution: a method for adjusting vehicle sound effects, comprising: acquiring audio data and images inside the vehicle; identifying the location distribution information, vital signs information, and interior space occupancy information of occupants from the images; determining acoustic parameters using the interior space occupancy information and audio data; determining a sound effect mode using the location distribution information and vital signs information; determining compensation parameters using the acoustic parameters; and adjusting the acoustic parameters corresponding to the sound effect mode using the compensation parameters.

[0008] The method of adjusting the acoustic parameters corresponding to the sound effect mode using compensation parameters includes: adjusting at least one of the following parameters corresponding to the sound effect mode: audio output frequency, volume, signal delay, or reverberation.

[0009] The vital signs information includes at least one of the following: age, gender, height, sitting posture, head position, and auricle.

[0010] Among them, determining the sound effect pattern using location distribution information and vital sign information includes: using location distribution information and vital sign information to construct a spatial processing model to determine the key positioning points corresponding to the people in the vehicle; and obtaining the sound effect pattern corresponding to the key positioning points.

[0011] The process of collecting audio data inside the vehicle includes: collecting environmental audio data inside the vehicle using a microphone, wherein the environmental audio data includes at least one audio source, such as a first audio source played by a speaker and a second audio source generated by people and objects inside the vehicle.

[0012] The process of adjusting the acoustic parameters corresponding to the sound effect mode using compensation parameters includes: determining the sound effect enhancement result of the currently adjusted acoustic parameters; if the enhancement result is greater than the preset value, audio output will be performed using the adjusted acoustic parameters.

[0013] To address the aforementioned technical problems, another technical solution adopted in this application is: providing a vehicle sound effect adjustment system, which includes: a data acquisition unit for acquiring audio data and images inside the vehicle; an analysis unit for identifying the location distribution information, vital sign information, and vehicle interior space occupancy information of occupants from the images; determining acoustic parameters using the vehicle interior space occupancy information and audio data; and determining a sound effect mode using the location distribution information and vital sign information; a determination unit for determining compensation parameters using the acoustic parameters; and an adjustment unit for adjusting the acoustic parameters corresponding to the sound effect mode using the compensation parameters.

[0014] The vehicle sound effect adjustment system also includes a feedback unit, which is used to determine the sound effect improvement result of the current adjusted acoustic parameters; if the improvement result is greater than the preset value, the adjusted acoustic parameters will be used for audio output.

[0015] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide an electronic device, which includes a memory and a processor. The memory is used to store computer programs, and the processor is used to execute the computer programs to implement the methods provided by the above-mentioned technical solutions.

[0016] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide a computer-readable storage medium storing a computer program, which, when executed by a processor, is used to implement the method provided by the above-mentioned technical solution.

[0017] The beneficial effects of this application are as follows: Unlike existing technologies, the vehicle sound effect adjustment method provided in this application identifies the location distribution information, vital signs information, and interior space occupancy information of the occupants from the collected in-vehicle images; then uses the interior space occupancy information and the collected in-vehicle audio data to determine acoustic parameters; and uses the location distribution information and vital signs information to determine the sound effect mode; uses the acoustic parameters to determine compensation parameters; and uses the compensation parameters to adjust the acoustic parameters corresponding to the sound effect mode. By combining in-vehicle visual information and in-vehicle spatial acoustic parameters, the optimal compensation parameters for the corresponding sound effect mode under different conditions such as the number of passengers, the passengers' vital signs information, and the interior space occupancy information are analyzed, thereby completing the corresponding sound effect adjustment, improving the adaptability of the output sound effect to the occupants, and thus improving the riding experience of the occupants. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein:

[0019] Figure 1 This is a flowchart illustrating the first embodiment of the vehicle sound effect adjustment method provided in this application;

[0020] Figure 2 This is a flowchart illustrating the second embodiment of the vehicle sound effect adjustment method provided in this application;

[0021] Figure 3 This is a flowchart illustrating the third embodiment of the vehicle sound effect adjustment method provided in this application;

[0022] Figure 4 This is a schematic diagram of the structure of an embodiment of the vehicle sound effect adjustment system provided in this application;

[0023] Figure 5 This is a schematic diagram of another embodiment of the vehicle sound effect adjustment system provided in this application;

[0024] Figure 6 This is a schematic diagram of the structure of an embodiment of the electronic device provided in this application;

[0025] Figure 7 This is a schematic diagram of an embodiment of the computer-readable storage medium provided in this application. Detailed Implementation

[0026] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0027] See Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the vehicle sound effect adjustment method provided in this application. The method includes:

[0028] Step 11: Collect audio data and images inside the vehicle.

[0029] In some embodiments, a microphone can be used to collect audio data. This audio data can be audio data emitted by the corresponding occupants in the vehicle, or audio data emitted by the vehicle's speakers. Alternatively, the audio data collected by the microphone may include audio data emitted by both occupants and the vehicle's speakers.

[0030] In one application scenario, the vehicle plays corresponding audio through the in-vehicle speakers, so the microphone can capture the audio played by the speakers.

[0031] In one application scenario, the vehicle plays audio through its in-vehicle speakers, and the occupants also output audio. Therefore, the microphone can capture the audio played by the speakers and the audio generated by the occupants.

[0032] In some embodiments, an image acquisition unit can be used to acquire images inside the vehicle. For example, corresponding cameras can be installed at appropriate locations within the vehicle to acquire images inside. For instance, a first camera can be installed in the front of the vehicle to acquire front-row images, and a second camera can be installed in the rear of the vehicle to acquire rear-row images. The image acquisition unit is connected to the vehicle's processing module and sends the acquired images to the processing module.

[0033] In some embodiments, the microphone and image acquisition unit are integrated, allowing audio data acquisition to occur simultaneously with image acquisition.

[0034] Step 12: Identify the location distribution, vital signs, and interior space occupancy information of the people inside the vehicle from the image.

[0035] The vital signs information includes at least one of the following: age, gender, height, sitting posture, head position, and auricle.

[0036] In some embodiments, a corresponding target recognition model can be used to identify occupants inside the vehicle and their vital signs. The identified information can then be used to determine the occupancy of the vehicle's interior space.

[0037] In one application scenario, a target recognition model is used to identify targets in the acquired images of the vehicle interior, specifically identifying occupants and items inside the vehicle. After identifying occupants, their vital signs are determined. Furthermore, the location information of occupants and items within the vehicle is used to determine the occupancy of the interior space.

[0038] Step 13: Determine acoustic parameters using in-vehicle space occupancy information and audio data.

[0039] In some embodiments, the acoustic atmosphere created by different in-vehicle spaces is different. For example, the sound is different in an open space and a crowded space. In an open space, sound loss during propagation is less, while in a crowded space, sound is lost more as it is consumed by the medium. Therefore, it is necessary to determine the acoustic parameters based on the in-vehicle space occupancy information and audio data. Here, acoustic parameters refer to the acoustic parameters that need to be adjusted.

[0040] In one application scenario, in-vehicle images and audio data can be acquired in real time. The images are used to determine the current occupancy of the vehicle's interior space, while the audio data is used to determine acoustic parameters. It's understandable that the interior space changes constantly as people move or get in and out of the vehicle; therefore, real-time image acquisition is necessary to determine the acoustic parameters that need adjustment based on the information about interior space occupancy.

[0041] Step 14: Determine the sound effect mode using location distribution information and physical characteristics information.

[0042] In some embodiments, the vehicle is equipped with multiple speakers, such as several speakers on the front seats, several speakers on the rear seats, and several speakers around the top of the vehicle.

[0043] It is understandable that different sound effect modes correspond to different location distribution information and vital sign information.

[0044] For example, location distribution information can determine the corresponding speaker location in a sound effect pattern, and physical characteristics information can determine the sound effect pattern. For instance, age and gender in physical characteristics information can be combined with big data to form a correspondence between age, gender, and sound effect patterns. Therefore, physical characteristics information can be used to determine the sound effect pattern, and location distribution information can be used to determine the corresponding speaker information within the sound effect pattern.

[0045] In one application scenario, speakers can be placed at the corresponding head area of ​​each seat, close to the ears of the occupants. When playing audio data, the speakers at seats with occupants can be identified, and these speakers can be controlled to play audio data.

[0046] Step 15: Determine the compensation parameters using acoustic parameters.

[0047] In some embodiments, corresponding compensation parameters can be determined for different acoustic parameters. For example, acoustic parameters may include at least one of audio output frequency, volume, signal delay, or reverberation. After determining the acoustic parameters, the corresponding acoustic parameters are weighted according to the vehicle interior space occupancy information to obtain the corresponding compensation parameters. The compensation parameters can be numerical values ​​corresponding to the acoustic parameters. For example, if the acoustic parameter is the audio output frequency, the compensation parameter can be the output compensation frequency. If the acoustic parameter is the volume, the compensation parameter can be the compensation volume. If the acoustic parameter is the signal delay, the compensation parameter can be the compensation signal delay.

[0048] It is understandable that different acoustic parameters can have their own different ways of determining compensation parameters.

[0049] Step 16: Adjust the acoustic parameters corresponding to the sound effect mode using the compensation parameters.

[0050] Once the compensation parameters are determined, the acoustic parameters in the sound effect mode can be compensated, and the compensated acoustic parameters can be used for audio playback.

[0051] In this embodiment, the system identifies the location distribution information, vital signs information, and interior space occupancy information of occupants from the acquired in-vehicle images; then uses the interior space occupancy information and the acquired in-vehicle audio data to determine acoustic parameters; uses the location distribution information and vital signs information to determine the sound effect mode; uses the acoustic parameters to determine compensation parameters; and uses the compensation parameters to adjust the acoustic parameters corresponding to the sound effect mode. By combining in-vehicle visual information and in-vehicle spatial acoustic parameters, the system analyzes the optimal compensation parameters for the corresponding sound effect mode under different conditions such as the number of passengers, their vital signs information, and interior space occupancy information, thereby completing the corresponding sound effect adjustment, improving the compatibility of the output sound effect with the occupants, and thus enhancing the riding experience of the occupants.

[0052] See Figure 2 , Figure 2 This is a flowchart illustrating the second embodiment of the vehicle sound effect adjustment method provided in this application. The method includes:

[0053] Step 21: Collect audio data and images inside the vehicle.

[0054] Step 22: Identify the location distribution, vital signs, and interior space occupancy information of the people inside the vehicle from the image.

[0055] The vital signs information includes at least one of the following: age, gender, height, sitting posture, head position, and auricle.

[0056] In some embodiments, a corresponding recognition model can be used to identify the location distribution information, vital signs information, and space occupancy information of occupants inside the vehicle. This recognition model can be constructed using relevant machine learning algorithms, such as convolutional neural networks or support vector machines.

[0057] Step 23: Determine acoustic parameters using in-vehicle space occupancy information and audio data.

[0058] Step 24: Determine the sound effect mode using location distribution information and physical characteristics information.

[0059] In some embodiments, after determining at least one of height, sitting posture, head space posture, and auricle, the current state of the occupant in the vehicle can be determined based on the sitting posture, and then the sound effect mode can be determined. For example, if the current sitting posture is reclined, the current state of the occupant in the vehicle is a resting state, and the sound effect mode can correspond to a resting mode. If the current sitting posture is upright, the current state of the occupant in the vehicle is a normal state, and the sound effect mode can correspond to a normal mode.

[0060] In one application scenario, when there are multiple people in the vehicle, excluding the driver, the vital signs of each person are determined. These vital signs are then prioritized, and the sound effect mode is determined based on the highest priority. Priority is further ranked by posture: the more upright the posture, the lower the priority; the more disheveled the posture, the higher the priority.

[0061] It's understandable that poor posture indicates the person is asleep, not in a normal riding posture. Therefore, it's necessary to ensure the sleep quality of those who are sleeping, and thus, the sound effects mode needs to be tailored to them.

[0062] Step 25: Determine the compensation parameters using acoustic parameters.

[0063] Step 25 has the same or similar technical solution as any of the above embodiments, and will not be described in detail here.

[0064] Step 26: Adjust at least one of the following parameters corresponding to the sound effect mode: audio output frequency, volume, signal delay, or reverb, using the compensation parameters.

[0065] It is understandable that audio output frequency, volume, signal delay, and reverberation each have their own compensation parameters. By adjusting these compensation parameters, the audio output frequency, volume, signal delay, and reverberation can be adjusted to adapt the sound effect mode to the actual conditions inside the vehicle, providing passengers with a better auditory experience.

[0066] In this embodiment, by combining in-vehicle visual information and in-vehicle spatial acoustic parameters, the optimal compensation parameters for the corresponding sound effect mode under different conditions such as the number of passengers, passengers' vital signs information, and in-vehicle space occupancy information are analyzed, and the corresponding sound effect adjustment is completed to improve the adaptability of the output sound effect to the people in the vehicle, thereby improving the riding experience of the people in the vehicle.

[0067] See Figure 3 , Figure 3 This is a flowchart illustrating the third embodiment of the vehicle sound effect adjustment method provided in this application. The method includes:

[0068] Step 31: Collect audio data and images inside the vehicle.

[0069] The system uses a microphone inside the vehicle to collect ambient audio data, which includes at least one audio source: a first audio source played by a speaker and a second audio source generated by people and objects inside the vehicle.

[0070] Step 32: Identify the location distribution, vital signs, and interior space occupancy information of the people inside the vehicle from the image.

[0071] The vital signs information includes at least one of the following: age, gender, height, sitting posture, head position, and auricle.

[0072] Step 33: Determine acoustic parameters using in-vehicle space occupancy information and audio data.

[0073] Among these features, in-vehicle microphones can be used to capture acoustic parameters, which can then be adaptively calculated by the in-vehicle audio power amplifier.

[0074] Steps 31-33 have the same or similar technical solutions as any of the above embodiments, and will not be described in detail here.

[0075] In some embodiments, audio data can be played through in-vehicle speakers and collected by in-vehicle microphones. The two sets of data are compared to calculate relevant acoustic parameters. Furthermore, the acoustic parameters are updated in real time when information such as the presence of people or objects within the vehicle is available.

[0076] Step 34: Construct a spatial processing model using location distribution information and vital sign information to determine the key positioning points corresponding to the occupants inside the vehicle.

[0077] Spatial processing models can be constructed based on three-dimensional space. By utilizing location distribution information and vital sign information, a three-dimensional model of the people inside the vehicle can be built, and key points of the corresponding vital sign information can be located.

[0078] Step 35: Obtain the sound effect mode corresponding to the key positioning point.

[0079] It's understandable that different key positioning points correspond to different sound effect modes.

[0080] In one application scenario, the sound effect mode can be determined based on the data of people inside the vehicle. For example, if only the driver is present, a single-person sound effect mode can be implemented, and the single-person sound effect mode can be further refined based on the driver's physical condition information to achieve compensation according to the driver's physical condition information in the single-person sound effect mode.

[0081] For example, when there are multiple people, a multi-person sound effect mode can be used. There are many speakers in the vehicle. The driver's speaker continues to use the driver's single sound effect mode for audio output, while the speakers of other people are optimized and compensated for acoustic parameters based on their physical characteristics, so that different people can experience a better auditory experience.

[0082] Step 36: Determine the compensation parameters using acoustic parameters.

[0083] Step 37: Adjust the acoustic parameters corresponding to the sound effect mode using the compensation parameters.

[0084] Furthermore, after adjusting the acoustic parameters corresponding to the sound effect mode using compensation parameters, it is necessary to determine the sound effect enhancement result of the current adjusted acoustic parameters. If the enhancement result is greater than the preset value, the adjusted acoustic parameters will be used for audio output. In this way, the rationality of the adjustment is further verified. If it is rational, the audio output will be based on the adjusted acoustic parameters; if it is not rational, the adjusted acoustic parameters will not be used, and the original acoustic parameters will be used for audio output.

[0085] In this embodiment, by combining in-vehicle visual information and in-vehicle spatial acoustic parameters, the optimal compensation parameters under the corresponding sound effect mode are analyzed under different conditions such as the number of passengers, passenger age, gender, height and other key parameters affecting the listening experience, and in-vehicle space occupancy information. The corresponding sound effect adjustment is completed to improve the adaptability of the output sound effect to the people in the vehicle, thereby improving the riding experience of the people in the vehicle.

[0086] In one application scenario, information on factors such as the distribution of people inside the vehicle, their seating arrangement, age, height, posture, head position, and ear position, as well as information affecting the acoustic environment, is utilized from collected images for recognition. The distribution of people inside the vehicle includes the passenger distribution at each seat, and the occupancy of items within the vehicle space is identified from the images.

[0087] The identified information is used to create a spatial model, obtaining key positioning points of passengers in the three-dimensional sound field. Then, the optimal sound output mode is determined based on the identified passenger distribution within the vehicle. The sound output modes corresponding to different passenger seating arrangements are shown in the table below.

[0088]

[0089] The system also calculates in-vehicle acoustic parameters based on in-vehicle audio output. In-vehicle audio output refers to parameters such as the frequency range, phase change, and sound pressure level of the sound output from the speakers, measured using in-vehicle microphones. These acoustic parameters are calculated based on the distribution of occupants within the vehicle, and the necessary sound effect parameters for compensation are then calculated in the in-vehicle audio amplifier.

[0090] Based on the above judgment results, the final sound effect is output by the car audio amplifier.

[0091] See Figure 4 , Figure 4 This is a schematic diagram of the structure of the first embodiment of the vehicle sound effect adjustment system provided in this application. The vehicle sound effect adjustment system 40 includes: a data acquisition unit 41, an analysis unit 42, a determination unit 43, and an adjustment unit 44.

[0092] The acquisition unit 41 is used to acquire audio data and images inside the vehicle.

[0093] The analysis unit 42 is used to identify the location distribution information, vital signs information and interior space occupancy information of the people in the vehicle from the image; to determine the acoustic parameters using the interior space occupancy information and audio data; and to determine the sound effect mode using the location distribution information and vital signs information.

[0094] The determining unit 43 is used to determine the compensation parameters using acoustic parameters.

[0095] The adjustment unit 44 is used to adjust the acoustic parameters corresponding to the sound effect mode using compensation parameters.

[0096] The vital signs information includes at least one of the following: age, gender, height, sitting posture, head position, and auricle.

[0097] In some embodiments, the analysis unit 42 is further configured to adjust at least one of the following parameters corresponding to the sound effect mode: audio output frequency, volume, signal delay, or reverberation, using compensation parameters.

[0098] In some embodiments, the analysis unit 42 is further configured to construct a spatial processing model based on location distribution information and vital sign information to determine key positioning points corresponding to the occupants in the vehicle; and to obtain sound effect patterns corresponding to the key positioning points.

[0099] In some embodiments, the acquisition unit 41 is further configured to acquire ambient audio data inside the vehicle using a microphone, the ambient audio data including at least one audio source, such as a first audio source played by a speaker and a second audio source generated by people and objects inside the vehicle.

[0100] It is understood that the vehicle sound effect adjustment system 40 can implement the method of any of the above embodiments using the acquisition unit 41, analysis unit 42, determination unit 43 and adjustment unit 44.

[0101] See Figure 5 , Figure 5 This is a schematic diagram of the structure of the first embodiment of the vehicle sound effect adjustment system provided in this application. The vehicle sound effect adjustment system 40 includes: a data acquisition unit 41, an analysis unit 42, a determination unit 43, an adjustment unit 44, and a feedback unit 45.

[0102] Feedback unit 45 is used to determine the sound effect enhancement result of the current adjusted acoustic parameters; if the enhancement result is greater than the preset value, the adjusted acoustic parameters will be used for audio output.

[0103] It is understood that the vehicle sound effect adjustment system 40 can implement the method of any of the above embodiments using the acquisition unit 41, analysis unit 42, determination unit 43, adjustment unit 44 and feedback unit 45.

[0104] See Figure 6 , Figure 6 This is a schematic diagram of an embodiment of the electronic device provided in this application. The electronic device 60 includes a memory 62 and a processor 61. The memory 62 stores a computer program, and the processor 61 executes the computer program to implement the following method:

[0105] The system collects audio data and images from inside the vehicle; identifies the location distribution, vital signs, and interior space occupancy information of the occupants from the images; determines acoustic parameters using the interior space occupancy information and audio data; determines sound effect modes using the location distribution and vital signs information; determines compensation parameters using the acoustic parameters; and adjusts the acoustic parameters corresponding to the sound effect modes using the compensation parameters.

[0106] It is understood that the processor 61 is also used to execute computer programs to implement the methods of any of the above embodiments, which will not be described in detail here.

[0107] See Figure 7 , Figure 7 This is a schematic diagram of an embodiment of the computer-readable storage medium provided in this application. The computer-readable storage medium 70 stores a computer program 71, which, when executed by a processor, implements the following method:

[0108] The system collects audio data and images from inside the vehicle; identifies the location distribution, vital signs, and interior space occupancy information of the occupants from the images; determines acoustic parameters using the interior space occupancy information and audio data; determines sound effect modes using the location distribution and vital signs information; determines compensation parameters using the acoustic parameters; and adjusts the acoustic parameters corresponding to the sound effect modes using the compensation parameters.

[0109] It is understood that computer program 71 is used to implement the methods of any of the above embodiments when executed by a processor, and will not be described in detail here.

[0110] In summary, this application combines in-vehicle visual information and in-vehicle acoustic parameters to analyze the optimal compensation parameters for the corresponding sound effect modes under different passenger numbers, passenger vital signs, and in-vehicle space occupancy information, thereby completing the corresponding sound effect adjustments, improving the compatibility of the output sound effects with the in-vehicle occupants, and thus enhancing the riding experience of the in-vehicle occupants.

[0111] Furthermore, in related technologies, since the sound field level inside the vehicle changes with the operation of the vehicle, it is impossible to know the acoustic parameters corresponding to the sound field inside the vehicle. Therefore, this application adopts the above-mentioned scheme to determine the acoustic parameters inside the vehicle in real time and complete the corresponding parameter compensation.

[0112] If the technical solution of this application involves personal information, the product using this technical solution has clearly informed the user of the personal information processing rules and obtained the user's voluntary consent before processing the personal information. If the technical solution of this application involves sensitive personal information, the product using this technical solution has obtained the user's separate consent before processing the sensitive personal information, and also meets the requirement of "express consent". For example, at personal information collection devices such as cameras, clear and prominent signs are set up to inform users that they have entered the scope of personal information collection and that personal information will be collected. If an individual voluntarily enters the collection scope, it is deemed that they have agreed to the collection of their personal information; or on the personal information processing device, with clear signs / information informing users of the personal information processing rules, authorization is obtained from the individual through pop-up information or by asking the individual to upload their personal information; wherein, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the types of personal information processed.

[0113] The processor involved in this application may be referred to as a CPU (Central Processing Unit), which may be an integrated circuit chip, or a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component.

[0114] The storage media used in this application include various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), or optical discs.

[0115] The above description is merely an embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A method for adjusting vehicle sound effects, characterized in that, The method includes: Collect audio data and images from inside the vehicle; The image is used to identify the location distribution information, vital signs information, and vehicle interior space occupancy information of the occupants. The vehicle interior space occupancy information is determined using the location information of the occupants and items inside the vehicle. The acoustic parameters that need to be adjusted are determined using the in-vehicle space occupancy information and the audio data; and the sound effect mode is determined using the position distribution information and the vital sign information. The compensation parameters are determined using the acoustic parameters that need to be adjusted. The acoustic parameters corresponding to the sound effect mode are adjusted using the compensation parameters; After adjusting the acoustic parameters corresponding to the sound effect mode using the compensation parameters, the process includes: determining the sound effect enhancement result of the acoustic parameters corresponding to the adjusted sound effect mode; if the enhancement result is greater than a preset value, outputting audio using the acoustic parameters corresponding to the adjusted sound effect mode.

2. The method according to claim 1, characterized in that, The step of adjusting the acoustic parameters corresponding to the sound effect mode using the compensation parameters includes: The compensation parameters are used to adjust at least one of the following parameters corresponding to the sound effect mode: audio output frequency, volume, signal delay, or reverberation.

3. The method according to claim 1, characterized in that, The vital signs information includes at least one of the following: age, gender, height, sitting posture, head position, and auricle.

4. The method according to claim 3, characterized in that, The step of determining the sound effect pattern using the location distribution information and the vital sign information includes: Using the location distribution information and the vital sign information, a spatial processing model is constructed to determine the key positioning points corresponding to the occupants in the vehicle; Obtain the sound effect mode corresponding to the key positioning point.

5. The method according to claim 1, characterized in that, The audio data collected from inside the vehicle includes: The ambient audio data inside the vehicle is collected using a microphone, and the ambient audio data includes at least one audio source, such as a first audio source played by a speaker and a second audio source generated by the occupants and objects inside the vehicle.

6. A vehicle sound effect adjustment system, characterized in that, The vehicle sound effect adjustment system includes: The acquisition unit is used to acquire audio data and images inside the vehicle; The analysis unit is used to identify the location distribution information, vital signs information, and vehicle interior space occupancy information of the occupants in the image; determine the acoustic parameters that need to be adjusted using the vehicle interior space occupancy information and the audio data; and determine the sound effect mode using the location distribution information and the vital signs information, wherein the vehicle interior space occupancy information is determined using the location information of the occupants and items in the vehicle. A determining unit is used to determine compensation parameters using the acoustic parameters that need to be adjusted; The adjustment unit is used to adjust the acoustic parameters corresponding to the sound effect mode using the compensation parameters; The feedback unit is used to determine the sound effect enhancement result of the adjusted acoustic parameters; if the enhancement result is greater than the preset value, the adjusted acoustic parameters will be used for audio output.

7. An electronic device, characterized in that, The electronic device includes a memory and a processor, the memory being used to store a computer program and the processor being used to execute the computer program to implement the method as described in any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, is used to implement the method as described in any one of claims 1-5.

Citation Information

Patent Citations

  • CN110636413A

  • CN112291677A