Vehicle volume adjusting method and device, electronic equipment and readable storage medium

By acquiring information from in-vehicle cameras and sensors, and combining this information with in-vehicle noise and occupant behavior, the volume is dynamically adjusted. This solves the problem of inaccurate volume control in existing technologies, enabling more flexible and intelligent volume control and improving the user experience.

CN119049019APending Publication Date: 2024-11-29CHONGQING SELIS PHOENIX INTELLIGENT INNOVATION TECH CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411150871.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-21
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

The existing vehicles have a single automatic volume adjustment method, which leads to inaccurate volume adjustment in situations such as vehicle speed signal sensor failure or complex driving environments, and fails to meet user needs.

Method used

By acquiring images of people, vehicle speed, and noise information through in-vehicle cameras, and combining this with a preset relationship between behavior and volume, the volume of the sound source is dynamically adjusted, taking into account in-vehicle noise and people's behavior, to achieve volume adjustment through the fusion of multi-source information.

Benefits of technology

It improves the accuracy and flexibility of volume adjustment, enhances the user experience, adapts to personalized volume needs under different driving conditions, and reduces the driver's operational burden.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119049019A_ABST
    Figure CN119049019A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of vehicles, and provides a vehicle volume adjusting method and device, electronic equipment and a readable storage medium. The method comprises the following steps: acquiring image information of personnel in a vehicle through a camera in the vehicle, and acquiring speed information of the vehicle and noise information in the vehicle; if it is detected that the behavior of the person in the vehicle belongs to a preset behavior according to the person image information, the target volume of the target sound source is determined according to a preset corresponding relation between the preset behavior and the sound source volume; if it is detected that the behavior of the person in the vehicle does not belong to the preset behavior according to the person image information, determining the target volume of the target sound source according to the speed information of the vehicle and the noise information in the vehicle; and controlling the volume of the target sound source to be adjusted to the target volume. According to the invention, the accuracy and flexibility of volume adjustment of the sound source in the vehicle are improved, and the user experience is enhanced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and more particularly to a method, apparatus, electronic device, and readable storage medium for adjusting the volume of a vehicle. Background Technology

[0002] With the development of technology, automobiles are becoming increasingly intelligent, and users' demands for the driving and riding experience are also gradually rising. The driving and riding experience has become an important part of enhancing the overall vehicle experience. A comfortable driving and riding experience is inseparable from the in-car volume control function. While driving, passengers often play music, use voice assistants, safety alerts, and navigation, all of which are closely related to the volume control function.

[0003] Existing automatic volume adjustment methods only intelligently adjust the volume of multimedia audio sources such as Bluetooth music, USB music, and radio. This is achieved by automatically adjusting the volume based on changes in vehicle speed to counteract external noise interference inside the vehicle (such as engine, tire, and wind noise). However, if the vehicle speed sensor malfunctions or there are problems with signal transmission, it may be unable to accurately determine the vehicle speed, leading to inaccurate or ineffective volume adjustment. Furthermore, in complex driving environments, such as strong winds, heavy rain, or other noise sources inside the vehicle, the vehicle may not be able to fully recognize these conditions, thus failing to counteract the noise interference for the user. Summary of the Invention

[0004] In view of this, embodiments of this application provide a method, device, electronic device, and readable storage medium for adjusting the volume of a vehicle, in order to solve the problem that the existing vehicle volume automatic adjustment method is singular, resulting in inaccurate volume adjustment and failure to meet user needs.

[0005] A first aspect of this application provides a method for adjusting the volume of a vehicle, comprising: acquiring image information of people inside the vehicle via an in-vehicle camera, and acquiring vehicle speed information and noise information inside the vehicle; if the behavior of people inside the vehicle is detected to be a preset behavior based on the image information, determining a target volume of a target sound source based on a preset correspondence between the preset behavior and the volume of a sound source; if the behavior of people inside the vehicle is detected to be a preset behavior based on the image information, determining a target volume of a target sound source based on the vehicle speed information and the noise information inside the vehicle; and controlling the volume of the target sound source to be adjusted to the target volume.

[0006] A second aspect of this application provides a vehicle volume control device, comprising:

[0007] The acquisition module is configured to acquire image information of people inside the vehicle through the in-vehicle camera, and to acquire vehicle speed information and noise information inside the vehicle;

[0008] The determination module is configured to determine the target volume of the target sound source if the behavior of the people inside the vehicle detected by the personnel image information belongs to the preset behavior, based on the preset correspondence between the preset behavior and the volume of the sound source; and to determine the target volume of the target sound source based on the vehicle speed information and the noise information inside the vehicle if the behavior of the people inside the vehicle detected by the personnel image information does not belong to the preset behavior.

[0009] The adjustment module is configured to control the volume adjustment of the target audio source to the target volume.

[0010] A third aspect of this application provides an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method described above.

[0011] A fourth aspect of this application provides a readable storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described method.

[0012] The beneficial effects of this application compared with the prior art are as follows: by combining the behavior of people inside the vehicle, the speed information of the vehicle, and the noise information inside the vehicle, the volume of the sound source can be adjusted more accurately. The multi-source information fusion method makes the adjustment of the volume inside the vehicle more flexible and intelligent. Even when the behavior of people inside the vehicle is not a preset behavior, the volume of the sound source can be dynamically adjusted according to the vehicle speed and noise information to adapt to different driving conditions. This solves the problem that the automatic volume adjustment method of the vehicle in the prior art is single, resulting in inaccurate volume adjustment and failure to meet user needs. It improves the accuracy and flexibility of the volume adjustment of the sound source inside the vehicle and enhances the user experience. Attached Figure Description

[0013] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0014] Figure 1 This is a schematic flowchart of a vehicle volume adjustment method provided in an embodiment of this application;

[0015] Figure 2 This is a schematic diagram of a scenario for the personalized settings interface in an embodiment of this application;

[0016] Figure 3 This is a schematic flowchart of another vehicle volume adjustment method provided in this application embodiment;

[0017] Figure 4 This is a schematic diagram of the structure of a vehicle volume control device provided in an embodiment of this application;

[0018] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0019] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0020] The following describes in detail, with reference to the accompanying drawings, a method and apparatus for adjusting the volume of a vehicle according to an embodiment of this application.

[0021] Figure 1 This is a schematic flowchart illustrating a method for adjusting the volume of a vehicle according to an embodiment of this application. Figure 1 As shown, the vehicle's volume adjustment method includes:

[0022] Step 101: Obtain image information of people inside the vehicle through the in-vehicle camera, and obtain vehicle speed information and noise information inside the vehicle.

[0023] Specifically, with the authorization of the occupants, the in-vehicle camera can capture images of the people inside the vehicle. The in-vehicle camera can be installed near the rearview mirror or other key locations to capture images of the vehicle's interior from all angles.

[0024] By performing feature processing on image information of people inside a vehicle, their behavior can be determined, enabling more intelligent volume adjustment based on this behavior. For example, the volume of a phone call can be lowered to reduce interference.

[0025] In addition, vehicle speed sensors can be used to monitor vehicle speed and obtain real-time speed information.

[0026] Furthermore, by installing microphones or other noise sensors inside the vehicle, the noise level inside the vehicle can be monitored in real time to obtain noise information. This noise information can be non-speed-related, such as passenger conversations, air conditioning operation, and strong winds. In existing technologies, in complex driving environments, such as strong winds, heavy rain, or other noise sources inside the vehicle (e.g., passenger conversations), the vehicle cannot fully recognize these situations. In such cases, the driver needs to manually adjust the volume to adapt to different driving environments. This application, by acquiring noise information inside the vehicle, helps to better cope with changes in in-vehicle noise, especially at low speeds or when stationary, where vehicle speed information provides limited information. By monitoring in-vehicle noise and using this noise information as a basis for adjusting the vehicle's audio source, the vehicle's volume can be adjusted more comprehensively to adapt to different driving environments.

[0027] In some embodiments, the in-vehicle intelligent volume control system in this embodiment can determine the on / off state of the intelligent volume control function switch after the vehicle is powered on and started. If the intelligent volume control function switch is not turned on, it will play at a fixed volume, and the volume needs to be manually adjusted by the driver or passengers (personnel in the vehicle). If the intelligent volume control function switch is turned on, it can automatically determine a suitable target volume by simultaneously using the aforementioned personnel image information, vehicle speed information, and vehicle noise information. This not only takes into account the influence of vehicle speed, but also the vehicle noise level and the behavior of the people in the vehicle, so as to more comprehensively meet the volume needs of the people in the vehicle under various conditions.

[0028] It should be noted that if the user sets the volume to 0, mute, or maximum volume, the volume will not be automatically adjusted.

[0029] Step 102: If the behavior of the people inside the vehicle is detected to be a preset behavior based on the personnel image information, the target volume of the target sound source is determined according to the preset correspondence between the preset behavior and the volume of the sound source.

[0030] Specifically, the preset behavior can be at least one of making a phone call, sleeping, or working.

[0031] The occupants of the vehicle can be the driver and passengers. When detecting whether the behavior of the occupants conforms to preset behaviors based on their image information, hand movements can be detected, and face detection algorithms can be used to detect and locate the facial positions of the occupants. After detecting the faces, the positions of the eyes and mouth can be determined, and their coordinates can be obtained, thus calculating the degree of eye and mouth opening. Simultaneously, by analyzing continuous frames of occupant image information, the frequency and number of blinks and mouth openings can be calculated. The mouth opening distance can be estimated by measuring the distance between the corners of the mouth when it is open. The aforementioned eye coordinates, mouth coordinates, eye opening degree, mouth opening degree, frequency and number of blinks, frequency and number of mouth openings, and mouth opening distance are all facial features of the occupants of the vehicle. In addition, hand movements can include tapping on the screen or keyboard of an electronic device.

[0032] In some embodiments, to accurately detect the behavior of occupants in a vehicle, preset facial and hand features for preset behaviors can be stored in a preset database. These preset facial features include the aforementioned mouth and eye features. The real-time extracted facial and hand features of occupants are compared and analyzed with the preset facial and hand features stored in the preset database to determine whether the current behavior of the occupants belongs to the preset behaviors.

[0033] Furthermore, in some embodiments, a pre-defined correspondence between preset behaviors and volume levels is established. These preset behaviors can include making a phone call, sleeping, or working. When the user's behavior is determined to be making a phone call or sleeping, the volume of the target audio source is adjusted to the target volume corresponding to the preset behavior, achieving automatic control of the target audio source volume adjustment without manual operation by the driver. When the user's behavior is determined to be different from the preset behavior, the volume of the target audio source at the current moment is not adjusted based on the user's behavior.

[0034] For example, assuming the volume range is 0-100, the target volume can be 0 or 10, but it needs to be relatively low so that the car interior is quiet when the target audio source's volume is at the target level. The target audio source can be a multimedia audio source, navigation prompt audio source, voice assistant audio source, etc.

[0035] By recognizing the behavior of occupants in a vehicle, a more personalized volume adjustment experience can be provided, making the audio source volume more suitable for the current situation without requiring manual operation by the driver, thus reducing the driver's workload. Lowering the volume of the target audio source when someone is making a phone call can reduce interference and improve driving safety, while lowering the volume of the target audio source when someone is resting provides a quieter environment for relaxation and rest.

[0036] Step 103: If the behavior of the people inside the vehicle is not a preset behavior as detected by the personnel image information, the target volume of the target sound source is determined based on the vehicle speed information and the noise information inside the vehicle.

[0037] Specifically, if the behavior of the people inside the vehicle does not belong to the preset behavior, the target volume can be determined by combining the current vehicle speed information and the noise information inside the vehicle, and the volume of the target sound source can be adjusted to the calculated target volume.

[0038] Specifically, as an example, suppose the target audio source is a multimedia audio source. When a multimedia audio source is playing in the vehicle, and the volume of the multimedia audio source is 35, the behavior of the people in the vehicle is determined to be non-preset behavior based on the image information obtained by the in-vehicle camera. Based on the current vehicle speed information and the noise information in the vehicle, the target volume is calculated to be 55. Then the volume of the multimedia audio source can be adjusted to 55.

[0039] In this way, when it is determined that the behavior of the people in the vehicle does not belong to the preset behavior, the volume of the sound source can be dynamically adjusted according to the vehicle's speed information and the noise information inside the vehicle, so that the volume of the sound source is kept within a comfortable range that is neither too loud nor too soft, in order to adapt to different driving environments and thus improve the user's auditory experience.

[0040] Step 104: Adjust the volume of the target audio source to the target volume.

[0041] Based on the vehicle volume adjustment method proposed in this application, an in-vehicle camera acquires image information of occupants, vehicle speed information, and in-vehicle noise information. The camera can capture the actions and expressions of occupants, all of which provide basic data support for subsequent volume adjustment. Processing the occupant image information allows analysis of their specific behaviors. If the occupant's behavior is identified as a preset behavior, the target sound source volume is adjusted to match the preset behavior's volume level, based on the pre-set correspondence between preset behaviors and sound source volume, to meet the occupants' needs under the preset behavior. If the occupant's behavior is not a preset behavior, a suitable volume value is dynamically calculated based on the vehicle speed and in-vehicle noise information to determine the target sound source's volume, ensuring that the target sound source's volume remains at a suitable level under different driving conditions (different speeds and different noise levels). In this way, by combining the behavior of people inside the vehicle, the vehicle's speed information, and the noise information inside the vehicle, the volume of the sound source can be adjusted more accurately. This achieves more flexible and intelligent adjustment of the volume inside the vehicle through multi-source information fusion. Even when the behavior of people inside the vehicle is not a preset behavior, the volume of the sound source can be dynamically adjusted according to the vehicle speed and noise information to adapt to different driving conditions. This solves the problem that the single automatic volume adjustment method of the vehicle in the existing technology leads to inaccurate volume adjustment and failure to meet user needs. It improves the accuracy and flexibility of volume adjustment of the sound source inside the vehicle and enhances the user experience.

[0042] In some embodiments, determining the target volume of the target sound source based on vehicle speed information and noise information inside the vehicle includes:

[0043] Based on the vehicle's speed information and the first correspondence between the speed information and the volume of the sound source, a first candidate volume of the target sound source is determined; based on the noise information inside the vehicle and the second correspondence between the noise information and the volume of the sound source, a second candidate volume of the target sound source is determined; based on the first candidate volume and the second candidate volume, the target volume of the target sound source is determined.

[0044] Specifically, as vehicle speed increases, external noise (such as wind noise and tire noise) also increases, thus requiring increased volume of in-vehicle audio sources to maintain a continuous auditory experience. A pre-defined first correspondence between vehicle speed information and audio source volume allows mapping the vehicle's current speed (i.e., vehicle speed information) to a specific audio source volume value, i.e., a first candidate volume. For example, the first correspondence between vehicle speed information and audio source volume can be shown in the table below.

[0045] Correspondence table between vehicle speed information and audio source volume

[0046] Vehicle speed information (km / h) Volume of the audio source 0 0 (0,30] 15 (30,60] 35 (60,90] 55 (90,110] 75 110 or more 95

[0047] In addition, noise information inside the vehicle can be acquired in real time through a noise monitoring device (such as a microphone), and a sound source volume value that can cover or compensate for the noise inside the vehicle can be determined according to a pre-set second correspondence, i.e., a second candidate volume. For example, the second correspondence between noise information and the volume of the sound source can be shown in the table below.

[0048] Correspondence table between noise information and sound source volume

[0049] Vehicle interior noise information (dB) Volume of the audio source 0 0 (0,20] 15 (20,40] 35 (40,60] 55 (60,70] 75 70 and above 95

[0050] Furthermore, by comprehensively considering the first and second candidate volume levels to determine the target volume, the system integrates vehicle speed information and in-vehicle noise information to determine the target volume, thereby achieving more precise and flexible volume adjustment and meeting the needs of users under current driving conditions.

[0051] In some embodiments, determining the target volume of the target sound source based on a first candidate volume and a second candidate volume includes:

[0052] Compare the volume of the first candidate volume and the volume of the second candidate volume, and determine the volume of the first candidate volume and the volume of the second candidate volume that is larger as the target volume of the target sound source; or, determine the average volume of the first candidate volume and the second candidate volume, and determine the average volume as the target volume of the target sound source.

[0053] Specifically, this embodiment can compare a first candidate volume and a second candidate volume, selecting the larger one as the target volume of the target sound source. The focus is on ensuring the volume is sufficiently large to overcome background noise and ensure the user can clearly hear the sound source content. For example, when the first candidate volume is 15 and the second candidate volume is 35, the second candidate volume of 35 is determined as the target volume of the target sound source. Furthermore, this embodiment can also calculate the average of the first and second candidate volumes and determine this average as the target volume of the target sound source, ensuring the target volume is neither too high nor too low to adapt to different driving conditions and user needs. For example, when the first candidate volume is 15 and the second candidate volume is 35, the average value of 25 is determined as the target volume of the target sound source.

[0054] Specifically, as an example, when the target audio source is a multimedia audio source, assuming the vehicle's speed is 0 and the noise level inside the vehicle is 50dB, the multimedia audio source volume is 35. Based on the image information inside the vehicle obtained by the camera, it is determined that the behavior of the people inside the vehicle does not belong to the preset behavior. Based on the vehicle speed information of 0, the corresponding first candidate volume is determined to be 0. Based on the noise level inside the vehicle of 50dB, the corresponding second candidate volume is determined to be 55. Based on the first candidate volume of 0 and the second candidate volume of 55, the larger one is selected as the target volume of the target audio source, and the target audio source volume is determined to be 55. The target audio source volume is then adjusted to the target volume of 55. Subsequently, based on the image information inside the vehicle obtained by the camera, it is determined that the behavior of the people inside the vehicle belongs to the preset behavior, and the target audio source volume can be adjusted to the first volume of 0 corresponding to the preset behavior. After the preset behavior ends, the vehicle speed information is 0 and the noise information inside the vehicle is 30dB. Based on the vehicle speed information of 0, the corresponding first candidate volume is determined to be 0. Based on the noise information inside the vehicle of 30dB, the corresponding second candidate volume is determined to be 35. Based on the first candidate volume of 0 and the second candidate volume of 35, the larger one is selected as the target volume of the target sound source. The target volume of the target sound source is determined to be 35 at this time, and the volume of the target sound source is controlled to be adjusted to the target volume of 35.

[0055] Specifically, as another example, suppose the target audio source is a multimedia audio source, the vehicle speed is 20 km / h, the noise level inside the vehicle is 30 dB, and the multimedia audio source volume is 15. Based on the image information inside the vehicle obtained by the camera, it is determined that the behavior of the people inside the vehicle does not belong to the preset behavior. Based on the vehicle speed of 20 km / h, the corresponding first candidate volume is determined to be 15. Based on the noise level inside the vehicle of 30 dB, the corresponding second candidate volume is determined to be 35. Based on the first candidate volume of 15 and the second candidate volume of 35, the larger one is selected as the target volume of the target audio source, and the target volume of the target audio source is determined to be 35. The volume of the target audio source is then adjusted to the target volume of 35. The vehicle accelerates to 80 km / h, at which point the noise level inside the vehicle is 32 dB. Based on the vehicle speed of 80 km / h, the corresponding first candidate volume is determined to be 55. Based on the noise level inside the vehicle of 32 dB, the corresponding second candidate volume is determined to be 35. Based on the first candidate volume of 55 and the second candidate volume of 35, the larger one is selected as the target volume of the target audio source, and the target volume of the target audio source is determined to be 55. Subsequently, based on the image information obtained from the camera inside the vehicle, it is determined that the behavior of the occupants belongs to a preset behavior. The volume of the target sound source can be adjusted to the first volume of 0, corresponding to the preset behavior. After the preset behavior ends, the vehicle speed information becomes 70km / h, and the noise information inside the vehicle is 31dB. Based on the vehicle speed information of 70km / h, the corresponding first candidate volume is determined to be 55. Based on the noise information of 31dB, the corresponding second candidate volume is determined to be 35. The larger of the first candidate volume 55 and the second candidate volume 35 is selected as the target volume of the target sound source. That is, the target volume of the target sound source is determined to be 55 at this time, and the volume of the target sound source is adjusted to the target volume of 55.

[0056] In some embodiments, after determining the target volume of the target audio source, the method further includes:

[0057] Detect whether there are other audio sources besides the target audio source playing sound simultaneously inside the vehicle;

[0058] If no other audio source is detected playing sound simultaneously inside the vehicle, the process proceeds to the step of adjusting the volume of the target audio source to the target volume.

[0059] If it is detected that other audio sources besides the target audio source are playing sound simultaneously in the vehicle, the mixing mode of all audio sources is determined. The mixing mode includes a first mixing mode and a second mixing mode. The first mixing mode refers to mixing and playing without adjusting the target volume of each audio source. The second mixing mode refers to mixing and playing the sound based on the priority of each audio source, suppressing the target volume of all audio sources except the highest priority.

[0060] If the mixing mode of all audio sources is determined to be the first mixing mode, proceed to the step of adjusting the volume of the target audio source to the target volume.

[0061] Specifically, current volume adjustment methods are simplistic, often adjusting only a single audio source and failing to adequately handle simultaneous playback from multiple sources. In the complex scenario of vehicle volume adjustment, besides adjusting the target audio source's volume based on vehicle speed, in-vehicle noise, and occupant behavior, it's also necessary to consider the possibility of multiple audio sources playing simultaneously within the vehicle. Furthermore, different users have varying sensitivities to volume and different audio source preferences, meaning current technologies may not meet the personalized needs of all users.

[0062] Specifically, after initially determining the target volume of the target sound source based on the vehicle's speed information, noise information inside the vehicle, and image information of the people inside the vehicle, it is possible to detect whether there are other sound sources besides the target sound source playing sound simultaneously inside the vehicle, so as to obtain the overall playback status of the current vehicle sound sources and generate a more reasonable volume adjustment strategy.

[0063] If no other audio source is detected playing sound simultaneously inside the vehicle, only the volume of the target audio source needs to be adjusted. There is no need to consider the influence of other audio sources, and the volume of the target audio source can be directly adjusted to the target volume.

[0064] If other audio sources besides the target audio source are detected playing simultaneously within the vehicle, the mixing mode of all audio sources is determined. This helps to intelligently adjust the volume based on the current audio source playback situation, adapting to different driving environments and user needs.

[0065] When the playback mode is the first mixing mode, the target volume of each audio source is not adjusted; instead, the target volume of each audio source is maintained during playback. It should be noted that the method for determining the target volume of each audio source is the same as the method for determining the target volume of the target audio source, and will not be repeated here. When the playback mode is the second mixing mode, based on the priority of each audio source, the target volume of all audio sources except the highest priority is suppressed before mixing and playback. In the second mixing mode, the volume can be adjusted according to the priority of the audio sources so that important information (i.e., high-priority audio sources, such as safety warning audio sources) can be clearly conveyed to the driver.

[0066] In some embodiments, to meet the different users' sensitivity to volume and their needs for audio sources, users can personalize the intelligent volume adjustment function. During this process, the vehicle can receive the user's selection command for the mixing mode and determine the mixing mode for all audio sources based on this command; it can also receive the user's input operation for the audio source and determine the audio source for which intelligent volume adjustment is performed based on this input operation. For specific personalized settings, please refer to [link / reference]. Figure 2 , Figure 2 For the personalized settings interface, when users enter the vehicle's infotainment system settings, they can select to turn the intelligent volume adjustment switch on or off, and then make more specific personalized settings. The intelligent volume adjustment function is activated by touching the intelligent volume adjustment switch. Once activated, the in-vehicle intelligent volume adjustment system will automatically adjust the audio source volume based on factors such as vehicle speed, noise, and the behavior of occupants. Furthermore, after the intelligent volume adjustment switch is turned on, a sub-menu personalized settings interface will pop up, including mixing settings and audio source selection settings. The mixing settings include two mixing modes: direct mixing (i.e., the first mixing mode in the above embodiment) and automatic mixing (i.e., the second mixing mode in the above embodiment). Direct mixing directly mixes the volumes of different audio sources at the current volume (i.e., the volume determined based on vehicle speed, noise, and the behavior of occupants) when multiple audio sources are played simultaneously, without any further volume adjustment. Automatic mixing automatically adjusts the volume according to the priority of the audio sources when multiple audio sources are played simultaneously, suppressing the volume of lower-priority audio sources. In the audio source selection settings, you can choose which audio sources participate in the intelligent volume adjustment process. For example, audio sources can include safety alert sounds, system alert sounds, voice assistant sounds, navigation alert sounds, and multimedia sounds. For instance, if you select safety alert sounds and system alert sounds to participate in the intelligent volume adjustment function, the system will adjust the volume of these audio sources according to the intelligent volume adjustment rules. If you do not select safety alert sounds and system alert sounds to participate in the intelligent volume adjustment function, the safety alert sounds and system alert sounds will follow the default logic of the vehicle's infotainment system, i.e., maintaining a fixed volume or following other preset rules. Through these personalized settings, drivers can customize the volume adjustment method according to their preferences and needs, making volume adjustment more intelligent and personalized, improving not only the flexibility of volume adjustment but also enhancing the user experience.

[0067] In this way, by supporting simultaneous playback of multiple audio sources and providing two different mixing modes, it can better cope with complex driving environments and more intelligently manage the volume of multiple audio sources at the same time. This solves the problem in existing technologies where different drivers have different sensitivities to volume and different needs for audio sources, which leads to the inability to meet personalized needs. It improves the flexibility of volume adjustment, enhances the user experience, and meets the personalized needs of users.

[0068] In some embodiments, after determining the mixing mode of the sounds played by all audio sources, the method further includes:

[0069] Given that the mixing mode of all audio sources is determined to be the second mixing mode, obtain the priority of each audio source among all audio sources.

[0070] Determine the priority interval between the highest priority audio source and all other audio sources except the highest priority audio source;

[0071] Based on the priority interval level corresponding to each audio source other than the highest priority, and the pre-set correspondence between the priority interval level and the volume suppression level, determine the volume suppression amount corresponding to each audio source other than the highest priority.

[0072] The volume to be played for each audio source other than the highest priority is determined as the difference between the target volume of the highest priority audio source and the volume suppression amount corresponding to each audio source other than the highest priority, and the volume of each audio source other than the highest priority is adjusted to the volume to be played.

[0073] Specifically, given that the mixing mode of all audio sources is determined to be the second mixing mode, the priority of each audio source is obtained, and the importance of each audio source is determined so that the volume can be adjusted when multiple audio sources are played at the same time. By assigning priority to each audio source, it is possible to identify which audio sources should have higher priority when playing, and ensure that important information (such as safety prompt audio sources) is not covered by other audio sources when multiple audio sources are played at the same time.

[0074] For example, the priority of each sound source can be shown in the table below.

[0075] Priority table of various sound sources

[0076]

[0077] Based on the priority of each audio source, a priority interval level is determined between the highest priority audio source and other audio sources. The priority difference between the highest priority audio source and other audio sources is calculated to determine the degree of volume suppression. This allows for more precise control of the volume differences between audio sources of different priorities, maintaining the clarity of the highest priority audio source while reasonably adjusting the volume of other audio sources to avoid mutual interference. Furthermore, based on the pre-set correspondence between priority interval levels and volume suppression levels, the corresponding volume suppression amount for each audio source other than the highest priority is determined, i.e., the volume level that needs to be suppressed for each audio source other than the highest priority. For example, the correspondence between priority interval levels and volume suppression levels can be shown in the table below.

[0078] Correspondence table between priority interval levels and volume suppression levels

[0079] Priority Interval Level 1 2 3 4 Volume suppression level 10 20 30 40

[0080] The difference between the target volume of the highest priority audio source and the volume suppression amount corresponding to each audio source other than the highest priority is determined as the playback volume other than the highest priority. The target volume is determined based on vehicle speed, noise, and the behavior of people in the vehicle. This ensures that the volume of each audio source is correctly adjusted after taking priority intervals into account, so that non-highest priority audio sources will not interfere with the highest priority audio source, while maintaining a certain auditory effect. This helps to meet the different drivers' sensitivity to volume and their needs for audio source usage.

[0081] Specifically, as an example, assume the mixing mode is the second mixing mode, and the audio sources include a voice assistant audio source, a navigation prompt audio source, and a multimedia audio source. The voice assistant audio source has a priority of 3, the navigation prompt audio source has a priority of 4, and the multimedia audio source has a priority of 5, with the priorities decreasing sequentially from voice assistant to navigation prompt to multimedia audio source. When the voice assistant is not activated, the navigation prompt audio source is broadcasting, and the multimedia audio source is playing. Since the navigation prompt audio source has a higher priority than the multimedia audio source, the volume of the multimedia audio source is suppressed based on the navigation prompt audio source. If the voice assistant is activated, the target volume of the voice assistant audio source is 45, the target volume of the navigation prompt audio source is 35, and the target volume of the multimedia audio source is 30. The priority interval between the voice assistant audio source and the multimedia audio source is 2, and the priority interval between the voice assistant audio source and the navigation prompt audio source is 1. According to the pre-set correspondence between the priority interval and the volume suppression level, the volume suppression amount corresponding to the multimedia audio source is 20, and the volume suppression amount corresponding to the navigation prompt audio source is 10. That is, the final playback volume of the voice assistant audio source is 45, the playback volume of the navigation prompt audio source is 25, and the playback volume of the multimedia audio source is 10.

[0082] In some embodiments, after acquiring image information of people inside the vehicle via an in-vehicle camera, and acquiring vehicle speed information and noise information inside the vehicle, the method further includes:

[0083] If the detected personnel image information is invalid, the target volume of the target sound source is determined based on the vehicle speed information and the noise information inside the vehicle.

[0084] If both the personnel image information and the noise information inside the vehicle are detected as invalid information, the target volume of the target sound source is determined based on the vehicle speed information and the first correspondence between the speed information and the volume of the sound source.

[0085] If both the personnel image information and speed information are detected as invalid, the target volume of the target sound source is determined based on the noise information inside the vehicle and the second correspondence between the noise information and the volume of the sound source.

[0086] Specifically, invalid personnel image information can be caused by blurry images, missing frames, or the inability to analyze personnel behavior from the images. In such cases, the target volume of the target sound source can be determined based on the vehicle's speed and noise information within the vehicle. The specific determination method can be found in the aforementioned embodiments and will not be repeated here. This allows for intelligent adjustment of the sound source volume within the vehicle even when the personnel image information is invalid.

[0087] Furthermore, invalid noise information inside the vehicle can be due to factors such as noise data exceeding a preset threshold range or discontinuous noise information. If both the personnel image information and the noise information inside the vehicle are invalid, the target volume of the target sound source can be determined based on the vehicle's speed information. This ensures that if one detection method malfunctions or becomes invalid, other detection methods can continue monitoring, guaranteeing that the automatic volume adjustment function remains effective.

[0088] Additionally, invalid speed information could indicate that the vehicle speed exceeds the preset speed range or that the vehicle speed detection is incorrect. If both the personnel image information and speed information are invalid, the target volume of the target sound source can be determined based on the noise information inside the vehicle, thus ensuring that the automatic volume adjustment function remains effective.

[0089] In addition, it should be noted that a malfunction in the speed sensor or a problem with signal transmission will result in invalid speed information; a malfunction in the in-vehicle camera or a problem with signal transmission will result in invalid image information; and a malfunction in the noise sensor or a problem with signal transmission will result in invalid noise information.

[0090] Specifically, in another embodiment, such as Figure 3As shown, after initialization, the system can also detect whether intelligent volume adjustment is enabled. If not, it plays audio at a fixed volume. If enabled, it monitors vehicle speed via a speed sensor, noise via an in-vehicle microphone / noise sensor, and occupant behavior via an in-vehicle camera. Then, it checks if the current vehicle speed reaches the volume adjustment threshold. If not, it maintains the current volume; if so, it adjusts the audio volume based on the first correspondence between vehicle speed and volume. Simultaneously, it checks if the current in-vehicle noise reaches the volume adjustment threshold. If not, it maintains the current volume; if so, it adjusts the audio volume based on the second correspondence between in-vehicle noise and volume. Finally, it checks if the occupant behavior is a preset behavior. If not, it maintains the current volume; if it is a preset behavior, it adjusts the audio volume based on the correspondence between preset behavior and volume.

[0091] In this way, by combining data from the camera, vehicle speed sensor, and noise sensor, the volume can be continuously adjusted using other data even if any one of the data is invalid, ensuring that the automatic volume adjustment function remains effective, thereby improving safety and comfort during driving.

[0092] In some embodiments, after acquiring image information of people inside the vehicle via an in-vehicle camera, and acquiring vehicle speed information and noise information inside the vehicle, the method further includes:

[0093] The system detects whether a volume adjustment command input by the user is received in a historical driving scenario. The behavior of the people in the vehicle in the historical driving scenario is the same as that of the people in the current driving scenario. The difference between the speed information in the historical driving scenario and the speed information in the current driving scenario is within a preset speed difference range. The difference between the noise information in the vehicle in the historical driving scenario and the noise information in the vehicle in the current driving scenario is within a preset noise difference range.

[0094] If a volume adjustment command is received, the volume corresponding to the volume adjustment command is determined as the target volume of the target audio source, and the volume of the target audio source is adjusted to the target volume.

[0095] Specifically, by comparing the occupant behavior, speed information, and noise information in the vehicle between the current driving scenario and historical driving scenarios, it is determined whether the historical driving scenario and the current driving scenario are sufficiently similar. If the occupant behavior in the vehicle in the current driving scenario is the same as that in the historical driving scenario, and the difference between the speed information in the historical driving scenario and the speed information in the current driving scenario is within a preset speed difference range, and the difference between the noise information in the vehicle in the historical driving scenario and the noise information in the vehicle in the current driving scenario is within a preset noise difference range, then the similarity between the historical driving scenario and the current driving scenario is determined to be higher than a preset similarity.

[0096] If the current driving scenario is sufficiently similar to the historical driving scenario, and a volume adjustment command is received in the historical driving scenario, the volume adjustment command corresponding to the volume adjustment volume is determined as the target volume of the target sound source, and the volume of the target sound source is adjusted to the target volume.

[0097] This allows the system to predict and adjust the volume that a user might expect in the current driving scenario by referencing the user's volume adjustment behavior in similar historical driving scenarios, thus providing a more personalized volume adjustment experience.

[0098] All of the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application, and will not be described in detail here.

[0099] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.

[0100] Figure 4 This is a schematic diagram of a vehicle volume control device provided in an embodiment of this application. Figure 4 As shown, the vehicle's volume control device includes:

[0101] The acquisition module 401 is configured to acquire image information of people inside the vehicle through an in-vehicle camera, and to acquire vehicle speed information and noise information inside the vehicle.

[0102] The determination module 402 is configured to determine the target volume of the target sound source if the behavior of the people inside the vehicle detected by the personnel image information belongs to the preset behavior, based on the preset correspondence between the preset behavior and the volume of the sound source; and to determine the target volume of the target sound source based on the vehicle speed information and the noise information inside the vehicle if the behavior of the people inside the vehicle detected by the personnel image information does not belong to the preset behavior.

[0103] The adjustment module 403 is configured to control the volume adjustment of the target sound source to the target volume.

[0104] In some embodiments, the determining module 402 is configured to determine a first candidate volume of the target sound source based on vehicle speed information and a first correspondence between speed information and sound source volume; determine a second candidate volume of the target sound source based on vehicle noise information and a second correspondence between noise information and sound source volume; and determine the target volume of the target sound source based on the first candidate volume and the second candidate volume.

[0105] In some embodiments, the determining module 402 is configured to compare the magnitudes of a first candidate volume and a second candidate volume, and determine the larger of the first candidate volume and the second candidate volume as the target volume of the target sound source; or, determine the average value of the first candidate volume and the second candidate volume, and determine the average value as the target volume of the target sound source.

[0106] In some embodiments, the adjustment module 403 is configured to detect whether there are other audio sources playing sound simultaneously in the vehicle besides the target audio source; if no other audio sources are detected playing sound simultaneously in the vehicle, the step of adjusting the volume of the target audio source to the target volume is entered; if other audio sources besides the target audio source are detected playing sound simultaneously in the vehicle, the mixing mode of all audio sources is determined, wherein the mixing mode includes a first mixing mode and a second mixing mode, the first mixing mode refers to mixing playback without adjusting the target volume of each audio source, and the second mixing mode refers to mixing playback after suppressing the target volume of other audio sources except the highest priority among all audio sources based on the priority of each audio source; if the mixing mode of all audio sources is determined to be the first mixing mode, the step of adjusting the volume of the target audio source to the target volume is entered.

[0107] In some embodiments, the adjustment module 403 is configured to, when determining that the mixing mode of the sound played by all audio sources is a second mixing mode, acquire the priority of each audio source among all audio sources; determine the priority interval level between the highest priority audio source and each audio source other than the highest priority; determine the volume suppression amount corresponding to each audio source other than the highest priority based on the priority interval level corresponding to each audio source other than the highest priority and a pre-set correspondence between the priority interval level and the volume suppression amount; determine the volume to be played for each audio source other than the highest priority as the difference between the target volume of the highest priority audio source and the volume suppression amount corresponding to each audio source other than the highest priority, and control the volume of each audio source other than the highest priority to be adjusted to the volume to be played.

[0108] In some embodiments, after acquiring image information of people inside the vehicle via an in-vehicle camera, and acquiring vehicle speed information and noise information inside the vehicle, the vehicle's volume adjustment device is configured to: if the image information is detected as invalid, determine the target volume of the target sound source based on the vehicle speed information and the noise information inside the vehicle; if both the image information and the noise information inside the vehicle are detected as invalid, determine the target volume of the target sound source based on the vehicle speed information and a first correspondence between the speed information and the volume of the sound source; if both the image information and the speed information are detected as invalid, determine the target volume of the target sound source based on the noise information inside the vehicle and a second correspondence between the noise information and the volume of the sound source.

[0109] In some embodiments, the determining module 402 is configured to detect whether a volume adjustment command input by a user is received in a historical driving scenario, wherein the behavior of the person in the vehicle in the historical driving scenario is the same as the behavior of the person in the current driving scenario, and the difference between the speed information in the historical driving scenario and the speed information in the current driving scenario is within a preset speed difference range, and the difference between the noise information in the vehicle in the historical driving scenario and the noise information in the vehicle in the current driving scenario is within a preset noise difference range; if a volume adjustment command is detected, the volume adjustment corresponding to the volume adjustment command is determined as the target volume of the target sound source, and the volume of the target sound source is controlled to be adjusted to the target volume.

[0110] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0111] Figure 5 This is a schematic diagram of the electronic device 5 provided in an embodiment of this application. Figure 5 As shown, the electronic device 5 of this embodiment includes: a processor 501, a memory 502, and a computer program 503 stored in the memory 502 and executable on the processor 501. When the processor 501 executes the computer program 503, it implements the steps in the various method embodiments described above. Alternatively, when the processor 501 executes the computer program 503, it implements the functions of each module / unit in the various device embodiments described above.

[0112] Electronic device 5 can be a desktop computer, laptop, handheld computer, cloud server, or other electronic device. Electronic device 5 may include, but is not limited to, processor 501 and memory 502. Those skilled in the art will understand that... Figure 5 This is merely an example of electronic device 5 and does not constitute a limitation on electronic device 5. It may include more or fewer components than shown, or different components.

[0113] The processor 501 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0114] The memory 502 can be an internal storage unit of the electronic device 5, such as a hard disk or RAM of the electronic device 5. The memory 502 can also be an external storage device of the electronic device 5, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card, etc., equipped on the electronic device 5. The memory 502 can also include both internal and external storage units of the electronic device 5. The memory 502 is used to store computer programs and other programs and data required by the electronic device.

[0115] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0116] If integrated modules / units are implemented as software functional units and sold or used as independent products, they can be stored in a readable storage medium (e.g., a computer-readable storage medium). Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program may include computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. A computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0117] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for adjusting the volume of a vehicle, characterized in that: include: Obtaining image information of people in the vehicle through the camera inside the vehicle, and obtaining speed information of the vehicle and noise information inside the vehicle; If it is detected according to the person image information that the behavior of the person in the vehicle belongs to a preset behavior, a target volume of a target sound source is determined according to a preset correspondence between the preset behavior and the volume of the sound source; If it is detected according to the person image information that the behavior of the person in the vehicle does not belong to the preset behavior, determine the target volume of the target sound source according to the speed information of the vehicle and the noise information in the vehicle; The volume of the target sound source is controlled to be adjusted to the target volume.

2. The method according to claim 1, characterized in that The step of determining the target volume of the target sound source according to the speed information of the vehicle and the noise information in the vehicle includes: Determining a first candidate volume of the target sound source according to the speed information of the vehicle and a first corresponding relationship between the speed information and the volume of the sound source; determining a second candidate volume of the target sound source according to the noise information in the vehicle and a second corresponding relationship between the noise information and the volume of the sound source; A target volume of the target sound source is determined according to the first candidate volume and the second candidate volume.

3. The method according to claim 2, characterized in that The determining the target volume of the target sound source according to the first candidate volume and the second candidate volume includes: comparing the first candidate volume and the second candidate volume, and determining the one with a larger volume between the first candidate volume and the second candidate volume as the target volume of the target sound source; or An average value of the first candidate volume and the second candidate volume is determined, and the average value is determined as a target volume of the target sound source.

4. The method according to claim 1, characterized in that: After determining the target volume of the target sound source, the method further includes: Detecting whether there are other sound sources other than the target sound source playing sound simultaneously in the vehicle; If it is detected that there is no other sound source playing sound simultaneously in the vehicle, entering the step of controlling the volume of the target sound source to be adjusted to the target volume; If it is detected that there are other sound sources other than the target sound source in the vehicle playing sounds at the same time, determining a mixing mode of the sounds played by all the sound sources, wherein the mixing mode includes a first mixing mode and a second mixing mode, the first mixing mode refers to mixing and playing without adjusting the target volume of each sound source, and the second mixing mode refers to mixing and playing after suppressing the target volume of other sound sources except the highest priority among all the sound sources based on the priority corresponding to each sound source; When it is determined that the mixing mode of the sounds played by all the sound sources is the first mixing mode, the step of controlling the volume of the target sound source to be adjusted to the target volume is entered.

5. The method according to claim 4, characterized in that After determining the mixing mode of the sounds played by all audio sources, it also includes: When it is determined that the mixing mode of the sounds played by all the sound sources is the second mixing mode, obtaining the priority of each sound source in all the sound sources; Determine a priority interval level between the highest priority sound source and each sound source other than the highest priority sound source; Determine the volume suppression amount corresponding to each sound source except the highest priority according to the priority interval level corresponding to each sound source except the highest priority and the correspondence between the preset priority interval level and the volume suppression amount; The volume to be played of each sound source except the highest priority is determined to be the difference between the target volume of the sound source with the highest priority and the volume suppression amount corresponding to each sound source except the highest priority, and the volume of each sound source except the highest priority is controlled to be adjusted to the volume to be played.

6. The method according to claim 1, characterized in that After obtaining the image information of the person in the vehicle through the camera in the vehicle, and obtaining the speed information of the vehicle and the noise information in the vehicle, the method further includes: If it is detected that the person image information is invalid information, determining a target volume of the target sound source according to the speed information of the vehicle and the noise information in the vehicle; If it is detected that both the person image information and the noise information in the vehicle are invalid information, determining the target volume of the target sound source according to the speed information of the vehicle and the first corresponding relationship between the speed information and the volume of the sound source; If it is detected that both the person image information and the speed information are invalid information, the target volume of the target sound source is determined according to the noise information in the vehicle and the second corresponding relationship between the noise information and the volume of the sound source.

7. The method according to claim 1, characterized in that After obtaining the image information of the person in the vehicle through the camera in the vehicle, and obtaining the speed information of the vehicle and the noise information in the vehicle, the method further includes: Detecting whether a volume adjustment instruction input by a user is received in a historical driving scene, wherein the behavior of a person in the vehicle in the historical driving scene is the same as the behavior of a person in the current driving scene, and the difference between the speed information in the historical driving scene and the speed information in the current driving scene is within a preset speed difference range, and the difference between the noise information in the vehicle in the historical driving scene and the noise information in the vehicle in the current driving scene is within a preset noise difference range; If the volume adjustment instruction is detected and received, the adjustment volume corresponding to the volume adjustment instruction is determined as the target volume of the target sound source, and the volume of the target sound source is controlled to be adjusted to the target volume.

8. A volume control device for a vehicle, characterized in that: include: An acquisition module is configured to acquire image information of a person in the vehicle through a camera in the vehicle, and acquire speed information of the vehicle and noise information in the vehicle; A determination module is configured to determine a target volume of a target sound source according to a preset correspondence between the preset behavior and the volume of the sound source if the behavior of the person in the vehicle is detected as a preset behavior according to the person image information; If it is detected according to the person image information that the behavior of the person in the vehicle does not belong to the preset behavior, determine the target volume of the target sound source according to the speed information of the vehicle and the noise information in the vehicle; The adjustment module is configured to control the volume of the target sound source to be adjusted to the target volume.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Batch processing method and device for intelligent terminal data

    CN119893473A