Sound adjusting method and device, electronic equipment and computer readable medium

Abstract

The invention discloses a sound adjusting method and device, electronic equipment and a computer readable medium, and belongs to the technical field of audio processing, and the method comprises the steps: obtaining a target seat corresponding to each person in a vehicle; acquiring at least one of image information of personnel on each target seat, voice information in each target seat area and audio categories corresponding to audio data played by a sound production device corresponding to each target seat; based on the reference information corresponding to each target seat, determining a no-disturbing level of each target seat, and based on the no-disturbing level of each target seat, obtaining a preset signal-to-noise ratio corresponding to each target seat; and determining a to-be-adjusted sound production device corresponding to each target seat, and adjusting the to-be-adjusted sound production device corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat. Based on the no-disturbing level of each target seat, the corresponding to-be-adjusted sound production device is adjusted, fine automatic adjustment can be achieved, and the requirements of each person in the vehicle are met.

Description

Technical Field

[0001] The present application relates to the field of audio processing technology, and more specifically, to a sound adjustment method, device, electronic device and computer-readable medium. Background Art

[0002] With the continuous iteration of automobiles, cars are equipped with a variety of leisure and entertainment functions, among which navigation, calls, audio and video and other functions are inseparable from the speaker system. However, the existing speaker system is difficult to meet the needs of users and still needs to be improved. Summary of the invention

[0003] The present application proposes a sound adjustment method, device, electronic device and computer-readable medium to improve the above-mentioned defects.

[0004] In a first aspect, the present application provides a sound adjustment method, comprising: obtaining a target seat corresponding to each person in a vehicle; collecting image information of the person in each target seat in the vehicle, at least one of voice information in the area of ​​each target seat, and an audio category corresponding to audio data played by a sound device corresponding to each target seat; determining a do not disturb level for each target seat based on reference information corresponding to each target seat, the reference information including the image information, the voice information, and at least one of the audio categories; obtaining a preset signal-to-noise ratio corresponding to each target seat based on the do not disturb level of each target seat; determining a sound device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the vehicle; adjusting the sound device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat.

[0005] Optionally, for a possible implementation, the target seat includes a passenger seat, and the do not disturb level of the passenger seat includes a plurality of levels arranged from high to low priority, wherein the preset signal-to-noise ratios corresponding to the plurality of levels arranged from high to low priority increase sequentially.

[0006] Optionally, for a possible implementation, the do not disturb level of each target seat is determined based on the reference information corresponding to each target seat, including: based on the image information corresponding to each passenger seat, obtaining the eye closing duration and mouth opening and closing frequency of the person in each passenger seat; for the person whose eye closing duration is greater than a first threshold and whose mouth opening and closing frequency is less than a second threshold, the do not disturb level of the corresponding passenger seat is set to the first level.

[0007] Optionally, for a possible implementation, determining the sound device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat includes: if it is detected that the do not disturb level of at least one passenger seat is the first level, determining the built-in sound device corresponding to each passenger seat and the external sound device of each non-driving seat as the sound device to be adjusted; adjusting the sound device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat includes: taking the passenger seat with the do not disturb level of the first level as the first seat, and taking the passenger seat with the do not disturb level not the first level as the second seat; turning off the external sound device corresponding to each non-driving seat in the car, turning off the built-in sound device corresponding to each first seat, and turning on the built-in sound device corresponding to each second seat; adjusting the volume of the built-in sound device corresponding to each second seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the second seat.

[0008] Optionally, for a possible implementation, determining the do not disturb level of each target seat based on the reference information corresponding to each target seat includes: obtaining ear information of the person in each passenger seat based on the image information corresponding to each passenger seat; and setting the do not disturb level of the passenger seat corresponding to the person whose ear area is covered by the mobile phone to the second level according to the ear information.

[0009] Optionally, for a possible implementation, determining the sound device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat includes: if it is detected that the do not disturb level of the passenger seat is the second level, taking the passenger seat with the second do not disturb level as the third seat, and determining the built-in sound device corresponding to the third seat and the external sound device of each seat other than the driving seat as the sound device to be adjusted; adjusting the sound device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat includes: turning off the external sound device corresponding to each seat other than the driving seat in the vehicle; adjusting the volume of the built-in sound device corresponding to each third seat according to the noise in the vehicle and the preset signal-to-noise ratio corresponding to the third seat.

[0010] Optionally, for a possible implementation, determining the do not disturb level of each target seat based on the reference information corresponding to each target seat includes: judging whether the audio category corresponding to each passenger seat is call audio; and setting the do not disturb level of the passenger seat whose audio category is call audio to the third level.

[0011] Optionally, for a possible implementation, determining the sound device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat includes: if it is detected that the do not disturb level of the passenger seat is the third level, taking the passenger seat with the do not disturb level of the third level as the fourth seat, and determining the built-in sound device corresponding to the fourth seat and the external sound device of each seat other than the driving seat as the sound device to be adjusted; adjusting the sound device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat includes: turning off the external sound device corresponding to each seat other than the driving seat in the car; adjusting the volume of the built-in sound device corresponding to each fourth seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat.

[0012] Optionally, for a possible implementation, after adjusting the volume of the built-in sound device corresponding to each fourth seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat, the volume also includes: obtaining keyword information of the person in each fourth seat based on the voice information corresponding to each fourth seat; taking the fourth seat that cannot be heard clearly according to the keyword information as the fifth seat, and increasing the volume of the built-in sound device corresponding to each fifth seat within the first preset range.

[0013] Optionally, for a possible implementation, after adjusting the volume of the built-in sound device corresponding to each fourth seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat, the method further includes: obtaining keyword information of the person in each fourth seat based on the voice information corresponding to each fourth seat; taking the noisy fourth seat represented by the keyword information as the sixth seat, and reducing the volume of the built-in sound device corresponding to each sixth seat within a second preset range.

[0014] Optionally, for a possible implementation, the target seat includes a driver's seat, and the do not disturb level of each target seat is determined based on the reference information corresponding to each target seat, including: if the audio category corresponding to the driver's seat is navigation audio, then determining that the do not disturb level of the driver's seat is a navigation level.

[0015] Optionally, for a possible implementation, determining the sound device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat includes: if it is detected that the do not disturb level of the driver's seat is the navigation level, determining the built-in sound device seat of the driver's seat as the sound device to be adjusted; adjusting the sound device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat includes: turning on the built-in sound device of the driver's seat, and adjusting the volume of the built-in sound device corresponding to the driver's seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat.

[0016] In a second aspect, the present application also provides a sound-emitting device adjustment device, the device comprising: an acquisition unit, used to acquire a target seat corresponding to each person in the vehicle; a collection unit, used to collect image information of the person in each target seat in the vehicle, voice information in the area of ​​each target seat, and an audio category corresponding to the audio data played by the sound-emitting device corresponding to each target seat; a level determination unit, used to determine the do not disturb level of each target seat based on reference information corresponding to each target seat, the reference information including at least one of the image information, the voice information and the audio category; a signal-to-noise ratio determination unit, used to acquire a preset signal-to-noise ratio corresponding to each target seat based on the do not disturb level of each target seat; an object determination unit, used to determine the sound-emitting device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat, wherein the sound-emitting device to be adjusted includes at least one of the sound-emitting devices installed in each seat in the vehicle; an adjustment unit, used to adjust the sound-emitting device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat.

[0017] In a third aspect, the present application also provides an electronic device, comprising: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory, the one or more applications are configured to be executed by the one or more processors, and the one or more applications are configured to execute the above method.

[0018] In a fourth aspect, the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the above method.

[0019] The solution provided by the present application first obtains the target seat corresponding to each person in the car; collects the image information of the person in each target seat in the car, the voice information in the area of ​​each target seat, and the audio category corresponding to the audio data played by the sound device corresponding to each target seat; then, based on the reference information corresponding to each target seat, determines the do not disturb level of each target seat, the reference information includes at least one of the image information, the voice information and the audio category; based on the do not disturb level of each target seat, obtains the preset signal-to-noise ratio corresponding to each target seat; based on the do not disturb level of each target seat, determines the sound device to be adjusted corresponding to each target seat, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the car; based on the preset signal-to-noise ratio corresponding to each target seat, adjusts the sound device to be adjusted corresponding to each target seat.

[0020] Compared with the existing manual adjustment of the switch and volume of the sound-emitting device in the car, the present application obtains the target seat of each person in the car, determines the do not disturb level corresponding to each target seat based on the reference information corresponding to each target seat, and then determines the preset signal-to-noise ratio and the sound-emitting device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat. Finally, based on the do not disturb level of each target seat, adjust the sound-emitting device to be adjusted corresponding to each target seat. On the one hand, the present application realizes the automatic adjustment of the sound-emitting device. On the other hand, the present application adjusts the corresponding sound-emitting device to be adjusted based on the do not disturb level of each target seat, and achieves refined adjustment, which can take into account the needs of everyone in the car at the same time. Moreover, the sound-emitting device to be adjusted based on the preset signal-to-noise ratio takes into account the compatibility of the preset signal-to-noise ratio and the user, which can give the user a better auditory experience.

[0021] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 A method flow chart of a sound adjustment method provided by an embodiment of the present application is shown;

[0024] Figure 2 A method flow chart of a sound adjustment method provided by another embodiment of the present application is shown;

[0025] Figure 3 A method flow chart of a sound adjustment method provided by another embodiment of the present application is shown;

[0026] Figure 4 A method flow chart of a sound adjustment method provided by another embodiment of the present application is shown;

[0027] Figure 5 A method flow chart of a sound adjustment method provided by another embodiment of the present application is shown;

[0028] Figure 6 A method flow chart of a sound adjustment method provided by another embodiment of the present application is shown;

[0029] Figure 7 A method flow chart of a sound adjustment method provided by another embodiment of the present application is shown;

[0030] Figure 8 A schematic diagram showing the priority of the do not disturb level of the driver's seat provided in an embodiment of the present application is shown;

[0031] Fig. 9 A schematic diagram showing the priority of the Do Not Disturb level of passenger seats provided by an embodiment of the present application is shown;

[0032] Fig.10 A structural block diagram of a sound adjustment method and device provided in an embodiment of the present application is shown;

[0033] Fig.11 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0034] Fig.12 A structural block diagram of a computer-readable storage medium provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0035] In order to make those skilled in the art better understand the present application scheme, the technical scheme in the present application embodiment will be clearly and completely described below in conjunction with the drawings in the present application embodiment. Obviously, the described embodiment is only a part of the present application embodiment, rather than all the embodiments. The components of the present application embodiment usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiment of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0036] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0037] With the continuous iteration of automobiles, cars are equipped with a variety of leisure and entertainment functions, among which navigation, calls, audio and video and other functions are inseparable from the speaker system. However, the existing speaker system is difficult to meet the needs of users and still needs to be improved.

[0038] Therefore, in the embodiments of the present application, a sound adjustment method, device, electronic device and computer-readable medium are provided to solve or partially solve the above-mentioned problems.

[0039] See also Figure 1 , which shows a method flow chart of a sound adjustment method provided in an embodiment of the present application, the method specifically includes steps S110 to S160.

[0040] Step S110: Obtain the target seat corresponding to each person in the car.

[0041] It is understood that the vehicle includes at least one of a driver or a passenger, and each seat in the vehicle is equipped with a corresponding sound-generating device, and the sound-generating device of each seat includes at least one of a built-in sound-generating device and an external sound-generating device. In order to adjust the sound-generating device in a targeted manner, the seat that needs to adjust the sound-generating device must be determined first.

[0042] It should be noted that the sound-generating device is a device that can generate sound, and the sound-generating device can be a device that generates sound such as a speaker, a horn, a stereo or a microphone.

[0043] Therefore, it is necessary to obtain the target seat corresponding to each person, that is, to determine the seat occupied by each person in the car and use it as the target seat.

[0044] Specifically, the pressure sensor in each seat can be used for detection, and the seat with pressure data greater than the trigger threshold can be used as the target seat; the image coordinates of the face image of each person in the car in the two-dimensional image can also be obtained through image information, and then the target seat can be determined based on the image coordinates of the face image in the two-dimensional image.

[0045] Step S120: collecting image information of persons in each of the target seats in the vehicle, voice information in each of the target seat areas, and at least one of the audio categories corresponding to the audio data played by the sound-generating device corresponding to each of the target seats.

[0046] It should be noted that the image information of the person in each target seat in the car can be collected by a camera. Specifically, an overall picture can be collected, and then the image information of the person in each target seat can be obtained based on the overall picture. The image information of the person in each target seat can also be collected separately.

[0047] It should be noted that the voice information in each target seat area can be collected by a microphone. Specifically, a microphone is installed on each seat, and the microphone based on the target seat collects the voice information in each target seat area. Alternatively, the microphone installed in an array can collect the voice information in the car, and the voice information in each target seat area can be obtained by processing the collected voice information.

[0048] It should be noted that the audio category corresponding to the audio data played by the sound device corresponding to each target seat can be obtained through the vehicle system, wherein the audio category includes navigation audio, call audio and audio and video audio. Navigation audio represents navigation, call audio represents calls through the vehicle system, and audio and video audio represents entertainment through the vehicle system.

[0049] Step S130: Determine the do not disturb level of each target seat based on the reference information corresponding to each target seat, wherein the reference information includes at least one of the image information, the voice information and the audio category.

[0050] The DND level of the target seat is used to represent the status of the person corresponding to the target seat.

[0051] It is understandable that with the continuous upgrading of cars, people in the car can navigate, rest, talk and entertain, etc. When passengers or drivers are in different states, they have different requirements for the audio played by the sound device in the car. Therefore, it is necessary to obtain the do not disturb level of each target seat.

[0052] Specifically, the do not disturb level of each target seat may be determined based on the reference information corresponding to each target seat.

[0053] In an exemplary embodiment, the target seats include passenger seats. Based on the image information corresponding to each of the passenger seats, the eye closing duration and mouth opening and closing frequency of the person in each passenger seat are obtained; for the person whose eye closing duration is greater than a first threshold and whose mouth opening and closing frequency is less than a second threshold, the do not disturb level of the corresponding passenger seat is set to the first level. For details, please refer to the subsequent embodiments.

[0054] Step S140: Based on the DND level of each target seat, a preset signal-to-noise ratio corresponding to each target seat is obtained.

[0055] It should be noted that the preset signal-to-noise ratio corresponding to each target seat can be obtained based on a preset database, and the preset database includes preset signal-to-noise ratios corresponding to different do-not-disturb levels of each seat in the car. Specifically, based on the do-not-disturb level of each target seat, the preset signal-to-noise ratio corresponding to the do-not-disturb level of the target seat is found from the preset database.

[0056] Furthermore, each seat corresponds to a built-in sound device and an external sound device, and the preset signal-to-noise ratio corresponding to the built-in sound device of the same target seat and the same do-not-disturb level in the preset database may be different from the preset signal-to-noise ratio of the corresponding external sound device.

[0057] Step S150: based on the do not disturb level of each of the target seats, determining the sound emitting device to be adjusted corresponding to each of the target seats, wherein the sound emitting device to be adjusted includes at least one of the sound emitting devices installed at each seat in the vehicle.

[0058] Each seat in the car is equipped with a built-in sound device and an external sound device. The audio played by the external sound device can cover the entire car, while the built-in sound device is set in the headrest of the seat, and the audio it plays approximately only covers the area where the seat is located.

[0059] The target seats have different do-not-disturbance levels and different requirements for sound devices. For example, when a passenger is resting, the audio played by the external sound device will affect the passenger's rest. When a passenger is playing games, the audio played by the external sound device may not affect the passenger.

[0060] It is understandable that the target seats have different do not disturb levels, and the sounding devices that need to be adjusted are also different. Therefore, it is necessary to determine the sounding device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat.

[0061] Step S160: Based on the preset signal-to-noise ratio corresponding to each of the target seats, adjust the sound device to be adjusted corresponding to each of the target seats.

[0062] After the DND level, the preset signal-to-noise ratio, and the sounding device to be adjusted corresponding to each target seat are determined, the sounding device to be adjusted corresponding to each target seat can be adjusted.

[0063] Specifically, adjusting the to-be-adjusted sound emitting device corresponding to each target seat may include adjusting switches of some or all of the to-be-adjusted sound emitting devices, and may also include adjusting volumes of some or all of the to-be-adjusted sound emitting devices.

[0064] Compared with the existing manual adjustment of the switch and volume of the sound-emitting device in the car, the present application obtains the target seat of each person in the car, determines the do not disturb level corresponding to each target seat based on the reference information corresponding to each target seat, and then determines the preset signal-to-noise ratio and the sound-emitting device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat. Finally, based on the do not disturb level of each target seat, adjust the sound-emitting device to be adjusted corresponding to each target seat. On the one hand, the present application realizes the automatic adjustment of the sound-emitting device. On the other hand, the present application adjusts the corresponding sound-emitting device to be adjusted based on the do not disturb level of each target seat, and achieves refined adjustment, which can take into account the needs of everyone in the car at the same time. Moreover, the sound-emitting device to be adjusted based on the preset signal-to-noise ratio takes into account the compatibility of the preset signal-to-noise ratio and the user, which can give the user a better auditory experience.

[0065] It is understandable that when the vehicle is driving, at least the driver is included in the vehicle. When the vehicle is parked, the vehicle may only contain the driver or the passenger, or may contain the driver and the passenger.

[0066] Further, if the target seat includes a passenger seat, the do not disturb level of the passenger seat includes a plurality of levels arranged from high to low priority, wherein the preset signal-to-noise ratios corresponding to the plurality of levels arranged from high to low priority increase sequentially.

[0067] It should be noted that the person corresponding to the passenger seat is the passenger.

[0068] Exemplarily, the do not disturb level of the passenger seat includes a first level, a second level and a third level arranged in descending order of priority, and the preset signal-to-noise ratios corresponding to the first level, the second level and the third level increase in sequence.

[0069] See also Figure 2 , which shows a method flow chart of a sound adjustment method provided in an embodiment of the present application, the method specifically includes steps S210 to S290.

[0070] Step S210: Obtain the target seat corresponding to each person in the car.

[0071] Step S220: Collect image information of persons in each of the target seats in the vehicle, voice information in each of the target seat areas, and at least one of the audio categories corresponding to the audio data played by the sound-emitting device corresponding to each of the target seats.

[0072] Among them, step S210 and step S220 have been introduced in detail in the above embodiments and will not be repeated here.

[0073] Step S230: Based on the image information corresponding to each of the passenger seats, the eye closing duration and mouth opening and closing frequency of the person in each passenger seat are obtained.

[0074] It should be noted that if there are passengers in the car, the target seats include the passenger seats, and the eye closing duration and mouth opening and closing frequency of the passengers in each passenger seat can be obtained based on the image information corresponding to each of the passenger seats.

[0075] Specifically, the eye state of the passenger in each passenger seat, that is, the open or closed state, can be detected based on the acquired image information, and the eye closing time of the passenger in each passenger seat can be acquired based on multiple consecutive frames of images.

[0076] Similarly, the mouth state of the passenger in each passenger seat, that is, the open and closed state of the mouth, can be detected based on the acquired image information. The mouth changes from an open state to a closed state, which is recorded as a mouth opening and closing once, and the mouth changes from a closed state to an open state, which is also recorded as a mouth opening and closing once. To this end, the mouth state of the passenger in each passenger seat can be acquired based on multiple consecutive frames of images to determine the mouth opening and closing frequency.

[0077] Step S240: For passengers whose eye closing time is greater than the first threshold and whose mouth opening and closing frequency is less than the second threshold, the do not disturb level of the corresponding passenger seat is set to the first level.

[0078] It should be noted that the eye closing time can indicate the passenger's fatigue state, and the mouth opening and closing frequency can indicate whether the passenger is talking. When the passenger's eye closing time is greater than the first threshold and the mouth opening and closing frequency is less than the second threshold, it indicates that the passenger is in a sleeping state or entering a sleeping state. For passengers whose eye closing time is greater than the first threshold and whose mouth opening and closing frequency is less than the second threshold, the DND level of the corresponding passenger seat is set to the first level.

[0079] The first threshold and the second threshold are pre-acquired based on actual experience data.

[0080] Step S250: Based on the DND level of each target seat, a preset signal-to-noise ratio corresponding to each target seat is obtained.

[0081] Among them, step S250 has been introduced in detail in the above embodiment and will not be repeated here.

[0082] Step S260: If it is detected that the do not disturb level of at least one of the passenger seats is the first level, the built-in sound device corresponding to each passenger seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted.

[0083] If it is detected that the DND level of at least one passenger seat is the first level, it means that at least one passenger is in a sleeping state or has entered a sleeping state, and the external sound device needs to be turned off to try not to disturb the passenger's rest. To this end, the built-in sound device corresponding to each passenger seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted.

[0084] It should be noted that the built-in sound devices of unoccupied seats are turned off by default.

[0085] Step S270: The passenger seat whose DND level is the first level is used as the first seat, and the passenger seat whose DND level is not the first level is used as the second seat.

[0086] The first level is used to characterize that the passenger is in a sleeping state or is about to fall asleep. When it is detected that a passenger is in a sleeping state, it is necessary to make special adjustments to the built-in sound device of the passenger seat. For this purpose, it is necessary to distinguish the passenger seat in a sleeping state from other passenger seats. The passenger seat with a Do Not Disturbance level of the first level can be regarded as the first seat, and the passenger seat with a Do Not Disturbance level not of the first level can be regarded as the second seat.

[0087] Step S280: turn off the external sound device corresponding to each non-driving seat in the vehicle, turn off the built-in sound device corresponding to each of the first seats, and turn on the built-in sound device corresponding to each of the second seats.

[0088] Among them, turning off the external sound device corresponding to each non-driving seat in the car can provide a relatively quiet environment for passengers in a sleeping state, and turning off the built-in sound device corresponding to each first seat can further provide a quiet environment for passengers in a sleeping state. If other passengers are not sleeping and can use the sound device normally, the built-in sound device corresponding to each second seat will be turned on to ensure that the hearing needs of other passengers are not affected.

[0089] Step S290: adjusting the volume of the built-in sound device corresponding to each of the second seats according to the noise in the vehicle and the preset signal-to-noise ratio corresponding to the second seat.

[0090] The noise in the car can be determined by processing the voice information collected by the microphone, and then the volume of the built-in sound device corresponding to each second seat can be adjusted based on the noise in the car and the preset signal-to-noise ratio corresponding to the second seat. The signal-to-noise ratio can be changed by changing the volume of the sound device.

[0091] See also Figure 3 , which shows a method flow chart of a sound adjustment method provided in an embodiment of the present application, the method specifically includes steps S310 to S380.

[0092] Step S310: Obtain the target seat corresponding to each person in the car.

[0093] Step S320: Collect image information of persons in each of the target seats in the vehicle, voice information in each of the target seat areas, and at least one of the audio categories corresponding to the audio data played by the sound-emitting device corresponding to each of the target seats.

[0094] Among them, step S310 and step S320 have been introduced in detail in the above embodiments and will not be repeated here.

[0095] Step S330: Based on the image information corresponding to each of the passenger seats, the ear information of the person in each passenger seat is obtained.

[0096] It should be noted that if there are passengers in the car, the target seats include the passenger seats, and the ear information of the passengers in each passenger seat can be obtained based on the image information corresponding to each of the passenger seats.

[0097] Specifically, a picture of the passenger's ear area can be obtained based on the image information corresponding to each of the passenger seats, and then image recognition is performed on the picture of the ear area. If a mobile phone is recognized in the picture of the ear area, it indicates that the passenger is making a mobile phone call.

[0098] Step S340: setting the do not disturb level of the passenger seat corresponding to the person whose ear area is covered by the mobile phone to the second level according to the ear information.

[0099] Among them, when it is detected that the passenger's ear area is covered by the mobile phone, it means that the passenger is making a mobile phone call.

[0100] Step S350: Based on the DND level of each target seat, a preset signal-to-noise ratio corresponding to each target seat is obtained.

[0101] Among them, step S350 has been introduced in detail in the above embodiment and will not be repeated here.

[0102] Step S360: If it is detected that the Do Not Disturb level of the passenger seat is the second level, the passenger seat with the Do Not Disturb level of the second level is used as the third seat, and the built-in sound device corresponding to the third seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted.

[0103] If it is detected that the DND level of the passenger seat is the second level, it means that a passenger is making a phone call. At this time, it is necessary to adjust the external sound device of each seat other than the driver's seat and the built-in sound device of the passenger seat. Therefore, it is necessary to distinguish between passenger seats with the second level of DND and passenger seats with a level other than the second level of DND.

[0104] Step S370: Turn off the external sound device corresponding to each seat other than the driver's seat in the vehicle.

[0105] When it is detected that a passenger in the car is talking on the mobile phone, the external sound device corresponding to each seat other than the driving seat in the car will be automatically turned off, which can provide the passenger with a quieter call scene and improve the passenger's calling experience.

[0106] Step S380: adjusting the volume of the built-in sound device corresponding to each of the third seats according to the noise in the car and the preset signal-to-noise ratio corresponding to the third seat.

[0107] The second level indicates that a passenger is making a call on a mobile phone. The noise inside the car can be obtained by processing the voice information collected by the microphone. Then, based on the noise inside the car and the preset signal-to-noise ratio corresponding to the third seat, the volume of the built-in sound device corresponding to each third seat is adjusted to change the signal-to-noise ratio by changing the volume of the sound device.

[0108] See also Figure 4 , which shows a method flow chart of a sound adjustment method provided in an embodiment of the present application, the method specifically includes steps S410 to S480.

[0109] Step S410: Obtain the target seat corresponding to each person in the car.

[0110] Step S420: Collect image information of persons in each of the target seats in the vehicle, voice information in each of the target seat areas, and at least one of the audio categories corresponding to the audio data played by the sound-emitting device corresponding to each of the target seats.

[0111] Among them, step S410 and step S420 have been introduced in detail in the above embodiments and will not be repeated here.

[0112] Step S430: Determine whether the audio category corresponding to each of the passenger seats is call audio.

[0113] The vehicle system can obtain the audio category corresponding to the audio data played by the sound device corresponding to each passenger seat, and determine whether the audio category corresponding to each passenger seat is a call audio. If the audio category corresponding to the passenger seat is a call audio, it means that the passenger is talking through the vehicle system.

[0114] Step S440: Set the Do Not Disturb level of the passenger seat whose audio category is call audio to the third level.

[0115] If it is detected that the audio category corresponding to the passenger seat is call audio, the do not disturb level of the passenger seat with the audio category of call audio is set to the third level.

[0116] Step S450: Based on the DND level of each target seat, a preset signal-to-noise ratio corresponding to each target seat is obtained.

[0117] Among them, step S450 has been introduced in detail in the above embodiment and will not be repeated here.

[0118] Step S460: If it is detected that the Do Not Disturb level of the passenger seat is the third level, the passenger seat with the Do Not Disturb level of the third level is used as the fourth seat, and the built-in sound device corresponding to the fourth seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted.

[0119] If it is detected that the DND level of the passenger seat is the third level, it means that a passenger is talking on the vehicle system. At this time, it is necessary to adjust the external sound device of each seat other than the driver's seat and the built-in sound device of the passenger seat. To this end, it is necessary to distinguish between passenger seats with the third level of DND and passenger seats with a level other than the third level of DND.

[0120] Step S470: Turn off the external sound device corresponding to each seat other than the driver's seat in the vehicle.

[0121] When it is detected that a passenger in the car is talking on the car system, the external sound device corresponding to each seat other than the driving seat in the car will be automatically turned off, which can provide the passenger with a quieter conversation scene and improve the passenger's conversation experience.

[0122] Step S480: adjusting the volume of the built-in sound device corresponding to each of the fourth seats according to the noise in the vehicle and the preset signal-to-noise ratio corresponding to the fourth seat.

[0123] Specifically, the noise inside the car is obtained by processing the voice information collected by the microphone, and then based on the noise inside the car and the preset signal-to-noise ratio corresponding to the fourth seat, the volume of the built-in sound device corresponding to each fourth seat is adjusted to change the signal-to-noise ratio by changing the volume of the sound device.

[0124] See also Figure 5 , which shows a method flow chart of a sound adjustment method provided in an embodiment of the present application, the method specifically includes steps S510 to S5100.

[0125] Step S510: Obtain the target seat corresponding to each person in the car.

[0126] Step S520: Collect image information of persons in each of the target seats in the vehicle, voice information in each of the target seat areas, and at least one of the audio categories corresponding to the audio data played by the sound-emitting device corresponding to each of the target seats.

[0127] Step S530: Determine whether the audio category corresponding to each of the passenger seats is call audio.

[0128] Step S540: Set the Do Not Disturb level of the passenger seat whose audio category is call audio to the third level.

[0129] Step S550: Based on the DND level of each target seat, a preset signal-to-noise ratio corresponding to each target seat is obtained.

[0130] Step S560: If it is detected that the Do Not Disturb level of the passenger seat is the third level, the passenger seat with the Do Not Disturb level of the third level is used as the fourth seat, and the built-in sound device corresponding to the fourth seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted.

[0131] Step S570: Turn off the external sound device corresponding to each seat other than the driver's seat in the vehicle.

[0132] Step S580: adjusting the volume of the built-in sound device corresponding to each of the fourth seats according to the noise in the vehicle and the preset signal-to-noise ratio corresponding to the fourth seat.

[0133] Among them, step S510 and step S580 have been introduced in detail in the above embodiments and will not be repeated here.

[0134] Step S590: Based on the voice information corresponding to each of the fourth seats, obtain keyword information of the person sitting in each fourth seat.

[0135] By acquiring voice information corresponding to each fourth seat based on a microphone and performing voice recognition on the collected voice information, keyword information of the person sitting in each fourth seat can be obtained.

[0136] It should be noted that the keyword information can represent unclear hearing. When the keywords are: ah, what, speak louder, I can't hear clearly, etc., the keyword information is used to represent unclear hearing.

[0137] When it is detected that the keyword information representation is not clearly heard, the passenger's call experience can be improved by reducing the ambient noise or improving the call voice.

[0138] Step S5100: The fourth seat whose voice cannot be clearly heard according to the keyword information is regarded as the fifth seat, and the volume of the built-in sound device corresponding to each of the fifth seats is increased within a first preset range.

[0139] When it is detected that the keyword information representation is not clearly heard, the fourth seat where the keyword information representation is not clearly heard is regarded as the fifth seat, and the volume of the built-in sound device corresponding to each of the fifth seats is increased within the first preset range to improve the call quality of the passenger. The first preset range is preset according to the present invention.

[0140] See also Figure 6 , which shows a method flow chart of a sound adjustment method provided in an embodiment of the present application, the method specifically includes steps S610 to S6100.

[0141] Step S610: Obtain the target seat corresponding to each person in the car.

[0142] Step S620: Collect image information of persons in each of the target seats in the vehicle, voice information in each of the target seat areas, and at least one of the audio categories corresponding to the audio data played by the sound-emitting device corresponding to each of the target seats.

[0143] Step S630: Determine whether the audio category corresponding to each of the passenger seats is call audio.

[0144] Step S640: Set the Do Not Disturb level of the passenger seat whose audio category is call audio to the third level.

[0145] Step S650: Based on the DND level of each target seat, a preset signal-to-noise ratio corresponding to each target seat is obtained.

[0146] Step S660: If it is detected that the Do Not Disturb level of the passenger seat is the third level, the passenger seat with the Do Not Disturb level of the third level is used as the fourth seat, and the built-in sound device corresponding to the fourth seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted.

[0147] Step S670: Turn off the external sound device corresponding to each seat other than the driver's seat in the vehicle.

[0148] Step S680: adjusting the volume of the built-in sound device corresponding to each of the fourth seats according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat.

[0149] Step S690: Based on the voice information corresponding to each of the fourth seats, obtain keyword information of the person sitting in each fourth seat.

[0150] Among them, step S610 and step S690 have been introduced in detail in the above embodiments and will not be repeated here.

[0151] Step S6100: The noisy fourth seat represented by the keyword information is used as the sixth seat, and the volume of each built-in sound device corresponding to the sixth seat is reduced within a second preset range.

[0152] It should be noted that the keyword information can represent noise. When the keywords are words such as "ouch", "hiss", "so noisy", etc., the keyword information is used to represent noise.

[0153] It should be noted that when the keyword information represents noise, since the external sound device has been turned off at this time, it can be known that the noise is caused by the excessively high call audio. The call quality of the passengers can be improved by reducing the call voice.

[0154] To this end, when it is detected that the keyword information represents noise, the fourth seat represented by the keyword information as noisy is used as the sixth seat, and the volume of the built-in sound device corresponding to each sixth seat is increased within the second preset range to improve the call quality of the passenger. The second preset range is preset according to the preset range.

[0155] In an optional embodiment, the target seat corresponding to each person in the car is first obtained. The image information of the person in each target seat in the car, the voice information in the area of ​​each target seat, and the audio category corresponding to the audio data played by the sound device corresponding to each target seat are collected. Wherein, the target seats include passenger seats, and then, based on the image information corresponding to each passenger seat, the mouth opening and closing frequency and ear information of the person in each passenger seat are obtained, and the do not disturb level of the passenger seat whose corresponding audio category is not call audio, whose ear is not covered by the mobile phone and whose mouth opening and closing frequency is greater than the second threshold is taken as the fourth level. Secondly, based on the do not disturb level of each target seat, the preset signal-to-noise ratio corresponding to each target seat is obtained. Based on the do not disturb level of each target seat, the sound device to be adjusted corresponding to each target seat is determined, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the car; finally, based on the preset signal-to-noise ratio corresponding to each target seat, the sound device to be adjusted corresponding to each target seat is adjusted.

[0156] It should be noted that the fourth level is used to characterize passengers engaging in live conversations.

[0157] Furthermore, after the DND level of each target seat is determined, the method further includes: if it is detected that the DND level of the passenger seat is the fourth level, determining that the built-in sound device corresponding to the passenger seat and the external sound device of each non-driving seat are the sound devices to be adjusted. Turning on the sound device corresponding to each non-driving seat in the vehicle, and adjusting the volume of the sound device corresponding to each passenger seat according to the noise in the vehicle and the preset signal-to-noise ratio corresponding to the passenger seat, wherein the sound device can be a built-in sound device or an external sound device.

[0158] Furthermore, after the DND level of each of the target seats is determined, the method further includes: if it is detected that the DND level of the passenger seat is the fourth level, the passenger seat with the fourth DND level is taken as the first target seat, and based on the voice information corresponding to each of the first target seats, the keyword information of the person in each first target seat is obtained. The first target seat characterized by the keyword information as being noisy is taken as the first passenger seat, and the volume of the sound device corresponding to each of the first passenger seats is reduced within a second preset range.

[0159] In an optional embodiment, the target seat corresponding to each person in the car is first obtained. The image information of the person in each target seat in the car, the voice information in the area of ​​each target seat, and the audio category corresponding to the audio data played by the sound device corresponding to each target seat are collected. Wherein, the target seats include passenger seats, and then, based on the image information corresponding to each passenger seat, the eye closing time and ear information of the person in each passenger seat are obtained, and the do not disturb level of the passenger seat whose corresponding audio category is not call audio, whose ears are not covered by the mobile phone and whose eye closing time is less than the first threshold is taken as the fifth level. Secondly, based on the do not disturb level of each target seat, the preset signal-to-noise ratio corresponding to each target seat is obtained. Based on the do not disturb level of each target seat, the sound device to be adjusted corresponding to each target seat is determined, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the car; finally, based on the preset signal-to-noise ratio corresponding to each target seat, the sound device to be adjusted corresponding to each target seat is adjusted.

[0160] It should be noted that the fifth level is used to indicate that passengers are engaging in recreational activities.

[0161] Furthermore, after the DND level of each target seat is determined, the method further includes: if it is detected that the DND level of the passenger seat is level 5, determining the sound device corresponding to the passenger seat as the sound device to be adjusted. According to the noise in the car and the preset signal-to-noise ratio corresponding to the passenger seat, adjusting the volume of the sound device corresponding to each passenger seat, wherein the sound device may be a built-in sound device or an external sound device.

[0162] It should be noted that, when it is detected at the same time that a passenger seat meets the conditions of two do not disturb levels, the one with a higher priority is selected as the do not disturb level of the passenger seat.

[0163] For an exemplary example, see Fig. 9 The Do Not Disturb level of the passenger seat is the first level, which can be understood as the passenger is resting; the Do Not Disturb level of the passenger seat is the second level, which can be understood as the passenger is talking on the phone; the Do Not Disturb level of the passenger seat is the fourth level, which can be understood as the passenger is talking on the spot; the Do Not Disturb level of the passenger seat is the fifth level, which can be understood as the passenger is entertaining.

[0164] If it is detected that the passenger is resting, the corresponding sound device is adjusted based on the passenger's resting state. If it is detected that the passenger is talking on a phone call, the passenger's resting state is switched to a talking state, and the corresponding sound device is adjusted based on the talking state. If the passenger is not detected talking on a phone call for a period of time, the state is switched back to the resting state.

[0165] If it is detected that the passenger is talking on the spot, the corresponding sound device is adjusted based on the passenger's on-site conversation state. If it is detected that the passenger is talking on the phone, the passenger's on-site conversation state is switched to the talking state, and the corresponding sound device is adjusted based on the talking state. If the passenger is not detected talking on the phone for a period of time, it is switched back to the on-site conversation state.

[0166] If it is detected that the passenger is talking on the phone, the corresponding sound device is adjusted based on the passenger's talking state. If it is detected that the passenger is entertaining, the passenger's talking state is switched to the entertainment state, and the corresponding sound device is adjusted based on the state.

[0167] It should be noted that the rest state is the default state. When other states are detected, it will immediately switch to other states. When no other states are detected, it will return to the rest state by default.

[0168] See also Figure 7 , which shows a method flow chart of a sound adjustment method provided in an embodiment of the present application, the method specifically includes steps S710 to S760.

[0169] Step S710: Obtain the target seat corresponding to each person in the car.

[0170] Step S720: Collect image information of persons in each of the target seats in the vehicle, voice information in each of the target seat areas, and at least one of the audio categories corresponding to the audio data played by the sound-emitting device corresponding to each of the target seats.

[0171] Among them, step S710 and step S720 have been introduced in detail in the above embodiments and will not be repeated here.

[0172] Step S730: If the audio category corresponding to the driver's seat is navigation audio, the do not disturb level of the driver's seat is determined to be the navigation level.

[0173] Wherein, the target seat includes a driver's seat. If it is detected that the audio category corresponding to the driver's seat is navigation audio, then the do not disturb level of the driver's seat is determined to be a navigation level.

[0174] Step S740: Based on the DND level of each target seat, obtain a preset signal-to-noise ratio corresponding to each target seat.

[0175] Among them, step S740 has been introduced in detail in the above embodiment and will not be repeated here.

[0176] Step S750: If it is detected that the DND level of the driver's seat is the navigation level, the built-in sound device seat of the driver's seat is determined to be the sound device to be adjusted.

[0177] If it is detected that the do not disturb level of the driver's seat is the navigation level, the built-in sound device seat of the driver's seat is determined to be the sound device to be adjusted.

[0178] Step S760: Turn on the built-in sound device of the driver's seat, and adjust the volume of the built-in sound device corresponding to the driver's seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat.

[0179] Turn on the built-in sound device of the driver's seat, and adjust the volume of the built-in sound device corresponding to the driver's seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat.

[0180] In an optional embodiment, the target seat corresponding to each person in the car is first obtained. The image information of the person in each target seat in the car, the voice information in the area of ​​each target seat, and the audio category corresponding to the audio data played by the sound device corresponding to each target seat are collected. Among them, the target seats include the driver's seat, and then the do not disturb level of the driver's seat with the audio category of call audio is set to the call level. Secondly, based on the do not disturb level of each target seat, the preset signal-to-noise ratio corresponding to each target seat is obtained. Based on the do not disturb level of each target seat, the sound device to be adjusted corresponding to each target seat is determined, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the car; finally, based on the preset signal-to-noise ratio corresponding to each target seat, the sound device to be adjusted corresponding to each target seat is adjusted.

[0181] Furthermore, after the DND level of each target seat is determined, the method further includes: if it is detected that the DND level of the driver's seat is a call level, determining that the built-in sound device corresponding to the driver's seat is the sound device to be adjusted. According to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat, adjusting the volume of the built-in sound device corresponding to the driver's seat.

[0182] Furthermore, the do not disturb level of the driver's seat whose audio category is call navigation audio is set to the navigation level, wherein the call navigation audio includes both navigation voice and call voice.

[0183] In an optional embodiment, the target seat corresponding to each person in the car is first obtained. The image information of the person in each target seat in the car, the voice information in the area of ​​each target seat, and the audio category corresponding to the audio data played by the sound device corresponding to each target seat are collected. Among them, the target seats include the driver's seat, and then, based on the image information corresponding to the driver's seat, the mouth opening and closing frequency of the person in the driver's seat is obtained, and the DND level of the driver's seat whose corresponding audio category is not call audio or navigation audio and whose mouth opening and closing frequency is greater than the second threshold is used as the on-site conversation level. Secondly, based on the DND level of each target seat, the preset signal-to-noise ratio corresponding to each target seat is obtained. Based on the DND level of each target seat, the sound device to be adjusted corresponding to each target seat is determined, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the car; finally, based on the preset signal-to-noise ratio corresponding to each target seat, the sound device to be adjusted corresponding to each target seat is adjusted.

[0184] Furthermore, after the DND level of each target seat is determined, the method further includes: if it is detected that the DND level of the driver's seat is the live conversation level, determining that the sound device corresponding to the driver's seat is the sound device to be adjusted. According to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat, adjusting the volume of the sound device corresponding to the driver's seat.

[0185] Further, the do not disturb level of the driver's seat with an audio category of navigation live conversation audio is set to the navigation level, wherein the navigation live conversation audio includes both the navigation voice and the driver's mouth opening and closing frequency greater than the second threshold.

[0186] In an optional embodiment, the target seat corresponding to each person in the car is first obtained. The image information of the person in each target seat in the car, the voice information in the area of ​​each target seat, and the audio category corresponding to the audio data played by the sound device corresponding to each target seat are collected. Among them, the target seats include the driving seat, and then the do not disturb level of the driving seat whose corresponding audio category is not audio and video audio is used as the live conversation level. Secondly, based on the do not disturb level of each target seat, the preset signal-to-noise ratio corresponding to each target seat is obtained. Based on the do not disturb level of each target seat, the sound device to be adjusted corresponding to each target seat is determined, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the car; finally, based on the preset signal-to-noise ratio corresponding to each target seat, the sound device to be adjusted corresponding to each target seat is adjusted.

[0187] Furthermore, after the DND level of each target seat is determined, the method further includes: if it is detected that the DND level of the driver's seat is the entertainment level, determining that the sound device corresponding to the driver's seat is the sound device to be adjusted. According to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat, adjusting the volume of the sound device corresponding to the driver's seat.

[0188] Further, the do not disturb level of the driver's seat whose audio category is navigation entertainment audio is set to the navigation level, wherein the navigation entertainment audio includes both navigation voice and entertainment audio.

[0189] Please note that Figure 8 The navigation level can coexist with the call level, the live conversation level and the entertainment level respectively, and the priority of the navigation level is greater than the priority of the call level, the live conversation level and the entertainment level. That is, when it is detected that the driver's seat meets the conditions of the navigation level and the entertainment level at the same time, the do not disturb level of the driver's seat is determined to be the navigation level.

[0190] In an exemplary embodiment, the DND level of the driver's seat is live conversation. If it is detected that the DND level of the driver's seat has changed to the call level, the live conversation level is immediately switched to the call level, and the corresponding sounding device is adjusted according to the call level. Then, if the DND level of the driver's seat is not detected to be the call level for a period of time, it is switched back to the live conversation level.

[0191] In an exemplary embodiment, the DND level of the driver's seat is live conversation. If it is detected that the DND level of the driver's seat has changed to the entertainment level, the live conversation level is immediately switched to the entertainment level, and the corresponding sound device is adjusted according to the entertainment level. If the DND level of the driver's seat is not detected to be the entertainment level for a period of time, it is switched back to the live conversation level.

[0192] In an exemplary embodiment, the do not disturb level of the driver's seat is a call level. If it is detected that the do not disturb level of the driver's seat has changed to an entertainment level, it is immediately switched from the call level to the entertainment level, and the corresponding sound device is adjusted according to the entertainment level.

[0193] See also Fig.10 , which shows a structural block diagram of a sound adjustment device 600 provided in an embodiment of the present application. The test device 600 includes: an acquisition unit 610, a collection unit 620, a level determination unit 630, a signal-to-noise ratio determination unit 640, an object determination unit 650 and an adjustment unit 660.

[0194] The acquisition unit 610 is used to acquire the target seat corresponding to each person in the car.

[0195] Further, if the target seat includes a passenger seat, the do not disturb level of the passenger seat includes a plurality of levels arranged from high to low priority, wherein the preset signal-to-noise ratios corresponding to the plurality of levels arranged from high to low priority increase sequentially.

[0196] The collection unit 620 is used to collect image information of people in each target seat in the car, voice information in each target seat area, and at least one of the audio categories corresponding to the audio data played by the sound device corresponding to each target seat.

[0197] The level determination unit 630 is used to determine the do not disturb level of each target seat based on the reference information corresponding to each target seat, wherein the reference information includes at least one of the image information, the voice information and the audio category.

[0198] Furthermore, the level determination unit 630 can also be used to obtain the eye closing duration and mouth opening and closing frequency of the person in each passenger seat based on the image information corresponding to each of the passenger seats; for persons whose eye closing duration is greater than the first threshold and whose mouth opening and closing frequency is less than the second threshold, the do not disturb level of the corresponding passenger seat is set to the first level.

[0199] Furthermore, the level determination unit 630 can also be used to obtain ear information of the person in each passenger seat based on the image information corresponding to each of the passenger seats; and set the do not disturb level of the passenger seat corresponding to the person whose ear area is covered by the mobile phone to the second level according to the ear information.

[0200] Furthermore, the level determination unit 630 can also be used to determine whether the audio category corresponding to each of the passenger seats is call audio; and set the do not disturb level of the passenger seats whose audio category is call audio to the third level.

[0201] Furthermore, the level determination unit 630 may also be used to determine that the do not disturb level of the driver's seat is a navigation level if the audio category corresponding to the driver's seat is a navigation audio.

[0202] The signal-to-noise ratio determining unit 640 is configured to obtain a preset signal-to-noise ratio corresponding to each of the target seats based on the DND level of each of the target seats.

[0203] The object determination unit 650 is used to determine the sound device to be adjusted corresponding to each target seat based on the do not disturb level of each target seat, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the vehicle.

[0204] Furthermore, the object determination unit 650 can also be used to determine the built-in sound device corresponding to each passenger seat and the external sound device of each seat other than the driver's seat as the sound device to be adjusted if it is detected that the do not disturb level of at least one of the passenger seats is the first level.

[0205] Furthermore, the object determination unit 650 can also be used to, if it is detected that the do not disturb level of the passenger seat is the second level, treat the passenger seat with the second do not disturb level as the third seat, and determine the built-in sound device corresponding to the third seat and the external sound device of each seat other than the driver's seat as the sound devices to be adjusted.

[0206] Furthermore, if it is detected that the do not disturb level of the passenger seat is the third level, the object determination unit 650 can also be used to treat the passenger seat with the third level of do not disturb level as the fourth seat, and determine the built-in sound device corresponding to the fourth seat and the external sound device of each seat other than the driver's seat as the sound devices to be adjusted.

[0207] Furthermore, the object determination unit 650 may also be used to determine that the built-in sound device seat of the driver's seat is the sound device to be adjusted if it is detected that the do not disturb level of the driver's seat is the navigation level.

[0208] The adjustment unit 660 is used to adjust the sound device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat.

[0209] Furthermore, the adjustment unit 660 can also be used to set a passenger seat with a first do not disturb level as a first seat, and a passenger seat with a do not disturb level not at the first level as a second seat; turn off an external sound device corresponding to each non-driving seat in the vehicle, turn off a built-in sound device corresponding to each of the first seats, and turn on a built-in sound device corresponding to each of the second seats; and adjust the volume of the built-in sound device corresponding to each of the second seats according to the noise in the vehicle and a preset signal-to-noise ratio corresponding to the second seat.

[0210] Furthermore, the adjustment unit 660 can also be used to turn off the external sound device corresponding to each non-driving seat in the car; according to the noise in the car and the preset signal-to-noise ratio corresponding to the third seat, adjust the volume of the built-in sound device corresponding to each third seat.

[0211] Furthermore, the adjustment unit 660 can also be used to turn off the external sound device corresponding to each non-driving seat in the car; and adjust the volume of the built-in sound device corresponding to each fourth seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat.

[0212] Furthermore, the adjustment unit 660 can also be used to obtain keyword information of the person in each fourth seat based on the voice information corresponding to each of the fourth seats; take the fourth seat that cannot be heard clearly according to the keyword information as the fifth seat, and increase the volume of the built-in sound device corresponding to each of the fifth seats within the first preset range.

[0213] Furthermore, the adjustment unit 660 can also be used to obtain keyword information of the person in each fourth seat based on the voice information corresponding to each of the fourth seats; use the noisy fourth seat represented by the keyword information as the sixth seat, and reduce the volume of the built-in sound device corresponding to each of the sixth seats within a second preset range.

[0214] Furthermore, the adjustment unit 660 can also be used to turn on the built-in sound device of the driver's seat, and adjust the volume of the built-in sound device corresponding to the driver's seat according to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat.

[0215] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0216] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0217] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0218] Please refer to Fig.11, which shows a structural block diagram of an electronic device 700 provided in an embodiment of the present application. The electronic device 700 may be a vehicle system, which may be arranged in a vehicle. The electronic device 700 in the present application may include one or more of the following components: a processor 711, a memory 712, and one or more application programs, wherein the processor 711 is electrically connected to the memory 712, and the one or more program configurations are used to execute the methods described in the various embodiments of the aforementioned test method.

[0219] The processor 711 may include one or more processing cores. The processor 711 uses various interfaces and lines to connect various parts of the entire electronic device 700, and executes various functions and processes data of the electronic device 700 by running or executing instructions, programs, code sets or instruction sets stored in the memory 712, and calling data stored in the memory 712. Optionally, the processor 711 can be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 711 can integrate one or a combination of a central processing unit (CPU), a graphics processor (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and computer programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 711, but may be implemented separately through a communication chip. Specifically, the method described in the above embodiments may be executed by one or more processors 711 .

[0220] For some embodiments, the memory 712 may include a random access memory (RAM) or a read-only memory (ROM). The memory 712 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 712 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the following various method embodiments, etc. The data storage area may also store data created by the electronic device 700 during use, etc.

[0221] Please refer to Fig.12, which shows a structural block diagram of a computer-readable medium provided in an embodiment of the present application. The computer-readable medium 800 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0222] The computer readable medium 800 can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable medium 800 includes a non-transitory computer-readable storage medium. The computer readable medium 800 has storage space for program code 810 that performs any method step in the above method. These program codes can be read from or written to one or more computer program products. The program code 810 can be compressed, for example, in an appropriate form.

[0223] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A sound adjustment method, characterized in that: The method comprises: Get the target seat corresponding to each person in the car; Collecting image information of a person in each target seat in the vehicle, voice information in each target seat area, and at least one of the audio categories corresponding to the audio data played by the sound device corresponding to each target seat; Determine a do not disturb level for each of the target seats based on reference information corresponding to each of the target seats, wherein the reference information includes at least one of the image information, the voice information, and the audio category; Based on the do not disturb level of each target seat, obtaining a preset signal-to-noise ratio corresponding to each target seat; Based on the DND level of each target seat, determine the sound device to be adjusted corresponding to each target seat, wherein the sound device to be adjusted includes at least one of the sound devices installed in each seat in the vehicle; Based on the preset signal-to-noise ratio corresponding to each of the target seats, the sounding device to be adjusted corresponding to each of the target seats is adjusted.

2. The method according to claim 1, characterized in that The target seat includes a passenger seat, and the do not disturb level of the passenger seat includes a plurality of levels arranged from high to low priority, wherein the preset signal-to-noise ratios corresponding to the plurality of levels arranged from high to low priority increase sequentially.

3. The method according to claim 2, characterized in that The determining the do not disturb level of each target seat based on the reference information corresponding to each target seat includes: Based on the image information corresponding to each of the passenger seats, obtaining the eye closing duration and mouth opening and closing frequency of the person in each passenger seat; For persons whose eye closing time is greater than the first threshold and whose mouth opening and closing frequency is less than the second threshold, the do not disturb level of the corresponding passenger seat is set to the first level.

4. The method according to claim 3, characterized in that The step of determining the sounding device to be adjusted corresponding to each target seat based on the DND level of each target seat includes: If it is detected that the DND level of at least one of the passenger seats is the first level, the built-in sound device corresponding to each passenger seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted; The adjusting the to-be-adjusted sounding device corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat comprises: The seat of a passenger whose DND level is the first level is designated as the first seat, and the seat of a passenger whose DND level is not the first level is designated as the second seat; Turn off the external sound device corresponding to each seat other than the driving seat in the vehicle, turn off the built-in sound device corresponding to each of the first seats, and turn on the built-in sound device corresponding to each of the second seats; The volume of the built-in sound device corresponding to each of the second seats is adjusted according to the noise in the car and the preset signal-to-noise ratio corresponding to the second seat.

5. The method according to claim 2, characterized in that: The determining the do not disturb level of each target seat based on the reference information corresponding to each target seat includes: Based on the image information corresponding to each of the passenger seats, obtaining ear information of the person in each passenger seat; The do not disturb level of the passenger seat corresponding to the person whose ear area is covered by the mobile phone is set to the second level according to the ear information.

6. The method according to claim 5, characterized in that The step of determining the sounding device to be adjusted corresponding to each target seat based on the DND level of each target seat includes: If it is detected that the DND level of the passenger seat is the second level, the passenger seat with the second DND level is taken as the third seat, and the built-in sound device corresponding to the third seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted; The adjusting the to-be-adjusted sounding device corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat comprises: Turn off the external sound device corresponding to each seat in the car other than the driver's seat; The volume of the built-in sound device corresponding to each of the third seats is adjusted according to the noise in the car and the preset signal-to-noise ratio corresponding to the third seat.

7. The method according to claim 2, characterized in that The determining the do not disturb level of each target seat based on the reference information corresponding to each target seat includes: Determining whether the audio category corresponding to each of the passenger seats is call audio; Set the DND level for the passenger seat whose audio category is call audio to the third level.

8. The method according to claim 7, characterized in that The step of determining the sounding device to be adjusted corresponding to each target seat based on the DND level of each target seat includes: If it is detected that the DND level of the passenger seat is the third level, the passenger seat with the third DND level is taken as the fourth seat, and the built-in sound device corresponding to the fourth seat and the external sound device of each seat other than the driver's seat are determined as the sound devices to be adjusted; The adjusting the to-be-adjusted sounding device corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat comprises: Turn off the external sound device corresponding to each seat in the car other than the driver's seat; The volume of the built-in sound device corresponding to each of the fourth seats is adjusted according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat.

9. The method according to claim 8, characterized in that After adjusting the volume of the built-in sound device corresponding to each of the fourth seats according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat, the method further includes: Based on the voice information corresponding to each of the fourth seats, obtaining keyword information of the person in each fourth seat; The fourth seat, which cannot hear the keyword information clearly, is regarded as the fifth seat, and the volume of the built-in sound device corresponding to each of the fifth seats is increased within the first preset range.

10. The method according to claim 8, characterized in that After adjusting the volume of the built-in sound device corresponding to each of the fourth seats according to the noise in the car and the preset signal-to-noise ratio corresponding to the fourth seat, the method further includes: Based on the voice information corresponding to each of the fourth seats, obtaining keyword information of the person in each fourth seat; The fourth seat represented by the keyword information as being noisy is used as the sixth seat, and the volume of each built-in sound device corresponding to the sixth seat is reduced within a second preset range.

11. The method according to claim 1, characterized in that: The target seat includes a driver's seat, and determining the do not disturb level of each target seat based on the reference information corresponding to each target seat includes: If the audio category corresponding to the driver's seat is navigation audio, the do not disturb level of the driver's seat is determined to be the navigation level.

12. The method according to claim 11, characterized in that The step of determining the sounding device to be adjusted corresponding to each target seat based on the DND level of each target seat includes: If it is detected that the DND level of the driver's seat is the navigation level, determining that the built-in sound device seat of the driver's seat is the sound device to be adjusted; The adjusting the to-be-adjusted sounding device corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat comprises: The built-in sound device of the driver's seat is turned on, and the volume of the built-in sound device corresponding to the driver's seat is adjusted according to the noise in the car and the preset signal-to-noise ratio corresponding to the driver's seat.

13. A sound-generating device adjusting device, characterized in that: The sound generating device adjusting device comprises: An acquisition unit, used to acquire a target seat corresponding to each person in the vehicle; A collection unit, used to collect image information of a person in each target seat in the vehicle, voice information in each target seat area, and audio categories corresponding to audio data played by a sound device corresponding to each target seat; a level determination unit, configured to determine a do not disturb level for each of the target seats based on reference information corresponding to each of the target seats, wherein the reference information includes at least one of the image information, the voice information, and the audio category; A signal-to-noise ratio determination unit, configured to obtain a preset signal-to-noise ratio corresponding to each of the target seats based on the do not disturb level of each of the target seats; an object determination unit, configured to determine a sound device to be adjusted corresponding to each target seat based on the DND level of each target seat, wherein the sound device to be adjusted includes at least one of the sound devices installed at each seat in the vehicle; The adjustment unit is used to adjust the sound device to be adjusted corresponding to each target seat based on the preset signal-to-noise ratio corresponding to each target seat.

14. An electronic device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory, the one or more applications are configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1-12.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, and the program codes can be called by a processor to execute the method according to any one of claims 1 to 12.

Images