Loudspeaker control method, device and system and storage medium

Abstract

The invention discloses a loudspeaker control method, device and system and a storage medium, and the method comprises the steps: judging whether a first passenger has the authority of a vehicle owner or not when the audio data of the first passenger is collected under the condition that a vehicle plays an audio; when the first passenger has the authority of the vehicle owner, identifying the audio data, and judging whether a second passenger exists in the audio data, the second passenger being a passenger on the current vehicle; when a second passenger exists in the audio data, determining the sitting position of the second passenger, and reducing the volume of a loudspeaker corresponding to the sitting position of the second passenger; wherein the corresponding relation between the seat and the loudspeaker is preset. By adopting the scheme provided by the invention, the volume of the loudspeaker can be automatically adjusted, a driver does not need to manually adjust the volume, and the driving safety and the user experience are improved.

Description

Technical Field

[0001] The present application relates to the field of voice monitoring technology, and in particular to a speaker control method, device, system and storage medium. Background Art

[0002] With the rapid development of smart cockpits, more and more scenarios are being used for in-car audio and video entertainment systems during driving. However, the continuous background sound of the audio and video entertainment system will affect the voice communication of passengers. When the passengers in the car need to communicate, if the background music is too loud, the driver usually manually adjusts the volume to reduce it so that he can hear the speaker's voice clearly. When no one is talking, he manually adjusts it back to the original volume. The volume cannot be adjusted automatically. Since the driver needs to manually adjust the volume multiple times, the driving risk is high and the user experience is poor.

[0003] Therefore, how to provide a speaker control method to automatically adjust the volume and improve driving safety and user experience has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] The present application provides a speaker control method, device, system and storage medium for automatically adjusting the volume to improve driving safety and user experience.

[0005] The present application provides a speaker control method, comprising:

[0006] In the case of audio playback in the vehicle, when audio data of the first passenger is collected, determining whether the first passenger has the vehicle owner authority;

[0007] When the first passenger has the vehicle owner authority, identifying the audio data and determining whether there is a second passenger in the audio data, wherein the second passenger is a passenger in the current vehicle;

[0008] When there is a second passenger in the audio data, the seating position of the second passenger is determined, and the volume of the speaker corresponding to the seating position of the second passenger is reduced; wherein the correspondence between the seat and the speaker is preset.

[0009] The beneficial effects of the present application are: when the audio is played in the vehicle, when the audio data of the first passenger is collected, it is determined whether the first passenger has the owner's authority; when the first passenger has the owner's authority, the audio data is identified, and it is determined whether there is a second passenger in the audio data, wherein the second passenger is a passenger in the current vehicle; when there is a second passenger in the audio data, the seating position of the second passenger is determined, and the volume of the speaker corresponding to the seating position of the second passenger is reduced. Since the audio information of the first passenger can be automatically identified, and when there is a second passenger in the current vehicle in the audio information of the first passenger, it is determined that the first passenger is currently communicating with the second passenger, and for the second passenger, the volume of the speaker at the distance from the second passenger's position is automatically reduced to facilitate communication between customers, and further, the present solution can automatically adjust the volume of the speaker without the driver having to manually adjust the volume, thereby improving driving safety and user experience.

[0010] In one embodiment, determining whether the first passenger has the vehicle owner's authority includes:

[0011] Obtaining voiceprint information corresponding to the audio data of the first passenger;

[0012] Traversing a first preset relationship table according to the voiceprint information to determine whether the voiceprint information is registered voiceprint information, wherein the first preset relationship table at least includes a correspondence between the voiceprint information and the passenger identity information;

[0013] When it is determined that the voiceprint information is registered voiceprint information, it is determined that the first passenger has the vehicle owner's authority.

[0014] In one embodiment, determining whether the first passenger has the vehicle owner's authority includes:

[0015] Collect the facial information of the first passenger through the camera;

[0016] Determining whether the facial information is stored in a second preset relationship table, wherein the second preset relationship table at least includes a correspondence between facial information and passenger identity information;

[0017] When the facial information exists in the second preset relationship table, it is determined that the first passenger is a user with vehicle owner authority.

[0018] In one embodiment, the method further comprises:

[0019] When the second passenger is not present in the audio data, the volume of all speakers in the vehicle is reduced.

[0020] In one embodiment, the identifying the audio data and determining whether the second passenger exists in the audio data includes:

[0021] Identify the audio data to determine whether there are keywords representing the title in the audio data;

[0022] When a keyword representing a title exists in the audio data, determining whether there is a passenger corresponding to the keyword on the bus;

[0023] When there is a passenger corresponding to the keyword in the car, it is determined that there is a second passenger in the audio data.

[0024] In one embodiment, the method further comprises:

[0025] Acquire a target location of the first passenger, and monitor audio data of the first passenger at the target location;

[0026] When the audio data of the first passenger is not detected within a preset time threshold, the volume of all speakers in the vehicle is restored.

[0027] In one embodiment, when the first passenger has the vehicle owner authority, obtaining the target location of the first passenger includes:

[0028] Obtaining target voiceprint information corresponding to the audio data of the first passenger;

[0029] querying a third preset relationship table according to the target voiceprint information to obtain target face information corresponding to the target voiceprint information, wherein the third preset relationship table at least contains a corresponding relationship between voiceprint information and face information;

[0030] Obtaining a recognition result of the correspondence between the face of each passenger in the vehicle and the location of the face through a camera, and matching the recognition result with the target face information to determine the location of the target face information;

[0031] When the seat pressure collected by the seat pressure sensor at the location where the target facial information is located is greater than the preset pressure, the location where the target facial information is located is determined to be the target location where the first passenger is located.

[0032] The present application also provides a speaker control device, comprising:

[0033] A collection module, used for determining whether the first passenger has the vehicle owner's authority when collecting the audio data of the first passenger in the case of audio playback in the vehicle;

[0034] an identification module, configured to identify the audio data and determine whether there is a second passenger in the audio data when the first passenger has the vehicle owner's authority, wherein the second passenger is a passenger in the current vehicle;

[0035] A lowering module is used to determine the seating position of a second passenger when the second passenger exists in the audio data, and to lower the volume of a speaker corresponding to the seating position of the second passenger; wherein the correspondence between the seat and the speaker is preset.

[0036] In one embodiment, the acquisition module includes:

[0037] An acquisition submodule, used to acquire voiceprint information corresponding to the audio data of the first passenger;

[0038] A first judgment submodule, configured to traverse a first preset relationship table according to the voiceprint information to determine whether the voiceprint information is registered voiceprint information, wherein the first preset relationship table at least includes a correspondence between the voiceprint information and the passenger identity information;

[0039] The first determination submodule is used to determine that the first passenger has the vehicle owner authority when it is determined that the voiceprint information is registered voiceprint information.

[0040] In one embodiment, the acquisition module includes:

[0041] A collection submodule, used for collecting facial information of the first passenger through a camera;

[0042] A second determination submodule is used to determine whether the facial information is stored in a second preset relationship table, wherein the second preset relationship table at least includes a correspondence between facial information and passenger identity information;

[0043] The second determination submodule is used to determine that the first passenger is a user with vehicle owner authority when the facial information exists in the second preset relationship table.

[0044] In one embodiment, the reducing module is further used for:

[0045] When the second passenger is not present in the audio data, the volume of all speakers in the vehicle is reduced.

[0046] In one embodiment, the identification module includes:

[0047] An identification submodule, used to identify the audio data to determine whether there are keywords representing the title in the audio data;

[0048] A third judgment submodule is used to judge whether there is a passenger corresponding to the keyword on the bus when there is a keyword representing the title in the audio data;

[0049] The third determination submodule is used to determine whether there is a second passenger in the audio data when there is a passenger corresponding to the keyword on the bus.

[0050] In one embodiment, the apparatus further comprises:

[0051] an acquisition module, used to acquire a target position where the first passenger is located, and monitor the audio data of the first passenger at the target position;

[0052] The recovery module is used to restore the volume of all speakers in the vehicle when the audio data of the first passenger is not detected within a preset time threshold.

[0053] In one embodiment, the acquisition module includes:

[0054] An acquisition submodule, used to acquire target voiceprint information corresponding to the audio data of the first passenger;

[0055] A query submodule, querying a third preset relationship table according to the target voiceprint information to obtain the target face information corresponding to the target voiceprint information, wherein the third preset relationship table at least contains the corresponding relationship between the voiceprint information and the face information;

[0056] A matching submodule, used to obtain a recognition result of the corresponding relationship between the face of each passenger in the vehicle and the position of the face through a camera, and match the recognition result with the target face information to determine the position of the target face information;

[0057] The fourth determination submodule is used to determine that the location of the target facial information is the target location of the first passenger when the seat pressure collected by the seat pressure sensor at the location of the target facial information is greater than a preset pressure.

[0058] The present application also provides a speaker control system, comprising:

[0059] at least one processor; and,

[0060] a memory communicatively connected to the at least one processor; wherein,

[0061] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to implement the speaker control method described in any of the above embodiments.

[0062] The present application also provides a computer-readable storage medium. When the instructions in the storage medium are executed by a processor corresponding to the speaker control system, the speaker control system can implement the speaker control method recorded in any of the above embodiments.

[0063] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings.

[0064] The technical solution of the present application is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] The accompanying drawings are used to provide a further understanding of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings:

[0066] Figure 1 This is a flow chart of a speaker control method in one embodiment of the present application;

[0067] Figure 2 This is a structural schematic diagram of a speaker control device in an embodiment of the present application;

[0068] Figure 3 Schematic diagram of the hardware structure of a speaker control system in one embodiment of the present application. DETAILED DESCRIPTION

[0069] The preferred embodiments of the present application are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application and are not used to limit the present application.

[0070] Figure 1 Flow chart of a speaker control method in one embodiment of the present application. Figure 1 As shown, the method can be implemented as the following steps S101-S103:

[0071] In step S101, when the vehicle is playing audio, when the audio data of the first passenger is collected, it is determined whether the first passenger has the vehicle owner authority;

[0072] In step S102, when the passenger identity information indicates that the passenger is a user with vehicle owner authority, the passenger voice is recognized to determine whether there is a designated object in the passenger voice;

[0073] In step S103, when there is a designated object in the passenger's voice, the volume of the speaker closest to the designated object is reduced.

[0074] In the present application, when the vehicle plays audio, when the audio data of the first passenger is collected, it is determined whether the first passenger has the owner's authority. Specifically, the user can pre-enter the voiceprint information and facial information. For example, the owner or family members can respectively enter the voiceprint information and facial information in the main driver's seat, the co-driver's seat or the back seat, and enter the corresponding passenger identity information when entering the voiceprint information and facial information. Furthermore, the vehicle pre-stores the correspondence between the voiceprint information, facial information and passenger identity information, and stores the correspondence in a preset relationship table. During the driving of the vehicle, turn on the voice monitoring mode to determine whether the first passenger is a user with the owner's authority. There are many specific judgment methods. In one embodiment, the first passenger is judged whether he is a user with the owner's authority by comparing the audio data of the first passenger with the pre-stored voiceprint information: first, the voiceprint information corresponding to the audio data of the first passenger is obtained, and then, according to the voiceprint information, the first preset relationship table is traversed to determine whether the voiceprint information is a registered voiceprint information, wherein the first preset relationship table at least contains the corresponding relationship between the voiceprint information and the passenger's identity information; finally, when it is determined that the voiceprint information is a registered voiceprint information, it is determined that the first passenger has the owner's authority. In another embodiment, the first passenger who sent the audio data is first determined by locating the sound source or comparing the collected audio data with the video information collected by the camera, and then the facial information corresponding to the first passenger is collected by the camera, and then it is determined whether the facial information is stored in the second preset relationship table, wherein the second preset relationship table at least contains the corresponding relationship between the facial information and the passenger's identity information. When the facial information exists in the second preset relationship table, it is determined that the first passenger is a user with the owner's authority.

[0075] When the first passenger has the car owner's authority, the audio data is identified and it is determined whether there is a second passenger in the audio data, wherein the second passenger is a passenger in the current vehicle. Since the passenger is not necessarily communicating when making a sound, for example, the passenger hums along with the music, at this time, there is no need to adjust the volume of the speaker. Therefore, the present application identifies the audio data of the first passenger and determines whether there is a second passenger in the current vehicle in the passenger's voice to determine whether the current passenger is communicating with the passengers in the car. Specifically, the audio data is identified to determine whether there are keywords representing the title in the audio data, such as nouns such as dad, mom, and Xiao Wang. When there are keywords representing the title in the voice information, it is determined whether there are passengers corresponding to the keywords in the car. For example, for keywords such as names that can directly determine the identity of passengers, the corresponding passenger identity can be determined directly based on the keywords; for keywords such as "dad" and "mom" that represent the direct identity relationship of passengers, the corresponding passenger identity cannot be determined directly based on the keywords, then the identity information of the first passenger is first determined, and then the passenger corresponding to the keyword is determined according to the identity relationship between the identity information of the first passenger and the identity information of each passenger in the car. When there is a passenger corresponding to the keyword on the bus, it is determined that there is a second passenger in the passenger's voice, and the passenger whose facial information matches the keyword is the second passenger.

[0076] When there is a second passenger in the audio data, the seat position of the second passenger is determined, and the volume of the speaker corresponding to the seat position of the second passenger is reduced; wherein the correspondence between the seat and the speaker is pre-set. Since the volume of the speaker at the seat position of the second passenger is adjusted, the volume of other speakers is not adjusted, thereby reducing the disturbance to other passengers listening to the audio. In this embodiment, when there is no second passenger in the audio data of the passenger, it may be that the passenger is making a phone call or the information of the communication object of the current conversation has not been stored in advance. In this case, the volume of all speakers in the vehicle is reduced to ensure that the audio in the vehicle does not affect the communication between passengers.

[0077] In addition, in the present application, in case the passenger's voice is too low, in order to ensure the listening effect between passengers' conversations, the volume corresponding to the passenger's audio data is obtained. When the volume is less than the preset volume, the volume of all speakers in the vehicle is lowered.

[0078] Furthermore, in order to restore the original volume of the speaker in time after the conversation ends to reduce the disturbance to the passengers listening to the audio, the target position of the first passenger is obtained, and the audio data of the first passenger at the target position is monitored; for example, the target position of the first passenger is determined by sound source localization technology, or the first passenger is determined by matching the collected audio data with the lip shape information of the passengers in the vehicle, and then the target position of the first passenger is determined. When the audio data of the first passenger is not detected within a preset time threshold, the volume of all speakers in the vehicle is restored.

[0079] It should be noted that in this application, when the volume is lowered, it can be directly lowered to a preset target value, or it can be dynamically adjusted according to the volume corresponding to the audio data of the first passenger, for example, adjusted to 30% of the volume corresponding to the audio data of the first passenger, to ensure that other people in the car can still listen to the audio normally. This application does not limit the specific method of lowering the volume.

[0080] The beneficial effects of the present application are: when the audio is played in the vehicle, when the audio data of the first passenger is collected, it is determined whether the first passenger has the owner's authority; when the first passenger has the owner's authority, the audio data is identified, and it is determined whether there is a second passenger in the audio data, wherein the second passenger is the passenger in the current vehicle; when there is a second passenger in the audio data, the sitting position of the second passenger is determined, and the volume of the speaker corresponding to the sitting position of the second passenger is reduced; wherein the correspondence between the seat and the speaker is pre-set. Since the audio information of the first passenger can be automatically identified, and when there is a second passenger in the current vehicle in the audio information of the first passenger, it is determined that the first passenger is currently communicating with the second passenger, and for the second passenger, the volume of the speaker at the position of the second passenger is automatically reduced to facilitate communication between customers, and further, the present solution can automatically adjust the volume of the speaker without the driver having to manually adjust the volume, thereby improving driving safety and user experience.

[0081] In one embodiment, the above step S101 may be implemented as the following steps A1-A3:

[0082] In step A1, voiceprint information corresponding to the audio data of the first passenger is obtained;

[0083] In step A2, a first preset relationship table is traversed according to the voiceprint information to determine whether the voiceprint information is registered voiceprint information, wherein the first preset relationship table at least contains a corresponding relationship between the voiceprint information and the passenger identity information;

[0084] In step A3, when it is determined that the voiceprint information is registered voiceprint information, it is determined that the first passenger has the vehicle owner's authority.

[0085] In this embodiment, the collected audio data of the first passenger is compared with the pre-stored audio information of the passengers to determine whether the first passenger has the specific vehicle owner authority.

[0086] First, the voiceprint information corresponding to the audio data of the first passenger is obtained. The voiceprint information may be voiceprint features extracted from the preprocessed sound collected by a microphone or other audio device after preprocessing the sound of the passenger, such as removing noise, filtering, normalization, etc., such as spectrum features, pitch features, phonetic features, and spectral features.

[0087] Then, according to the voiceprint information, a first preset relationship table is traversed to determine whether the voiceprint information is registered voiceprint information, wherein the first preset relationship table at least contains the correspondence between the voiceprint information and the passenger identity information; specifically, the extracted voiceprint information is compared with the pre-stored voiceprint information, for example, by performing a similarity comparison through a pre-established voiceprint matching model, and when the similarity is greater than a preset value, it is determined that the match is successful, and then the identity information of the passenger currently making the sound is determined through the preset relationship table.

[0088] Finally, when the voiceprint information exists in the first preset relationship table, it is determined that the passenger who made the sound is a user with vehicle owner authority.

[0089] In one embodiment, the above step S101 may be implemented as the following steps B1-B3:

[0090] In step B1, facial information of the first passenger is collected through a camera;

[0091] In step B2, it is determined whether the facial information is stored in a second preset relationship table, wherein the second preset relationship table at least includes a correspondence between facial information and passenger identity information;

[0092] In step B3, when the facial information exists in the second preset relationship table, it is determined that the first passenger is a user with vehicle owner authority.

[0093] In this embodiment, a multimodal identity authentication method is used, that is, the collected audio data is matched with the lip shape information to determine whether the first passenger has the owner's authority.

[0094] First, the facial information of the first passenger is collected by a camera. There are many ways to determine the first passenger. In one embodiment, the facial information of all passengers in the car is collected by a camera, and the corresponding lip images are obtained from the facial information of all passengers; then, the collected sound and lip images are preprocessed, and the corresponding sound features and lip features are extracted; then the sound features and lip features are aligned in time to ensure that the two have a corresponding time relationship, for example, a synchronization mark or a timestamp can be used. Finally, the similarity of the sound features and the lip features is compared by a pre-stored matching model. When there is a lip feature with a similarity greater than a preset threshold, the passenger corresponding to the lip shape is determined to be the first passenger. Since the corresponding relationship between the sound and lip movement in time is utilized, the sound signal is matched with the lip image, and the sound and visual information are combined to improve the accuracy of recognition. In another embodiment, the passenger who makes the sound is determined by the sound source localization technology, that is, by analyzing the time difference, phase and other characteristics of the sound signals collected by different microphones, the position of the sound source in space is determined, and then the first passenger is determined. After the first passenger is determined, the facial information of the first passenger is collected.

[0095] Determine whether the facial information is stored in a second preset relationship table, wherein the second preset relationship table at least includes a correspondence between facial information and passenger identity information, wherein the second preset relationship table at least includes a correspondence between facial information and passenger identity information. Further, by comparing the facial information corresponding to the first passenger with the facial information stored in the preset relationship table, determine whether the first passenger is a pre-stored user with vehicle owner authority. The specific comparison process can be implemented through a variety of facial recognition methods in the prior art, which is not limited in this application.

[0096] When the facial information exists in the second preset relationship table, it is determined that the first passenger is a user with vehicle owner authority.

[0097] In one embodiment, the method is further implemented as the following step C1:

[0098] In step C1 , when the second passenger does not exist in the audio data, the volume of all speakers in the vehicle is reduced.

[0099] In this embodiment, when there is no second passenger in the audio data, it is possible that the passenger is on the phone or the information of the communication partner in the current conversation has not been stored in advance. At this time, the volume of all speakers in the vehicle is lowered to ensure that the audio in the car does not affect the hearing between passengers.

[0100] In one embodiment, the method is further implemented as the following steps C2-C3:

[0101] In step C2, the volume corresponding to the audio data of the first passenger is obtained;

[0102] In step C3, when the volume is less than a preset volume, the volume of all speakers in the vehicle is reduced.

[0103] In this embodiment, in case the passenger's voice is too low, in order to ensure that the conversation can be heard, the volume corresponding to the audio data emitted by the first passenger is obtained, and when the volume is less than the preset volume, the volume of all speakers in the vehicle is reduced.

[0104] Furthermore, different preset volume values ​​can also be set for the elderly and children. For example, the preset relationship table can be queried through voiceprint information or face information to obtain the passenger's age, or the passenger's age can be predicted through face recognition. When the obtained or predicted passenger age is not in the preset age range (such as 6-75 years old), the volume corresponding to the sound made by the passenger is obtained; when the volume is less than the preset volume, the volume of all speakers in the vehicle is reduced.

[0105] In one embodiment, the above step S102 may be implemented as the following steps D1-D3:

[0106] In step D1, the audio data is identified to determine whether there are keywords representing the title in the audio data;

[0107] In step D2, when a keyword representing a title exists in the audio data, it is determined whether there is a passenger corresponding to the keyword on the bus;

[0108] In step D3, when there is a passenger corresponding to the keyword on the bus, it is determined that there is a second passenger in the audio data.

[0109] In this embodiment, in order to determine whether the first passenger is communicating, the audio data of the first passenger is identified to determine whether there are keywords representing the title in the audio data. The keywords representing the title may be names or titles, such as nouns such as Dad, Mom, and Xiao Wang.

[0110] When there are keywords representing the title in the audio data, it is determined whether there are passengers corresponding to the keywords on the bus. Specifically, the corresponding passenger identity can be determined directly based on the keywords. For example, for keywords such as names that can directly determine the identity of passengers, it is determined whether the keywords representing the title exist in the identity correspondence table, wherein the identity correspondence table at least contains the correspondence between the keywords and facial information; when the keywords representing the title exist in the identity correspondence table, the facial information corresponding to the keywords is determined; the facial images of all passengers on the bus are obtained to determine whether there are passengers on the bus whose facial information matches the keywords; when there are passengers on the bus whose facial information matches the keywords, there are passengers corresponding to the keywords on the bus. In addition, when the identity of the corresponding passenger cannot be determined directly based on the keyword, for example, for keywords such as "dad" and "mom" that represent the identity relationship between passengers, the identity information of the first passenger is first determined, for example, the passenger identity information is determined by querying the identity correspondence table, wherein the identity correspondence table contains a correspondence between voiceprint information, facial information, passenger identity information, and the identity relationship between each passenger identity information; then, based on the keyword, the facial information corresponding to the keyword is determined according to the identity relationship between the passenger's identity information and each passenger identity information; thereafter, the facial images of all passengers on the bus are obtained to determine whether there is a passenger on the bus whose facial information matches the keyword; when there is a passenger on the bus whose facial information matches the keyword, there is a passenger corresponding to the keyword on the bus.

[0111] Finally, when there is a passenger corresponding to the keyword in the car, it is determined that there is a second passenger in the audio data, and the passenger whose face information matches the keyword is the designated object. Then, based on the passenger's voice, it is determined whether the current speaking object is in the car, that is, whether the current first passenger is having a conversation with a passenger in the car, and the communication object of the conversation is determined.

[0112] In one embodiment, the method is further implemented as the following steps E1-E2:

[0113] In step E1, a target position where the first passenger is located is obtained, and audio data of the first passenger at the target position is monitored;

[0114] In step E2, when the audio data of the first passenger is not detected within a preset time threshold, the volume of all speakers in the vehicle is restored.

[0115] In this embodiment, the target position of the first passenger is obtained, and the audio data of the first passenger at the target position is monitored; wherein, the target position of the passenger can be determined by sound source localization technology, or the first passenger can be determined by matching the collected sound with the lip shape information of the passengers on the vehicle, thereby determining the target position of the passenger.

[0116] When the audio data of the first passenger is not detected within the preset time threshold, the volume of all speakers in the vehicle is restored. Specifically, when the first passenger is speaking, continuous monitoring is performed, and when the audio data of the first passenger is not detected within the preset time threshold, it means that the first passenger has finished speaking, and the volume of all speakers in the vehicle is restored, thereby reducing the disturbance to the passengers in listening to the audio information.

[0117] In one embodiment, when the first passenger has the vehicle owner's authority, the above step E1 can be implemented as the following steps E11-E14:

[0118] In step E11, target voiceprint information corresponding to the audio data of the first passenger is obtained;

[0119] In step E12, a third preset relationship table is queried according to the target voiceprint information to obtain target face information corresponding to the target voiceprint information, wherein the third preset relationship table at least contains a corresponding relationship between voiceprint information and face information;

[0120] In step E13, a recognition result including the corresponding relationship between the face of each passenger in the vehicle and the position of the face is obtained through a camera, and the recognition result is matched with the target face information to determine the position of the target face information;

[0121] In step E14, when the seat pressure collected by the seat pressure sensor at the location where the target facial information is located is greater than the preset pressure, the location where the target facial information is located is determined to be the target location where the first passenger is located.

[0122] Figure 2 This is a schematic structural diagram of a speaker control device in an embodiment of the present application, comprising:

[0123] The collection module 201 is used to determine whether the first passenger has the vehicle owner authority when the audio data of the first passenger is collected in the case where the vehicle plays audio;

[0124] The identification module 202 is used to identify the audio data and determine whether there is a second passenger in the audio data when the first passenger has the vehicle owner authority, wherein the second passenger is a passenger in the current vehicle;

[0125] The reduction module 203 is used to determine the seating position of a second passenger when the audio data contains the second passenger, and to reduce the volume of the speaker corresponding to the seating position of the second passenger; wherein the correspondence between the seat and the speaker is preset.

[0126] In one embodiment, the acquisition module includes:

[0127] An acquisition submodule, used to acquire voiceprint information corresponding to the audio data of the first passenger;

[0128] A first judgment submodule, configured to traverse a first preset relationship table according to the voiceprint information to determine whether the voiceprint information is registered voiceprint information, wherein the first preset relationship table at least includes a correspondence between the voiceprint information and the passenger identity information;

[0129] The first determination submodule is used to determine that the first passenger has the vehicle owner authority when it is determined that the voiceprint information is registered voiceprint information.

[0130] In one embodiment, the acquisition module includes:

[0131] A collection submodule, used for collecting facial information of the first passenger through a camera;

[0132] A second determination submodule is used to determine whether the facial information is stored in a second preset relationship table, wherein the second preset relationship table at least includes a correspondence between facial information and passenger identity information;

[0133] The second determination submodule is used to determine that the first passenger is a user with vehicle owner authority when the facial information exists in the second preset relationship table.

[0134] In one embodiment, the reducing module is further used for:

[0135] When the second passenger is not present in the audio data, the volume of all speakers in the vehicle is reduced.

[0136] In one embodiment, the identification module includes:

[0137] An identification submodule, used to identify the audio data to determine whether there are keywords representing the title in the audio data;

[0138] A third judgment submodule is used to judge whether there is a passenger corresponding to the keyword on the bus when there is a keyword representing the title in the audio data;

[0139] The third determination submodule is used to determine whether there is a second passenger in the audio data when there is a passenger corresponding to the keyword on the bus.

[0140] In one embodiment, the apparatus further comprises:

[0141] an acquisition module, used to acquire a target position where the first passenger is located, and monitor the audio data of the first passenger at the target position;

[0142] The recovery module is used to restore the volume of all speakers in the vehicle when the audio data of the first passenger is not detected within a preset time threshold.

[0143] In one embodiment, the acquisition module includes:

[0144] An acquisition submodule, used to acquire target voiceprint information corresponding to the audio data of the first passenger;

[0145] A query submodule, querying a third preset relationship table according to the target voiceprint information to obtain the target face information corresponding to the target voiceprint information, wherein the third preset relationship table at least contains the corresponding relationship between the voiceprint information and the face information;

[0146] A matching submodule, used to obtain a recognition result of the corresponding relationship between the face of each passenger in the vehicle and the position of the face through a camera, and match the recognition result with the target face information to determine the position of the target face information;

[0147] The fourth determination submodule is used to determine that the location of the target facial information is the target location of the first passenger when the seat pressure collected by the seat pressure sensor at the location of the target facial information is greater than a preset pressure.

[0148] Figure 3 FIG. 1 is a schematic diagram of the hardware structure of a speaker control system in an embodiment of the present application. Figure 3 As shown, the speaker control system comprises:

[0149] at least one processor 320; and,

[0150] A memory 304 in communication with the at least one processor 320; wherein,

[0151] The memory 304 stores instructions that can be executed by the at least one processor 320 , and the instructions are executed by the at least one processor 320 to implement the speaker control method described in any of the above embodiments.

[0152] Reference Figure 3, the speaker control system 300 may include one or more of the following components: a processing component 302 , a memory 304 , a power component 306 , a multimedia component 308 , an audio component 310 , an input / output (I / O) interface 312 , a sensor component 314 , and a communication component 316 .

[0153] The processing component 302 generally controls the overall operation of the speaker control system 300. The processing component 302 may include one or more processors 320 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 302 may include one or more modules to facilitate the interaction between the processing component 302 and other components. For example, the processing component 302 may include a multimedia module to facilitate the interaction between the multimedia component 308 and the processing component 302.

[0154] The memory 304 is configured to store various types of data to support the operation of the speaker control system 300. Examples of such data include instructions for any application or method operating on the speaker control system 300, such as text, pictures, videos, etc. The memory 304 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0155] The power supply component 306 provides power to the various components of the speaker control system 300. The power supply component 306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the speaker control system 300.

[0156] The multimedia component 308 includes a screen that provides an output interface between the speaker control system 300 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 308 may also include a front camera and / or a rear camera. When the speaker control system 300 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0157] The audio component 310 is configured to output and / or input audio signals. For example, the audio component 310 includes a microphone (MIC), and when the speaker control system 300 is in an operation mode, such as an alarm mode, a recording mode, a voice recognition mode, and a voice output mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 304 or sent via the communication component 316. In some embodiments, the audio component 310 also includes a speaker for outputting audio signals.

[0158] I / O interface 312 provides an interface between processing component 302 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0159] The sensor assembly 314 includes one or more sensors for providing various aspects of status assessment for the speaker control system 300. For example, the sensor assembly 314 may include a sound sensor. In addition, the sensor assembly 314 may detect the on / off state of the speaker control system 300, the relative positioning of components, such as the display and keypad of the speaker control system 300, the sensor assembly 314 may also detect the operating state of the speaker control system 300 or a component of the speaker control system 300, such as the operating state of the air distribution plate, the structural state, the operating state of the discharge scraper, etc., the orientation or acceleration / deceleration of the speaker control system 300 and the temperature change of the speaker control system 300. The sensor assembly 314 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 314 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, a material stack thickness sensor or a temperature sensor.

[0160] The communication component 316 is configured to enable the speaker control system 300 to provide the ability to communicate with other devices and cloud platforms in a wired or wireless manner. The speaker control system 300 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 316 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 316 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0161] In an exemplary embodiment, the speaker control system 300 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the speaker control method described in any of the above embodiments.

[0162] The present application also provides a computer-readable storage medium. When the instructions in the storage medium are executed by a processor corresponding to the speaker control system, the speaker control system can implement the speaker control method recorded in any of the above embodiments.

[0163] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0164] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0165] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0166] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0167] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A speaker control method, characterized in that: include: In the case of audio playback in the vehicle, when audio data of the first passenger is collected, determining whether the first passenger has the vehicle owner authority; When the first passenger has the vehicle owner's authority, identifying the audio data and determining whether there is a second passenger in the audio data, wherein the second passenger is a passenger in the current vehicle; When there is a second passenger in the audio data, the seating position of the second passenger is determined, and the volume of the speaker corresponding to the seating position of the second passenger is reduced; wherein the correspondence between the seat and the speaker is preset.

2. The method according to claim 1, characterized in that The determining whether the first passenger has the vehicle owner authority includes: Obtaining voiceprint information corresponding to the audio data of the first passenger; Traversing a first preset relationship table according to the voiceprint information to determine whether the voiceprint information is registered voiceprint information, wherein the first preset relationship table at least includes a correspondence between the voiceprint information and the passenger identity information; When it is determined that the voiceprint information is registered voiceprint information, it is determined that the first passenger has the vehicle owner's authority.

3. The method according to claim 1, characterized in that The determining whether the first passenger has the vehicle owner authority includes: Collecting the facial information of the first passenger through a camera; Determining whether the facial information is stored in a second preset relationship table, wherein the second preset relationship table at least includes a correspondence between facial information and passenger identity information; When the facial information exists in the second preset relationship table, it is determined that the first passenger is a user with vehicle owner authority.

4. The method according to claim 1, characterized in that The method further comprises: When the second passenger is not present in the audio data, the volume of all speakers in the vehicle is reduced.

5. The method according to claim 1, characterized in that: The identifying the audio data and determining whether there is a second passenger in the audio data includes: Identify the audio data to determine whether there are keywords representing the title in the audio data; When the keyword representing the title exists in the audio data, determining whether there is a passenger corresponding to the keyword on the bus; When there is a passenger corresponding to the keyword in the car, it is determined that there is a second passenger in the audio data.

6. The method according to claim 1, characterized in that The method further comprises: Acquire a target location of the first passenger, and monitor audio data of the first passenger at the target location; When the audio data of the first passenger is not detected within a preset time threshold, the volume of all speakers in the vehicle is restored.

7. The method according to claim 6, characterized in that When the first passenger has the vehicle owner's authority, obtaining the target location of the first passenger includes: Obtaining target voiceprint information corresponding to the audio data of the first passenger; querying a third preset relationship table according to the target voiceprint information to obtain target face information corresponding to the target voiceprint information, wherein the third preset relationship table at least contains a corresponding relationship between voiceprint information and face information; Obtaining a recognition result of the correspondence between the face of each passenger in the vehicle and the location of the face through a camera, and matching the recognition result with the target face information to determine the location of the target face information; When the seat pressure collected by the seat pressure sensor at the location where the target facial information is located is greater than the preset pressure, the location where the target facial information is located is determined to be the target location where the first passenger is located.

8. A speaker control device, characterized in that: include: A collection module, used for determining whether the first passenger has the vehicle owner's authority when collecting the audio data of the first passenger in the case of audio playback in the vehicle; an identification module, configured to identify the audio data and determine whether there is a second passenger in the audio data when the first passenger has the vehicle owner's authority, wherein the second passenger is a passenger in the current vehicle; A lowering module is used to determine the seating position of a second passenger when the second passenger exists in the audio data, and to lower the volume of a speaker corresponding to the seating position of the second passenger; wherein the correspondence between the seat and the speaker is preset.

9. A speaker control system, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to implement the speaker control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor corresponding to the speaker control system, the speaker control system can implement the speaker control method according to any one of claims 1 to 7.

Images