Vehicle voice instruction response method and device, equipment and storage medium

Abstract

The invention relates to the technical field of intelligent cabins, and discloses a vehicle voice instruction response method, device and equipment and a storage medium, and the method comprises the steps: determining a current working mode of a distributed microphone array disposed on a vehicle based on a current operation state of the vehicle; wherein the distributed microphone array comprises first microphones arranged on the outer sides of all vehicle doors of the vehicle and second microphones arranged in all preset areas in the vehicle; according to the current working mode, whether the vehicle is controlled to respond to a voice instruction collected by the distributed microphone array or not is judged. By applying the technical scheme of the invention, accurate recognition of sound sources inside and outside the vehicle can be realized in different running states of the vehicle, so that whether to respond to the voice instruction is judged, and the accuracy and safety of vehicle voice instruction response are improved.

Description

Technical Field

[0001] The present application relates to the field of smart cockpit technology, and in particular to a vehicle voice command response method, device, equipment and storage medium. Background Art

[0002] At present, the process of automobile electrification and intelligence is changing with each passing day, and the human-computer interaction is deeply integrated, bringing convenient and comfortable experience to the people in the car. Among them, voice control commands can perform more functions in smart electric vehicles and are the core embodiment of automobile ecological intelligence. In actual applications, voice assistants can recognize people by voice and identify and act on commands issued in different sound zones in the car, but voice commands from outside the car can also be recognized through the windows and perform related actions (open / close windows, adjust volume, location navigation, etc.), which poses a great safety hazard to the vehicle.

[0003] Therefore, it is urgent to provide a technical solution to solve the above problems. Summary of the invention

[0004] In view of the above problems, the present application provides a vehicle voice command response method, device, equipment and storage medium to solve the problem in the prior art that voice commands inside and outside the vehicle cannot be accurately responded to.

[0005] According to one aspect of an embodiment of the present application, a vehicle voice command response method is provided, the method comprising:

[0006] Based on the current running state of the vehicle, determining the current working mode of the distributed microphone array arranged on the vehicle; wherein the distributed microphone array includes: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle;

[0007] According to the current working mode, it is determined whether to control the vehicle to respond to the voice command collected by the distributed microphone array.

[0008] In an optional manner, the current operating state includes: at least one of: a current vehicle speed, a current window state, and a current vehicle lock state; the step of determining the current operating mode of the distributed microphone array arranged on the vehicle based on the current operating state of the vehicle further includes:

[0009] When the current vehicle lock state is closed or the current vehicle window state is closed, determining that the current working mode is the first working mode; the first working mode is: turning off all first microphones and turning on all second microphones;

[0010] When the current vehicle speed is lower than a first threshold and the current window state is open, the current operating mode is determined to be a second operating mode; the second operating mode is: turning on all first microphones and all second microphones.

[0011] In an optional manner, the step of determining whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode further includes:

[0012] When the current working mode is the first working mode, if at least one second microphone collects the voice command, controlling the vehicle to respond to the voice command;

[0013] When the current working mode is the second working mode, if at least one first microphone and at least one second microphone collect the voice command, the sound source position corresponding to the voice command is determined according to the sound source intensity and collection time when each first microphone and each second microphone collects the voice command, and based on the sound source position, it is determined whether to control the vehicle to respond to the voice command.

[0014] In an optional manner, the step of determining whether to control the vehicle to respond to the voice command according to the sound source position further includes:

[0015] If the sound source is located outside the vehicle and it is detected that there is someone in the vehicle, confirmation information of the external voice command input is output through the large screen inside the vehicle, and a real-time image at the sound source location is output and displayed through the large screen inside the vehicle; or, if the sound source is located outside the vehicle and it is detected that there is no one in the vehicle, a real-time image at the sound source location is collected using a camera arranged on the vehicle, and confirmation information of the external voice command input and the real-time image are sent to a terminal device associated with the vehicle;

[0016] When the user responds to the confirmation information, the vehicle is controlled to respond to the voice command; when the user does not respond to the confirmation information, the vehicle is controlled not to respond to the voice command.

[0017] In an optional manner, the step of determining whether to control the vehicle to respond to the voice command according to the sound source position further includes:

[0018] If the sound source is located inside the vehicle, the vehicle is controlled to respond to the voice command.

[0019] In an optional manner, the method further includes:

[0020] When the current vehicle speed is lower than a third threshold, each speaker is controlled to emit a prompt message for prompting pedestrian safety.

[0021] In an optional manner, the method further includes:

[0022] Performing voiceprint recognition on the voice command pair to obtain a voiceprint matching result corresponding to the voice command;

[0023] When the voiceprint matching result is a successful match, the step of determining whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode is executed.

[0024] According to another aspect of an embodiment of the present application, a vehicle voice command response device is provided, comprising:

[0025] A determination module, configured to determine a current operating mode of a distributed microphone array arranged on the vehicle based on a current operating state of the vehicle; wherein the distributed microphone array comprises: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle;

[0026] A response module is used to determine whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode.

[0027] According to another aspect of an embodiment of the present application, a vehicle voice command response device is provided, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus;

[0028] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the operation of the vehicle voice command response method of the present invention.

[0029] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein the storage medium stores at least one executable instruction, wherein the executable instruction enables a vehicle voice command response device / equipment to perform operations such as the vehicle voice command response method of the present invention.

[0030] The embodiment of the present application determines the current operating mode of the distributed microphone array arranged on the vehicle based on the current operating state of the vehicle; wherein the distributed microphone array includes: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle; according to the current operating mode, it is determined whether to control the vehicle to respond to the voice command collected by the distributed microphone array, and it can realize accurate identification of the sound sources inside and outside the vehicle under different operating states of the vehicle, so as to determine whether to respond to the voice command, thereby improving the accuracy and safety of the vehicle's voice command response.

[0031] The above description is only an overview of the technical solution of the embodiment of the present application. In order to more clearly understand the technical means of the embodiment of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings are only used to illustrate the embodiments and are not to be considered as limiting the present application. In addition, the same reference symbols are used to represent the same components throughout the accompanying drawings. In the accompanying drawings:

[0033] Figure 1 A schematic diagram showing a flow chart of an embodiment of a vehicle voice command response method provided by the present application;

[0034] Figure 2 A schematic diagram showing the structure of an embodiment of a vehicle voice command response device provided by the present application is shown;

[0035] Figure 3 A schematic structural diagram of an embodiment of a vehicle voice command response device provided by the present application is shown. DETAILED DESCRIPTION

[0036] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0037] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0038] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0039] The term "multiple" as used in this application refers to two or more than two. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship.

[0040] At present, the process of automobile electrification and intelligence is changing with each passing day, and human-computer interaction is deeply integrated, bringing convenient and comfortable experience to people in the car. Among them, voice control commands can execute more functions in smart electric vehicles and are the core embodiment of automobile ecological intelligence. In actual applications, voice assistants can recognize people by voice and identify and act on commands issued in different sound zones in the car, but voice commands from outside the car can also be recognized through the windows and perform related actions (open / close windows, adjust volume, position navigation, etc.), posing a great safety hazard to the vehicle. Based on this:

[0041] Figure 1 The flowchart of the first embodiment of the vehicle voice command response method provided by the present application is shown, and the method is executed by the vehicle voice command response device. Figure 1 As shown, the method comprises the following steps:

[0042] Step S110: Based on the current operating state of the vehicle, determine the current operating mode of the distributed microphone array deployed on the vehicle.

[0043] Among them, the vehicle in this embodiment is an electric vehicle by default, and it can also be a hybrid vehicle, without any limitation. The current operating state refers to: the various states exhibited by the vehicle at the current moment when it is driving or stationary, and these states can be monitored and recorded by various systems and sensors of the vehicle. The distributed microphone array includes: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle. The vehicle has different working modes corresponding to different operating states.

[0044] It should be noted that the number of first microphones in this embodiment is four by default, which are respectively arranged on the outside of the main driver's door, the outside of the co-driver's door, the outside of the second row of left doors, and the outside of the second row of right doors, forming four independent sound zones outside the vehicle. The specific setting positions are not limited here. For example, the first microphone is set at the outside handle of each door. The number of second microphones in this embodiment is four or six by default, and they are distributed in four or six sound zones. When the vehicle adopts a four-sound zone distribution to set the second microphone, the preset areas inside the vehicle are: main driver, co-driver, left rear row, and right rear row; when the vehicle adopts a six-sound zone distribution to set the second microphone, the preset areas inside the vehicle are: main driver, co-driver, left rear row, right rear row, middle rear row, roof or a specific location (such as trunk, depending on the vehicle model).

[0045] Step S120: According to the current working mode, determine whether to control the vehicle to respond to the voice command collected by the distributed microphone array.

[0046] Among them, voice commands include: display commands (such as safety setting interface commands, telephone operation commands, navigation commands and media commands, etc.), operation commands (start, shut down, accelerate, decelerate, turn, etc.), question-and-answer commands (usually used to obtain vehicle status information or perform simple voice interaction tasks), etc. The voice commands issued by the user can be collected by at least one microphone in the distributed microphone array. If multiple microphones of the vehicle collect the same voice command, the voice command collected by the microphone closest to the sound source is used by default. If multiple microphones of the vehicle collect different voice commands respectively, the vehicle detects multiple sound source positions at this time, and uses time-frequency analysis, beamforming, independent component analysis (ICA), deep learning and other technologies to decompose the mixed multiple voice commands into multiple independent voice commands, and separate the voice commands from different sound sources so that different microphones can collect corresponding voice commands. For example, the voice commands of the main driver, co-driver, and rear passengers are separated into different channels for subsequent processing.

[0047] The technical solution of this embodiment can realize accurate recognition of sound sources inside and outside the vehicle under different operating conditions of the vehicle, thereby determining whether to respond to voice commands, thereby improving the accuracy and safety of the vehicle's voice command response.

[0048] In an optional manner, the current operating state includes at least one of the current vehicle speed, the current window state and the current vehicle lock state, which can be collected in real time by the vehicle-mounted ECU unit and the vehicle-mounted VIU unit. Step S110 further includes:

[0049] When the current vehicle lock state is closed or the current vehicle window state is closed, the current operating mode is determined to be the first operating mode.

[0050] The first working mode is: turning off all first microphones and turning on all second microphones. When the windows are completely closed or the vehicle is locked (including locking during operation and locking at rest), the sound source outside the vehicle is isolated and filtered, and the first microphone outside the vehicle does not need to work.

[0051] When the current vehicle speed is lower than a first threshold and the current window state is open, the current operating mode is determined to be the second operating mode.

[0052] The second working mode is: all first microphones and all second microphones are turned on. The first threshold is 10km / h by default, which usually means that the vehicle is idling or temporarily stopped. The first threshold can also be adjusted according to actual conditions and is not limited here. When the window is open (not closed) and the vehicle is idling or temporarily stopped, all microphones are turned on to work.

[0053] In the above optional method, the start and stop status of the microphone in the distributed microphone array is further determined according to the vehicle speed, window status and lock status, which can dynamically filter the voice commands outside the vehicle, enrich the interaction between inside and outside the vehicle, and improve the accuracy and safety of the vehicle's voice command response.

[0054] In an optional manner, step S120 further includes:

[0055] When the current working mode is the first working mode, if at least one second microphone collects the voice command, the vehicle is controlled to respond to the voice command.

[0056] If only one second microphone collects a voice command, the vehicle is directly controlled to respond to the voice command collected by the second microphone. If multiple second microphones collect the same voice command, the vehicle is controlled to respond to the voice command collected by the second microphone closest to the sound source. If multiple second microphones collect different voice commands, they respond to different voice commands according to the order of collection time.

[0057] When the current operating mode is the second operating mode, if at least one first microphone and at least one second microphone collect the voice command, the sound source position corresponding to the voice command is determined according to the sound source intensity and the collection time when each first microphone and each second microphone collects the voice command, and based on the sound source position, it is determined whether to control the vehicle to respond to the voice command.

[0058] When a user (sound source) makes a sound, the sound wave propagates to each microphone in the distributed microphone array. Since the distance from the sound source to each microphone is different, the time it takes for the sound to reach each microphone will be different. By measuring these time differences and sound pressure level differences and other parameters, and using relevant algorithms (such as beamforming algorithms, minimum mean square error algorithms, etc.), the location of the sound source can be calculated.

[0059] In the above optional methods, the method of responding to voice commands in different working modes is further clarified, thereby improving the accuracy and safety of vehicle voice command responses.

[0060] In an optional manner, the step of determining whether to control the vehicle to respond to the voice command according to the sound source position further includes:

[0061] If the sound source is located outside the vehicle and it is detected that there is someone in the vehicle, confirmation information of the external voice command input is output through the large screen inside the vehicle, and the real-time image at the sound source location is displayed through the large screen inside the vehicle; or, if the sound source is located outside the vehicle and it is detected that there is no one in the vehicle, the real-time image at the sound source location is collected by the camera arranged on the vehicle, and confirmation information of the external voice command input and the real-time image are sent to the terminal device associated with the vehicle.

[0062] Among them, when there is someone in the car, the confirmation information is a text prompt box output by the large screen in the car, which is used to prompt the user in the car whether to respond to the input voice command. The real-time image is output and displayed in real time through the large screen in the car to assist the user in the car to make a judgment. When there is no one in the car, the confirmation information is a prompt information output by the terminal device (such as a mobile phone) associated with the vehicle, which is used to prompt the owner whether to respond to the input voice command. The real-time image is output and displayed in real time through the terminal device to assist the user in the car to make a judgment.

[0063] When the user responds to the confirmation information, the vehicle is controlled to respond to the voice command; when the user does not respond to the confirmation information, the vehicle is controlled not to respond to the voice command.

[0064] If the sound source is located inside the vehicle, the vehicle is controlled to respond to the voice command.

[0065] Among them, if the sound source is located inside the vehicle, the vehicle is controlled to respond to the voice command according to the response rule corresponding to the first working mode.

[0066] It should be noted that if the sound source is located outside the vehicle, and before executing the step of outputting the confirmation information of the external voice command input, the voiceprint recognition can be directly performed on the voice command; if the voice command passes the voiceprint match, the vehicle is directly controlled to respond to the voice command; if the voice command does not pass the voiceprint match, the step of outputting the confirmation information of the external voice command input through the large screen inside the vehicle or the step of sending the confirmation information of the external voice command input to the terminal device associated with the vehicle is executed.

[0067] In the above optional method, the specific process of determining whether to control the vehicle to respond to voice commands based on the location of the sound source is further clarified. After identifying unfamiliar voice commands outside the vehicle, the personal information can be recorded in combination with the external camera and displayed on the car screen to assist the driver and passengers in making judgments, thereby improving the accuracy and safety of the vehicle's voice command responses.

[0068] In an optional manner, each door of the vehicle is further provided with a speaker on its outer side, the number of the speakers is the same as the number of the first microphones, and the speakers are arranged at positions close to the first microphones. The method further includes:

[0069] When the current vehicle speed is higher than a second threshold, each first microphone is controlled to collect a wind noise signal at a corresponding layout position, and each speaker is controlled to emit a sound wave with a phase opposite to that of the wind noise signal at the corresponding layout position and the same amplitude, so as to reduce the wind noise of the vehicle.

[0070] The second threshold is set to 80km / h by default, which usually means that the vehicle is in a high-speed driving state. The second threshold can also be adjusted according to actual conditions and is not limited here. Each first microphone collects a wind noise signal at a corresponding layout position, and controls each speaker to emit a sound wave with the opposite phase and the same amplitude as the wind noise signal at the corresponding layout position, so that the two sound waves cancel each other when they meet, thereby achieving a vehicle noise reduction effect.

[0071] In an optional manner, the method further includes:

[0072] When the current vehicle speed is lower than a third threshold, each speaker is controlled to emit a prompting message for prompting pedestrian safety.

[0073] The second threshold is 30km / h by default, which usually means that the vehicle is in a low-speed driving state. The third threshold can also be adjusted according to actual conditions and is not limited here.

[0074] In the above optional methods, by further adding speakers, functions such as high-speed active noise reduction and interaction between inside and outside the vehicle can be achieved.

[0075] In an optional manner, the method further includes:

[0076] Perform voiceprint recognition on the voice command pair to obtain a voiceprint matching result corresponding to the voice command.

[0077] Among them, the process of voiceprint recognition for voice command pairs includes: ① preprocessing the voice command (the preprocessing method includes: silence removal, noise suppression and other steps to eliminate background noise and non-human voice parts and retain effective voice) to obtain the preprocessed voice signal; ② extracting acoustic features from the preprocessed voice signal to obtain the first voice feature. This process converts the preprocessed voice signal into a series of voice feature parameters that can describe the sound characteristics. Voice feature parameters include acoustic features (such as inverse spectrum, Mel frequency cepstral coefficient MFCC), lexical features, prosodic features, etc. ③ purifying the first voice feature to obtain the second voice feature. ④ Using a trained deep learning model (such as DNN-ivector system, end-to-end CNN system, etc.) to identify the second voice feature, obtain the target voice feature. ⑤ Using a preset algorithm (dynamic time warping (DTW), hidden Markov model (HMM), Gaussian mixture model (GMM), etc.), compare the target voice feature with the preset voiceprint feature in the preset database to obtain the voiceprint matching result corresponding to the voice command.

[0078] When the voiceprint matching result is a successful match, the step of determining whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode is executed.

[0079] In the above optional method, further through voiceprint entry and recognition, it is convenient for vehicle users to implement commands outside the vehicle, and it can avoid interference from voice commands of strangers, thereby improving the convenience and safety of vehicle voice command response.

[0080] It should be noted that in this embodiment, a shielding mode for shielding voice commands outside the vehicle can also be set through the setting function of the vehicle's large screen or through the voice assistant. At this time, if the sound source is determined to be outside the vehicle, the command will be automatically filtered and shielded, and the voice command will not be responded to.

[0081] Figure 2 The structure diagram of the embodiment of the vehicle voice command response device provided by the present application is shown. Figure 2 As shown, the device 300 includes: a determination module 310 and a response module 320.

[0082] The determination module 310 is used to determine the current working mode of the distributed microphone array arranged on the vehicle based on the current running state of the vehicle; wherein the distributed microphone array includes: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle;

[0083] The response module 320 is used to determine whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode.

[0084] In an optional manner, the current operating state includes: at least one of: a current vehicle speed, a current window state, and a current vehicle lock state; the determination module 310 is specifically used to:

[0085] When the current vehicle lock state is closed or the current vehicle window state is closed, determining that the current working mode is the first working mode; the first working mode is: turning off all first microphones and turning on all second microphones;

[0086] When the current vehicle speed is lower than a first threshold and the current window state is open, the current operating mode is determined to be a second operating mode; the second operating mode is: turning on all first microphones and all second microphones.

[0087] In an optional manner, the response module 320 is specifically configured to:

[0088] When the current working mode is the first working mode, if at least one second microphone collects the voice command, controlling the vehicle to respond to the voice command;

[0089] When the current working mode is the second working mode, if at least one first microphone and at least one second microphone collect the voice command, the sound source position corresponding to the voice command is determined according to the sound source intensity and collection time when each first microphone and each second microphone collects the voice command, and based on the sound source position, it is determined whether to control the vehicle to respond to the voice command.

[0090] In an optional manner, the response module 320 is further configured to:

[0091] If the sound source is located outside the vehicle and it is detected that there is someone in the vehicle, confirmation information of the external voice command input is output through the large screen inside the vehicle, and a real-time image at the sound source location is output and displayed through the large screen inside the vehicle; or, if the sound source is located outside the vehicle and it is detected that there is no one in the vehicle, a real-time image at the sound source location is collected using a camera arranged on the vehicle, and confirmation information of the external voice command input and the real-time image are sent to a terminal device associated with the vehicle;

[0092] When the user responds to the confirmation information, the vehicle is controlled to respond to the voice command; when the user does not respond to the confirmation information, the vehicle is controlled not to respond to the voice command.

[0093] In an optional manner, the response module 320 is further configured to:

[0094] If the sound source is located inside the vehicle, the vehicle is controlled to respond to the voice command.

[0095] In an optional manner, the device 300 further includes: a prompt module; the prompt module is used to:

[0096] When the current vehicle speed is lower than a third threshold, each speaker is controlled to emit a prompt message for prompting pedestrian safety.

[0097] In an optional manner, the device 300 further includes: a voiceprint recognition module; the voiceprint recognition module is used to:

[0098] Performing voiceprint recognition on the voice command pair to obtain a voiceprint matching result corresponding to the voice command;

[0099] When the voiceprint matching result is a successful match, the response module 320 is called.

[0100] The technical solution of this embodiment can realize accurate recognition of sound sources inside and outside the vehicle under different operating conditions of the vehicle, thereby determining whether to respond to voice commands, thereby improving the accuracy and safety of the vehicle's voice command response.

[0101] It should be noted that the vehicle voice command response device provided in the above embodiment and the vehicle voice command response method provided in the above embodiment belong to the same concept, and the specific manner in which each module and unit performs operations has been described in detail in the method embodiment and will not be repeated here.

[0102] Figure 3 A structural schematic diagram of an embodiment of a vehicle voice command response device provided by the present application is shown, which shows a structural schematic diagram of a computer system suitable for implementing the vehicle voice command response device of the embodiment of the present application. The specific embodiment of the present application does not limit the specific implementation of the vehicle voice command response device.

[0103] See also Figure 3 As shown, the vehicle voice command response device includes: a controller; a memory for storing one or more programs, when the one or more programs are executed by the controller, the above-mentioned vehicle voice command response method is executed.

[0104] Please continue reading Figure 3As shown, the computer system 500 of the vehicle voice command response device includes a central processing unit (CPU) 501, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 502 or the program loaded from the storage part 508 to the random access memory (RAM) 503, such as executing the method in the above embodiment. In RAM 503, various programs and data required for system operation are also stored. CPU 501, ROM 502 and RAM 503 are connected to each other through bus 504. Input / output (I / O) interface 505 is also connected to bus 504.

[0105] The following components are connected to the I / O interface 505: an input section 506 including a keyboard, a mouse, etc.; an output section 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed so that a computer program read therefrom is installed into the storage section 508 as needed.

[0106] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 509, and / or installed from a removable medium 511. When the computer program is executed by a central processing unit (CPU) 501, various functions defined in the system of the present application are executed.

[0107] Another aspect of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the vehicle voice command response method described above is implemented. The computer-readable storage medium may be included in the vehicle voice command response device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0108] Another aspect of the present application also provides a computer program product or computer program, which includes at least one executable instruction. When the executable instruction is run on a vehicle voice command response device / equipment, the vehicle voice command response device / equipment executes the vehicle voice command response method as described above.

[0109] The executable instructions may be specifically used to enable the vehicle voice command response device / apparatus to perform the following operations:

[0110] Based on the current running state of the vehicle, determining the current working mode of the distributed microphone array arranged on the vehicle; wherein the distributed microphone array includes: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle;

[0111] According to the current working mode, it is determined whether to control the vehicle to respond to the voice command collected by the distributed microphone array.

[0112] In an optional manner, the current operating state includes: at least one of: a current vehicle speed, a current window state, and a current vehicle lock state; the step of determining the current operating mode of the distributed microphone array arranged on the vehicle based on the current operating state of the vehicle further includes:

[0113] When the current vehicle lock state is closed or the current vehicle window state is closed, determining that the current working mode is the first working mode; the first working mode is: turning off all first microphones and turning on all second microphones;

[0114] When the current vehicle speed is lower than a first threshold and the current window state is open, the current operating mode is determined to be a second operating mode; the second operating mode is: turning on all first microphones and all second microphones.

[0115] In an optional manner, the step of determining whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode further includes:

[0116] When the current working mode is the first working mode, if at least one second microphone collects the voice command, controlling the vehicle to respond to the voice command;

[0117] When the current working mode is the second working mode, if at least one first microphone and at least one second microphone collect the voice command, the sound source position corresponding to the voice command is determined according to the sound source intensity and collection time when each first microphone and each second microphone collects the voice command, and based on the sound source position, it is determined whether to control the vehicle to respond to the voice command.

[0118] In an optional manner, the step of determining whether to control the vehicle to respond to the voice command according to the sound source position further includes:

[0119] If the sound source is located outside the vehicle and it is detected that there is someone in the vehicle, confirmation information of the external voice command input is output through the large screen inside the vehicle, and a real-time image at the sound source location is output and displayed through the large screen inside the vehicle; or, if the sound source is located outside the vehicle and it is detected that there is no one in the vehicle, a real-time image at the sound source location is collected using a camera arranged on the vehicle, and confirmation information of the external voice command input and the real-time image are sent to a terminal device associated with the vehicle;

[0120] When the user responds to the confirmation information, the vehicle is controlled to respond to the voice command; when the user does not respond to the confirmation information, the vehicle is controlled not to respond to the voice command.

[0121] In an optional manner, the step of determining whether to control the vehicle to respond to the voice command according to the sound source position further includes:

[0122] If the sound source is located inside the vehicle, the vehicle is controlled to respond to the voice command.

[0123] In an optional manner, the method further includes:

[0124] When the current vehicle speed is lower than a third threshold, each speaker is controlled to emit a prompting message for prompting pedestrian safety.

[0125] In an optional manner, the method further includes:

[0126] Performing voiceprint recognition on the voice command pair to obtain a voiceprint matching result corresponding to the voice command;

[0127] When the voiceprint matching result is a successful match, the step of determining whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode is executed.

[0128] The technical solution of this embodiment can realize accurate recognition of sound sources inside and outside the vehicle under different operating conditions of the vehicle, thereby determining whether to respond to voice commands, thereby improving the accuracy and safety of the vehicle's voice command response.

[0129] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium can include a data signal propagated in a baseband or as a part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0130] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0131] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0132] According to one aspect of an embodiment of the present application, a computer system is also provided, including a central processing unit (CPU), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage portion into a random access memory (RAM), such as executing the method in the above embodiment. In RAM, various programs and data required for system operation are also stored. CPU, ROM and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0133] The following components are connected to the I / O interface: an input part including a keyboard, a mouse, etc.; an output part including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage part including a hard disk, etc.; and a communication part including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication part performs communication processing via a network such as the Internet. A drive is also connected to the I / O interface as needed. Removable media, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., are installed on the drive as needed so that the computer program read therefrom is installed into the storage part as needed.

[0134] The above content is only a preferred exemplary embodiment of the present application and is not intended to limit the implementation scheme of the present application. A person skilled in the art can easily make corresponding changes or modifications based on the main concept and spirit of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection required by the claims.

Claims

1. A vehicle voice command response method, characterized in that: The steps include: Based on the current running state of the vehicle, determining the current working mode of the distributed microphone array arranged on the vehicle; wherein the distributed microphone array includes: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle; According to the current working mode, it is determined whether to control the vehicle to respond to the voice command collected by the distributed microphone array.

2. The vehicle voice command response method according to claim 1, characterized in that: The current operating state includes: at least one of a current vehicle speed, a current window state, and a current vehicle lock state; the step of determining the current operating mode of the distributed microphone array arranged on the vehicle based on the current operating state of the vehicle further includes: When the current vehicle lock state is closed or the current vehicle window state is closed, determining that the current working mode is the first working mode; the first working mode is: turning off all first microphones and turning on all second microphones; When the current vehicle speed is lower than a first threshold and the current window state is open, the current operating mode is determined to be a second operating mode; the second operating mode is: turning on all first microphones and all second microphones.

3. The vehicle voice command response method according to claim 2, characterized in that: The step of determining whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode further includes: When the current working mode is the first working mode, if at least one second microphone collects the voice command, controlling the vehicle to respond to the voice command; When the current working mode is the second working mode, if at least one first microphone and at least one second microphone collect the voice command, the sound source position corresponding to the voice command is determined according to the sound source intensity and collection time when each first microphone and each second microphone collects the voice command, and based on the sound source position, it is determined whether to control the vehicle to respond to the voice command.

4. The vehicle voice command response method according to claim 3, characterized in that: The step of determining whether to control the vehicle to respond to the voice command according to the sound source position further includes: If the sound source is located outside the vehicle and it is detected that there is someone in the vehicle, confirmation information of the external voice command input is output through the large screen inside the vehicle, and a real-time image at the sound source location is output and displayed through the large screen inside the vehicle; or, if the sound source is located outside the vehicle and it is detected that there is no one in the vehicle, a real-time image at the sound source location is collected using a camera arranged on the vehicle, and confirmation information of the external voice command input and the real-time image are sent to a terminal device associated with the vehicle; When the user responds to the confirmation information, the vehicle is controlled to respond to the voice command; when the user does not respond to the confirmation information, the vehicle is controlled not to respond to the voice command.

5. The vehicle voice command response method according to claim 4, characterized in that: The step of determining whether to control the vehicle to respond to the voice command according to the sound source position further includes: If the sound source is located inside the vehicle, the vehicle is controlled to respond to the voice command.

6. The vehicle voice command response method according to claim 5, characterized in that: The method further comprises: When the current vehicle speed is lower than a third threshold, each speaker is controlled to emit a prompting message for prompting pedestrian safety.

7. The vehicle voice command response method according to any one of claims 1 to 6, characterized in that: The method further comprises: Performing voiceprint recognition on the voice command pair to obtain a voiceprint matching result corresponding to the voice command; When the voiceprint matching result is a successful match, the step of determining whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode is executed.

8. A vehicle voice command response device, characterized in that: The device comprises: A determination module, configured to determine a current operating mode of a distributed microphone array arranged on the vehicle based on a current operating state of the vehicle; wherein the distributed microphone array comprises: a first microphone arranged on the outside of each door of the vehicle and a second microphone arranged in each preset area inside the vehicle; A response module is used to determine whether to control the vehicle to respond to the voice command collected by the distributed microphone array according to the current working mode.

9. A vehicle voice command response device, characterized in that: include: Controller; A memory for storing one or more programs, which, when executed by the controller, enables the controller to implement the vehicle voice command response method described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The storage medium stores at least one executable instruction. When the executable instruction is executed on the vehicle voice command response device / equipment, the vehicle voice command response device / equipment performs the operation of the vehicle voice command response method as described in any one of claims 1-7.

Images