Method and device for controlling vehicle through voice outside vehicle and medium

Abstract

The invention relates to a method and device for controlling a vehicle through voice outside the vehicle and a medium. The method comprises the steps of determining that pedestrians appear near a vehicle; intercepting a face image; judging whether the face image is in an input information base or not; if yes, detecting whether the vehicle is in a dormant state currently; if in the dormant state, waking up the intelligent voice module, the microphone and the loudspeaker to enter a working state; obtaining human voice; judging whether the voice is in an input information base or not; if yes, acquiring a voice instruction; converting the voice instruction into a text through a voice recognition technology; an intelligent voice module is used for understanding the text and generating a control instruction; determining an out-of-vehicle sound area where the sound source position of the voice instruction is located by using a microphone; judging whether the external sound area supports the control instruction or not; the invention provides a method for controlling a vehicle through a voice instruction outside the vehicle. When the vehicle is dormant, the specific part can be opened through the voice instruction, and the vehicle does not need to be started.

Description

Technical Field

[0001] The present disclosure relates to vehicle technology, and more particularly to a method, device and medium for controlling a vehicle through voice outside the vehicle. Background Art

[0002] At present, the in-vehicle voice interaction system, through voice recognition and speech synthesis technology, enables the driver to control various functions of the vehicle through voice commands without having to distract his attention to operate the in-vehicle equipment or touch screen, thereby improving safety and convenience.

[0003] The current in-vehicle voice interaction system only supports in-vehicle intelligent voice, not outside the vehicle; for vehicles with poor sound insulation, commands issued from outside the vehicle will be mistakenly recognized as commands issued in the sound zone inside the vehicle, affecting safety; when the vehicle is in sleep mode, the voice cannot be awakened, and the vehicle must be started before corresponding voice interaction can be performed. Summary of the invention

[0004] The present disclosure provides a method, device and medium for controlling a vehicle through external voice to solve the above technical problems.

[0005] According to a first aspect of the present disclosure, a method for controlling a vehicle by voice outside the vehicle is provided, the method comprising: determining the presence of pedestrians near the vehicle by a surround-view camera; capturing a face image from a panoramic image, wherein the panoramic image is generated by means of a surround-view camera; determining whether the face image is in a recorded information library; if in the recorded information library, detecting whether the vehicle is currently in a dormant state; if the vehicle is currently in a dormant state, waking up an intelligent voice module, and causing a microphone and a speaker arranged outside the vehicle to enter a working state; obtaining a human voice by means of a microphone; determining whether the human voice is in the recorded information library; if in the recorded information library, obtaining a voice command; converting the voice command into text by means of voice recognition technology; understanding the text by means of an intelligent voice module and generating a control command; determining the sound zone outside the vehicle where the sound source of the voice command is located by means of a microphone; determining whether the sound zone outside the vehicle where the sound source of the voice command is located supports the control command; if supported, controlling the vehicle to perform a corresponding action based on the control command; and issuing a control command support prompt message and an execution completion prompt message through a speaker.

[0006] In some embodiments, if the current vehicle is not in a dormant state but in a startup state, a microphone is used to obtain human voice; it is determined whether the human voice is in the recorded information database; if it is in the recorded information database, a voice command is obtained; the voice command is converted into text through voice recognition technology; it is detected whether there is a voice command in the sound zone inside the vehicle; if there is a voice command in the sound zone inside the vehicle, the intelligent voice module is controlled to refuse to understand the text; if there is no voice command in the sound zone inside the vehicle, the intelligent voice module is controlled to understand the text and generate a control command; a microphone is used to determine the sound zone outside the vehicle where the sound source of the voice command is located; it is determined whether the sound zone outside the vehicle where the sound source of the voice command is located supports the control command; if it is supported, the vehicle is controlled to perform corresponding actions based on the control command; and a control command support prompt message and an execution completion prompt message are issued through a speaker.

[0007] In some embodiments, the exterior sound zone includes a front sound zone, a rear sound zone, an exterior main driving sound zone, an exterior co-driving sound zone, an exterior rear left sound zone, and an exterior right right sound zone; the control commands supported by all exterior sound zones include wake-up commands, exterior projection commands, exterior lighting control commands, air conditioning opening and closing commands, navigation commands, media opening commands, seat heating commands, seat ventilation commands, and fragrance opening commands; the control commands supported by the exterior main driving sound zone also include door opening and closing commands, window opening and closing commands, sunshade opening and closing commands, sunroof opening and closing commands, electric tailgate opening and closing commands, front hood opening and closing commands, wiper maintenance position drive commands, and wiper reset commands; the control commands supported only by the exterior main driving sound zone include parking in and out commands, suspension height adjustment commands, four-door lock unlocking commands, and child lock unlocking commands.

[0008] In some embodiments, the in-vehicle sound zone includes an in-vehicle main driver's sound zone, an in-vehicle co-driver's sound zone, an in-vehicle rear left sound zone, and an in-vehicle rear right sound zone.

[0009] According to a second aspect of the present disclosure, a device for controlling a vehicle by voice outside the vehicle is provided, comprising: a pedestrian determination module, for determining the presence of pedestrians near the vehicle by means of a surround-view camera; a face image capture module, for capturing a face image from a panoramic image, wherein the panoramic image is generated by means of a surround-view camera; a face image judgment module, for judging whether the face image is in a recorded information library; a vehicle state detection module, for detecting whether the vehicle is currently in a dormant state if the face image is in the recorded information library; an intelligent voice module wake-up module, for waking up the intelligent voice module if the vehicle is currently in a dormant state, and for causing a microphone and a speaker arranged outside the vehicle to enter a working state; a voice acquisition module, for acquiring a voice by means of a microphone; a voice judgment module, Used to determine whether the human voice is in the recorded information database; a voice command acquisition module, used to obtain the voice command if it is in the recorded information database; a voice command conversion module, used to convert the voice command into text through voice recognition technology; a control command generation module, used to use the intelligent voice module to understand the text and generate control commands; an external sound zone determination module, used to use a microphone to determine the external sound zone where the sound source of the voice command is located; an external sound zone judgment module, used to determine whether the external sound zone where the sound source of the voice command is located supports the control command; a vehicle control module, used to control the vehicle to perform corresponding actions based on the control command if it is supported; a prompt information sending module, used to send control command support prompt information and execution completion prompt information through the speaker.

[0010] According to a third aspect of the present disclosure, a device for controlling a vehicle through external voice is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to execute the method for controlling a vehicle through external voice as described above based on instructions stored in the memory.

[0011] According to a fourth aspect of the present disclosure, a computer storable medium is provided, on which computer program instructions are stored, and when the instructions are executed by a processor, the method for controlling a vehicle by voice outside the vehicle as described above is implemented.

[0012] The beneficial effects of the present invention are as follows: supporting intelligent voice outside the vehicle, and at the same time, designing face recognition and voice recognition mechanisms to ensure that the voice commands outside the vehicle are legal and valid; the microphone outside the vehicle prevents the voice commands outside the vehicle from being mistaken for the voice commands issued inside the vehicle, avoiding unsafe risks; when the vehicle is dormant, the voice commands of pedestrians can be executed without starting the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0014] Figure 1is a flowchart illustrating a method for controlling a vehicle through external voice according to some embodiments of the present disclosure.

[0015] Figure 2 Schematic diagram showing the deployment positions of an off-vehicle microphone and an off-vehicle speaker according to some embodiments of the present disclosure.

[0016] Figure 3 2 is a schematic diagram showing the division of exterior sound zones of a vehicle according to some embodiments of the present disclosure.

[0017] Figure 4 is a flow chart showing a method for controlling a vehicle by external voice when the vehicle is dormant according to other embodiments of the present disclosure.

[0018] Figure 5 is a flow chart showing a method for controlling a vehicle by voice outside the vehicle when the vehicle is started according to some embodiments of the present disclosure.

[0019] Figure 6 is a block diagram showing an apparatus for controlling a vehicle through external voice according to some embodiments of the present disclosure.

[0020] Figure 7 is a block diagram showing an apparatus for controlling a vehicle through external voice according to other embodiments of the present disclosure.

[0021] Figure 8 is a block diagram illustrating a computer system for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0022] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless otherwise specifically stated.

[0023] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0024] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0025] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0026] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0027] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0028] At present, the in-vehicle voice interaction system, through voice recognition and speech synthesis technology, enables the driver to control various functions of the vehicle through voice commands without having to distract his attention to operate the in-vehicle equipment or touch screen, thereby improving safety and convenience.

[0029] The current in-vehicle voice interaction system only supports in-vehicle intelligent voice, not outside the vehicle; for vehicles with poor sound insulation, commands issued from outside the vehicle will be mistakenly recognized as commands issued in the sound zone inside the vehicle, affecting safety; when the vehicle is in sleep mode, the voice cannot be awakened, and the vehicle must be started before corresponding voice interaction can be performed.

[0030] In view of this, the present disclosure proposes a method, device and medium for controlling a vehicle through external voice, which supports external intelligent voice; the external microphone prevents the voice commands outside the vehicle from being mistaken for the voice commands issued inside the vehicle, avoiding unsafe risks; when the vehicle is dormant, the voice commands of pedestrians can be executed without starting the vehicle.

[0031] Figure 1 is a flow chart showing a method for controlling a vehicle by voice outside the vehicle according to some embodiments of the present disclosure. Figure 1 As shown, the method for controlling a vehicle by external voice includes steps 1 to 14.

[0032] In step 1, a surround view camera is used to determine whether a pedestrian is near the vehicle.

[0033] In step 2, a face image is captured from the panoramic image, wherein the panoramic image is generated by means of a surround-view camera;

[0034] In step 3, it is determined whether the face image is in the entered information database;

[0035] In step 4, if in the entered information database, check whether the vehicle is currently in a dormant state;

[0036] In step 5, if the current vehicle is in a dormant state, the intelligent voice module is awakened, and the microphone and speaker disposed outside the vehicle enter a working state;

[0037] In step 6, a human voice is acquired by means of a microphone;

[0038] In step 7, it is determined whether the human voice is in the recorded information database;

[0039] In step 8, if the information is in the input database, obtain the voice command;

[0040] In step 9, the voice command is converted into text by voice recognition technology;

[0041] In step 10, the intelligent voice module is used to understand the text and generate control instructions;

[0042] In step 11, a microphone is used to determine an external sound zone where a sound source of the voice command is located;

[0043] In step 12, it is determined whether the external sound zone where the sound source of the voice command is located supports the control command;

[0044] In step 13, if supported, the vehicle is controlled to perform corresponding actions based on the control command;

[0045] In step 14, a control instruction support prompt message and an execution completion prompt message are sent out through a speaker.

[0046] In some embodiments, if the current vehicle is not in a dormant state but in a startup state, a microphone is used to obtain human voice; it is determined whether the human voice is in the recorded information database; if it is in the recorded information database, a voice command is obtained; the voice command is converted into text through voice recognition technology; it is detected whether there is a voice command in the sound zone inside the vehicle; if there is a voice command in the sound zone inside the vehicle, the intelligent voice module is controlled to refuse to understand the text; if there is no voice command in the sound zone inside the vehicle, the intelligent voice module is controlled to understand the text and generate a control command; a microphone is used to determine the sound zone outside the vehicle where the sound source of the voice command is located; it is determined whether the sound zone outside the vehicle where the sound source of the voice command is located supports the control command; if it is supported, the vehicle is controlled to perform corresponding actions based on the control command; and a control command support prompt message and an execution completion prompt message are issued through a speaker.

[0047] In some embodiments, the exterior sound zone includes a front sound zone, a rear sound zone, an exterior main driving sound zone, an exterior co-driving sound zone, an exterior rear left sound zone, and an exterior right right sound zone; the control commands supported by all exterior sound zones include wake-up commands, exterior projection commands, exterior lighting control commands, air conditioning opening and closing commands, navigation commands, media opening commands, seat heating commands, seat ventilation commands, and fragrance opening commands; the control commands supported by the exterior main driving sound zone also include door opening and closing commands, window opening and closing commands, sunshade opening and closing commands, sunroof opening and closing commands, electric tailgate opening and closing commands, front hood opening and closing commands, wiper maintenance position drive commands, and wiper reset commands; the control commands supported only by the exterior main driving sound zone include parking in and out commands, suspension height adjustment commands, four-door lock unlocking commands, and child lock unlocking commands.

[0048] In some embodiments, the in-vehicle sound zone includes an in-vehicle main driver's sound zone, an in-vehicle co-driver's sound zone, an in-vehicle rear left sound zone, and an in-vehicle rear right sound zone.

[0049] Sound source localization: Identify the sound source of voice commands through microphones deployed in the vehicle.

[0050] Voice partition: Different areas of the vehicle are divided into different partitions. The present disclosure defines 10 voice partitions on the vehicle. Voice zone FL: the main driving voice zone in the vehicle; Voice zone FR: the co-pilot voice zone in the vehicle; Voice zone RL: the rear left voice zone in the vehicle; Voice zone RR: the rear right voice zone in the vehicle; Voice zone OF: the front voice zone; Voice zone OR: the rear voice zone; Voice zone OFL: the main driving voice zone outside the vehicle; Voice zone OFR: the co-pilot voice zone outside the vehicle; Voice zone ORL: the rear left voice zone outside the vehicle; Voice zone ORR: the rear right voice zone outside the vehicle.

[0051] like Figure 2 As shown in the figure, by deploying microphones and speakers outside the car and combining the surround view camera to add 6 voice zones outside the car, the intelligent voice interaction system can effectively recognize and execute voice commands outside the car while supporting the car. At the same time, through the face and voiceprint recognition functions, the security risks brought by voice commands outside the car can be avoided.

[0052] like Figure 2 As shown, a combination of four microphones and speakers are deployed at the front, rear and both sides of the B-pillar.

[0053] like Figure 3 As shown, based on the microphone outside the car, the outside of the car is divided into 6 sound zones, namely OF (front sound zone), OR (rear sound zone), OFL (outside main driver sound zone), OFR (outside co-driver sound zone), ORL (outside rear left sound zone), and ORR (outside rear right sound zone). The maximum distance of each sound zone is 2m.

[0054] The central control screen provides an out-of-car voice mode switch, which can trigger out-of-car intelligent voice only when the switch is turned on; it only supports use by people who have entered their faces and voiceprints. Before entering information of non-car owners or co-users, face recognition of the car owner or co-user will be initiated, and the information entry process can only be entered after successful recognition; the face recognition function is realized by the surround-view camera, the voiceprint recognition function is realized by the out-of-car microphone, and the out-of-car intelligent voice interaction is realized by the out-of-car speakers.

[0055] Voice commands supported by all exterior audio zones: wake-up, exterior projection, exterior lighting control, air conditioning on and off, navigation, media, seat heating, seat ventilation, and fragrance functions. Voice commands supported by the corresponding audio zone or the exterior main driving audio zone: opening and closing of doors / windows / sunshades / sunroof / electric tailgate / front hatch, and wiper repair position function. Voice commands supported only by the main driving audio zone: parking in and out, suspension height adjustment, four-door unlocking, and child lock function.

[0056] like Figure 4As shown, when the vehicle is dormant, it detects whether there are pedestrians near the vehicle; if a pedestrian is detected, facial recognition is triggered; if the recognition is successful, the intelligent voice module is awakened, and the microphone and speaker enter the working state; if the recognition is unsuccessful, the sentinel mode judgment logic is entered; the intelligent voice module is awakened by human voice, and if the awakening is successful, the human voice is recognized; if the recognition is successful, the voice command is obtained, and the voice command is converted into text through voice recognition technology; the intelligent voice module is used to understand the text and generate control commands; the microphone is used to determine the external sound zone where the source position of the voice command is located; it is determined whether the external sound zone where the sound source position of the voice command is located supports the control command; if supported, the vehicle is controlled to perform corresponding actions based on the control command; and the control command support prompt information and execution completion prompt information are issued through the speaker.

[0057] If the wake-up fails, the intelligent voice module will sleep after 15 seconds; if the voice recognition fails, the intelligent voice module will sleep after 15 seconds; if no voice command is obtained, the intelligent voice module will sleep after 15 seconds.

[0058] like Figure 5 As shown, when a pedestrian appears near the vehicle, face recognition is triggered, and the intelligent voice module is awakened by the human voice to determine whether the human voice is in the recorded information database; if it is in the recorded information database, the voice is recognized by voice recognition technology and text is generated; it is detected whether there is a voice command in the sound zone inside the car. If there is a command, it will not respond to the voice command outside the car; if there is no command, the intelligent voice module understands the natural language and generates a control command, and the curtain is controlled to perform the corresponding action based on the control command; the control command support prompt information and the execution completion prompt information are issued through the speaker.

[0059] If there are no pedestrians near the vehicle, the vehicle will not respond; if the human voice is not in the recorded information database, the vehicle will not respond; if there is a voice command in the sound zone inside the car, the priority is higher than the voice command outside the car, the vehicle will not respond to the voice command outside the car, and the voice command inside the car will be executed.

[0060] The microphone outside the car effectively prevents the voice commands outside the car from being mistakenly identified as the sound zone inside the car by the sound source positioning, avoiding the safety risks of use. Add the voice interaction logic outside the car to increase the needs of users for outside car usage scenarios, such as opening the front hood, electric tailgate, digital projector, etc. Add the voice interaction logic when the vehicle is dormant. When the vehicle is dormant, the user issues voice commands such as opening the electric tailgate and front hood, and the user's commands can be executed without starting the vehicle.

[0061] Figure 6 is a block diagram showing an apparatus for controlling a vehicle through voice outside the vehicle according to some embodiments of the present disclosure. Figure 6As shown, the device 200 for controlling a vehicle through external voice includes a pedestrian determination module 201, a face image capture module 202, a face image judgment module 203, a vehicle status detection module 204, an intelligent voice module wake-up module 205, a human voice acquisition module 206, a human voice judgment module 207, a voice instruction acquisition module 208, a voice instruction conversion module 209, a control instruction generation module 210, an external sound zone determination module 211, an external sound zone judgment module 212, a vehicle control module 213, and a prompt information sending module 214.

[0062] A pedestrian determination module 201 is used to determine the presence of pedestrians near the vehicle through a surround view camera;

[0063] A face image capture module 202, used to capture a face image from a panoramic image, wherein the panoramic image is generated with the aid of a surround-view camera;

[0064] The face image determination module 203 is used to determine whether the face image is in the input information database;

[0065] The vehicle state detection module 204 is used to detect whether the vehicle is currently in a dormant state if in the input information database;

[0066] The intelligent voice module awakening module 205 is used to awaken the intelligent voice module if the current vehicle is in a dormant state, and the microphone and speaker arranged outside the vehicle enter a working state;

[0067] A human voice acquisition module 206, used to acquire human voice with the aid of a microphone;

[0068] A human voice determination module 207 is used to determine whether the human voice is in the recorded information database;

[0069] The voice command acquisition module 208 is used to acquire the voice command if it is in the input information database;

[0070] A voice instruction conversion module 209, used to convert the voice instruction into text through voice recognition technology;

[0071] A control instruction generation module 210, for using an intelligent voice module to understand text and generate control instructions;

[0072] An external sound zone determining module 211 is used to determine the external sound zone of the vehicle where the sound source of the voice command is located using a microphone;

[0073] An external sound zone determination module 212 is used to determine whether the external sound zone where the sound source of the voice command is located supports the control command;

[0074] The vehicle control module 213 is used to control the vehicle to perform corresponding actions based on the control instructions if supported;

[0075] The prompt information sending module 214 is used to send control instruction support prompt information and execution completion prompt information through the speaker.

[0076] In the device of the disclosed embodiment, intelligent voice outside the vehicle is supported. At the same time, face recognition and voice recognition mechanisms are designed to ensure that the voice commands outside the vehicle are legal and valid; the microphone outside the vehicle prevents the voice commands outside the vehicle from being mistaken for the voice commands issued inside the vehicle, avoiding unsafe risks; when the vehicle is dormant, the voice commands of pedestrians can be executed without starting the vehicle.

[0077] Figure 7 FIG. 2 is a block diagram showing an apparatus for controlling a vehicle through voice outside the vehicle according to other embodiments of the present disclosure. Figure 7 As shown, the device 300 for controlling a vehicle by voice outside the vehicle includes a memory 310; and a processor 320 coupled to the memory 310. The memory 310 is used to store instructions for executing the corresponding embodiment of the method for controlling a vehicle by voice outside the vehicle. The processor 320 is configured to execute the method for controlling a vehicle by voice outside the vehicle in any of the embodiments of the present disclosure based on the instructions stored in the memory 310.

[0078] Figure 8 is a block diagram showing a computer system for implementing some embodiments of the present disclosure. Figure 8 As shown, computer system 400 may be embodied in the form of a general purpose computing device. Computer system 400 includes memory 410, processor 420, and bus 430 that connects various system components.

[0079] The memory 410 may include, for example, a system memory, a non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application program, a boot loader, and other programs. The system memory may include a volatile storage medium, such as a random access memory (RAM) and / or a cache memory. The non-volatile storage medium may store, for example, instructions for executing at least one of the corresponding embodiments of the method for controlling a vehicle by voice outside the vehicle. The non-volatile storage medium may include, but is not limited to, a disk memory, an optical memory, a flash memory, and the like.

[0080] The processor 420 can be implemented by a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistors and other discrete hardware components. Accordingly, each module such as a pedestrian determination module, a face image capture module, a face image judgment module, a vehicle state detection module, an intelligent voice module wake-up module, a human voice acquisition module, a human voice judgment module, a voice command acquisition module, a voice command conversion module, a control command generation module, a vehicle external sound zone determination module, a vehicle external sound zone judgment module, a vehicle control module, and a prompt information sending module can be implemented by a central processing unit (CPU) running instructions in a memory to execute corresponding steps, or can be implemented by a dedicated circuit to execute corresponding steps.

[0081] The bus 430 may use any of a variety of bus architectures, including, but not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, and a Peripheral Component Interconnect (PCI) bus.

[0082] The computer system 400 may also include an input / output interface 440, a network interface 450, a storage interface 460, etc. These interfaces 440, 450, 460, the memory 410, and the processor 420 may be connected via a bus 430. The input / output interface 440 may provide a connection interface for input / output devices such as a display, a mouse, and a keyboard. The network interface 450 may provide a connection interface for various networked devices. The storage interface 460 may provide a connection interface for external storage devices such as a floppy disk, a USB flash drive, and an SD card.

[0083] Here, various aspects of the present disclosure are described with reference to flowcharts and / or block diagrams of methods, devices, and computer program products according to embodiments of the present disclosure. It should be understood that each frame of the flowchart and / or block diagram and the combination of frames can be implemented by computer-readable program instructions.

[0084] These computer-readable program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable device to produce a machine, so that the processor executes the instructions to produce means for implementing the functions specified in one or more blocks in the flowchart and / or block diagram.

[0085] These computer-readable program instructions may also be stored in a computer-readable memory, which cause the computer to work in a specific manner to produce an article of manufacture, including instructions for implementing the functions specified in one or more blocks in the flowchart and / or block diagram.

[0086] The present disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects.

[0087] In the present disclosure, intelligent voice outside the car is supported. At the same time, face recognition and voice recognition mechanisms are designed to ensure that the voice commands outside the car are legal and valid; the microphone outside the car prevents the voice commands outside the car from being mistaken for the voice commands issued inside the car, avoiding unsafe risks; when the vehicle is dormant, the voice commands of pedestrians can be executed without starting the vehicle.

[0088] So far, the method, device and medium for controlling a vehicle by voice outside the vehicle according to the present disclosure have been described in detail. In order to avoid obscuring the concept of the present disclosure, some details known in the art are not described. Based on the above description, those skilled in the art can fully understand how to implement the technical solution disclosed here.

[0089] Although some specific embodiments of the present disclosure have been described in detail by way of examples, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A method for controlling a vehicle by voice outside the vehicle, characterized in that: The method comprises: Determine the presence of pedestrians near the vehicle through the surround-view camera; Capturing a face image from a panoramic image, wherein the panoramic image is generated with the aid of a surround-view camera; Determine whether the face image is in the entered information database; If in the entered information database, check whether the vehicle is currently in a dormant state; If the vehicle is currently in a dormant state, the intelligent voice module is awakened, and the microphone and speaker installed outside the vehicle enter a working state; Acquire human voice with the help of microphone; Determine whether the human voice is in the recorded information database; If it is in the entered information database, obtain the voice command; Convert voice commands into text through speech recognition technology; Use intelligent voice modules to understand text and generate control instructions; Using a microphone to determine the external sound zone of the vehicle where the sound source of the voice command is located; Determine whether the external sound zone of the vehicle where the sound source of the voice command is located supports the control command; If supported, the vehicle is controlled to perform corresponding actions based on the control command; The control instructions are sent through the speaker to support prompt information and execution completion prompt information.

2. The method for controlling a vehicle by voice outside the vehicle according to claim 1, characterized in that: If the current vehicle is not in a dormant state but in a start-up state, the human voice is acquired with the aid of a microphone; Determine whether the human voice is in the recorded information database; If it is in the entered information database, obtain the voice command; Convert voice commands into text through speech recognition technology; Detect whether there is a voice command in the car's audio zone; If there is a voice command in the car's audio zone, the control intelligent voice module refuses to understand the text; If there is no voice command in the car's audio zone, the intelligent voice module is controlled to understand the text and generate a control command; Using a microphone to determine the external sound zone of the vehicle where the sound source of the voice command is located; Determine whether the external sound zone of the vehicle where the sound source of the voice command is located supports the control command; If supported, the vehicle is controlled to perform corresponding actions based on the control command; The control instructions are sent through the speaker to support prompt information and execution completion prompt information.

3. The method for controlling a vehicle by voice outside the vehicle according to claim 1, characterized in that: The exterior sound zone includes the front sound zone, the rear sound zone, the exterior main driving sound zone, the exterior co-driving sound zone, the exterior rear left sound zone, and the exterior right right sound zone; the control commands supported by all exterior sound zones include wake-up commands, exterior projection commands, exterior lighting control commands, air conditioning opening and closing commands, navigation commands, media opening commands, seat heating commands, seat ventilation commands, and fragrance opening commands; the control commands supported by the exterior main driving sound zone also include door opening and closing commands, window opening and closing commands, sunshade opening and closing commands, sunroof opening and closing commands, electric tailgate opening and closing commands, front hood opening and closing commands, wiper maintenance position drive commands, and wiper reset commands; the control commands supported only by the exterior main driving sound zone include parking in and out commands, suspension height adjustment commands, four-door lock unlocking commands, and child lock unlocking commands.

4. The method for controlling a vehicle by voice outside the vehicle according to claim 2, characterized in that: The in-car sound zone includes an in-car main driver's sound zone, an in-car assistant driver's sound zone, an in-car rear left sound zone, and an in-car rear right sound zone.

5. A device for controlling a vehicle by voice outside the vehicle, characterized in that: include: A pedestrian determination module, used to determine the presence of pedestrians near the vehicle through a surround-view camera; A face image capture module, used to capture a face image from a panoramic image, wherein the panoramic image is generated with the aid of a surround-view camera; A face image judgment module is used to judge whether the face image is in the input information database; The vehicle status detection module is used to detect whether the vehicle is currently in a dormant state in the input information database; An intelligent voice module wake-up module is used to wake up the intelligent voice module if the current vehicle is in a dormant state, and the microphone and speaker set outside the vehicle enter a working state; A human voice acquisition module, used to acquire human voice with the aid of a microphone; A voice judgment module is used to judge whether the human voice is in the recorded information database; The voice command acquisition module is used to obtain the voice command if it is in the input information database; A voice command conversion module, used for converting voice commands into text through voice recognition technology; A control instruction generation module is used to understand text using an intelligent voice module and generate control instructions; An external sound zone determination module, used to determine the external sound zone of the vehicle where the sound source of the voice command is located using a microphone; An external audio zone determination module is used to determine whether the external audio zone where the sound source of the voice command is located supports the control command; A vehicle control module, for controlling the vehicle to perform corresponding actions based on the control instructions if supported; The prompt information sending module is used to send control instruction support prompt information and execution completion prompt information through the speaker.

6. A device for controlling a vehicle by voice outside the vehicle, characterized in that: include: Memory; as well as A processor coupled to the memory, the processor being configured to execute the method for controlling a vehicle by external voice according to any one of claims 1 to 4 based on instructions stored in the memory.

7. A computer storable medium, characterized in that: Computer program instructions are stored thereon, and when the instructions are executed by a processor, a method for controlling a vehicle by external voice according to any one of claims 1 to 7 is implemented.

Images