Vehicle door control method, device and equipment based on voice recognition and storage medium

Abstract

The embodiment of the invention provides a vehicle door control method and device based on voice recognition, equipment and a storage medium, when a recognition result of a voice module is a preset recognition result, a prompt flag bit is changed from a first preset flag bit to a second preset flag bit, and a preset voice prompt is played through a prompt module; when the prompt flag bit is a second preset flag bit and the driving state of the vehicle and the vehicle door state of the vehicle meet the vehicle door control condition, the vehicle door of the vehicle is controlled to be normally opened through the control module, and a door closing protection mechanism is started; and when the duration that the prompt flag bit is the second preset flag bit exceeds the preset duration, recovering the prompt flag bit from the second preset flag bit to the first preset flag bit, and canceling the door closing protection mechanism. According to the embodiment of the invention, the voice module, the control module and the prompt module can effectively solve the problems that passengers are difficult to touch a get-off button during peak hours and oral prompt is likely to be neglected, and ensure that the passengers can get off the vehicle timely and safely.

Description

Technical Field

[0001] The present application relates to the field of public transportation technology, and in particular to a vehicle door control method and device based on voice recognition, an electronic device and a storage medium. Background Art

[0002] As a widely used public transportation tool, buses are usually opened by drivers after stopping at each stop to allow passengers to get on and off. However, since the driver's seat is located at the front of the vehicle, it is difficult for them to fully observe the passengers' needs to get off at the rear, which may cause some passengers to fail to get off in time, especially when the driver closes the door after thinking that no one needs to get off. To address this issue, current measures include installing a "get off button" on the rear door of the bus, where passengers can press the button to prompt the driver that someone wants to get off, or directly inform the driver verbally. Some buses are also equipped with cameras, and the driver can observe the passengers getting off through the on-board TV monitor in the front.

[0003] However, during peak hours, the bus is often very crowded, and many passengers are far from the rear door, making it difficult for them to reach the button to get off. They may also be out of the camera's range, which means that the driver has already started to close the door while the passengers are squeezing towards the rear door. At this time, the passengers can only remind the driver verbally, but due to the long distance and the noise inside the bus, such reminders may be ignored, causing the passengers to miss their stops. It is even possible that the driver starts to close the door while the passengers are getting off, causing the passengers to be trapped. Summary of the invention

[0004] The embodiment of the present application provides a door control method based on voice recognition to solve the problem that when the bus is crowded, the driver may easily ignore the getting-off reminder sound issued by passengers who are far away from the door, resulting in passengers being pinched when getting off the bus.

[0005] Correspondingly, an embodiment of the present application also provides a door control device based on voice recognition, an electronic device and a storage medium to ensure the implementation and application of the above method.

[0006] In order to solve the above problems, the embodiment of the present application discloses a door control method based on voice recognition, which is applied to a vehicle. The vehicle includes a voice module, a control module and a prompt module. The method includes:

[0007] When the recognition result of the voice module is a preset recognition result, the prompt flag is changed from the first preset flag to the second preset flag, and the preset voice prompt is played through the prompt module;

[0008] When the prompt flag is the second preset flag, and the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module controls the door of the vehicle to be normally open, and turns on the door closing protection mechanism;

[0009] When the time duration during which the prompt flag is the second preset flag exceeds the preset time duration, the prompt flag is restored from the second preset flag to the first preset flag, and the door closing protection mechanism is canceled.

[0010] Optionally, when the prompt flag is the second preset flag, and the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module is used to control the door of the vehicle to be normally open, and the door closing protection mechanism is activated, including:

[0011] When the prompt flag is the second preset flag, determining the driving state of the vehicle and the door state of the vehicle;

[0012] When the driving state of the vehicle and the door state of the vehicle meet the door control condition, the door of the vehicle is controlled to be normally open through the control module, and the door closing protection mechanism is turned on.

[0013] Optionally, when the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module is used to control the door of the vehicle to be normally open, and before the door closing protection mechanism is turned on, the method further includes:

[0014] Determining a driving state of the vehicle according to a driving speed of the vehicle;

[0015] Determining a door state of the vehicle according to the number of times a door opening button of the vehicle is pressed;

[0016] When the driving speed of the vehicle is a preset speed and the door opening button of the vehicle is pressed at least once, it is determined that the driving state of the vehicle and the door state of the vehicle meet the door control condition.

[0017] Optionally, the vehicle further includes a plurality of voice input devices, the voice module includes a voice word library, the voice input device is connected to the voice module, and when the recognition result of the voice module is a preset recognition result, the prompt flag is changed from the first preset flag to the second preset flag, and before the preset voice prompt is played by the prompt module, the method further includes:

[0018] When the voice module receives the voice audio sent by the voice input device, it performs noise reduction processing on the voice audio to obtain the noise-reduced audio;

[0019] Performing speech recognition on the noise reduction audio to obtain a plurality of audio keywords;

[0020] Matching the plurality of audio keywords with target keywords in the voice word library, and determining whether the target keywords in the voice word library exist in the noise reduction audio;

[0021] If the target keyword in the voice vocabulary exists in the noise reduction audio, determining the recognition result of the voice module to be the preset recognition result;

[0022] If the target keyword in the voice vocabulary does not exist in the noise reduction audio, it is determined that the recognition result of the voice module is not the preset recognition result.

[0023] Optionally, the voice module is connected to the prompt module and the control module respectively; the playing of the preset voice prompt by the prompt module comprises: when the prompt module receives the play signal sent by the voice module, playing the voice prompt;

[0024] The controlling the vehicle door to be normally open by the control module includes: when the control module receives the normally open signal sent by the voice module, controlling the vehicle door to be normally open.

[0025] Optionally, the speech word library includes word libraries corresponding to multiple languages, and before performing speech recognition on the noise reduction audio to obtain multiple audio keywords, the method further includes:

[0026] Performing speech recognition on the noise-reduced audio to determine a target language corresponding to the noise-reduced audio;

[0027] The word library corresponding to the target language is determined as the target word library in the speech word library.

[0028] Optionally, matching the plurality of audio keywords with a target keyword in the voice vocabulary to determine whether the target keyword in the voice vocabulary exists in the noise reduction audio includes:

[0029] The plurality of audio keywords are matched with the target keywords in the target vocabulary, and it is determined whether the target keywords in the target vocabulary exist in the noise reduction audio.

[0030] Optionally, the method further includes:

[0031] If the duration during which the prompt flag is the second preset flag does not exceed the preset duration, a preset operation is performed on the door closing button of the vehicle to cancel the door closing protection mechanism.

[0032] Optionally, the voice module is connected to a station announcement system, and the method further includes:

[0033] When the voice module receives the first electrical signal sent by the station announcement system, the voice module is turned on; the first electrical signal is used to indicate that the vehicle has arrived at the station;

[0034] When the voice module receives the second electrical signal sent by the station announcement system, the voice module is turned off, and the vehicle door is controlled to be always closed through the control module; the second electrical signal is used to indicate that the vehicle has left the station.

[0035] The embodiment of the present application also discloses a door control device based on voice recognition, which is applied to a vehicle. The vehicle includes a voice module, a control module and a prompt module. The device includes:

[0036] A prompt flag changing module, used for changing the prompt flag from a first preset flag to a second preset flag when the recognition result of the voice module is a preset recognition result, and playing a preset voice prompt through the prompt module;

[0037] A door control condition satisfaction module, used for controlling the doors of the vehicle to be normally open and starting the door closing protection mechanism through the control module when the prompt flag is the second preset flag and the driving state of the vehicle and the door state of the vehicle meet the door control condition;

[0038] The prompt flag recovery module is used to restore the prompt flag from the second preset flag to the first preset flag and cancel the door closing protection mechanism when the duration of the prompt flag being the second preset flag exceeds the preset duration.

[0039] Optionally, the door control condition satisfaction module includes:

[0040] a determination module, configured to determine the driving state of the vehicle and the door state of the vehicle when the prompt flag is the second preset flag;

[0041] The satisfying module is used to control the vehicle's doors to be normally open and activate the door closing protection mechanism through the control module when the vehicle's driving state and the vehicle's door state satisfy the door control conditions.

[0042] Optionally, the device further comprises:

[0043] A driving state determination module, used to determine the driving state of the vehicle according to the driving speed of the vehicle;

[0044] A door state determination module, used to determine the door state of the vehicle according to the number of times the door opening button of the vehicle is pressed;

[0045] The door control condition determination module is used to determine whether the driving state of the vehicle and the door state of the vehicle meet the door control condition when the driving speed of the vehicle is a preset speed and the door opening button of the vehicle is pressed at least once.

[0046] Optionally, the vehicle further comprises a plurality of voice input devices, the voice module comprises a voice word library, the voice input devices are connected to the voice module, and the apparatus further comprises:

[0047] A noise reduction processing module, configured to perform noise reduction processing on the voice audio sent by the voice input device when the voice module receives the voice audio, so as to obtain a noise-reduced audio frequency;

[0048] A speech recognition module, used for performing speech recognition on the noise reduction audio to obtain a plurality of audio keywords;

[0049] A target keyword determination module, used for matching the plurality of audio keywords with the target keywords in the voice word library, and determining whether the target keywords in the voice word library exist in the noise reduction audio;

[0050] A first recognition result module, configured to determine that the recognition result of the voice module is the preset recognition result if the target keyword in the voice vocabulary exists in the noise reduction audio;

[0051] The second recognition result module is used to determine that the recognition result of the voice module is not the preset recognition result if the target keyword in the voice vocabulary does not exist in the noise reduction audio.

[0052] Optionally, the voice module is connected to the prompt module and the control module respectively; the prompt flag changing module includes: a voice prompt playing module, which is used to play the voice prompt when the prompt module receives the play signal sent by the voice module;

[0053] The door control condition satisfaction module includes: a door control module, which is used to control the door of the vehicle to be normally open when the control module receives the normally open signal sent by the voice module.

[0054] Optionally, the speech word library includes word libraries corresponding to multiple languages, and the device includes:

[0055] a target language determination module, configured to perform speech recognition on the noise-reduced audio to determine a target language corresponding to the noise-reduced audio;

[0056] The target word library determination module is used to determine the word library corresponding to the target language in the speech word library as the target word library.

[0057] Optionally, the target keyword determination module includes:

[0058] The matching module is used to match the multiple audio keywords with the target keywords in the target vocabulary, and determine whether the target keywords in the target vocabulary exist in the noise reduction audio.

[0059] Optionally, the device further comprises:

[0060] The door closing protection mechanism canceling module is used to execute a preset operation on the door closing button of the vehicle to cancel the door closing protection mechanism if the duration of the prompt flag being the second preset flag does not exceed the preset duration.

[0061] Optionally, the voice module is connected to a station announcement system, and the device further includes:

[0062] A first electrical signal module, used to activate the voice module when the voice module receives a first electrical signal sent by the station announcement system; the first electrical signal is used to indicate that the vehicle has arrived at the station;

[0063] The second electrical signal module is used to turn off the voice module and control the vehicle door to be always closed through the control module when the voice module receives the second electrical signal sent by the station announcement system; the second electrical signal is used to indicate that the vehicle has left the station.

[0064] An embodiment of the present application also discloses an electronic device, including: a processor; and a memory, on which executable code is stored. When the executable code is executed, the processor executes the vehicle door control method based on voice recognition as described in any one of the embodiments of the present application.

[0065] The embodiments of the present application also disclose one or more machine-readable media on which executable codes are stored. When the executable codes are executed, the processor executes the vehicle door control method based on voice recognition as described in any of the embodiments of the present application.

[0066] Compared with the prior art, the embodiments of the present application have the following advantages:

[0067] In an embodiment of the present application, when the recognition result of the voice module is a preset recognition result, the prompt flag is changed from the first preset flag to the second preset flag, and a preset voice prompt is played through the prompt module; when the prompt flag is the second preset flag, and the driving state of the vehicle and the door state of the vehicle meet the door control conditions, the vehicle's doors are controlled to be always open through the control module, and the door closing protection mechanism is turned on; when the duration of the prompt flag being the second preset flag exceeds the preset duration, the prompt flag is restored from the second preset flag to the first preset flag, and the door closing protection mechanism is canceled.

[0068] The embodiment of the present application performs recognition through a voice module. When a preset voice prompt is recognized, the prompt flag is changed from a first preset flag to a second preset flag, and the preset voice prompt is played through the prompt module to remind the driver that someone is about to get off the vehicle; when the prompt flag is the second preset flag, and the vehicle's driving status and door status meet the door control conditions, the control module controls the door to be always open, and turns on the door closing protection mechanism to ensure that the door remains open before the passenger gets off the vehicle; when the duration of the prompt flag being the second preset flag exceeds the preset duration, the prompt flag will be restored to the first preset flag, and the door closing protection mechanism will be canceled to ensure that the door can be closed normally after the passenger gets off the vehicle. The embodiments of the present application can effectively solve the problem that it is difficult for passengers to reach the get-off button during peak hours and the verbal prompts may be ignored through the voice module, control module and prompt module. As long as the vehicle is in a non-starting state, the door will be immediately controlled to open, and the driver will be informed by voice that there are passengers who are about to get off, so that the driver can pay attention to the passengers behind. At the same time, the door closing protection is triggered to prevent the door closing operation from being pressed by the driver due to untimely reaction, thereby avoiding passengers from being pinched, thereby ensuring that passengers can get off the vehicle in a timely and safe manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] Figure 1 is a schematic diagram of an application environment of the present application;

[0070] Figure 2 is a flow chart of steps of an embodiment of a vehicle door control method based on voice recognition of the present application;

[0071] Figure 3 is a flowchart of another embodiment of a vehicle door control method based on voice recognition of the present application;

[0072] Figure 4 It is a structural block diagram of an embodiment of a vehicle door control device based on voice recognition of the present application;

[0073] Figure 5 It is a schematic diagram of the structure of a device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0074] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0075] Reference Figure 1 , shows a schematic diagram of an application environment of the present application, a vehicle door control method based on voice recognition of the present application is applied to a vehicle, and the vehicle includes a voice module, a control module and a prompt module. Specifically, the voice module is used to recognize the passenger's request to get off the vehicle, the control module is used to control the door switch of the vehicle, and the prompt module is set in the cab to remind the driver that there are passengers who need to get off the vehicle.

[0076] In an embodiment of the present application, an offline speech recognition technology is used to train specific keywords for getting off. When the vehicle arrives at a station, if a passenger utters words such as "get off" or "wait a moment", the speech module recognizes them and gives a voice prompt in the cab through the prompt module. In this way, in crowded conditions, the driver can receive the getting off requests of passengers who are far away from the door. At the same time, the control module keeps the door open to ensure that passengers will not miss their stop or be pinched by the door, thereby improving safety and riding experience.

[0077] Reference Figure 2 , is a flow chart of a method for controlling a vehicle door based on voice recognition according to an embodiment of the present application, comprising the following steps:

[0078] Step 201: When the recognition result of the voice module is a preset recognition result, the prompt flag is changed from the first preset flag to the second preset flag, and the preset voice prompt is played through the prompt module;

[0079] In an embodiment of the present application, an offline voice module will be installed in the bus, which can be connected to multiple input terminals (such as microphones). The input terminals can be set at various positions inside the car. The number of input terminals can be set according to actual conditions. The embodiment of the present application does not limit the number and position of the input terminals.

[0080] During the driving process of the bus, the voice module is closed by default, and the prompt flag is the first preset flag by default. When the bus is about to enter the station, the bus's station announcement system will send a first electrical signal to the voice module, and the voice module is in the on state at this time. When the voice module is turned on, it will identify whether there are any preset keywords that trigger the preset keywords. When the voice module successfully recognizes the preset keywords, it is considered that the recognition result of the voice module is the preset recognition result. At this time, the system will immediately change the prompt flag from the first preset flag to the second preset flag. At the same time, the prompt module in the cab will immediately play a pre-recorded voice prompt, such as "A passenger is about to get off the bus." The purpose of this voice prompt is to remind the driver to pay attention to the request of the passengers behind to get off the bus and ensure that the driver can respond in time.

[0081] In the embodiment of the present application, the "first preset flag" is set to 0 and the "second preset flag" is set to 1. This is only an example to distinguish the difference and relationship between the first preset flag and the second preset flag, and the embodiment of the present application is not limited thereto.

[0082] Step 202: When the prompt flag is the second preset flag, and the driving state of the vehicle and the door state of the vehicle meet the door control condition, the door of the vehicle is controlled to be normally open through the control module, and the door closing protection mechanism is turned on;

[0083] In the embodiment of the present application, when the passenger speaks a request related to getting off the bus and the request is recognized by the voice module, the prompt flag will remain at the second preset flag. During this process, the system needs to obtain the driving status of the vehicle to determine whether the vehicle is entering the station or has stopped. If the vehicle is still entering the station, the vehicle's doors will not be controlled to be open through the control module; if the vehicle has stopped, the vehicle's doors will be controlled to be open through the control module.

[0084] In actual applications, the driving status of a vehicle is usually determined by the GPS of the station announcement system and the vehicle's driving speed. However, there may be too many vehicles entering the station at the same time, resulting in the vehicle braking before entering the station. In this case, an erroneous signal that the vehicle has entered the station and stopped is often given, which causes the vehicle's door to be opened without entering the station, which affects the safety of the passengers on the vehicle.

[0085] To solve this problem, the embodiment of the present application not only determines the door control condition by the driving state of the vehicle, but also further confirms whether the door control condition is met by the door state of the vehicle. Specifically, whether the vehicle's door is always open and the door closing protection mechanism is automatically controlled by the control module is determined by whether the driver has actively opened the door. If the driver has actively opened the door, it means that the current position allows passengers to get off normally.

[0086] Therefore, when the prompt flag is the second preset flag, it means that the passengers on the vehicle need to get off. At this time, the system will comprehensively consider the driving status and door status of the vehicle. Only when the door control conditions are met will the control module control the vehicle's doors to be always open and turn on the door closing protection mechanism. The purpose of the door closing protection mechanism is to prevent the driver from accidentally triggering the vehicle's door closing button, so as to avoid the driver's inability to react in time and cause the passengers getting off the vehicle to be trapped or locked in the vehicle, thereby ensuring the safety of passengers and a smooth ride.

[0087] The prompt flag is changed from the first preset flag to the second preset flag only when the voice module recognizes the command to get off the vehicle. This can be combined with the vehicle's driving status and the vehicle's door status to decide whether to control the door to be always open and to open the door closing protection mechanism. During this period, the driver will not be prompted repeatedly to prevent passengers from continuously issuing commands to get off the vehicle and frequent prompts that affect the driver's normal driving.

[0088] Step 203: When the time duration during which the prompt flag is the second preset flag exceeds the preset time duration, the prompt flag is restored from the second preset flag to the first preset flag, and the door closing protection mechanism is canceled.

[0089] In actual applications, passengers' requests to get off the bus are usually immediate. Once the passengers get off the bus, the vehicle should be able to quickly return to the default state in order to be ready to respond to the next possible request. If the prompt flag remains unchanged for a long time, it may cause unnecessary occupation of system resources and affect the normal operation of other functions. At this time, a preset time can be set to ensure that the passenger's needs have been met or are no longer needed within this preset time. For example, the preset time can be set to 3 seconds, which is not limited in the embodiments of the present application. At the same time, the door closing protection mechanism in the embodiments of the present application is to prevent injuries caused by accidental closing of the door when the passenger gets off the bus. However, once it is determined that the passenger has safely got off the bus, continuing to maintain the door closing protection mechanism may cause the door to fail to close normally, affecting the normal operation of the bus.

[0090] Therefore, in the embodiment of the present application, after the prompt flag is changed from the first preset flag to the second preset flag, the timing will automatically start. When the timing exceeds the preset time, the prompt flag will be automatically restored from the second preset flag to the first preset flag, and the door closing protection mechanism will be cancelled. By automatically restoring the prompt flag and canceling the door closing protection mechanism, it can be ensured that the vehicle resumes normal operation when additional protection is not needed, improving operational efficiency and also ensuring the safety of passengers.

[0091] Furthermore, in the embodiment of the present application, the prompt flag is not directly related to the switch of the voice module, and the prompt flag is determined by whether the voice module recognizes the command to get off. Therefore, when the vehicle enters the station, the voice module is turned on, but no passenger issues a command to get off during the period. At this time, the prompt flag is always the first preset flag. When the prompt flag is the first preset flag, the prompt module will not be used to remind the driver that there are passengers who want to get off, the control module will not be used to control the door to be always open, and the door closing protection mechanism will not be turned on.

[0092] The embodiment of the present application performs recognition through a voice module. When a preset voice prompt is recognized, the prompt flag is changed from a first preset flag to a second preset flag, and the preset voice prompt is played through the prompt module to remind the driver that someone is about to get off the vehicle; when the prompt flag is the second preset flag, and the vehicle's driving status and door status meet the door control conditions, the control module controls the door to be always open, and turns on the door closing protection mechanism to ensure that the door remains open before the passenger gets off the vehicle; when the duration of the prompt flag being the second preset flag exceeds the preset duration, the prompt flag will be restored to the first preset flag, and the door closing protection mechanism will be canceled to ensure that the door can be closed normally after the passenger gets off the vehicle. The embodiments of the present application can effectively solve the problem that it is difficult for passengers to reach the get-off button during peak hours and the verbal prompts may be ignored through the voice module, control module and prompt module. As long as the vehicle is in a non-starting state, the door will be immediately controlled to open, and the driver will be informed by voice that there are passengers who are about to get off, so that the driver can pay attention to the passengers behind. At the same time, the door closing protection is triggered to prevent the door closing operation from being pressed by the driver due to untimely reaction, thereby avoiding passengers from being pinched, thereby ensuring that passengers can get off the vehicle in a timely and safe manner.

[0093] In another embodiment of the present application, the step 202, when the prompt flag is the second preset flag, and the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module controls the door of the vehicle to be normally open, and turns on the door closing protection mechanism, including:

[0094] When the prompt flag is the second preset flag, determining the driving state of the vehicle and the door state of the vehicle;

[0095] When the driving state of the vehicle and the door state of the vehicle meet the door control condition, the door of the vehicle is controlled to be normally open through the control module, and the door closing protection mechanism is turned on.

[0096] In the embodiment of the present application, the prompt flag being the second preset flag means that the passenger has a need to get off the vehicle. At this time, it is necessary to comprehensively consider the two factors of the vehicle's driving state and the door state to determine whether the current door opening environment is safe. Under the premise of a safe environment, it is necessary to control the vehicle's doors to be always open through the control module, and to start the door closing protection mechanism when the doors are always open.

[0097] For example, if the vehicle is still moving or has not completely stopped, opening the door may cause danger to passengers and pedestrians. At this time, the current door opening environment is considered unsafe, that is, the vehicle's driving state does not meet the door control conditions; if the vehicle has completely stopped and the door has been opened by the driver, opening the door will not cause danger to passengers and pedestrians. At this time, the current door opening environment is considered safe, that is, the vehicle's driving state and door state both meet the door control conditions.

[0098] Therefore, in order to ensure the safety, accuracy and efficiency of door control operations, the embodiment of the present application needs to obtain the vehicle's driving status and door status when the prompt flag is the second preset flag, while also optimizing the passenger experience and improving the overall operational efficiency of the public transportation system.

[0099] In another embodiment of the present application, in step 202, when the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module controls the door of the vehicle to be normally open, and before the door closing protection mechanism is turned on, the method further includes:

[0100] Determining a driving state of the vehicle according to a driving speed of the vehicle;

[0101] Determining a door state of the vehicle according to the number of times a door opening button of the vehicle is pressed;

[0102] When the driving speed of the vehicle is a preset speed and the door opening button of the vehicle is pressed at least once, it is determined that the driving state of the vehicle and the door state of the vehicle meet the door control condition.

[0103] In an embodiment of the present application, the driving state of the vehicle is determined by the GPS of the station announcement system and the driving speed of the vehicle to determine whether the current vehicle is in a driving state or has stopped steadily. However, in actual applications, there may be too many vehicles entering the station at the same time, resulting in a situation where the vehicle has not entered the station but has already braked to a stop. In this case, an erroneous signal that the vehicle has entered the station and stopped steadily is often given, which in turn causes the vehicle's doors to be opened without entering the station, which affects the safety of the passengers on the vehicle. To solve this problem, an embodiment of the present application also needs to determine the vehicle's door state by the number of times the vehicle's door opening button is pressed, and further confirm whether the vehicle's driving state and door state meet the door control conditions.

[0104] The number of times the vehicle's door opening button is pressed can be used to determine whether the driver has actively opened the door. If the vehicle's door opening button is pressed at least once, it is considered that the driver has actively opened the door. At this time, opening the door will not cause danger to passengers and pedestrians.

[0105] In the actual driving process of the vehicle, when the vehicle has come to a complete stop, the following situations may occur, all of which are situations where the driving state of the vehicle and the state of the door meet the door control conditions:

[0106] Case 1: The door button is pressed at least once and the door is open:

[0107] If the door opening button is pressed at least once and it is detected that the door is always open (i.e. the door has been kept open), the system may assume that the door status has met the door control conditions. In this case, the system will continue to keep the door always open and ensure that the door closing protection mechanism is activated to prevent the door from closing accidentally.

[0108] Case 2: The door button is pressed at least once and the door is closed:

[0109] If the door opening button is pressed at least once, and the driver closes the door after the door opens, the vehicle has not started to move and is still in a stable state, but a passenger requests to get off through voice, the door will be automatically controlled to stay open and the door closing protection mechanism will be activated to ensure that the passenger can get off safely.

[0110] Case 3: The door button is pressed at least once and the door is closed:

[0111] If the door opening button is pressed at least once but the system detects that the door is in the process of closing, the system may pause the door closing operation and reopen the door to keep the door open, while activating the door closing protection mechanism to ensure that passengers can exit the vehicle safely.

[0112] It can be seen from the above three situations that it is meaningful to consider the door status of the vehicle only when the vehicle has come to a complete stop. Therefore, in the embodiment of the present application, it is possible to prioritize determining whether the driving status of the vehicle satisfies the door control conditions. Then, when the driving status of the vehicle satisfies the door control conditions, it is further determined whether the door status of the vehicle satisfies the door control conditions. This ensures that the door will not be opened when the vehicle has not come to a complete stop or is still in motion, thereby avoiding safety risks caused by accidental door opening. Considering the door status after determining that the vehicle has come to a complete stop can reduce unnecessary door operations caused by misjudgment of the vehicle status, such as avoiding the door from being opened under inappropriate circumstances when the vehicle has not fully entered the station but has already braked to a stop.

[0113] In another embodiment of the present application, the vehicle further includes a plurality of voice input devices, the voice module includes a voice word library, the voice input device is connected to the voice module, and in step 201, when the recognition result of the voice module is a preset recognition result, the prompt flag is changed from the first preset flag to the second preset flag, and before the preset voice prompt is played by the prompt module, the method further includes:

[0114] When the voice module receives the voice audio sent by the voice input device, it performs noise reduction processing on the voice audio to obtain the noise-reduced audio;

[0115] Performing speech recognition on the noise reduction audio to obtain a plurality of audio keywords;

[0116] Matching the plurality of audio keywords with target keywords in the voice word library, and determining whether the target keywords in the voice word library exist in the noise reduction audio;

[0117] If the target keyword in the voice vocabulary exists in the noise reduction audio, determining the recognition result of the voice module to be the preset recognition result;

[0118] If the target keyword in the voice vocabulary does not exist in the noise reduction audio, it is determined that the recognition result of the voice module is not the preset recognition result.

[0119] like Figure 1 As shown, the voice input device is connected to the voice module. The embodiment of the present application needs to obtain the voice audio of the passengers in the vehicle through multiple voice input devices, and then transmit the voice audio to the voice module for voice recognition to determine whether the passenger has a request to get off.

[0120] The voice module in the embodiment of the present application uses an offline voice recognition method and specifically trains a fixed voice vocabulary. Only the keywords in the voice vocabulary will be triggered, which is faster and more sensitive than online voice content recognition. Related words other than the keywords in the voice vocabulary are identified as invalid words, and invalid words are blocked in the voice module.

[0121] In actual applications, the voice environment in public buses is generally noisy. Therefore, the audio will be processed for noise reduction in the offline speech recognition algorithm. When passengers get off the bus, they will subconsciously raise their voices, making the voices more prominent in the surrounding environment. As long as the signal-to-noise ratio (SNR) between the passenger's voice and the surrounding noise reaches a certain threshold, the microphone installed in the car can accurately capture and recognize these key instructions to get off the bus. This recognition strategy based on the signal-to-noise ratio ensures that the system can reliably execute the passenger's request to get off the bus even in a noisy bus environment.

[0122] In audio processing, the signal-to-noise ratio refers to the ratio of the strength of the effective sound signal to the strength of the background noise. A high signal-to-noise ratio means that the signal strength is much greater than the noise strength, so it is easier to identify and extract the effective signal from the background noise. On the contrary, a low signal-to-noise ratio means that the signal is masked by the noise and it is difficult to clearly identify the signal.

[0123] Specifically, when the voice module receives the voice audio sent by the voice input device, it will first perform noise reduction processing on the audio to remove background noise and improve the accuracy of voice recognition; then perform voice recognition on the noise-reduced audio to extract multiple audio keywords, which are important words or phrases in the voice and help to judge the voice content; match the extracted audio keywords with target keywords in the voice vocabulary, which contains preset keywords or phrases that are related to the passenger's request to get off the bus; if the target keyword in the voice vocabulary exists in the noise-reduced audio, it will be determined that the recognition result of the voice module is the preset recognition result, that is, the passenger has made a request to get off the bus; if the target keyword in the voice vocabulary does not exist in the noise-reduced audio, it will be determined that the recognition result of the voice module is not the preset recognition result, that is, the passenger's request to get off the bus is not detected.

[0124] With respect to the prior art, in which the driver is reminded by a "get off button" and the monitor on the rear door of the vehicle is used to detect the passenger's request to get off, the embodiment of the present application implements an offline voice recognition method through a voice input device and a voice module. The passenger only needs to simply speak out the request, and the voice module directly processes the passenger's voice audio to detect the passenger's request to get off. There is no need for the passenger to search for or press the "get off button", and there is no need for the driver to continuously observe the passenger's getting off through the on-board monitor. This effectively solves the limitations of the prior art in determining the passenger's request to get off, better controls the vehicle's doors, and thereby improves the overall service quality and passenger satisfaction of the public transportation system.

[0125] In an embodiment of the present application, the voice input device may be a microphone installed inside a bus. These microphones may be distributed in different positions in the car to capture the voices of passengers from all directions. Those skilled in the art may set them according to actual needs, and the embodiment of the present application is not limited thereto.

[0126] In another embodiment of the present application, the voice module is connected to the prompt module and the control module respectively; the playing of the preset voice prompt by the prompt module comprises: when the prompt module receives the play signal sent by the voice module, the voice prompt is played;

[0127] The controlling the vehicle door to be normally open by the control module includes: when the control module receives the normally open signal sent by the voice module, controlling the vehicle door to be normally open.

[0128] like Figure 1 As shown, the voice module interacts with the prompt module and the control module respectively, and there is no interaction between the prompt module and the control module. In an embodiment of the present application, when the voice module recognizes the passenger's request to get off (i.e., the recognition result is a preset recognition result), a play signal will be sent to the prompt module. After the prompt module receives this signal, it will play a preset voice prompt, such as "a passenger is about to get off", to convey to the driver the information that a passenger needs to get off, so that the driver can take corresponding actions in time. Similarly, when the voice module recognizes the passenger's request to get off, when the vehicle's driving state and door state meet the door control conditions, a normally open signal will also be sent to the control module. After the control module receives this signal, it will control the vehicle's door to remain in a normally open state, ensuring that the passenger can get off safely and smoothly, and avoiding the inconvenience or danger caused by the door closing.

[0129] The vehicle door has only two states: open and closed. Therefore, the vehicle door can be controlled by simple high and low levels. The "normally open signal" in the embodiment of the present application can be simply understood as a high level to control the door to be normally open. Correspondingly, when the door needs to be closed, a low level can be sent to the control module to control the door to be closed.

[0130] In another embodiment of the present application, the speech word library includes word libraries corresponding to multiple languages, and before performing speech recognition on the noise reduction audio to obtain multiple audio keywords, the method further includes:

[0131] Performing speech recognition on the noise-reduced audio to determine a target language corresponding to the noise-reduced audio;

[0132] The word library corresponding to the target language is determined as the target word library in the speech word library.

[0133] In the embodiment of the present application, in order to accommodate passengers with different language backgrounds, the voice word library contains word libraries corresponding to multiple languages. Before performing voice recognition, the system first performs voice recognition on the noise reduction audio to determine the target language used in the voice audio. Once the target language is determined, the system selects the corresponding target language word library in the voice word library for subsequent keyword matching and recognition, which ensures that the system can accurately understand the get-off requests issued by passengers in different languages.

[0134] In the embodiments of the present application, multi-language support includes not only different official languages, but also various dialects to accommodate a wider user group, such as Mandarin, English, Cantonese, Spanish, French, etc., as well as dialects of various regions. Those skilled in the art can make corresponding settings according to actual needs, and the embodiments of the present application are not limited thereto.

[0135] In another embodiment of the present application, in order to ensure that the speech recognition system can continue to adapt to new passenger needs and dialect changes, it is very important to regularly check and update the vocabulary library of speech recognition. Over time, the needs of passengers may change, and they may use new words or expressions to express their requests to get off the bus. Therefore, the vocabulary library needs to be continuously updated to include these new expressions to ensure that these changes can be understood and responded to. It is also possible to collect feedback from actual use to understand which words or phrases are frequently used and which may need to be updated or added. For example, if a passenger frequently uses a specific word to indicate getting off the bus, and this word is not in the current vocabulary library, then this word should be added.

[0136] In another embodiment of the present application, matching the plurality of audio keywords with the target keyword in the voice vocabulary, and determining whether the target keyword in the voice vocabulary exists in the noise reduction audio includes:

[0137] The plurality of audio keywords are matched with the target keywords in the target vocabulary, and it is determined whether the target keywords in the target vocabulary exist in the noise reduction audio.

[0138] In the embodiment of the present application, firstly, a plurality of audio keywords are extracted from the noise reduction audio. These keywords are important words or phrases in the speech and are helpful in judging the speech content. Then, these audio keywords are matched with target keywords in the target vocabulary. The target vocabulary is selected according to the previously determined target language and contains keywords and phrases related to the request to get off the bus in the language. Through the matching process, it is determined whether the target keyword in the target vocabulary exists in the noise reduction audio. If so, it is confirmed that the passenger has issued a request to get off the bus.

[0139] By matching these audio keywords with the target keywords in the target word library, passengers can easily use their familiar language to issue a request to get off the bus without worrying about language barriers. In addition, by matching through the preset target word library, there is no need to match in the voice word library containing multiple languages, which simplifies the operation process of voice recognition and makes the system easier to maintain and upgrade. The precise matching process in the target word library reduces the resource consumption due to processing invalid instructions, allowing computing resources to be used more efficiently, thereby optimizing the passenger's riding experience and enhancing the service quality of the public transportation system.

[0140] In another embodiment of the present application, the method further includes:

[0141] If the duration during which the prompt flag is the second preset flag does not exceed the preset duration, a preset operation is performed on the door closing button of the vehicle to cancel the door closing protection mechanism.

[0142] In the embodiment of the present application, when the prompt flag is the second preset flag, the voice module is still turned on, but the voice module will suspend its work and not perform recognition, to prevent passengers from repeating the voice of the request to get off the bus multiple times, which will cause frequent broadcasts in a short period of time and interfere with the driver's driving. Therefore, after the preset time, the voice module will work again to identify whether there is a trigger keyword.

[0143] In the embodiment of the present application, in addition to the automatic release of the door closing protection mechanism, a manual release double insurance operation can also be set. When the door closing protection mechanism has not been cancelled, but the driver has determined that there is no danger and wants to start the vehicle, the driver can manually release the door closing protection mechanism by performing a preset operation on the vehicle's door closing button. For example, the door closing button can be pressed twice in half a second to cancel the door closing protection mechanism, or the door closing button can be pressed for 1 second to cancel the door closing protection mechanism. Those skilled in the art can set it according to actual conditions, and the embodiment of the present application is not limited thereto.

[0144] In another embodiment of the present application, the voice module is connected to a station announcement system, and the method further includes:

[0145] When the voice module receives the first electrical signal sent by the station announcement system, the voice module is turned on; the first electrical signal is used to indicate that the vehicle has arrived at the station;

[0146] When the voice module receives the second electrical signal sent by the station announcement system, the voice module is turned off, and the vehicle door is controlled to be always closed through the control module; the second electrical signal is used to indicate that the vehicle has left the station.

[0147] like Figure 1 As shown, the voice module is connected to the bus's built-in station announcement system, which provides the voice module with information about the vehicle's entry and departure. Therefore, in the embodiment of the present application, the switch of the voice module is related to the information about the vehicle's arrival and departure. The voice module is turned on when the vehicle enters the station and turned off after leaving the station, preventing accidental triggering by passengers chatting during driving, while also reducing the power consumption of the voice module.

[0148] Specifically, when the voice module receives the first electrical signal sent by the station announcement system, the voice module will be turned on. The first electrical signal is used to indicate that the vehicle has arrived at the station, that is, the vehicle has approached or arrived at a certain station. The purpose of turning on the voice module is to enable the voice module to receive and process passengers' voice requests, especially requests to get off, at the appropriate time. When the vehicle arrives at the station, passengers may need to get off, so the voice module needs to be in working condition; when the voice module receives the second electrical signal sent by the station announcement system, the voice module will be turned off. The second electrical signal is used to indicate that the vehicle has left the station, that is, the vehicle has begun to leave the current station. The purpose of turning off the voice module is to avoid the voice module having to process unnecessary voice requests during the driving of the vehicle, reduce the burden on the voice module, and also ensure that the driver will not be disturbed by voice prompts during driving.

[0149] Moreover, when the voice module is turned off, the voice module will also control the vehicle's doors to be always closed through the control module, which means that after the vehicle leaves the station, the doors will be locked in a closed state to ensure the safety of the vehicle during driving.

[0150] In the embodiment of the present application, the first electrical signal and the second electrical signal are both determined based on the indication information provided by the station announcement system. Existing buses all monitor the location of the vehicle in real time through GPS to determine whether the vehicle has arrived at or left the station. The driver can also actively trigger the arrival information or departure information to prompt passengers or trigger the voice module. The voice module will automatically turn on as soon as it receives the first electrical signal of arrival, and will automatically turn off as soon as it receives the second electrical signal of departure.

[0151] In the embodiment of the present application, the information provided by the station announcement system can determine whether the voice module is turned on and off, thereby preventing the vehicle from being mistakenly triggered by passengers chatting during driving, and at the same time reducing the power consumption of the voice module; the voice module is used for recognition, and when a preset voice prompt is recognized, the prompt flag is changed from the first preset flag to the second preset flag, and the preset voice prompt is played through the prompt module to remind the driver that someone wants to get off the vehicle; through offline voice recognition technology and a preset voice vocabulary, the system can accurately recognize the passenger's request to get off the vehicle, reducing the possibility of misidentification; the voice vocabulary contains multiple languages ​​and dialects, ensuring that the system can serve passengers with different language backgrounds, and improving the inclusiveness of the system; when the prompt flag is the second preset flag, and the driving state and door state of the vehicle meet the door control conditions, the control module will control the door to be always open, and turn on the door closing protection mechanism to ensure that the door remains open before the passenger gets off the vehicle; when the time when the prompt flag is the second preset flag exceeds the preset time, the prompt flag will be restored to the first preset flag, and the door closing protection mechanism will be cancelled to ensure that the door can be closed normally after the passenger gets off the vehicle. The embodiments of the present application can effectively solve the problem that it is difficult for passengers to reach the get-off button during peak hours and the verbal prompts may be ignored through the voice module, control module and prompt module. As long as the vehicle is in a non-starting state, the door will be immediately controlled to open, and the driver will be informed by voice that there are passengers who are about to get off, so that the driver can pay attention to the passengers behind. At the same time, the door closing protection is triggered to prevent the door closing operation from being pressed by the driver due to untimely reaction, thereby avoiding passengers from being pinched, thereby ensuring that passengers can get off the vehicle in a timely and safe manner.

[0152] When there are many passengers in the vehicle, it is difficult for passengers to reach the rear door. They cannot press the "get off button" at the rear door, and it is not easy to be captured by the camera monitoring the rear door. The passengers' requests to get off the vehicle are easily ignored due to the long distance or other noises in the vehicle. Therefore, an offline voice module can be installed in the vehicle to identify the passengers' requests to get off the vehicle and pass the request to the driver to ensure that the passengers will not miss their stop or be caught by the door.

[0153] Reference Figure 3 , is a flowchart of another embodiment of a vehicle door control method based on voice recognition of the present application, comprising the following steps:

[0154] S301, the voice module is closed by default, and the prompt flag is 0 by default (the first preset flag).

[0155] S302, judging whether the vehicle is ready to enter the station. If the vehicle is not entering the station, the voice module is kept in a closed state, and the prompt flag is 0 (the first preset flag); otherwise, enter S303.

[0156] S303, when the bus is about to enter the station, the bus station announcement system sends a first electrical signal to the voice module, the voice module is turned on, and starts to identify whether there is a trigger keyword, as follows:

[0157] S3031. The voice module is trained in advance to recognize words to identify whether someone has issued a series of requests for getting off the bus, such as "there are others", "there are more getting off", "not all getting off", "stop for a moment", "open the door", etc.

[0158] S3032: When a passenger speaks a relevant request and it is recognized, obtain whether the vehicle's driving state and door state meet the door control condition. If the door control condition is not met, execute S304; if the door control condition is met, execute S305.

[0159] S304: If the door control condition is not met (the vehicle is still entering the station), the voice module sends a play signal to the prompt module in the cab, plays the pre-recorded voice prompt "A passenger is about to get off", and changes the prompt flag to 1 (the second preset flag), and automatically returns to 0 (the first preset flag) after 3s (preset duration). During the period when the prompt flag is 1 (the second preset flag), the voice module does not recognize it to prevent passengers from repeating it multiple times, resulting in frequent broadcasts in a short period of time, which interferes with the driver's driving.

[0160] S305: If the door control condition is met (the vehicle has stopped and the door opening button of the vehicle has been pressed at least once), a pre-recorded voice prompt is played, and the voice module interacts with the control module to control the door status. The details are as follows:

[0161] S3051. The voice module sends a play signal to the prompt module in the cab, plays the pre-recorded voice prompt "A passenger wants to get off", and changes the prompt flag to 1 (the second preset flag). After timing for 3s (preset duration), it automatically returns to 0 (the first preset flag). The logic is the same as S304 to prevent frequent broadcasts in a short period of time.

[0162] S3052. When the voice module is triggered, it will send a normally open signal to the control module. If the rear door is already open at this time, it will remain unchanged; if the rear door is closing or has been closed, the rear door will be automatically opened to prevent passengers from being trapped or shut in.

[0163] S306, when the prompt flag is 1 (the second preset flag), the voice module will send a trigger signal to the control module to trigger the door closing protection mechanism. If the driver wants to actively close the door, he needs to press the door closing button twice in half a second to cancel the door closing protection mechanism to prevent the door closing operation from being performed when the driver does not respond in time. When the prompt flag becomes 0 (the first preset flag), a cancel signal is also sent to the control module to cancel the door closing protection mechanism.

[0164] S307: When the vehicle starts to leave the station, the station announcement system sends a second electrical signal to the voice module, and the voice module is turned off.

[0165] In the embodiment of the present application, the information provided by the station announcement system can determine whether the voice module is turned on and off, thereby preventing the vehicle from being mistakenly triggered by passengers chatting during driving, and at the same time reducing the power consumption of the voice module; the voice module is used for recognition, and when a preset voice prompt is recognized, the prompt flag is changed from the first preset flag to the second preset flag, and the preset voice prompt is played through the prompt module to remind the driver that someone wants to get off the vehicle; through offline voice recognition technology and a preset voice vocabulary, the system can accurately recognize the passenger's request to get off the vehicle, reducing the possibility of misidentification; the voice vocabulary contains multiple languages ​​and dialects, ensuring that the system can serve passengers with different language backgrounds, and improving the inclusiveness of the system; when the prompt flag is the second preset flag, and the driving state and door state of the vehicle meet the door control conditions, the control module will control the door to be always open, and turn on the door closing protection mechanism to ensure that the door remains open before the passenger gets off the vehicle; when the time when the prompt flag is the second preset flag exceeds the preset time, the prompt flag will be restored to the first preset flag, and the door closing protection mechanism will be cancelled to ensure that the door can be closed normally after the passenger gets off the vehicle. The embodiments of the present application can effectively solve the problem that it is difficult for passengers to reach the get-off button during peak hours and the verbal prompts may be ignored through the voice module, control module and prompt module. As long as the vehicle is in a non-starting state, the door will be immediately controlled to open, and the driver will be informed by voice that there are passengers who are about to get off, so that the driver can pay attention to the passengers behind. At the same time, the door closing protection is triggered to prevent the door closing operation from being pressed by the driver due to untimely reaction, thereby avoiding passengers from being pinched, thereby ensuring that passengers can get off the vehicle in a timely and safe manner.

[0166] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0167] Reference Figure 4 , shows a structural block diagram of an embodiment of a door control device based on voice recognition of the present application, which may specifically include the following modules:

[0168] A prompt flag changing module 401 is used to change the prompt flag from the first preset flag to the second preset flag when the recognition result of the voice module is the preset recognition result, and play the preset voice prompt through the prompt module;

[0169] The door control condition satisfying module 402 is used to control the doors of the vehicle to be normally open and start the door closing protection mechanism through the control module when the prompt flag is the second preset flag and the driving state of the vehicle and the door state of the vehicle meet the door control condition;

[0170] The prompt flag recovery module 403 is used to restore the prompt flag from the second preset flag to the first preset flag and cancel the door closing protection mechanism when the duration of the prompt flag being the second preset flag exceeds the preset duration.

[0171] In another embodiment of the present application, the door control condition satisfying module 402 includes:

[0172] a determination module, configured to determine the driving state of the vehicle and the door state of the vehicle when the prompt flag is the second preset flag;

[0173] The satisfying module is used to control the vehicle's doors to be normally open and activate the door closing protection mechanism through the control module when the vehicle's driving state and the vehicle's door state satisfy the door control conditions.

[0174] In another embodiment of the present application, the device further includes:

[0175] A driving state determination module, used to determine the driving state of the vehicle according to the driving speed of the vehicle;

[0176] A door state determination module, used to determine the door state of the vehicle according to the number of times the door opening button of the vehicle is pressed;

[0177] The door control condition determination module is used to determine whether the driving state of the vehicle and the door state of the vehicle meet the door control condition when the driving speed of the vehicle is a preset speed and the door opening button of the vehicle is pressed at least once.

[0178] In another embodiment of the present application, the vehicle further comprises a plurality of voice input devices, the voice module comprises a voice word library, the voice input device is connected to the voice module, and the apparatus further comprises:

[0179] A noise reduction processing module, configured to perform noise reduction processing on the voice audio sent by the voice input device when the voice module receives the voice audio, so as to obtain a noise-reduced audio frequency;

[0180] A speech recognition module, used for performing speech recognition on the noise reduction audio to obtain a plurality of audio keywords;

[0181] A target keyword determination module, used for matching the plurality of audio keywords with the target keywords in the voice word library, and determining whether the target keywords in the voice word library exist in the noise reduction audio;

[0182] A first recognition result module, configured to determine that the recognition result of the voice module is the preset recognition result if the target keyword in the voice vocabulary exists in the noise reduction audio;

[0183] The second recognition result module is used to determine that the recognition result of the voice module is not the preset recognition result if the target keyword in the voice vocabulary does not exist in the noise reduction audio.

[0184] In another embodiment of the present application, the voice module is connected to the prompt module and the control module respectively; the prompt flag changing module 401 includes: a voice prompt playing module, which is used to play the voice prompt when the prompt module receives the play signal sent by the voice module;

[0185] The door control condition satisfying module 402 includes: a door control module, which is used to control the door of the vehicle to be normally open when the control module receives the normally open signal sent by the voice module.

[0186] In another embodiment of the present application, the speech word library includes word libraries corresponding to multiple languages, and the device includes:

[0187] a target language determination module, configured to perform speech recognition on the noise-reduced audio to determine a target language corresponding to the noise-reduced audio;

[0188] The target word library determination module is used to determine the word library corresponding to the target language in the speech word library as the target word library.

[0189] In another embodiment of the present application, the target keyword determination module includes:

[0190] The matching module is used to match the multiple audio keywords with the target keywords in the target vocabulary, and determine whether the target keywords in the target vocabulary exist in the noise reduction audio.

[0191] In another embodiment of the present application, the device further includes:

[0192] The door closing protection mechanism canceling module is used to execute a preset operation on the door closing button of the vehicle to cancel the door closing protection mechanism if the duration of the prompt flag being the second preset flag does not exceed the preset duration.

[0193] In another embodiment of the present application, the voice module is connected to a station announcement system, and the device further includes:

[0194] A first electrical signal module, used to activate the voice module when the voice module receives a first electrical signal sent by the station announcement system; the first electrical signal is used to indicate that the vehicle has arrived at the station;

[0195] The second electrical signal module is used to turn off the voice module and control the vehicle door to be always closed through the control module when the voice module receives the second electrical signal sent by the station announcement system; the second electrical signal is used to indicate that the vehicle has left the station.

[0196] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0197] The embodiment of the present application also provides a non-volatile readable storage medium, which stores one or more modules (programs). When the one or more modules are applied to a device, the device can execute instructions (instructions) of each method step in the embodiment of the present application.

[0198] The present application embodiment provides one or more machine-readable media on which instructions are stored, and when executed by one or more processors, an electronic device executes one or more of the methods described in the above embodiments. In the present application embodiment, the electronic device includes various types of devices such as terminal devices and servers (clusters).

[0199] The embodiments of the present disclosure may be implemented as a device configured as desired using any appropriate hardware, firmware, software, or any combination thereof, and the device may include electronic devices such as terminal devices and servers (clusters). Figure 5 An exemplary apparatus 500 that can be used to implement various embodiments described in this application is schematically shown.

[0200] For one embodiment, Figure 5An exemplary apparatus 500 is shown having one or more processors 502, a control module (chip set) 504 coupled to at least one of the processor(s) 502, a memory 506 coupled to the control module 504, a non-volatile memory (NVM) / storage device 508 coupled to the control module 504, one or more input / output devices 510 coupled to the control module 504, and a network interface 512 coupled to the control module 504.

[0201] The processor 502 may include one or more single-core or multi-core processors, and the processor 502 may include any combination of general-purpose processors or special-purpose processors (such as graphics processors, application processors, baseband processors, etc.). In some embodiments, the device 500 can be used as a terminal device, server (cluster), etc. described in the embodiments of the present application.

[0202] In some embodiments, the apparatus 500 may include one or more computer-readable media (e.g., memory 506 or NVM / storage device 508) having instructions 514 and one or more processors 502 configured in conjunction with the one or more computer-readable media to execute the instructions 514 to implement a module to perform the actions described in the present disclosure.

[0203] For one embodiment, control module 504 may include any suitable interface controller to provide any suitable interface to at least one of processor(s) 502 and / or any suitable device or component in communication with control module 504 .

[0204] The control module 504 may include a memory controller module to provide an interface to the memory 506. The memory controller module may be a hardware module, a software module, and / or a firmware module.

[0205] The memory 506 may be used, for example, to load and store data and / or instructions 514 for the device 500. For one embodiment, the memory 506 may include any suitable volatile memory, such as a suitable DRAM. In some embodiments, the memory 506 may include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

[0206] For one embodiment, control module 504 may include one or more input / output controllers to provide interfaces to NVM / storage device 508 and input / output device(s) 510 .

[0207] For example, NVM / storage 508 may be used to store data and / or instructions 514. NVM / storage 508 may include any suitable non-volatile memory (e.g., flash memory) and / or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).

[0208] NVM / storage device 508 may include storage resources that are physically part of the device on which apparatus 500 is installed, or it may be accessible to the device without being part of the device. For example, NVM / storage device 508 may be accessed via input / output device(s) 510 over a network.

[0209] (One or more) input / output devices 510 may provide an interface for the apparatus 500 to communicate with any other appropriate device, and the input / output device 510 may include a communication component, an audio component, a sensor component, etc. The network interface 512 may provide an interface for the apparatus 500 to communicate through one or more networks, and the apparatus 500 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, for example, accessing a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G, etc., or a combination thereof for wireless communication.

[0210] For one embodiment, at least one of the processor(s) 502 may be packaged together with the logic of one or more controllers (e.g., a memory controller module) of the control module 504. For one embodiment, at least one of the processor(s) 502 may be packaged together with the logic of one or more controllers of the control module 504 to form a system-in-package (SiP). For one embodiment, at least one of the processor(s) 502 may be integrated on the same die with the logic of one or more controllers of the control module 504. For one embodiment, at least one of the processor(s) 502 may be integrated on the same die with the logic of one or more controllers of the control module 504 to form a system-on-chip (SoC).

[0211] In various embodiments, the apparatus 500 may be, but is not limited to, a terminal device such as a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet computer, a netbook, etc.). In various embodiments, the apparatus 500 may have more or fewer components and / or a different architecture. For example, in some embodiments, the apparatus 500 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC), and a speaker.

[0212] Among them, the main control chip can be used as a processor or control module in the detection device, sensor data, location information, etc. are stored in a memory or NVM / storage device, the sensor group can be used as an input / output device, and the communication interface may include a network interface.

[0213] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0214] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0215] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable voice recognition-based vehicle door control terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable voice recognition-based vehicle door control terminal device generate instructions for implementing the steps in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0216] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable voice recognition-based vehicle door control terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which is implemented in the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0217] These computer program instructions can also be loaded onto a computer or other programmable voice recognition-based door control terminal device, so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0218] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0219] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0220] The above is a detailed introduction to a vehicle door control method and device based on voice recognition, an electronic device and a storage medium provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A door control method based on voice recognition, It is characterized in that Applied to a vehicle, the vehicle includes a voice module, a control module and a prompt module, and the method includes: When the recognition result of the voice module is a preset recognition result, the prompt flag is changed from the first preset flag to the second preset flag, and the preset voice prompt is played through the prompt module; When the prompt flag is the second preset flag, and the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module controls the door of the vehicle to be normally open, and turns on the door closing protection mechanism; When the time duration during which the prompt flag is the second preset flag exceeds the preset time duration, the prompt flag is restored from the second preset flag to the first preset flag, and the door closing protection mechanism is canceled.

2. The method according to claim 1, It is characterized in that When the prompt flag is the second preset flag, and the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module is used to control the door of the vehicle to be normally open, and the door closing protection mechanism is activated, including: When the prompt flag is the second preset flag, determining the driving state of the vehicle and the door state of the vehicle; When the driving state of the vehicle and the door state of the vehicle meet the door control condition, the door of the vehicle is controlled to be normally open through the control module, and the door closing protection mechanism is turned on.

3. The method according to claim 2, It is characterized in that When the driving state of the vehicle and the door state of the vehicle meet the door control condition, the control module is used to control the door of the vehicle to be normally open, and before the door closing protection mechanism is turned on, the method further includes: Determining a driving state of the vehicle according to a driving speed of the vehicle; Determining a door state of the vehicle according to the number of times a door opening button of the vehicle is pressed; When the driving speed of the vehicle is a preset speed and the door opening button of the vehicle is pressed at least once, it is determined that the driving state of the vehicle and the door state of the vehicle meet the door control condition.

4. The method according to claim 1, It is characterized in that The vehicle further includes a plurality of voice input devices, the voice module includes a voice word library, the voice input device is connected to the voice module, and when the recognition result of the voice module is a preset recognition result, the prompt flag is changed from a first preset flag to a second preset flag, and before the preset voice prompt is played by the prompt module, the method further includes: When the voice module receives the voice audio sent by the voice input device, it performs noise reduction processing on the voice audio to obtain the noise-reduced audio; Performing speech recognition on the noise reduction audio to obtain a plurality of audio keywords; Matching the plurality of audio keywords with target keywords in the voice word library, and determining whether the target keywords in the voice word library exist in the noise reduction audio; If the target keyword in the voice vocabulary exists in the noise reduction audio, determining the recognition result of the voice module to be the preset recognition result; If the target keyword in the voice vocabulary does not exist in the noise reduction audio, it is determined that the recognition result of the voice module is not the preset recognition result.

5. The method according to claim 1, It is characterized in that The voice module is connected to the prompt module and the control module respectively; the playing of the preset voice prompt by the prompt module comprises: when the prompt module receives the play signal sent by the voice module, the voice prompt is played; The controlling the vehicle door to be normally open by the control module includes: when the control module receives the normally open signal sent by the voice module, controlling the vehicle door to be normally open.

6. The method according to claim 4, It is characterized in that The speech word library includes word libraries corresponding to multiple languages. Before performing speech recognition on the noise reduction audio to obtain multiple audio keywords, the method further includes: Performing speech recognition on the noise-reduced audio to determine a target language corresponding to the noise-reduced audio; The word library corresponding to the target language is determined as the target word library in the speech word library.

7. The method according to claim 6, It is characterized in that The step of matching the plurality of audio keywords with the target keyword in the voice word library and determining whether the target keyword in the voice word library exists in the noise reduction audio frequency comprises: The plurality of audio keywords are matched with the target keywords in the target vocabulary, and it is determined whether the target keywords in the target vocabulary exist in the noise reduction audio.

8. The method according to claim 1, It is characterized in that The method further comprises: If the duration during which the prompt flag is the second preset flag does not exceed the preset duration, a preset operation is performed on the door closing button of the vehicle to cancel the door closing protection mechanism.

9. The method according to claim 1, It is characterized in that The voice module is connected to a station announcement system, and the method further comprises: When the voice module receives the first electrical signal sent by the station announcement system, the voice module is turned on; the first electrical signal is used to indicate that the vehicle has arrived at the station; When the voice module receives the second electrical signal sent by the station announcement system, the voice module is turned off, and the vehicle door is controlled to be always closed through the control module; the second electrical signal is used to indicate that the vehicle has left the station.

10. A door control device based on voice recognition, It is characterized in that Applied to a vehicle, the vehicle includes a voice module, a control module and a prompt module, and the device includes: A prompt flag changing module, used for changing the prompt flag from a first preset flag to a second preset flag when the recognition result of the voice module is a preset recognition result, and playing a preset voice prompt through the prompt module; A door control condition satisfaction module, used for controlling the doors of the vehicle to be normally open and starting the door closing protection mechanism through the control module when the prompt flag is the second preset flag and the driving state of the vehicle and the door state of the vehicle meet the door control condition; The prompt flag recovery module is used to restore the prompt flag from the second preset flag to the first preset flag and cancel the door closing protection mechanism when the duration of the prompt flag being the second preset flag exceeds the preset duration.

11. An electronic device, It is characterized in that include: processor; and A memory having executable codes stored thereon, which, when executed, enables the processor to execute the vehicle door control method based on voice recognition as described in any one of claims 1-9.

12. One or more machine-readable media having executable codes stored thereon, which, when executed, enable a processor to execute the vehicle door control method based on voice recognition as claimed in any one of claims 1 to 9.

Images