Vehicle fault alarm method and device and computer program product

Abstract

The invention discloses a vehicle fault alarm method and device and a computer program product, and the method comprises the steps: receiving a fault alarm signal from a vehicle control system; according to the fault alarm signal, sending out a fault alarm sound through a vehicle-mounted sound output device; recovering the fault alarm sound emitted by the vehicle-mounted sound output equipment, and detecting whether the recovered fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted sound output equipment or not; and if the collected fault alarm sound is not consistent or the collected fault alarm sound is not received within the set time, sending the fault alarm sound through the standby sound output equipment. By introducing a redundancy mechanism of main and standby sound output, when the fault alarm sound emitted by the main sound output equipment cannot be correctly transmitted to a driver, the fault alarm sound can be timely emitted through the standby sound output equipment, so that the reliability and the safety of fault alarm are remarkably improved, and the safety of the driver is improved. And potential safety risks caused by system faults are reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent cockpit, in particular to a vehicle fault alarm method, device and computer program product. BACKGROUND

[0002] The intelligent cockpit is the main carrier of human-computer interaction, which provides various vehicle control modes for the driver and carries the state information feedback of the vehicle. The driving brake system, parking brake system and automatic driving system are strongly related to driving safety. If such systems have a driving safety-impacting fault, the driver needs to be informed in the first time. After detecting the fault, the fault information is sent to the cockpit (including the instrument), and the cockpit alarms through sound, text or instrument warning light in multiple ways to ensure that the alarm can be presented to the driver.

[0003] To ensure that the alarm can be presented to the driver, the industry generally develops the instrument according to functional safety, requiring the instrument to correctly light the alarm lamp. Even if the cockpit controller or instrument has a single point fault, the safety mechanism built-in the cockpit controller and instrument can detect the fault and light the alarm icon.

[0004] The prior art solution is based on the fact that the driver will often observe the current state of the instrument when starting the vehicle or during driving. In fact, during driving, the driver focuses on the road conditions and the driving attitude of the vehicle, and the sound alarm is the most easily perceived way for the driver, so the cockpit sound is mainly relied on to perceive the alarm information. However, the sound alarm function may not be able to output sound due to a single point fault of the system.

[0005] Under the current technical conditions, the cockpit may have a small probability of losing the alarm sound. For example, when the vehicle is in the automatic driving state of high-speed piloting, the system fails and the driver needs to take over, the instrument displays a text reminder or icon asking for takeover, but there is no takeover prompt sound (the cockpit fails to lose sound), the driver may be focused on the road ahead or distracted, and cannot discover the takeover prompt in time, and thus cannot take over within the specified time, which easily leads to traffic accidents. SUMMARY

[0006] The technical problem to be solved by the embodiments of the present application is to provide a vehicle fault alarm method, device and computer program product to improve the timeliness of sound alarm and ensure driving safety.

[0007] To solve the above technical problems, the present application provides a vehicle fault alarm method, comprising the following steps:

[0008] Receiving a fault alarm signal from a vehicle control system;

[0009] According to the fault alarm signal, a fault alarm sound is emitted through a vehicle-mounted sound output device.

[0010] The fault alarm sound emitted by the vehicle-mounted sound output device is collected, and it is detected whether the collected fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device;

[0011] If the collected fault alarm sound is inconsistent or is not received within a set time, the fault alarm sound is emitted by the backup sound output device.

[0012] Preferably, the fault alarm sound is emitted by the vehicle-mounted sound output device according to the fault alarm signal, specifically:

[0013] The fault alarm sound is retrieved and decoded according to the fault alarm signal;

[0014] According to the priority definition of the sound, the output of the sound with low priority is suppressed, and the headrest speaker and the full-vehicle speaker are simultaneously driven to output the fault alarm sound.

[0015] Preferably, the fault alarm sound emitted by the vehicle-mounted sound output device is collected, specifically including:

[0016] The fault alarm sound emitted by the vehicle-mounted sound output device is collected by microphone pickup;

[0017] The audio feature parameters are extracted from the collected fault alarm sound;

[0018] It is identified whether the extracted audio feature parameters match the predefined pattern;

[0019] If the match is found, the identification result is converted into a collection signal of the fault alarm sound.

[0020] Preferably, the consistency of the collected fault alarm sound with the fault alarm sound emitted by the vehicle-mounted sound output device is detected, specifically including:

[0021] The expected audio feature parameters are extracted from the fault alarm sound emitted by the vehicle-mounted sound output device;

[0022] The audio feature parameters extracted from the collected fault alarm sound are compared with the expected audio feature parameters to determine whether they are consistent or the similarity exceeds a preset threshold;

[0023] If the audio feature parameters match or the similarity exceeds the preset threshold, it is determined that the collected fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device; otherwise, it is determined that the consistency is not found.

[0024] Preferably, the fault alarm sound is emitted by the backup sound output device, specifically: the fault alarm sound is output by the sound alarm connected to the cabin controller.

[0025] Preferably, the method further comprises: in response to the operation of the switch by the driver, turning off the non-automatic driving takeover type fault alarm sound.

[0026] Preferably, the method further comprises: automatically switching the language of the fault alarm sound according to the geographical area or language selected by the driver on the cockpit controller.

[0027] Preferably, the method further comprises:

[0028] When a valid certain fault alarm signal is not received, marking the fault alarm signal as invalid or missing;

[0029] Stopping the fault alarm sound from being output through the backup sound output device.

[0030] The present application also provides a vehicle fault alarm device, comprising:

[0031] A collection module for receiving a fault alarm signal from a vehicle control system;

[0032] A main output module for outputting a fault alarm sound through a vehicle-mounted sound output device according to the fault alarm signal;

[0033] A detection module for back collecting the fault alarm sound output by the vehicle-mounted sound output device and detecting whether the back-collected fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device;

[0034] A backup output module for outputting a fault alarm sound through a backup sound output device if the back-collected fault alarm sound is not consistent or if the back-collected fault alarm sound is not received within a set time.

[0035] The present application also provides a vehicle fault alarm device, comprising:

[0036] A cockpit controller for receiving a fault alarm signal from a vehicle control system and generating a corresponding fault alarm sound;

[0037] A vehicle-mounted sound output device for outputting the fault alarm sound according to a control signal of the cockpit controller;

[0038] A sound pickup device for back collecting the fault alarm sound output by the vehicle-mounted sound output device;

[0039] A backup sound output device electrically connected to the cockpit controller for outputting a fault alarm sound when the cockpit controller detects that the fault alarm sound back collected by the sound pickup device is not consistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0040] Preferably, the cockpit controller comprises a safety control unit and a system on chip connected through a serial peripheral interface (SPI), the system on chip being configured to control the vehicle-mounted sound output device to output the fault alarm sound, and the safety control unit being configured to control the backup sound output device to output the fault alarm sound when detecting that the fault alarm sound picked up by the sound pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0041] Preferably, the vehicle-mounted sound output device is specifically a headrest speaker and a vehicle-wide speaker; the backup sound output device is specifically a voice alarm or a buzzer alarm; and the sound pickup device is specifically a microphone.

[0042] Preferably, the cockpit controller is specifically configured to:

[0043] retrieve and decode the fault alarm sound according to the fault alarm signal;

[0044] inhibit the output of a sound of low priority according to a priority definition of the sound, and simultaneously drive the headrest speaker and the vehicle-wide speaker to output the fault alarm sound.

[0045] Preferably, the cockpit controller is further configured to:

[0046] extract an audio feature parameter from the fault alarm sound picked up by the microphone;

[0047] identify whether the extracted audio feature parameter matches a predefined pattern;

[0048] if so, convert the identification result into a picked-up signal of the fault alarm sound.

[0049] Preferably, the detection of whether the picked-up fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device specifically comprises:

[0050] extracting an expected audio feature parameter from the fault alarm sound output by the vehicle-mounted sound output device;

[0051] comparing the audio feature parameter extracted from the picked-up fault alarm sound with the expected audio feature parameter to determine whether they are consistent or the similarity exceeds a preset threshold;

[0052] if the audio feature parameters match or the similarity exceeds the preset threshold, determining that the picked-up fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device; otherwise, determining that they are inconsistent.

[0053] The present application also provides a vehicle fault alarm device, comprising:

[0054] one or more processors;

[0055] a memory;

[0056] one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more application programs are configured to execute the vehicle fault alarm method.

[0057] The application further provides a computer program product comprising computer instructions for instructing a computer device to perform operations corresponding to the method.

[0058] The application has the following beneficial effects: the application introduces a redundancy mechanism of main and backup sound outputs, when the fault alarm sound emitted by the main sound output device fails to be correctly conveyed to the driver, the backup sound output device can timely discover and emit the fault alarm sound, thereby significantly improving the reliability and safety of the fault alarm, reducing potential safety risks caused by system faults, ensuring that the driver can receive critical alarm information at critical moments, thereby effectively preventing traffic accidents. Meanwhile, the application also supports automatic switching of the language of the alarm signal according to the geographical area or language selected by the driver, so that the system is more flexible and adaptive to different use scenarios. In addition, the application can timely and accurately emit the alarm prompt sound, and automatically exit the automatic driving state after the driver takes over the vehicle, thereby avoiding unnecessary interference and greatly improving the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0059] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description only constitute some embodiments of the application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0060] Figure 1 is a flowchart of a vehicle fault alarm method according to an embodiment of the application.

[0061] Figure 2 is a schematic diagram of an implementation architecture of a vehicle fault alarm method according to an embodiment of the application.

[0062] Figure 3 is a schematic diagram of a structure of a cockpit controller according to an embodiment of the application. DETAILED DESCRIPTION

[0063] The following description of the embodiments is with reference to the drawings, which are used to illustrate specific embodiments of the application that can be implemented.

[0064] Please refer to Figure 1As shown in the drawings, the embodiment one of the present application provides a vehicle fault alarm method, comprising the following steps:

[0065] receiving a fault alarm signal from a vehicle control system;

[0066] According to the fault alarm signal, issuing a fault alarm sound through a vehicle-mounted sound output device;

[0067] backing up the fault alarm sound issued by the vehicle-mounted sound output device and detecting whether the backed-up fault alarm sound is consistent with the fault alarm sound issued by the vehicle-mounted sound output device;

[0068] If the backed-up fault alarm sound is not consistent with the fault alarm sound issued by the vehicle-mounted sound output device or the backed-up fault alarm sound is not received within a set time, issuing a fault alarm sound through a backup sound output device.

[0069] As known from the above steps, the present application introduces a redundancy mechanism of main and backup sound outputs. When the fault alarm sound issued by the main sound output device fails to be correctly conveyed to the driver, the backup sound output device can timely issue a fault alarm sound, thereby significantly improving the reliability and safety of fault alarm, reducing potential safety risks caused by system failure, ensuring that the driver can receive critical alarm information at critical moments, and effectively preventing traffic accidents.

[0070] Specifically, please refer to Figure 2 and Figure 3 As shown in the drawings, the vehicle fault alarm method of the embodiment of the present application is implemented based on the following elements:

[0071] A cockpit controller 60, which includes a safety control unit 600 and a system on chip 620 connected by a serial peripheral interface SPI. The safety control unit 600 is abbreviated as MCU, which specifically includes: alarm signal management 602, alarm information verification 604, fault processing 605, backup alarm processing 606 and other modules. The system on chip 620 is abbreviated as SOC, which specifically includes: alarm signal processing 610, voice decoding 611, voice arbitration 612, voice output 613, voice collection 614 and voice recognition 615 and other modules. The cockpit controller 60 is used for receiving and processing fault alarm signals, outputting sound signals and image information; as a driver to realize vehicle control, obtain vehicle state and other human-computer interaction media; as a video and audio entertainment control center, etc. The MCU 600 in the cockpit controller 60 is connected to the SOC 620 through a bus, and the MCU 600 can send alarm signals to the SOC 620 through the bus, receive the sound alarm signals collected by the SOC 620, and request the SOC 620 to reset the voice related modules or the entire SOC 620. Other controllers such as automatic driving controllers are connected to the cockpit controller 60 through a CAN bus or an Ethernet bus, and input state information or alarm signals.

[0072] A speaker has two output channels: a headrest speaker 70 and a full-vehicle speaker 80 (a speaker not in the headrest position). The cockpit controller 60 outputs sound signals to the headrest speaker 70 and the full-vehicle speaker 80 (including multiple speakers) through audio lines. In this embodiment, the speaker is used as a vehicle-mounted sound output device, and the full-vehicle speaker 80 is used as the default output speaker for fault alarm sound. At the same time that the full-vehicle speaker 80 outputs the fault alarm sound, the fault alarm sound is also output synchronously from the headrest speaker 70, and since the headrest speaker 70 is closer to the driver, it helps the driver to perceive the fault alarm sound in a timely and accurate manner.

[0073] A microphone has two input channels: a first microphone 10 and a second microphone 20. The microphone is connected to the cockpit controller 60 through an audio line for sound pickup in the cockpit, collecting sound information, including alarm sound. The second microphone 20 is used to assist the first microphone 10 in collecting sound information. If a single microphone fails or fails to accurately pick up sound due to the installation position of the microphone, it may lead to a false conclusion that no fault alarm sound is output, so this embodiment preferably uses two microphone inputs.

[0074] A sound alarm 100 is dedicated to sound alarm and can be a voice alarm or a buzzer alarm. The MCU 600 in the cockpit controller 60 is connected to the sound alarm 100 through an audio line to output a sound alarm. In this embodiment, the sound alarm 100 is used as a backup sound output device when the alarm sound fails to be output from the speaker.

[0075] Instrument 90, used for graphical display of vehicle status information, is an important medium for the driver to obtain vehicle warning information through vision, including text or warning lights. The cockpit controller 60 is connected to the instrument 90 through the LVDS video line, and outputs the image signal to the instrument 90.

[0076] Switch 50, used for resetting the cockpit controller 60 and turning off the sound alarm 100. The MCU 600 in the cockpit controller 60 is connected to the switch 50 through a hard wire, and the switch 50 can stop the sound alarm 100 from sounding.

[0077] Next, the specific flow of a vehicle fault alarm method according to an embodiment of the application is introduced.

[0078] (I) Generation and transmission of vehicle fault alarm signals

[0079] A plurality of electronic control units (ECUs) in the vehicle, such as automatic driving controllers, brake controllers and steering controllers, are responsible for monitoring the key functions and states of the vehicle. When these controllers detect a fault or an abnormal situation, for example, the automatic driving system approaches the boundary of the operational design domain (ODD), or the driver's hands-off time exceeds the safety limit, or the monitoring system detects that the driver is not paying attention, they will send fault alarm information through the internal communication bus (such as CAN bus) of the vehicle.

[0080] After receiving these fault alarm information, the cockpit controller processes it. The cockpit controller is the center of human-machine interaction inside the vehicle, responsible for displaying the vehicle status and alarm information to the driver in the form of sound and image. After integrating these fault alarm information, the cockpit controller displays it to the driver through the display device (such as the instrument) and the sound system (such as the loudspeaker) in the cockpit. The following describes the working process taking the takeover type alarm signal as an example, and other fault alarm signal processing methods are similar.

[0081] When the automatic driving system detects a situation that requires the driver to take over the vehicle (such as approaching the boundary of the ODD, the driver's hands-off time being too long, or the driver's attention being not concentrated), the automatic driving controller will send a takeover request signal through the bus.

[0082] (II) Output and verification of vehicle fault alarm sound

[0083] After receiving the takeover request signal, the cockpit controller 60 will trigger the corresponding alarm mechanism, and send a takeover request to the driver through sound (such as voice prompt or beep) and image (such as warning light or text prompt on the instrument).

[0084] The network input management module 601 of the MCU 600 in the cabin controller 60 receives the takeover request and other signals, separates the takeover request signal from them, and sends it to the alarm signal management module 602 and the alarm information verification module 604. The alarm signal management module 602 packages the takeover signal or other alarm signals and forwards them to the second input / output management module 609 of the SOC 620 through the first input / output management module 603.

[0085] After receiving the alarm signal, the second input / output management module 609 forwards it to the alarm signal processing module 610. Takeover-type alarms need to remind the driver through sound, alarm lights, and text at the same time, so the alarm signal processing module 610 forwards it to the display rendering module 616 or the speech decoding module 611 according to the type of the alarm.

[0086] The speech decoding module 611 retrieves and decodes the takeover prompt sound according to the alarm signal code and outputs it to the speech arbitration module 612.

[0087] The speech arbitration module 612 suppresses the output of low-priority sound according to the priority definition of the sound and sends the alarm sound to the speech output module 613, while driving the headrest speaker 70 and the vehicle-wide speaker 80 to output the takeover prompt sound. The display rendering module 616 completes display rendering based on the current theme, vehicle information, and alarm signal, and then outputs image information to the instrument screen 90 through the display output module 617.

[0088] After the speech output module 613 outputs the takeover prompt sound, it will trigger monitoring of the takeover prompt sound synchronously. The specific process is as follows: after the microphone picks up the sound, it is input to the speech collection module 614, which processes and sends the audio to the speech recognition module 615. The speech recognition module 615 extracts useful audio feature parameters from the audio, which usually include: frequency characteristics such as fundamental frequency (pitch), formant (vocal tract characteristics); time characteristics such as syllable duration and interval between syllables; amplitude characteristics such as sound intensity and volume change; spectral characteristics such as sound spectral distribution; Mel frequency cepstral coefficient (MFCC), etc.

[0089] The extracted audio feature parameters are compared with predefined patterns, which are obtained by the system through learning a large number of voice samples in the training stage. The purpose of pattern matching is to determine whether the collected audio signal matches the specific voice or sound pattern preset in the system. Pattern matching usually uses some algorithms, such as dynamic time warping (DTW), hidden Markov model (HMM), or deep learning models (such as convolutional neural network CNN, recurrent neural network RNN). Through pattern matching, the system generates an identification result, which is used to indicate whether the collected audio signal matches the predefined takeover prompt tone pattern. If the match is successful, the system considers that the audio picked up by the microphone is the takeover prompt tone.

[0090] After that, the identification result is further converted into a back-sampling signal of the takeover prompt tone. The back-sampling signal of the takeover prompt tone is usually a digital signal containing the identification result and related timestamp information, which is sent to the alarm information verification module 604 for further processing.

[0091] After receiving the takeover request signal of the autonomous driving controller, the alarm information verification module 604 starts a timer to monitor the playback and back-sampling process of the takeover prompt tone. After receiving the back-sampling signal of the takeover prompt tone sent back by the SOC 620, the alarm information verification module 604 compares the received takeover request signal with the back-sampling signal of the takeover prompt tone sent back by the SOC to verify whether the takeover prompt tone has been played as expected. If the comparison is consistent, that is, the back-sampling signal matches the takeover request signal, it means that the takeover prompt tone has been normally issued, and the driver should have heard the takeover prompt tone. The alarm information verification module 604 will determine that the verification is passed.

[0092] Specifically, the consistency of the back-sampled fault alarm sound with the fault alarm sound emitted by the vehicle-mounted sound output device is detected, which includes the following steps:

[0093] Obtaining expected audio features: First, extract the expected audio feature parameters from the fault alarm sound emitted by the vehicle-mounted sound output device, which represent the characteristics of the normally played fault alarm sound.

[0094] Comparing audio features: Compare the audio feature parameters extracted from the back-sampled fault alarm sound with the expected audio feature parameters to determine whether they are consistent or the similarity exceeds a preset threshold.

[0095] Determining consistency: According to the comparison result, determine whether the back-sampled fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device: if the audio feature parameters match or the similarity exceeds the preset threshold, determine that they are consistent; otherwise, determine that they are inconsistent.

[0096] If the driver has taken over the vehicle after the takeover prompt sound is sent, and the MCU 600 does not continue to receive a valid takeover request signal from the automatic driving controller, the system will not enter the verification process. In this case, the system will stop timing and end the verification. If the comparison is inconsistent, or the MCU 600 does not receive a back-sampling signal of the takeover prompt sound sent back within a set time, indicating that the takeover prompt sound is not played correctly, or the sound played is inconsistent with the expected, the verification fails.

[0097] After the verification fails, the fault handling module 605 of the MCU 600 triggers the backup output mechanism specially set in the embodiments of the present application, that is, the takeover prompt sound is sent through the backup sound output device. Specifically, the backup alarm processing module 606 sends the takeover prompt sound to the sound alarm 100, reminding the driver to pay attention to the vehicle state and observing the instrument panel alarm. At the same time, the fault handling module 605 of the MCU 600 monitors the heartbeat state with the SOC 620, if the heartbeat signal is normal, the MCU 600 triggers the voice related module reset of the SOC 620, if the heartbeat signal is not normal, the MCU 600 triggers the overall reset of the SOC 620.

[0098] After the driver perceives the alarm sound sent by the sound alarm 100 and takes over the vehicle, the automatic driving controller exits the automatic driving state and no longer sends the takeover request signal.

[0099] It should be noted that the headrest speaker 70 and the full-vehicle speaker 80 as the main sound output device are connected to and controlled by the SOC 620, and the sound alarm 100 as the backup sound output device is connected to and controlled by the MCU 600, that is, the two alarm sound outputs are independent of each other and do not affect each other; and the failure rate of the backup sound output link controlled by the MCU 600 is lower than that of the main sound output link controlled by the SOC 620, the safety of the sound alarm is improved, and the burden on the driver is reduced.

[0100] If the MCU 600 does not receive a valid takeover request signal from the autopilot controller, the alarm information verification module 604 will change the verification result. Furthermore, the fault handling module 605 will trigger the backup alarm handling module 606 to stop the alarm sound. Specifically, when the autopilot controller requires driver takeover, it sends a takeover request signal to the MCU. If the MCU does not receive this valid takeover request signal, it indicates that the driver has taken over. The alarm information verification module 604 will change its verification result according to the current state, marking the fault alarm signal as canceled or invalid because the expected takeover request signal was not received. After the alarm information verification module 604 changes the verification result, the fault handling module 605 will receive this information and trigger the backup alarm handling module 606 to stop emitting the alarm sound. The alarm sound is stopped because the system considers the current alarm signal to be canceled or invalid, therefore, there is no need to continue prompting the driver.

[0101] Through this multi-layered fault detection and handling mechanism, the system can improve its overall reliability and robustness. Even in the event of a failure of the main alarm mechanism, the backup alarm handling module and fault handling module can ensure that the driver receives the necessary takeover prompts, thereby guaranteeing driving safety.

[0102] If it is a non-autonomous driving takeover alarm sound, the driver can turn off the alarm sound by operating switch 50, such as by pressing the switch twice or by other operating methods.

[0103] Based on the geographical region or language selected by the driver on the cockpit controller 60, the system automatically switches the language of voice alarm signals such as takeover prompts. To prevent the driver from accidentally turning off or lowering the volume, the alarm sound level is set to the system default and is not controlled by the volume adjustment switch.

[0104] Corresponding to the vehicle fault alarm method described in Embodiment 1 of the present invention, Embodiment 2 of the present invention also provides a vehicle fault alarm device.

[0105] The data acquisition module is used to receive fault alarm signals from the vehicle control system.

[0106] The main output module is used to emit a fault alarm sound through the vehicle-mounted sound output device based on the fault alarm signal;

[0107] The detection module is used to collect the fault alarm sound emitted by the vehicle-mounted audio output device and detect whether the collected fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted audio output device.

[0108] The backup output module is used to issue a fault alarm sound through the backup sound output device if there is inconsistency or if no fault alarm sound is received within a set time.

[0109] Corresponding to the vehicle fault alarm method of the aforementioned embodiment one of the present application, the present application embodiment three also provides a vehicle fault alarm device, comprising:

[0110] a cockpit controller for receiving a fault alarm signal from a vehicle control system and generating a corresponding fault alarm sound;

[0111] a vehicle-mounted sound output device for outputting the fault alarm sound according to the control signal of the cockpit controller;

[0112] a pickup device for back-drawing the fault alarm sound output by the vehicle-mounted sound output device;

[0113] a backup sound output device electrically connected to the cockpit controller, for outputting a fault alarm sound when the cockpit controller detects that the fault alarm sound back-drawn by the pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0114] Preferably, the cockpit controller comprises a safety control unit and a system on chip connected through a serial peripheral interface (SPI), the system on chip being configured to control the vehicle-mounted sound output device to output the fault alarm sound, and the safety control unit being configured to control the backup sound output device to output a fault alarm sound when detecting that the fault alarm sound back-drawn by the pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0115] Preferably, the vehicle-mounted sound output device is specifically a headrest speaker and a whole-vehicle speaker; the backup sound output device is specifically a voice alarm or a buzzer alarm; and the pickup device is specifically a microphone.

[0116] Preferably, the cockpit controller is specifically configured to:

[0117] retrieve and decode a fault alarm sound according to the fault alarm signal;

[0118] inhibit the output of a low-priority sound according to a sound priority definition, and simultaneously drive the headrest speaker and the whole-vehicle speaker to output the fault alarm sound.

[0119] Preferably, the cockpit controller is further configured to:

[0120] extract an audio feature parameter from the fault alarm sound back-drawn by the microphone;

[0121] identify whether the extracted audio feature parameter matches a predefined pattern;

[0122] if the match is found, convert the identification result into a back-drawing signal of the fault alarm sound.

[0123] Preferably, the detection of the fault alarm sound of the back mining is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device, and specifically includes:

[0124] extracting the expected audio feature parameters from the fault alarm sound emitted by the vehicle-mounted sound output device;

[0125] comparing the audio feature parameters extracted from the fault alarm sound of the back mining with the expected audio feature parameters to determine whether they are consistent or the similarity exceeds a preset threshold;

[0126] if the audio feature parameters match or the similarity exceeds the preset threshold, it is determined that the fault alarm sound of the back mining is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device; otherwise, it is determined that they are inconsistent.

[0127] Corresponding to the vehicle fault alarm method of the aforementioned embodiment one, the present application embodiment three further provides a vehicle fault alarm device, comprising:

[0128] one or more processors;

[0129] a memory;

[0130] one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more application programs are configured to execute the vehicle fault alarm method.

[0131] Corresponding to the vehicle fault alarm method of the aforementioned embodiment one, the present application embodiment four further provides a computer program product, comprising computer instructions instructing a computer device to execute the operations corresponding to the method.

[0132] Preferably, the processor can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor, or the processor can also be any conventional processor. The processor is the control center of the device, and connects various parts of the device through various interfaces and lines.

[0133] The memory mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required by a function, and the like, and the data storage area can store relevant data and the like. In addition, the memory can be a high-speed random access memory, and can also be a non-volatile memory such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, and the like, or the memory can also be other volatile solid-state storage devices.

[0134] It should be noted that the above device can include but is not limited to a processor and a memory, which can be understood by those skilled in the art.

[0135] For the working principle and process of the above-mentioned embodiments, refer to the foregoing description of the first embodiment of the present application, which will not be repeated here.

[0136] As can be seen from the above description, compared with the prior art, the beneficial effects of the present application are as follows: by introducing the redundancy mechanism of the main and backup sound output, when the fault alarm sound emitted by the main sound output device fails to correctly convey to the driver, the backup sound output device can timely discover and emit the fault alarm sound, thereby significantly improving the reliability and safety of the fault alarm, reducing the potential safety risk caused by system failure, ensuring that the driver can receive critical alarm information at critical moments, thereby effectively preventing traffic accidents. At the same time, the present application also supports automatic switching of the language of the alarm signal according to the geographical area or language selected by the driver, making the system more flexible and adaptable to different use scenarios. In addition, the present application can timely and accurately emit an alarm prompt sound, and automatically exit the automatic driving state after the driver takes over the vehicle, thereby avoiding unnecessary interference and greatly improving the user experience.

[0137] The above disclosure is only the preferred embodiment of the present application, and of course cannot limit the scope of the right of the present application, therefore the equivalent changes made according to the claims of the present application still belong to the scope covered by the present application.

Claims

1. A vehicle fault alarm method, characterized in that, Includes the following steps: Receive fault alarm signals from the vehicle control system; Based on the fault alarm signal, a fault alarm sound is emitted through the vehicle-mounted audio output device; The fault alarm sounds emitted by the vehicle-mounted audio output device are collected and the consistency between the collected fault alarm sounds and those emitted by the vehicle-mounted audio output device is checked. If there is a discrepancy or if no fault alarm sound is received within the set time, a fault alarm sound will be issued through the backup sound output device.

2. The method according to claim 1, characterized in that, The step of emitting a fault alarm sound through the vehicle-mounted audio output device based on the fault alarm signal is specifically as follows: The fault alarm sound is retrieved and decoded based on the fault alarm signal; Based on the definition of sound priority, low-priority sound output is suppressed, while the headrest speakers and all vehicle speakers are driven to output the fault alarm sound simultaneously.

3. The method according to claim 1, characterized in that, The process of re-collecting fault alarm sounds emitted by the vehicle-mounted audio output device specifically includes: The fault alarm sound emitted by the vehicle-mounted sound output device is picked up and returned by the microphone; Extract audio feature parameters from the collected fault alarm sounds; It identifies whether the extracted audio feature parameters match a predefined pattern; If a match is found, the identification result will be converted into a fault alarm sound signal.

4. The method according to claim 3, characterized in that, Whether the fault alarm sound detected and collected is consistent with the fault alarm sound emitted through the vehicle-mounted sound output device, specifically includes: Extract the expected audio feature parameters from the fault alarm sounds emitted by the vehicle's audio output device; The audio feature parameters extracted from the fault alarm sound are compared with the expected audio feature parameters to determine whether they are consistent or whether the similarity exceeds a preset threshold. If the audio feature parameters match or the similarity exceeds a preset threshold, the fault alarm sound collected is determined to be consistent with the fault alarm sound emitted through the vehicle audio output device; otherwise, it is determined to be inconsistent.

5. The method according to claim 1, characterized in that, Specifically, the fault alarm sound is emitted through the backup sound output device by outputting a fault alarm sound through a sound alarm connected to the cockpit controller.

6. The method according to claim 1, characterized in that, Also includes: In response to the driver's operation of the switch, the alarm sound for non-autonomous driving takeover faults is turned off.

7. The method according to claim 1, characterized in that, Also includes: The language of the fault alarm sound is automatically switched based on the geographical region or language selected by the driver on the cockpit controller.

8. The method according to claim 1, characterized in that, Also includes: When no valid fault alarm signal is received, the fault alarm signal is marked as invalid or missing. Stop issuing fault alarm sounds through the backup sound output device.

9. A vehicle fault alarm device, characterized in that, include: The data acquisition module is used to receive fault alarm signals from the vehicle control system. The main output module is used to emit a fault alarm sound through the vehicle-mounted sound output device based on the fault alarm signal; The detection module is used to collect the fault alarm sound emitted by the vehicle-mounted audio output device and detect whether the collected fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted audio output device. The backup output module is used to issue a fault alarm sound through the backup sound output device if there is inconsistency or if no fault alarm sound is received within a set time.

10. A vehicle fault alarm device, characterized in that, include: The cockpit controller is used to receive fault alarm signals from the vehicle control system and generate corresponding fault alarm sounds. The vehicle-mounted audio output device is used to output the fault alarm sound according to the control signal from the cockpit controller; A sound pickup device is used to collect the fault alarm sound output by the vehicle-mounted sound output device; A backup audio output device, electrically connected to the cockpit controller, is used to output a fault alarm sound when the cockpit controller detects that the fault alarm sound collected by the pickup device is inconsistent with the fault alarm sound output by the vehicle audio output device.

11. The apparatus according to claim 10, characterized in that, The cockpit controller includes a safety control unit and a system-on-a-chip connected via a serial peripheral interface (SPI). The system-on-a-chip is used to control the vehicle-mounted audio output device to output the fault alarm sound. The safety control unit is used to control the backup audio output device to output the fault alarm sound when it detects that the fault alarm sound collected by the pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted audio output device.

12. The apparatus according to claim 11, characterized in that, The in-vehicle sound output device is specifically a headrest speaker and a whole vehicle speaker, both of which are electrically connected to the system-on-a-chip; the backup sound output device is specifically a voice alarm or a buzzer alarm, which is electrically connected to the safety control unit; the sound pickup device is specifically a microphone, which is electrically connected to the system-on-a-chip.

13. The apparatus according to claim 12, characterized in that, The cockpit controller is specifically used for: The fault alarm sound is retrieved and decoded based on the fault alarm signal; Based on the definition of sound priority, low-priority sound output is suppressed, while the headrest speakers and all vehicle speakers are driven to output the fault alarm sound simultaneously.

14. The apparatus according to claim 13, characterized in that, The cockpit controller is also used for: Extract audio feature parameters from fault alarm sounds captured by the microphone; It identifies whether the extracted audio feature parameters match a predefined pattern; If a match is found, the identification result will be converted into a fault alarm sound signal.

15. The apparatus according to claim 14, characterized in that, Whether the fault alarm sound detected and collected is consistent with the fault alarm sound emitted through the vehicle-mounted sound output device, specifically includes: Extract the expected audio feature parameters from the fault alarm sounds emitted by the vehicle's audio output device; The audio feature parameters extracted from the fault alarm sound are compared with the expected audio feature parameters to determine whether they are consistent or whether the similarity exceeds a preset threshold. If the audio feature parameters match or the similarity exceeds a preset threshold, the fault alarm sound collected is determined to be consistent with the fault alarm sound emitted through the vehicle audio output device; otherwise, it is determined to be inconsistent.

16. A vehicle fault alarm device, characterized in that, include: One or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications being configured to perform the vehicle fault alarm method as described in any one of claims 1 to 8.

17. A computer program product, characterized in that, Includes computer instructions that instruct a computer device to perform an operation corresponding to the method as described in any one of claims 1 to 8.

Images