Vehicle fault alarm method and apparatus, and computer program product

Abstract

Disclosed in the present disclosure are a vehicle fault alarm method and apparatus, and a computer program product. The method comprises: receiving a fault alarm signal from a vehicle control system; on the basis of the fault alarm signal, emitting a fault alarm sound by means of a vehicle-mounted sound output device; looping back the fault alarm sound emitted by the vehicle-mounted sound output device, and detecting whether the looped back fault alarm sound is consistent with the fault alarm sound emitted by means of the vehicle-mounted sound output device; and if the looped back fault alarm sound is not consistent with the fault alarm sound emitted by means of the vehicle-mounted sound output device or if the looped back fault alarm sound is not received within a set period of time, emitting the fault alarm sound by means of a standby sound output device. By means of introducing a redundancy mechanism for primary and standby sound outputs, the present disclosure can emit a fault alarm sound by means of a standby sound output device in a timely manner when the fault alarm sound emitted by a primary sound output device fails to be correctly conveyed to a driver, thereby significantly improving the reliability and safety of fault alarms, and reducing potential safety risks caused by system faults.

Description

Vehicle fault alarm method, device and computer program product TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of intelligent cockpit, in particular to a vehicle fault alarm method, device and computer program product. BACKGROUND

[0002] The intelligent cockpit is the main carrier of human-computer interaction, which not only provides various vehicle control modes for the driver, but also carries the state information feedback function of the vehicle. The driving brake system, parking brake system and automatic driving system are strongly related to driving safety. If such systems have a driving safety-impacting fault, the driver needs to be informed in the first time. After detecting the fault, the fault information is sent to the cockpit (including the instrument), and the cockpit alarms through sound, text or instrument warning light in multiple ways to ensure that the alarm can be presented to the driver.

[0003] To ensure that the alarm can be presented to the driver, the industry generally develops the instrument according to functional safety, requiring the instrument to correctly light the alarm lamp. Even if the cockpit controller or instrument has a single-point fault, the safety mechanism built-in the cockpit controller and instrument can detect the fault and light the alarm icon.

[0004] The prior art solution is based on the fact that the driver will often observe the current state of the instrument when starting the vehicle or during driving. In fact, during driving, the driver focuses on the road conditions and the driving attitude of the vehicle, and the sound alarm is the most easily perceived way for the driver, so the cockpit sound is mainly relied on to perceive the alarm information. However, the sound alarm function may not be able to output sound due to a single-point system fault.

[0005] Under the current technical conditions, there is a small probability that the cockpit will lose the alarm sound. For example, when the vehicle is in the automatic driving state of high-speed piloting, the system fault needs to be taken over by the driver, and the instrument displays a text reminder or icon asking for takeover, but there is no takeover prompt sound (the cockpit fault causes the loss of sound), the driver may be focused on the road ahead or distracted, and cannot discover the takeover prompt in time, and thus cannot take over within the specified time, which easily leads to traffic accidents. SUMMARY

[0006] The technical problem to be solved by the embodiments of the present disclosure is to provide a vehicle fault alarm method, device and computer program product to improve the timeliness of sound alarm and ensure driving safety.

[0007] To solve the above technical problem, the present disclosure provides a vehicle fault alarm method, comprising the following steps:

[0008] receiving a fault alarm signal from a vehicle control system;

[0009] According to the fault alarm signal, a fault alarm sound is emitted through a vehicle-mounted sound output device;

[0010] The fault alarm sound emitted by the vehicle-mounted sound output device is backhauled, and it is detected whether the backhauled fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device;

[0011] If the backhauled fault alarm sound is inconsistent or is not received within a set time, a fault alarm sound is emitted through a backup sound output device.

[0012] Optionally, according to the fault alarm signal, a fault alarm sound is emitted through a vehicle-mounted sound output device, specifically:

[0013] According to the fault alarm signal, a fault alarm sound is retrieved and decoded;

[0014] According to a sound priority definition, low-priority sound output is suppressed, and the headrest speaker and the full-vehicle speaker are simultaneously driven to output the fault alarm sound.

[0015] Optionally, the backhauling of the fault alarm sound emitted by the vehicle-mounted sound output device specifically includes:

[0016] The fault alarm sound emitted by the vehicle-mounted sound output device is backhauled through microphone sound pickup;

[0017] Audio feature parameters are extracted from the backhauled fault alarm sound;

[0018] It is identified whether the extracted audio feature parameters match a predefined pattern;

[0019] If the match is identified, the identification result is converted into a backhauling signal of the fault alarm sound.

[0020] Optionally, the detection of whether the backhauled fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device specifically includes:

[0021] Expected audio feature parameters are extracted from the fault alarm sound emitted by the vehicle-mounted sound output device;

[0022] The audio feature parameters extracted from the backhauled fault alarm sound are compared with the expected audio feature parameters to determine whether they are consistent or the similarity exceeds a preset threshold;

[0023] If the audio feature parameters match or the similarity exceeds the preset threshold, it is determined that the backhauled fault alarm sound is consistent with the fault alarm sound emitted by the vehicle-mounted sound output device; otherwise, it is determined that the backhauled fault alarm sound is inconsistent with the fault alarm sound emitted by the vehicle-mounted sound output device.

[0024] Optionally, the issuing of the failure alarm sound through the backup sound output device specifically comprises: outputting the failure alarm sound through a sound alarm connected to the cockpit controller.

[0025] Optionally, the method further comprises: in response to the operation of the switch by the driver, turning off the non-automatic driving takeover type failure alarm sound.

[0026] Optionally, the method further comprises: automatically switching the language of the failure alarm sound according to the geographical area or language selected by the driver on the cockpit controller.

[0027] Optionally, the method further comprises:

[0028] When a valid failure alarm signal is not received, marking the failure alarm signal as invalid or missing;

[0029] Stopping the issuing of the failure alarm sound through the backup sound output device.

[0030] The present disclosure also provides a vehicle failure alarm device, comprising:

[0031] A collection module configured to receive a failure alarm signal from a vehicle control system;

[0032] A main output module configured to issue a failure alarm sound through a vehicle-mounted sound output device according to the failure alarm signal;

[0033] A detection module configured to back up the failure alarm sound issued by the vehicle-mounted sound output device and detect whether the back-up failure alarm sound is consistent with the failure alarm sound issued through the vehicle-mounted sound output device;

[0034] A backup output module configured to issue a failure alarm sound through a backup sound output device if the back-up failure alarm sound is not consistent or if the back-up failure alarm sound is not received within a set time.

[0035] The present disclosure also provides a vehicle failure alarm device, comprising:

[0036] A cockpit controller configured to receive a failure alarm signal from a vehicle control system and generate a corresponding failure alarm sound;

[0037] A vehicle-mounted sound output device configured to output the failure alarm sound according to a control signal of the cockpit controller;

[0038] A sound pickup device configured to back up the failure alarm sound output by the vehicle-mounted sound output device;

[0039] The backup sound output device is electrically connected with the cabin controller and is configured to output the fault alarm sound when the cabin controller detects that the fault alarm sound collected by the sound pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0040] Optionally, the cabin controller comprises a safety control unit and a system on chip connected through a serial peripheral interface, the system on chip is configured to control the vehicle-mounted sound output device to output the fault alarm sound, and the safety control unit is configured to control the backup sound output device to output the fault alarm sound when it is detected that the fault alarm sound collected by the sound pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0041] Optionally, the vehicle-mounted sound output device is specifically a headrest loudspeaker and a full-vehicle loudspeaker, the backup sound output device is specifically a voice alarm or a buzzer alarm, and the sound pickup device is specifically a microphone.

[0042] Optionally, the cabin controller is specifically configured to:

[0043] retrieve and decode the fault alarm sound according to the fault alarm signal;

[0044] inhibit the output of a sound with a low priority according to a priority definition of the sound, and simultaneously drive the headrest loudspeaker and the full-vehicle loudspeaker to output the fault alarm sound.

[0045] Optionally, the cabin controller is further configured to:

[0046] extract an audio feature parameter from the fault alarm sound collected by the microphone;

[0047] identify whether the extracted audio feature parameter matches a predefined pattern;

[0048] if the match is found, convert the identification result into a collection signal of the fault alarm sound.

[0049] Optionally, the detection of whether the collected fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device specifically comprises:

[0050] extract an expected audio feature parameter from the fault alarm sound output by the vehicle-mounted sound output device;

[0051] compare the audio feature parameter extracted from the collected fault alarm sound with the expected audio feature parameter to determine whether they are consistent or whether the similarity exceeds a preset threshold;

[0052] If the audio feature parameters match or the similarity exceeds a preset threshold, it is determined that the failure alarm sound of the backhaul is consistent with the failure alarm sound output by the vehicle-mounted sound output device; otherwise, it is determined that the failure alarm sound is inconsistent.

[0053] The present disclosure also provides a vehicle failure alarm device, comprising:

[0054] one or more processors;

[0055] a memory;

[0056] one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more application programs are configured to execute the vehicle failure alarm method.

[0057] The present disclosure also provides a computer program product comprising computer instructions instructing a computer device to perform operations corresponding to the method.

[0058] The present disclosure has the following beneficial effects: the present disclosure introduces a redundancy mechanism of main and backup sound output, when the failure alarm sound output by the main sound output device fails to be correctly conveyed to the driver, the backup sound output device can timely discover and output the failure alarm sound, thereby significantly improving the reliability and safety of the failure alarm, reducing the potential safety risk caused by system failure, ensuring that the driver can receive critical alarm information at critical moments, thereby effectively preventing traffic accidents. At the same time, the present disclosure also supports automatic switching of the language of the alarm signal according to the geographical area or language selected by the driver, making the system more flexible and adaptable to different use scenarios. In addition, the present disclosure can timely and accurately output the alarm prompt sound, and automatically exit the automatic driving state after the driver takes over the vehicle, avoiding unnecessary interference, and greatly improving the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0059] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and those skilled in the art can obtain other drawings according to these drawings without creative labor.

[0060] FIG. 1 is a flow diagram of a vehicle failure alarm method according to an embodiment of the present disclosure;

[0061] FIG. 2 is a schematic diagram of an implementation architecture of a vehicle failure alarm method according to an embodiment of the present disclosure;

[0062] FIG. 3 is a structural schematic diagram of a cockpit controller according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0063] The following description of the embodiments is provided with reference to the drawings, which are intended to illustrate specific embodiments in which the present disclosure can be implemented.

[0064] Referring to FIG. 1, a vehicle fault alarm method according to an embodiment of the present disclosure includes the following steps.

[0065] Receiving a fault alarm signal from a vehicle control system;

[0066] According to the fault alarm signal, issuing a fault alarm sound through a vehicle-mounted sound output device;

[0067] Sensing the fault alarm sound issued by the vehicle-mounted sound output device and detecting whether the sensed fault alarm sound is consistent with the fault alarm sound issued by the vehicle-mounted sound output device;

[0068] If the sensed fault alarm sound is not consistent with the fault alarm sound issued by the vehicle-mounted sound output device or the sensed fault alarm sound is not received within a set time, issuing a fault alarm sound through a backup sound output device.

[0069] As can be seen from the above steps, the present disclosure introduces a redundancy mechanism of main and backup sound outputs. When the fault alarm sound issued by the main sound output device fails to be correctly conveyed to the driver, the present disclosure can timely find and issue a fault alarm sound through the backup sound output device, thereby significantly improving the reliability and safety of fault alarm, reducing potential safety risks caused by system failure, and ensuring that the driver can receive critical alarm information at critical moments, thereby effectively preventing traffic accidents.

[0070] Specifically, referring to FIGS. 2 and 3, the vehicle fault alarm method according to an embodiment of the present disclosure is implemented based on the following elements.

[0071] The cockpit controller 60 includes a safety control unit 600 and a system on a chip 620 connected through a serial peripheral interface (SPI). The safety control unit (MCU) specifically includes: a network input management module 601, an alarm signal management module 602, a first input / output management module 603, an alarm information verification module 604, a fault processing module 605, a backup alarm processing module 606, and a switch input management module 607. The system on a chip (SOC) specifically includes: a second input / output management module 609, an alarm signal processing module 610, a voice decoding module 611, a voice arbitration module 612, a voice output module 613, a voice collection module 614, a voice recognition module 615, a display rendering module 616, and a display output module 617. The cockpit controller 60 is configured to receive and process fault alarm signals, output sound signals and image information; as a human-machine interaction medium for the driver to realize vehicle control, obtain vehicle status, etc.; as an audio and video entertainment control center, etc. The MCU 600 in the cockpit controller 60 is connected to the SOC 620 through a bus, and the MCU 600 can send alarm signals to the SOC 620 through the bus, receive the sound alarm signals collected by the SOC 620, request the SOC 620 to reset the voice-related modules or the entire SOC 620. The autonomous driving controller 30 and other controllers 40 are connected to the cockpit controller 60 through a CAN bus or an Ethernet bus, and input state information or alarm signals to the cockpit controller 60.

[0072] The loudspeaker has two outputs: a headrest loudspeaker 70 and a full-vehicle loudspeaker 80 (a loudspeaker not in the headrest position). The cockpit controller 60 outputs sound signals to the headrest loudspeaker 70 and the full-vehicle loudspeaker 80 (including multiple speakers) through audio lines, respectively. In this embodiment, the loudspeaker serves as a vehicle-mounted sound output device, and the full-vehicle loudspeaker 80 serves as the default output loudspeaker for fault alarm sounds. At the same time that the full-vehicle loudspeaker 80 outputs fault alarm sounds, the fault alarm sounds are synchronously output from the headrest loudspeaker 70. Since the headrest loudspeaker 70 is closer to the driver, it helps the driver to timely and accurately perceive the fault alarm sounds.

[0073] The microphone has two inputs: a first microphone 10 and a second microphone 20. The microphone is connected to the cockpit controller 60 through an audio line and is configured to pick up sound in the cockpit and collect sound information, including alarm sounds. The second microphone 20 is configured to assist the first microphone 10 in collecting sound information. If a single microphone fails or does not accurately pick up sound due to the installation position of the microphone, it may lead to a false belief that no fault alarm sound is output. Therefore, this embodiment can optionally use two microphone inputs.

[0074] The sound alarm 100 is configured to sound an alarm, which can be a voice alarm or a buzzer alarm. The MCU 600 in the cockpit controller 60 is connected to the sound alarm 100 through an audio line to output a sound alarm. In this embodiment, the sound alarm 100 serves as a backup sound output device when the alarm sound fails to be output from the speaker.

[0075] The instrument 90 is configured to display vehicle status information in the form of graphics, which is an important medium for the driver to obtain vehicle alarm information through vision, where the alarm information includes text or alarm lights. The cockpit controller 60 is connected to the instrument 90 through a LVDS (Low-Voltage Differential Signaling) video line to output an image signal to the instrument 90.

[0076] The switch 50 is configured to reset the cockpit controller 60 and turn off the sound alarm 100. The MCU 600 in the cockpit controller 60 is connected to the switch 50 through a hard line, and operating the switch 50 can stop the sound alarm 100 from sounding.

[0077] Next, a specific flow of a vehicle fault alarm method provided by the embodiment of the disclosure is introduced.

[0078] (I) Generation and transmission of vehicle fault alarm signals

[0079] Multiple electronic control units (ECUs) in a vehicle, such as an automatic driving controller, a brake controller, and a steering controller, are responsible for monitoring the key functions and states of the vehicle. When these controllers detect a fault or an abnormal situation, for example, the automatic driving system approaches the boundary of the operational design domain (ODD), or the driver's hands-off time exceeds the safety limit, or the monitoring system detects that the driver is not paying attention, they will send fault alarm information through the internal communication bus (such as CAN bus) of the vehicle.

[0080] The cockpit controller processes these fault alarm information after receiving them. The cockpit controller is the center for human-machine interaction inside the vehicle, which is responsible for displaying the vehicle status and alarm information to the driver in the form of sound and image. After integrating these fault alarm information, the cockpit controller displays them to the driver through the display device (such as the instrument) and the sound system (such as the speaker) inside the cockpit. The following describes the working process taking the takeover class alarm signal as an example, and other fault alarm signal processing methods are similar.

[0081] When the autonomous driving system detects a situation that requires the driver to take over the vehicle (such as approaching the boundary of the ODD, the driver's hands being off the wheel for too long, or the driver's attention being diverted), the autonomous driving controller sends a takeover request signal through the bus.

[0082] (ii) Output and verification of vehicle fault alarm sound

[0083] Upon receiving the takeover request signal, the cockpit controller 60 triggers the corresponding alarm mechanism and sends a takeover request to the driver through sound (such as a voice prompt or a beep) and images (such as warning lights or text prompts on the instrument panel).

[0084] The network input management module 601 of the MCU 600 in the cockpit controller 60 receives the takeover request and other signals, separates the takeover request signal from them, and sends it to the alarm signal management module 602 and the alarm information verification module 604. The alarm signal management module 602 packages the takeover request signal or other alarm signals and forwards them to the second input / output management module 609 of the SOC 620 through the first input / output management module 603.

[0085] Upon receiving the alarm signal, the second input / output management module 609 forwards it to the alarm signal processing module 610. Takeover-type alarms require the driver to be reminded through sound, warning lights, and text at the same time, so the alarm signal processing module 610 forwards the alarm signal to the display rendering module 616 or the voice decoding module 611 according to the type of the alarm.

[0086] The voice decoding module 611 retrieves and decodes the takeover prompt sound according to the alarm signal code and outputs it to the voice arbitration module 612.

[0087] The voice arbitration module 612 suppresses the output of low-priority sound according to the priority definition of the sound, sends the alarm sound to the voice output module 613, and drives the headrest speaker 70 and the vehicle-wide speaker 80 to output the takeover prompt sound. The display rendering module 616 completes display rendering based on the current theme, vehicle information, and alarm signal, and then outputs image information to the instrument panel 90 through the display output module 617.

[0088] After the voice output module 613 sends out the takeover prompt sound, the system will trigger the monitoring of the takeover prompt sound. The specific process is as follows: the microphone picks up the sound and inputs it to the voice collection module 614, and after processing, the audio is sent to the voice recognition module 615. The voice recognition module 615 extracts useful audio feature parameters from the audio, which usually include: frequency features such as fundamental frequency (pitch), formant (vocal tract characteristics); time features such as syllable duration, interval between syllables; amplitude features such as sound intensity, volume change; spectral features such as sound spectral distribution; Mel Frequency Cepstral Coefficients (MFCC) and the like.

[0089] The extracted audio feature parameters are compared with the predefined patterns, which are obtained by the system through learning a large number of voice samples in the training stage. The purpose of pattern matching is to determine whether the collected audio signal matches the specific voice or sound pattern preset in the system. Pattern matching usually uses some algorithms such as Dynamic Time Warping (DTW), Hidden Markov Mode (HMM) or deep learning model. Exemplarily, the deep learning model can be Convolutional Neural Network (CNN), Recurrent Neural Network (RNN). Through pattern matching, the system generates a recognition result, which is used to indicate whether the collected audio signal matches the predefined takeover prompt sound pattern. If the matching is successful, the system considers that the audio picked up by the microphone is the takeover prompt sound.

[0090] Then, the recognition result is further converted into a back collection signal of the takeover prompt sound. The back collection signal of the takeover prompt sound is usually a digital signal containing the recognition result and related timestamp information, which is sent to the alarm information verification module 604 for further processing.

[0091] After receiving the takeover request signal of the autonomous driving controller, the alarm information verification module 604 starts the timer to monitor the playback and back collection process of the takeover prompt sound. After receiving the back collection signal of the takeover prompt sound sent back by the SOC 620, the alarm information verification module 604 compares the received takeover request signal with the back collection signal of the takeover prompt sound sent back by the SOC 620 to verify whether the takeover prompt sound has been played as expected. If the comparison is consistent, that is, the back collection signal matches the takeover request signal, it means that the takeover prompt sound has been normally sent out, and the driver should have heard the takeover prompt sound. The alarm information verification module 604 will determine that the verification is passed.

[0092] Specifically, the detection of the consistency between the captured fault alarm sound and the fault alarm sound emitted by the vehicle-mounted sound output device comprises the following steps:

[0093] Obtaining expected audio features: first, the expected audio feature parameters are extracted from the fault alarm sound emitted by the vehicle-mounted sound output device, which represent the characteristics of the fault alarm sound during normal playback.

[0094] Comparing audio features: comparing the audio feature parameters extracted from the captured fault alarm sound with the expected audio feature parameters to determine whether the two are consistent in features or the similarity exceeds a preset threshold.

[0095] Determining consistency: according to the comparison result, it is determined whether the captured fault alarm sound and the fault alarm sound emitted by the vehicle-mounted sound output device are consistent: if the audio feature parameters match or the similarity exceeds the preset threshold, it is determined that the two are consistent; otherwise, it is determined that they are not consistent.

[0096] If the driver has taken over the vehicle after the takeover prompt sound is emitted, and the MCU 600 does not continue to receive a valid takeover request signal from the autonomous driving controller, the system will not enter this verification process. In this case, the system will stop timing and end the verification. If the comparison is inconsistent, or the MCU 600 does not receive a captured signal of the emitted takeover prompt sound within a set time, indicating that the takeover prompt sound is not played correctly or the played sound does not match the expected sound, the verification fails.

[0097] After the verification fails, the fault handling module 605 of the MCU 600 triggers the backup output mechanism specially set in the embodiments of the present disclosure, i.e., emitting a takeover prompt sound through a backup sound output device. Specifically, the backup alarm processing module 606 emits a takeover prompt sound to the sound alarm 100, reminding the driver to pay attention to the vehicle status and observing the instrument panel alarm. At the same time, the fault handling module 605 of the MCU 600 monitors the heartbeat state of the SOC 620, and if the heartbeat signal is normal, the MCU 600 triggers the voice-related module of the SOC 620 to reset, and if the heartbeat signal is not normal, the MCU 600 triggers the SOC 620 to reset as a whole.

[0098] After the driver perceives the alarm sound emitted by the sound alarm 100 and takes over the vehicle, the autonomous driving controller exits the autonomous driving state and no longer sends a takeover request signal.

[0099] It should be noted that the headrest speaker 70 and the full-vehicle speaker 80 as the main sound output device are connected with the SOC 620 and controlled by the SOC 620, and the sound alarm 100 as the backup sound output device is connected with the MCU 600 and controlled by the MCU 600, that is, the two-way alarm sound output is independent of each other and does not affect each other, and the failure rate of the backup sound output link controlled by the MCU 600 is lower than that of the main sound output link controlled by the SOC 620, so that the safety of the sound alarm is improved and the burden of the driver is reduced.

[0100] The MCU 600 does not receive the takeover request signal of the automatic driving controller, the alarm information verification module 604 changes the verification result, and further, the fault processing module 605 triggers the backup alarm processing module 606 to stop the alarm prompt sound. Specifically, the automatic driving controller sends a takeover request signal to the MCU 600 when the driver needs to take over; if the MCU 600 does not receive the effective takeover request signal, it means that the driver has taken over. The alarm information verification module 604 will change its verification result according to the current state, that is, mark this fault alarm signal as canceled or invalid, because the expected takeover request signal is not received. When the alarm information verification module 604 changes the verification result, the fault processing module 605 receives this information and triggers the backup alarm processing module 606 to stop sending the alarm prompt sound. The alarm prompt sound is stopped because the system considers that the current alarm signal has been canceled or invalidated, so there is no need to continue to prompt the driver.

[0101] Through this multi-level fault detection and processing mechanism, the system can improve its overall reliability and robustness. Even in the case of failure of the main alarm mechanism, the backup alarm processing module 606 and the fault processing module 605 can ensure that the driver can receive the necessary takeover prompt, thereby ensuring driving safety.

[0102] If it is a non-automatic driving takeover type alarm sound, the driver can turn off the alarm sound by operating the switch 50, for example, pressing the switch twice or other operation modes.

[0103] According to the geographical area or language selected by the driver in the cockpit controller 60, the system automatically switches the language of the takeover prompt sound and other voice type alarm signals. In order to avoid the driver from mistakenly operating to turn off or lower the volume, the alarm sound volume is the system default and is not controlled by the volume adjustment switch.

[0104] Corresponding to the vehicle fault alarm method of the first embodiment of the present disclosure, the second embodiment of the present disclosure further provides a vehicle fault alarm device, comprising:

[0105] The acquisition module is configured to receive a fault alarm signal from a vehicle control system;

[0106] a main output module configured to output a fault alarm sound through a vehicle-mounted sound output device according to the fault alarm signal;

[0107] a detection module configured to collect the fault alarm sound output by the vehicle-mounted sound output device and detect whether the collected fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device;

[0108] a backup output module configured to output a fault alarm sound through a backup sound output device if the collected fault alarm sound is inconsistent or is not received within a set time.

[0109] Corresponding to the vehicle fault alarm method of the foregoing embodiment one of the present disclosure, the present disclosure embodiment three further provides a vehicle fault alarm device, comprising:

[0110] a cabin controller configured to receive a fault alarm signal from a vehicle control system and generate a corresponding fault alarm sound;

[0111] a vehicle-mounted sound output device configured to output the fault alarm sound according to a control signal of the cabin controller;

[0112] a sound pickup device configured to collect the fault alarm sound output by the vehicle-mounted sound output device;

[0113] a backup sound output device electrically connected to the cabin controller and configured to output a fault alarm sound when the cabin controller detects that the fault alarm sound collected by the sound pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0114] Optionally, the cabin controller comprises a safety control unit and a system on chip connected through a serial peripheral interface (SPI), the system on chip is configured to control the vehicle-mounted sound output device to output the fault alarm sound, and the safety control unit is configured to control the backup sound output device to output a fault alarm sound when it is detected that the fault alarm sound collected by the sound pickup device is inconsistent with the fault alarm sound output by the vehicle-mounted sound output device.

[0115] Optionally, the vehicle-mounted sound output device is specifically a headrest speaker and a full-vehicle speaker; the backup sound output device is specifically a voice alarm or a buzzer alarm; and the sound pickup device is specifically a microphone.

[0116] Optionally, the cabin controller is specifically configured to:

[0117] retrieve and decode a fault alarm sound according to the fault alarm signal;

[0118] According to the priority definition of the sound, the low-priority sound output is suppressed, and the headrest speaker and the vehicle speaker are driven to output the fault alarm sound.

[0119] Optionally, the cabin controller is further configured to:

[0120] extracting an audio feature parameter from the fault alarm sound collected from the microphone;

[0121] identifying whether the extracted audio feature parameter matches a predefined pattern;

[0122] if the match is found, converting the identification result into a collected signal of the fault alarm sound.

[0123] Optionally, the detection of whether the collected fault alarm sound is consistent with the fault alarm sound emitted by the vehicle sound output device comprises:

[0124] extracting an expected audio feature parameter from the fault alarm sound emitted by the vehicle sound output device;

[0125] comparing the audio feature parameter extracted from the collected fault alarm sound with the expected audio feature parameter to determine whether they are consistent or the similarity exceeds a preset threshold;

[0126] if the audio feature parameters match or the similarity exceeds the preset threshold, it is determined that the collected fault alarm sound is consistent with the fault alarm sound emitted by the vehicle sound output device; otherwise, it is determined that they are not consistent.

[0127] Corresponding to the vehicle fault alarm method of the foregoing embodiment one of the present disclosure, the present disclosure embodiment four further provides a vehicle fault alarm device, comprising:

[0128] one or more processors;

[0129] a memory;

[0130] one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more application programs are configured to execute the vehicle fault alarm method.

[0131] Corresponding to the vehicle fault alarm method of the foregoing embodiment one of the present disclosure, the present disclosure embodiment five further provides a computer program product comprising computer instructions instructing a computer device to execute the operations corresponding to the method.

[0132] Optionally, the processor can be a central processing unit (CPU), and can also be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor, or the processor can also be any conventional processor. The processor is a control center of the device, and connects various parts of the device through various interfaces and lines.

[0133] The memory mainly includes a program storage area and a data storage area. The program storage area can store an operating system, at least one application required by a function, etc., and the data storage area can store related data, etc. In addition, the memory can be a high-speed random access memory, and can also be a non-volatile memory such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc., or can also be other volatile solid-state storage devices.

[0134] It should be noted that the above device can include but is not limited to the processor and the memory, and those skilled in the art can understand this.

[0135] For the working principle and process of the above-mentioned embodiments, refer to the foregoing description of the first embodiment of the present disclosure, which will not be repeated here.

[0136] From the above description, it can be seen that, compared with the prior art, the present disclosure has the beneficial effects that: by introducing the redundancy mechanism of the main and backup sound output, when the fault alarm sound emitted by the main sound output device fails to correctly convey to the driver, the backup sound output device can timely discover and emit the fault alarm sound, thereby significantly improving the reliability and safety of the fault alarm, reducing the potential safety risk caused by system failure, ensuring that the driver can receive critical alarm information at critical moments, thereby effectively preventing traffic accidents. At the same time, the present disclosure also supports automatic switching of the language of the alarm signal according to the geographical area or language selected by the driver, so that the system is more flexible and adaptable to different use scenarios. In addition, the present disclosure can timely and accurately emit an alarm prompt tone, and automatically exit the automatic driving state after the driver takes over the vehicle, thereby avoiding unnecessary interference and greatly improving the user experience.

[0137] The above disclosure is merely the preferred embodiments of the present disclosure and is not intended to limit the scope of the present disclosure. Therefore, equivalent changes made within the scope of the claims of the present disclosure are still within the scope of the present disclosure.

Claims

1. A vehicle fault alarm method, comprising the steps of: receiving a fault alarm signal from a vehicle control system; outputting a fault alarm sound through a vehicle-mounted sound output device according to the fault alarm signal; backing up the fault alarm sound output by the vehicle-mounted sound output device and detecting whether the backed-up fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device; outputting a fault alarm sound through a backup sound output device if the backed-up fault alarm sound is inconsistent or is not received within a set time.

2. The method of claim 1, wherein, The step of outputting a fault alarm sound through a vehicle-mounted sound output device according to the fault alarm signal comprises the steps of: calling and decoding a fault alarm sound according to the fault alarm signal; suppressing the output of a sound with a low priority according to a sound priority definition, and simultaneously driving a headrest speaker and a vehicle-wide speaker to output the fault alarm sound.

3. The method of claim 1, wherein, The step of backing up the fault alarm sound output by the vehicle-mounted sound output device comprises the steps of: backing up the fault alarm sound output by the vehicle-mounted sound output device through microphone sound pickup; extracting an audio feature parameter from the backed-up fault alarm sound; identifying whether the extracted audio feature parameter matches a predefined pattern; if the extracted audio feature parameter matches the predefined pattern, converting the identification result into a backed-up fault alarm sound signal.

4. The method of claim 3, wherein, The step of detecting whether the backed-up fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device comprises the steps of: extracting an expected audio feature parameter from the fault alarm sound output by the vehicle-mounted sound output device; comparing the audio feature parameter extracted from the backed-up fault alarm sound with the expected audio feature parameter to determine whether they are consistent or have a similarity exceeding a preset threshold; if the audio feature parameters match or have a similarity exceeding the preset threshold, determining that the backed-up fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device; otherwise, determining that they are inconsistent.

5. The method of claim 1, wherein, The step of outputting a fault alarm sound through a backup sound output device comprises the step of outputting a fault alarm sound through a sound alarm connected to a cabin controller.

6. The method of claim 1, wherein, The method further comprises the steps of: turning off a non-automatic driving takeover type fault alarm sound in response to an operation of a switch by a driver.

7. The method of claim 1, wherein, The method further comprises the step of automatically switching the language of a fault alarm sound according to a geographical area or language selected by the driver on a cabin controller.

8. The method of claim 1, wherein, The method further comprises the steps of: when no valid fault alarm signal is received, marking the fault alarm signal as invalid or missing; stopping outputting a fault alarm sound through a backup sound output device. 9.A vehicle fault alarm device, comprising: a collection module configured to receive a fault alarm signal from a vehicle control system; a main output module configured to output a fault alarm sound through a vehicle-mounted sound output device according to the fault alarm signal; a detection module configured to backup the fault alarm sound output by the vehicle-mounted sound output device and detect whether the backed-up fault alarm sound is consistent with the fault alarm sound output by the vehicle-mounted sound output device; a backup output module configured to output a fault alarm sound through a backup sound output device if the backed-up fault alarm sound is inconsistent or is not received within a set time.

10. A vehicle fault alarm device, comprising: a cabin controller configured to receive a fault alarm signal from a vehicle control system and generate a corresponding fault alarm sound; an in-vehicle sound output device configured to output the fault alarm sound according to a control signal of the cabin controller; a sound pickup device configured to pick up the fault alarm sound output by the in-vehicle sound output device; a backup sound output device electrically connected to the cabin controller and configured to output the fault alarm sound when the cabin controller detects that the fault alarm sound picked up by the sound pickup device is inconsistent with the fault alarm sound output by the in-vehicle sound output device.

11. The apparatus of claim 10, wherein, The cabin controller comprises a safety control unit and a system on chip connected through a serial peripheral interface, the system on chip is configured to control the in-vehicle sound output device to output the fault alarm sound, and the safety control unit is configured to control the backup sound output device to output the fault alarm sound when it is detected that the fault alarm sound picked up by the sound pickup device is inconsistent with the fault alarm sound output by the in-vehicle sound output device.

12. The apparatus of claim 11, wherein, The in-vehicle sound output device comprises a headrest speaker and a full-vehicle speaker, both of which are electrically connected to the system on chip; the backup sound output device comprises a voice alarm or a buzzer alarm, both of which are electrically connected to the safety control unit; and the sound pickup device is specifically a microphone electrically connected to the system on chip.

13. The apparatus of claim 12, wherein, The cabin controller is configured to: retrieve and decode the fault alarm sound according to the fault alarm signal; inhibit the output of low-priority sound and simultaneously drive the headrest speaker and the full-vehicle speaker to output the fault alarm sound according to the priority definition of the sound.

14. The apparatus of claim 13, wherein, The cabin controller is further configured to: extract an audio feature parameter from the fault alarm sound picked up by the microphone; identify whether the extracted audio feature parameter matches a predefined pattern; if so, convert the identification result into a pickup signal of the fault alarm sound.

15. The apparatus of claim 14, wherein, Further comprising: extracting an expected audio feature parameter from the fault alarm sound emitted by the in-vehicle sound output device; comparing the audio feature parameter extracted from the picked-up fault alarm sound with the expected audio feature parameter to determine whether they are consistent or the similarity exceeds a preset threshold; if the audio feature parameters match or the similarity exceeds the preset threshold, it is determined that the picked-up fault alarm sound is consistent with the fault alarm sound emitted by the in-vehicle sound output device; otherwise, it is determined that they are inconsistent.

16. A vehicle fault alarm device, comprising: one or more processors; a memory; one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more application programs are configured to perform the vehicle fault alarm method according to any one of claims 1-8.

17. A computer program product comprising computer instructions instructing a computer device to perform operations corresponding to the method according to any one of claims 1-8.

Images