Vehicle part abnormity identification method, electronic equipment, vehicle and program product

Abstract

The invention provides a vehicle part abnormity identification method, electronic equipment, a vehicle and a program product. The software upgrading method comprises the steps that a first audio signal is collected once every a first duration or a first mileage, and the first audio signal is from an acoustic sensor of a vehicle; determining whether abnormal sound signals exist in the first audio signals or not; in response to existence of the abnormal sound signal, a second audio signal is obtained, the second audio signal is an audio signal of a second duration or a second mileage and comes from the acoustic sensor, the second duration is smaller than the first duration, and the second mileage is smaller than the first mileage; determining whether the occurrence frequency of abnormal sound signals in the second audio signal is greater than a first threshold; and in response to the occurrence frequency of the abnormal sound signal being greater than a first threshold, identifying that the vehicle component is in an abnormal state.

Description

Technical Field

[0001] The present disclosure relates to a vehicle component abnormality identification method, electronic equipment, a vehicle, and a program product. Background Art

[0002] During the storage or use of vehicles, vehicle parts may gradually age and become abnormal due to many reasons such as light radiation, wear and tear, and harsh environment. If there is no timely intervention after the abnormality of vehicle parts, the vehicle parts will eventually be scrapped. Although some vehicles are regularly maintained, the abnormality of vehicle parts may not be discovered during the vehicle maintenance process. Therefore, how to identify vehicle parts in an abnormal state has become a problem that needs to be solved urgently. Summary of the invention

[0003] The present disclosure provides a vehicle component abnormality identification method, electronic equipment, vehicle, and program product.

[0004] According to one aspect of the present disclosure, a method for identifying abnormalities in vehicle components is provided, the method comprising: collecting a first audio signal once every first time duration or first mileage, the first audio signal coming from an acoustic sensor of a vehicle; determining whether there is an abnormal sound signal in the first audio signal; in response to the presence of the abnormal sound signal, acquiring a second audio signal, the second audio signal being an audio signal of a second time duration or a second mileage and coming from an acoustic sensor, wherein the second time duration is less than the first time duration, and the second mileage is less than the first mileage; determining whether the number of occurrences of the abnormal sound signal in the second audio signal is greater than a first threshold; in response to the number of occurrences of the abnormal sound signal being greater than the first threshold, identifying that the vehicle component is in an abnormal state.

[0005] According to one aspect of the technical solution, after the first audio signal is acquired, if there is an abnormal sound signal in the first audio signal, it indicates that the vehicle component may be in an abnormal state. In order to avoid collecting abnormal sound signals due to unexpected events, it is necessary to use an acoustic sensor to collect the second audio signal again. If the number of occurrences of the abnormal sound signal in the second audio signal is greater than the first threshold, it means that the abnormal sound signal appears multiple times in succession, and then it is identified that the vehicle component is indeed in an abnormal state. Therefore, the technical solution of the present disclosure can avoid the interference caused by the collection of abnormal sound signals due to unexpected events, and more accurately identify that the vehicle component is in an abnormal state. In addition, collecting the first audio signal once every first time length or first mileage can avoid continuous signal collection, thereby saving electric energy.

[0006] According to at least one embodiment of the present disclosure, a method for identifying an abnormality of a vehicle component is disclosed, which identifies that a vehicle component is in an abnormal state, including: determining a first vehicle component corresponding to an acoustic sensor of an abnormal sound signal, and determining a type of the abnormal sound signal; determining whether the type of the abnormal sound signal is the type of a reference abnormal sound signal of the first vehicle component, the reference abnormal sound signal being a signal emitted when the first vehicle component is in an abnormal state; and determining that the first vehicle component is in an abnormal state in response to the type of the abnormal sound signal being the type of the reference abnormal sound signal of the first vehicle component.

[0007] Among them, through the mapping relationship between the acoustic sensor and the vehicle component, it can be determined that the vehicle component corresponding to the acoustic sensor that collects the abnormal sound signal is the first vehicle component, and by judging whether the type of the collected abnormal sound signal is the type of the reference abnormal sound signal of the first vehicle component, it is determined whether the collected abnormal sound signal is an electrical signal generated according to the abnormal sound emitted by the first vehicle component. If so, it means that the collected abnormal sound signal is an electrical signal generated according to the abnormal sound emitted by the first vehicle component, and it can be determined that the first vehicle component is in an abnormal state; otherwise, it means that the collected abnormal sound signal is not related to the first vehicle component, so it can be determined that the first vehicle component is not in an abnormal state. Therefore, the present disclosure can determine whether the first vehicle component corresponding to the acoustic sensor of the abnormal sound signal is in an abnormal state.

[0008] According to the vehicle component abnormality identification method of at least one embodiment of the present disclosure, the method further includes: when the type of the abnormal sound signal is not the type of the reference abnormal sound signal of the first vehicle component, determining that the first vehicle component is not in an abnormal state.

[0009] According to the vehicle component abnormality identification method of at least one embodiment of the present disclosure, after determining that the first vehicle component is in an abnormal state, the method further includes: outputting first prompt information, the first prompt information including the identification of the first vehicle component and the type of abnormal sound.

[0010] After determining that the first vehicle component is in an abnormal state, it is necessary to output first prompt information to remind the user that the first vehicle component is in an abnormal state, so that the user can repair the first vehicle component in time.

[0011] According to the vehicle component abnormality identification method of at least one embodiment of the present disclosure, after determining that the first vehicle component is in an abnormal state, the method also includes: sending the identification and abnormal sound type of the first vehicle component to a server, and the identification and abnormal sound type of the first vehicle component are used to determine the cause of the abnormality of the first vehicle component.

[0012] Among them, after determining that the first vehicle component is in an abnormal state, the identification and abnormal sound type of the first vehicle component are sent to the server, so that the server can analyze the cause of the abnormal state of the first vehicle component according to the identification and abnormal sound type of the first vehicle component, thereby providing ideas for product updates.

[0013] According to the vehicle component abnormality identification method of at least one embodiment of the present disclosure, determining whether there is an abnormal sound signal in a first audio signal includes: comparing the first audio signal with a reference abnormal sound signal in an audio library, wherein the audio library has a plurality of reference abnormal sound signals; and determining that there is an abnormal sound signal in the first audio signal when a signal in the first audio signal matches the reference abnormal sound signal.

[0014] According to at least one embodiment of the vehicle component abnormality identification method disclosed herein, a first audio signal is compared with a reference abnormal sound signal in an audio library, including: extracting a first audio feature of the first audio signal; determining whether the similarity between the first audio feature and a reference audio feature of the reference abnormal sound signal is greater than a second threshold; if the similarity between the first audio feature and the reference audio feature is greater than the second threshold, determining that the first audio signal matches the reference abnormal sound signal.

[0015] Among them, by matching the first audio signal with the reference abnormal sound signal in the audio library through the audio features, it can be determined more accurately whether the first audio signal matches the reference abnormal sound signal.

[0016] According to the vehicle component abnormality identification method of at least one embodiment of the present disclosure, determining whether the number of occurrences of the abnormal sound signal in the second audio signal is greater than a first threshold includes: comparing the second audio signal with a reference abnormal sound signal in an audio library to determine the abnormal sound signal present in the second audio signal; and comparing the number of occurrences of the abnormal sound signal in the second audio signal with the first threshold to determine whether the number of occurrences is greater than the first threshold.

[0017] After determining the number of occurrences of the abnormal sound signal in the second audio signal, it is also necessary to compare the number of occurrences of the abnormal sound signal with the first threshold to determine whether the number of occurrences of the abnormal sound signal is greater than the first threshold. If it is greater than the first threshold, it means that there is indeed an abnormal vehicle component in the vehicle.

[0018] According to another aspect of the present disclosure, an electronic device is provided, comprising: a memory storing execution instructions; and a processor executing the execution instructions stored in the memory, so that the processor executes the vehicle component abnormality identification method according to any one of claims 1 to 8.

[0019] According to yet another aspect of the present disclosure, a vehicle is provided, comprising the electronic device as described above.

[0020] According to another aspect of the present disclosure, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, it is used to implement at least any one of the methods described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.

[0022] Figure 1 A schematic diagram of an application scenario provided by the present invention.

[0023] Figure 2 A schematic flow chart of a method for identifying abnormalities in vehicle components in one embodiment provided by the present disclosure.

[0024] Figure 3 A schematic flow chart of a method for identifying abnormalities in vehicle components in another embodiment provided by the present disclosure.

[0025] Figure 4 A schematic flow chart of a method for identifying abnormalities in vehicle components in yet another embodiment provided by the present disclosure.

[0026] Figure 5 A flowchart of a method for identifying abnormality of vehicle parts according to another embodiment of the present disclosure is provided.

[0027] Figure 6 A schematic diagram of an electronic device provided by the present disclosure.

[0028] Figure 7 A schematic diagram of a vehicle provided by the present disclosure. DETAILED DESCRIPTION

[0029] The present disclosure is further described in detail below in conjunction with the accompanying drawings and examples. It is understood that the specific examples described herein are only used to explain the relevant content, rather than to limit the present disclosure. It should also be noted that, for ease of description, only the parts related to the present disclosure are shown in the accompanying drawings.

[0030] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0031] Some vehicle parts will gradually age and become abnormal due to many reasons such as light radiation, wear and tear, and harsh environment. If not intervened in time, the vehicle parts will eventually be scrapped. Usually, vehicle parts in abnormal conditions will make abnormal sounds during operation, but this abnormal sound is difficult for users to detect, thus missing the opportunity to repair the vehicle parts in time.

[0032] For example, when a vehicle is driving on the road, if the motor on the vehicle is in an abnormal state, the motor will usually make an abnormal sound, which may be some abnormal impact sound. Since the road environment noise is relatively loud when the vehicle is driving, the user in the vehicle may not be able to hear the abnormal sound of the motor. For another example, after the vehicle stops, the motor of the vehicle is in the off state. Even if the motor is in an abnormal state, the motor will not make an abnormal sound when it is not running. For another example, during the maintenance of the vehicle, the motor of the vehicle is in the off state, and the staff will only clean the stains on the surface of the vehicle. Even if the motor is in an abnormal state, the staff cannot confirm whether the motor is in an abnormal state.

[0033] Therefore, during daily use of the vehicle or during vehicle maintenance, it is difficult for users and staff to know whether vehicle components are in an abnormal state.

[0034] Based on this, the inventors of the present disclosure have conducted in-depth research on the above-mentioned problems and proposed the following technical solutions.

[0035] A plurality of acoustic sensors are arranged on the vehicle, and the acoustic sensors are arranged on important vehicle components or near important vehicle components, so that the acoustic sensors can monitor the sound emitted by each important vehicle component.

[0036] For example, an acoustic sensor is set on the casing of the motor to collect the sound made by the motor when it is running; as another example, an acoustic sensor is set inside the seat to collect the sound made when the seat is in use; as another example, an acoustic sensor is set near each tire to collect the sound made by each tire when it rotates.

[0037] During the operation of the vehicle, at regular intervals or every mileage, each acoustic sensor collects the sound emitted by the vehicle components, converts the sound into an audio signal, and then sends the audio signal to the central processor.

[0038] After the central processor receives the audio signal, it will analyze the audio signals provided by multiple acoustic sensors one by one. If an abnormal sound signal is found in one of the multiple audio signals, it means that there may be a vehicle component in an abnormal state. In order to eliminate misjudgments caused by various reasons, further verification is required, that is, the acoustic sensor that collects the abnormal sound signal needs to collect the audio signal again and determine whether the abnormal sound signal appears continuously in the audio signal collected again. If so, it means that there is indeed a vehicle component in an abnormal state in the vehicle.

[0039] Therefore, the technical solution disclosed in the present invention can avoid interference from unexpected events and more accurately identify vehicle components that are in abnormal states.

[0040] In order to facilitate understanding of the contents of the embodiments of the present disclosure, some technical terms used in the embodiments of the present disclosure are described below.

[0041] An acoustic sensor is a device that can collect the sound emitted by vehicle components and convert it into an audio signal.

[0042] Audio signal refers to the electrical signal generated based on sound.

[0043] Abnormal sound signal refers to the electrical signal generated based on abnormal sound.

[0044] Audio features refer to the properties of an audio signal that can be used to identify, classify or describe the audio content. Audio features include sampling rate, bit depth, bit rate, frequency content, loudness, pitch, rhythm, timbre, duration, dynamic range, harmonic content, envelope, transient characteristics, time-frequency characteristics and statistical characteristics.

[0045] See also Figure 1 As shown, Figure 1 Schematic diagram of an application scenario provided by the present disclosure. In this application scenario, a motor 101, an acoustic sensor 102 and a central processor 103 are arranged in a vehicle 100, for example, the acoustic sensor 102 is arranged on the housing of the motor 101, and the acoustic sensor 102 is used to monitor the sound emitted by the motor 101.

[0046] It should be noted that due to Figure 1 The space is limited and cannot be Figure 1 All acoustic sensors disposed on the vehicle 100 are shown above, and the acoustic sensor 102 disposed on the housing of the motor 101 is shown only by way of example. Of course, in order to collect the sound emitted by the battery, an acoustic sensor may be disposed near the battery; in order to collect the sound emitted by the seat, an acoustic sensor may be disposed inside the seat; in order to collect the sound emitted by the wheel, an acoustic sensor may also be disposed near the wheel.

[0047] exist Figure 1 In the example shown, during the operation of the vehicle 100 , at regular intervals or after each mileage, the acoustic sensor 102 collects the sound emitted by the motor 101 and generates a first audio signal, and then sends the collected first audio signal to the central processor 103 .

[0048] After the central processing unit 103 receives the first audio signal, it will analyze the first audio signal. If it is analyzed that there is an abnormal sound signal in the first audio signal, it means that there may be a vehicle component in an abnormal state. In order to eliminate misjudgments caused by various reasons, further verification is required, that is, the acoustic sensor 102 needs to collect the sound emitted by the motor 101 again and generate a second audio signal, and send the second audio signal to the central processing unit 103. The central processing unit 103 determines whether the abnormal sound signal appears continuously in the second audio signal. If so, it means that there are indeed vehicle components in an abnormal state in the vehicle 100.

[0049] If the central processor 103 needs to determine which vehicle component is in an abnormal state, the central processor 103 can determine it through a mapping relationship between the acoustic sensor and the vehicle component.

[0050] When the acoustic sensor is placed near various vehicle components on the vehicle, a mapping relationship between the acoustic sensor and the vehicle component is established. Moreover, when the acoustic sensor sends an audio signal to the central processor, it will carry the identification of the acoustic sensor. When the central processor receives the identification of the acoustic sensor and the audio signal, it can determine which vehicle component the acoustic sensor detects based on the identification of the acoustic sensor and the mapping relationship between the acoustic sensor and the vehicle component.

[0051] For example, the acoustic sensor 102 is disposed on the housing of the motor 101, and the acoustic sensor 102 is used to monitor the sound emitted by the motor 101, and a mapping relationship between the acoustic sensor 102 and the motor 101 is established. When the acoustic sensor 102 sends an audio signal to the central processor 103, the identification of the acoustic sensor 102 is attached. The central processor 103 can determine that the vehicle component in an abnormal state is the motor 101 according to the identification of the acoustic sensor 102 and the mapping relationship between the acoustic sensor 102 and the motor 101.

[0052] exist Figure 1 In the example shown, the technical solution of the present disclosure can avoid interference from unexpected events and more accurately identify the presence of vehicle components in abnormal states in the vehicle 100.

[0053] See also Figure 2 As shown, Figure 2 The following is a flow chart of a method for identifying abnormalities in vehicle components provided by the present disclosure. Figure 2 The method shown includes steps S210 to S250, wherein the method may be executed by a central processing unit.

[0054] In step S210, a first audio signal is collected once every first time period or first mileage.

[0055] The first audio signal comes from an acoustic sensor of the vehicle. Multiple acoustic sensors are provided on the vehicle to collect sounds emitted by multiple vehicle components. If multiple acoustic sensors work in real time, a large amount of power will be consumed. The first audio signal can be collected once every first time period or first mileage, and the multiple acoustic sensors are kept in standby mode for the rest of the time, thereby reducing the power consumption of the vehicle.

[0056] The first mileage is a fixed number of kilometers. For example, if the first mileage is set to 500 kilometers, the acoustic sensor will collect an audio signal every 500 kilometers of the vehicle.

[0057] The first duration is a fixed duration. For example, if the first duration is set to 15 days, the acoustic sensor will collect an audio signal every 15 days of operation of the vehicle.

[0058] In step S220, it is determined whether there is an abnormal sound signal in the first audio signal.

[0059] Among them, the first audio signal refers to an electrical signal generated according to the sound collected by the acoustic sensor, and the abnormal sound signal refers to an electrical signal generated according to the abnormal sound collected by the acoustic sensor. The abnormal sound can be a resonance sound, a sticky sound, or an impact sound, etc.

[0060] For example, if the abnormal sound is a resonance sound, the abnormal sound signal is an electrical signal generated according to the resonance sound. For another example, if the abnormal sound is a stick-slip sound, the abnormal sound signal is an electrical signal generated according to the stick-slip sound. For another example, if the abnormal sound is an impact sound, the abnormal sound signal is an electrical signal generated according to the impact sound.

[0061] Of course, there may be abnormal sound signals and other noise signals in the audio signal, and the audio features can be used to determine whether there are abnormal sound signals in the audio signal. Since each abnormal sound signal corresponds to a unique audio feature, the audio feature can be understood as the unique identifier of the abnormal sound signal.

[0062] If there is an abnormal sound signal in the first audio signal, it means that there may be a vehicle component in an abnormal state. If there is no abnormal sound signal in the first audio signal, it means that there is no vehicle component in an abnormal state.

[0063] In step S230, in response to the presence of an abnormal sound signal, a second audio signal is acquired.

[0064] The second audio signal is an audio signal of a second duration or a second mileage and is from an acoustic sensor, the second duration is less than the first duration, and the second mileage is less than the first mileage. For example, the second duration may be 10 minutes, and the second mileage may be 10 kilometers. By continuously collecting audio signals, it is possible to avoid using abnormal sound signals caused by accidental events to determine abnormalities in vehicle components.

[0065] If there is an abnormal sound signal in the first audio signal, it means that it may be caused by an abnormality in a vehicle component, which in turn generates the abnormal sound signal, or it may be caused by other unexpected events. In order to determine whether the abnormal sound signal is caused by an abnormality in a vehicle component, it is necessary to further verify it through the second audio signal.

[0066] In step S240, it is determined whether the number of occurrences of the abnormal sound signal in the second audio signal is greater than a first threshold.

[0067] If the number of occurrences of the abnormal sound signal in the second audio signal is greater than the first threshold, it means that a certain vehicle component has made abnormal sounds multiple times in succession within the second time period or the second mileage. The possibility of the abnormal sound being generated by an accident can be ruled out, and it can be determined that a certain vehicle component is in an abnormal state.

[0068] In step S250 , in response to the number of occurrences of the abnormal sound signal being greater than a first threshold, it is identified that the vehicle component is in an abnormal state.

[0069] When the number of occurrences of the abnormal sound signal in the second audio signal is greater than the first threshold, it can be determined that a certain vehicle component is in an abnormal state. However, it is not possible to determine which specific vehicle component is in an abnormal state. If it is necessary to clearly know which vehicle component is in an abnormal state, subsequent steps are required to further implement it, which will not be repeated here.

[0070] pass Figure 2 In the illustrated embodiment, the technical solution of the present disclosure can avoid interference from unexpected events and more accurately identify vehicle components in abnormal states within the vehicle.

[0071] Regarding step S250, in some embodiments of the present disclosure, it may include: Figure 3 Steps S2501 to S2503 are shown. Figure 3 A schematic flow chart of a method for identifying abnormalities in vehicle components in another embodiment provided by the present disclosure.

[0072] In step S2501, a first vehicle component corresponding to the acoustic sensor of the abnormal sound signal is determined, and a type of the abnormal sound signal is determined.

[0073] When multiple acoustic sensors are respectively arranged near multiple vehicle components, which acoustic sensor corresponds to which vehicle component is recorded, thereby forming a mapping relationship between the multiple acoustic sensors and the multiple vehicle components. When the central processor determines that the number of occurrences of the abnormal sound signal in the second audio signal sent by a certain acoustic sensor is greater than the first threshold, the first vehicle component corresponding to the acoustic sensor can be determined through the mapping relationship between the multiple acoustic sensors and the multiple vehicle components.

[0074] Each type of abnormal sound signal corresponds to only one audio feature of the abnormal sound signal, and the type of the abnormal sound signal can be determined by the audio feature of the abnormal sound signal.

[0075] For example, it is assumed that the type X of the abnormal sound signal corresponds to the audio feature A of the abnormal sound signal, the type Y of the abnormal sound signal corresponds to the audio feature B of the abnormal sound signal, and the type Z of the abnormal sound signal corresponds to the audio feature C of the abnormal sound signal. Based on the above correspondence, the type of the abnormal sound signal can be determined according to the audio feature of the abnormal sound signal.

[0076] In step S2502, it is determined whether the type of the abnormal sound signal is the type of the reference abnormal sound signal of the first vehicle component.

[0077] The reference abnormal sound signal is an electrical signal generated by a sound emitted when the first vehicle component is in an abnormal state.

[0078] There are only a limited number of reference abnormal sound signals corresponding to each type of vehicle component in an abnormal state. A mapping relationship between the types of vehicle components and reference abnormal sound signals can be established in advance, so that it can be determined whether the type of a certain abnormal sound signal is the type of the reference abnormal sound signal of the vehicle component based on the mapping relationship.

[0079] For example, assuming that the type of the reference abnormal sound signal of the motor is impact sound, and the type of the abnormal sound signal in the audio signal obtained by the acoustic sensor is also impact sound, then it can be determined that the type of the abnormal sound signal is the type of the reference abnormal sound signal of the motor, thereby determining that the motor is in an abnormal state.

[0080] For another example, assuming that the type of the reference abnormal sound signal of the motor is impact sound, and the type of the abnormal sound signal in the audio signal obtained by the acoustic sensor is also resonance sound, then it can be determined that the type of the abnormal sound signal is not the type of the reference abnormal sound signal of the motor, and thus it can be determined that the motor is not in an abnormal state.

[0081] In step S2503, in response to the type of the abnormal sound signal being the type of the reference abnormal sound signal of the first vehicle component, it is determined that the first vehicle component is in an abnormal state.

[0082] After step S2503, Figure 3The illustrated embodiment may further include the following step: when the type of the abnormal sound signal is not the type of the reference abnormal sound signal of the first vehicle component, determining that the first vehicle component does not have an abnormal state.

[0083] exist Figure 3 In the illustrated embodiment, through the mapping relationship between the acoustic sensor and the vehicle component, it can be determined that the vehicle component corresponding to the acoustic sensor that collected the abnormal sound signal is the first vehicle component, and by judging whether the type of the collected abnormal sound signal is the type of the reference abnormal sound signal of the first vehicle component, it can be determined whether the collected abnormal sound signal is an electrical signal generated based on the abnormal sound emitted by the first vehicle component. If so, it means that the collected abnormal sound signal is an electrical signal generated based on the abnormal sound emitted by the first vehicle component, and it can be determined that the first vehicle component is in an abnormal state; otherwise, it means that the collected abnormal sound signal is not related to the first vehicle component, and it can be determined that the first vehicle component is not in an abnormal state. Therefore, Figure 3 The illustrated embodiment can determine whether a first vehicle component corresponding to the acoustic sensor of the abnormal sound signal is in an abnormal state.

[0084] In the case where the abnormal sound signal collected is not related to the first vehicle component, if you still want to know which vehicle component specifically emits the abnormal sound, you can determine whether there are other vehicle components near the acoustic sensor that collects the abnormal sound signal. If so, you can determine whether other vehicle components near the acoustic sensor are in an abnormal state according to the ideas of steps S2501 to S2503. If it is finally determined that other vehicle components near the acoustic sensor are in an abnormal state, you can use a voice system, a vehicle screen, or an external electronic device to remind the user which vehicle component is in an abnormal state.

[0085] After step S2503, Figure 3 The illustrated embodiment may further include the following step: outputting first prompt information, the first prompt information including an identification of the first vehicle component and a type of abnormal sound.

[0086] After determining that the first vehicle component is in an abnormal state, it is necessary to output first prompt information to remind the user that the first vehicle component is in an abnormal state, so that the user can repair the first vehicle component in time.

[0087] In addition, the first prompt information can be output in a variety of ways. For example, the first prompt information is displayed on the vehicle screen; another example, the first prompt information is played through the vehicle voice system; another example, the central processor sends the first prompt information to an external device, and the external device displays or plays the first prompt information. The external device can be a mobile phone, etc.

[0088] The identifier of the first vehicle component may be the name of the first vehicle component. There are many types of abnormal noises, such as impact sound, resonance sound or stick-slip sound.

[0089] After step S2503, Figure 3 The illustrated embodiment may further include the following steps: sending the identification and abnormal sound type of the first vehicle component to a server, wherein the identification and abnormal sound type of the first vehicle component are used to determine the abnormal cause of the first vehicle component.

[0090] Among them, after determining that the first vehicle component is in an abnormal state, the identification and abnormal sound type of the first vehicle component are sent to the server, so that the server can analyze the cause of the abnormal state of the first vehicle component according to the identification and abnormal sound type of the first vehicle component, thereby providing ideas for product updates.

[0091] Regarding step S220, in some embodiments of the present disclosure, it may include: Figure 4 Steps S2201 to S2202 are shown. Figure 4 A schematic flow chart of a method for identifying abnormalities in vehicle components in yet another embodiment provided by the present disclosure.

[0092] In step S2201, the first audio signal is compared with a reference abnormal sound signal in an audio library.

[0093] The reference abnormal sound signal refers to an electrical signal generated according to the abnormal sound collected by the acoustic sensor. The audio library has a variety of reference abnormal sound signals. For example, the reference abnormal sound can be a resonance sound, a sticky sound, or an impact sound, etc. If the first audio signal matches any of the multiple reference abnormal sound signals, it indicates that there is a possibility that the vehicle component is in an abnormal state.

[0094] Specifically, step S2201 can be implemented by the following steps: extracting a first audio feature of the first audio signal, determining whether the similarity between the first audio feature and the reference audio feature of the reference abnormal sound signal is greater than a second threshold, and if the similarity between the first audio feature and the reference audio feature is greater than the second threshold, determining that the first audio signal matches the reference abnormal sound signal. Therefore, the first audio signal can be matched with the reference abnormal sound signal in the audio library through the audio feature.

[0095] In step S2202, when the signal in the first audio signal matches the reference abnormal sound signal, it is determined that the first audio signal contains an abnormal sound signal.

[0096] When it is determined that the similarity between the audio feature of the first audio signal and the audio feature of the reference abnormal sound signal is greater than the threshold, it indicates that the abnormal sound signal exists in the first audio signal, indicating that there is a possibility that the vehicle component is in an abnormal state.

[0097] Regarding step S240, in some embodiments of the present disclosure, it may include: Figure 5 Steps S2401 to S2402 are shown. Figure 5 A schematic flow chart of a method for identifying abnormalities in vehicle components in another embodiment provided by the present disclosure.

[0098] In step S2401, the second audio signal is compared with a reference abnormal sound signal in an audio library to determine the abnormal sound signal present in the second audio signal.

[0099] After acquiring the second audio signal, the audio features of the second audio signal can be extracted, and then the audio features of the reference abnormal sound signal in the audio library can be extracted. By comparing the audio features of the second audio signal with the audio features of the reference abnormal sound signal, the number of abnormal sound signals in the second audio signal can be determined, and the number of abnormal sound signals in the second audio signal is the number of occurrences of the abnormal sound signal in the second audio signal.

[0100] In step S2402, the number of occurrences of the abnormal sound signal in the second audio signal is compared with a first threshold to determine whether the number of occurrences is greater than the first threshold.

[0101] After determining the number of occurrences of the abnormal sound signal in the second audio signal, it is also necessary to compare the number of occurrences of the abnormal sound signal with the first threshold to determine whether the number of occurrences of the abnormal sound signal is greater than the first threshold.

[0102] For example, by comparing the audio features of the second audio signal with the audio features of the reference abnormal sound signal, it can be learned that the number of abnormal sound signals present in the second audio signal is 10. Assuming that the first threshold is set to 5, it can be determined that the number of occurrences of the abnormal sound signal in the second audio signal is greater than the first threshold, which means that there are indeed vehicle components in an abnormal state in the vehicle.

[0103] According to a further embodiment of the present application, an electronic device is also provided. The electronic device is a vehicle-mounted electronic device. The electronic device may include the vehicle control unit, action recognition system, expression recognition system, voice recognition system, auxiliary driving system and voice system as described above. The electronic device may also be a vehicle controller of a vehicle. Figure 6 A schematic block diagram of an electronic device according to an embodiment is shown in FIG.

[0104] like Figure 6As shown, the electronic device 600 may include a processor 610, a memory 620, and a communication bus 630. The number of the processor 610 may be one or more, and the number of the memory 620 may be one or more. The memory 620 stores a computer-readable program. When the electronic device 600 is running, the processor 610 communicates with the memory 620 via the communication bus 630, and the computer-readable program is called and executed by the processor 610, thereby realizing the voice interaction method of the present application. The communication bus 630 is used to realize communication between various hardware in the electronic device.

[0105] In addition, the electronic device may include more components or adopt Figure 6 Different settings. For example, all or part of the steps of the method of the present application may be implemented by hardware, and the hardware may communicate with the processor 610 or the like via the communication bus 630.

[0106] The processor may include a general-purpose processor, such as a central processing unit, a microcontroller unit, a network processor or other conventional processors; it may also include a special-purpose processor, including a neural network processor, a graphics processor, a digital signal processor, etc. In addition, some of the multiple processors may be general-purpose processors, and the other part may be special-purpose processors.

[0107] The memory includes, but is not limited to, a random access memory, a read-only memory, a programmable read-only memory, an erasable programmable read-only memory, an electrically erasable programmable read-only memory, etc. The number of memories may be multiple.

[0108] As Figure 6 In the example of, the processor 610 can call the computer program in the memory 620 to execute the voice interaction method of each embodiment of the present disclosure. For example, after calling the computer program, the processor can perform the following process: collect a first audio signal once every first duration or first mileage, the first audio signal comes from the acoustic sensor of the vehicle; determine whether there is an abnormal sound signal in the first audio signal; in response to the presence of the abnormal sound signal, obtain a second audio signal, the second audio signal is an audio signal of a second duration or a second mileage and comes from the acoustic sensor, wherein the second duration is less than the first duration, and the second mileage is less than the first mileage; determine whether the number of occurrences of the abnormal sound signal in the second audio signal is greater than a first threshold; in response to the number of occurrences of the abnormal sound signal being greater than the first threshold, identify that the vehicle component is in an abnormal state.

[0109] See also Figure 7 As shown, Figure 7 A schematic diagram of a vehicle provided by the present disclosure, Figure 7 The vehicle shown may include the above Figure 6 The electronic device 600 in.

[0110] The present disclosure also provides a readable storage medium, in which a computer program is stored, and the computer program is used to implement the above method when executed by a processor. "Readable storage medium" can be any device that can contain, store, communicate, propagate or transmit a program for use in an instruction execution system, device or equipment or in combination with these instruction execution systems, devices or equipment. More specific examples of readable storage media include the following: an electrical connection portion (electronic device) with one or more wirings, a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), an optical fiber device, and a portable read-only memory (CDROM), etc.

[0111] The present disclosure also provides a computer program product. The method of the present disclosure can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed, the process or function of the present disclosure is executed in whole or in part.

[0112] The computer program or instructions may be stored in a readable storage medium or transmitted from one readable storage medium to another readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The readable storage medium may be any available medium that can be accessed or a data storage device such as a server, data center, etc. that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid state drive. The computer readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0113] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0114] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, systems, and computer program products according to the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0115] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0116] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0117] In the description of this specification, the description with reference to the terms "one embodiment / method", "some embodiments / methods", "example", "specific example", or "some examples" etc. means that the specific features, structures, or characteristics described in conjunction with the embodiment / method or example are included in at least one embodiment / method or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment / method or example. Moreover, the specific features, structures, or characteristics described may be combined in any one or more embodiments / methods or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments / methods or examples described in this specification and features of different embodiments / methods or examples, unless they are contradictory.

[0118] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0119] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.

Claims

1. A method for identifying abnormality of vehicle parts, characterized in that: The method comprises: Collecting a first audio signal once every first time period or first mileage, where the first audio signal comes from an acoustic sensor of the vehicle; Determining whether there is an abnormal sound signal in the first audio signal; In response to the presence of the abnormal sound signal, a second audio signal is acquired, where the second audio signal is an audio signal of a second duration or a second mileage and is from the acoustic sensor, wherein the second duration is shorter than the first duration, and the second mileage is shorter than the first mileage; determining whether the number of occurrences of the abnormal sound signal in the second audio signal is greater than a first threshold; and In response to the occurrence frequency of the abnormal sound signal being greater than the first threshold, it is identified that the vehicle component is in an abnormal state.

2. The method according to claim 1, characterized in that The identifying that the vehicle component is in an abnormal state includes: Determining a first vehicle component corresponding to the acoustic sensor of the abnormal sound signal, and determining a type of the abnormal sound signal; determining whether the type of the abnormal sound signal is the type of a reference abnormal sound signal of the first vehicle component, the reference abnormal sound signal being a signal emitted when the first vehicle component is in an abnormal state; and In response to the type of the abnormal sound signal being the type of the reference abnormal sound signal of the first vehicle component, it is determined that an abnormal state occurs in the first vehicle component.

3. The method according to claim 2, characterized in that The method further comprises: In the case that the type of the abnormal sound signal is not the type of the reference abnormal sound signal of the first vehicle component, it is determined that the first vehicle component does not have an abnormal state.

4. The vehicle component abnormality identification method according to claim 2 or 3, characterized in that: After determining that the first vehicle component is in an abnormal state, the method further includes: A first prompt message is output, wherein the first prompt message includes an identifier of the first vehicle component and the type of the abnormal sound.

5. The vehicle component abnormality identification method according to claim 2 or 3, characterized in that: After determining that the first vehicle component is in an abnormal state, the method further includes: The identification of the first vehicle component and the type of abnormal sound are sent to a server, and the identification of the first vehicle component and the type of abnormal sound are used to determine the abnormal cause of the first vehicle component.

6. The vehicle component abnormality identification method according to any one of claims 1 to 3, characterized in that: The determining whether an abnormal sound signal exists in the first audio signal includes: Comparing the first audio signal with a reference abnormal sound signal in an audio library, wherein the audio library has a plurality of reference abnormal sound signals; and In the case that the signal in the first audio signal matches the reference abnormal sound signal, it is determined that an abnormal sound signal exists in the first audio signal.

7. The vehicle component abnormality identification method according to claim 6, characterized in that: The comparing the first audio signal with a reference abnormal sound signal in an audio library comprises: extracting a first audio feature of the first audio signal; Determine whether the similarity between the first audio feature and the reference audio feature of the reference abnormal sound signal is greater than a second threshold; and When the similarity between the first audio feature and the reference audio feature is greater than a second threshold, it is determined that the first audio signal matches the reference abnormal sound signal.

8. The vehicle component abnormality identification method according to any one of claims 1 to 3, characterized in that: The determining whether the number of occurrences of the abnormal sound signal in the second audio signal is greater than a first threshold comprises: Compare the second audio signal with a reference abnormal sound signal in an audio library to determine the abnormal sound signal present in the second audio signal; and The number of occurrences of the abnormal sound signal in the second audio signal is compared with the first threshold to determine whether the number of occurrences is greater than the first threshold.

9. An electronic device, characterized in that: include: A memory storing execution instructions; as well as A processor, wherein the processor executes the execution instruction stored in the memory, so that the processor executes the vehicle component abnormality identification method according to any one of claims 1 to 8.

10. A vehicle, characterized in that: Comprising the electronic device as claimed in claim 9.

11. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the vehicle component abnormality identification method according to any one of claims 1 to 8 is implemented.

Images