Abnormal sound diagnosing system

Abstract

To ensure that an accurate diagnosis result of abnormal sound generated in a vehicle is obtained easily, for even an operator less experienced in using an abnormal sound diagnosing system.SOLUTION: An abnormal sound diagnosing system according to the present disclosure comprises: a computation processing unit for acquiring a spectrogram indicating a relationship between time, a frequency and a sound pressure from the time series data of sound; an abnormal sound frequency acquisition unit for acquiring the time series data of a frequency of an abnormal sound phenomenon causing generation of an abnormal sound in a vehicle, on the basis of vehicle identification information, and vehicle state data indicating a vehicle state acquired in synchronism with sound data; a display control unit for causing a display unit to display the spectrogram, the time series data of the frequency acquired by the abnormal sound frequency acquisition unit, and information on the abnormal sound phenomenon; and a diagnosis unit for diagnosing the cause of an abnormal sound generated in the vehicle on the basis of the time series data of sound and a selected range of the spectrogram.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an abnormal sound diagnosis system that diagnoses abnormal sounds generated in a vehicle. [Background technology]

[0002] Conventionally, there is known a sound and vibration analyzer that performs analysis by taking in data on sound or vibration generated with the rotation of rotating bodies and data on the number of rotations of selected rotating bodies (pulse signal data) during operation of the power transmission mechanism of a vehicle having multiple rotating bodies (see, for example, Patent Document 1). This sound and vibration analyzer performs frequency analysis on the sound or vibration data, and calculates an order according to the specifications of the rotating bodies from the frequency-analyzed sound or vibration data. Furthermore, in order to facilitate consistency with a sensory test, the sound and vibration analyzer displays the sound pressure level calculated from the sound or vibration data in a color-coded manner according to the magnitude, and in correspondence with the order and vehicle speed on a display unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-98984 A Summary of the Invention [Problem to be solved by the invention]

[0004] According to the conventional sound and vibration analyzer described in the above Patent Document 1, it is easy to match with the sensory test by displaying a graph using the vehicle speed, and it may be possible to identify the rotating body that is the source of the sound by checking the order of the sound or playing back the captured sound. However, it is not easy for an inexperienced worker to identify the rotating body that is the source of the sound using the sound and vibration analyzer, and the worker needs to have a certain amount of experience to accurately identify the rotating body that is the source of the sound while comparing the order of the sound, the vehicle speed, and the sound pressure level.

[0005] Therefore, a primary object of the present disclosure is to enable even an operator with little experience in using abnormal sound diagnosis systems to easily obtain accurate diagnosis results for abnormal sounds occurring in a vehicle. [Means for solving the problem]

[0006] The abnormal sound diagnosis system disclosed herein is an abnormal sound diagnosis system that diagnoses abnormal sounds generated in a vehicle based on time series data of sound emitted from the vehicle, and includes: an arithmetic processing unit that acquires a spectrogram showing the relationship between time, frequency, and sound pressure from the sound time series data; an abnormal sound frequency acquisition unit that acquires time series data of the frequency of an abnormal sound phenomenon that generates an abnormal sound in the vehicle based on identification information of the vehicle and vehicle state data that shows the state of the vehicle acquired in synchronization with the sound data; a display control unit that causes a display unit to display the spectrogram, the time series data of the frequency acquired by the abnormal sound frequency acquisition unit, and information on the abnormal sound phenomenon; and a diagnosis unit that diagnoses a cause of the abnormal sound generated in the vehicle based on the sound time series data and a selected range of the spectrogram.

[0007] In the abnormal sound diagnosis system of the present disclosure, the calculation processing unit acquires a spectrogram showing the relationship between time, frequency, and sound pressure from the time series data of the sound. The abnormal sound frequency acquisition unit acquires time series data of the frequency of an abnormal sound phenomenon that generates an abnormal sound in the vehicle based on the vehicle identification information and vehicle state data indicating the state of the vehicle acquired in synchronization with the sound data. The display control unit then displays the spectrogram, the time series data of the frequency of the abnormal sound phenomenon, and the information of the abnormal sound phenomenon on the display unit. This allows the user of the abnormal sound diagnosis system to appropriately select the range to be diagnosed by the diagnostic unit of the spectrogram while referring to the frequency of the abnormal sound phenomenon displayed on the display unit. As a result, even an operator with little experience in using the abnormal sound diagnosis system can easily obtain a highly accurate diagnosis result of an abnormal sound generated in the vehicle. The diagnostic unit may be constructed by machine learning so as to diagnose the cause of the abnormal sound based on given information. [Brief description of the drawings]

[0008] [Figure 1] 1 is a schematic configuration diagram showing an abnormal sound diagnosis system according to the present disclosure. [Diagram 2] 4 is a flowchart showing a series of processes executed in a terminal constituting the abnormal sound diagnosis system of the present disclosure. [Diagram 3] FIG. 2 is an explanatory diagram showing an example of a display on a display unit of a terminal constituting the abnormal sound diagnosis system of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Next, an embodiment of the present disclosure will be described with reference to the drawings.

[0010] 1 is a schematic diagram showing an abnormal sound diagnosis system 1 according to the present disclosure. The abnormal sound diagnosis system 1 shown in the figure is for diagnosing the cause of abnormal sound generated in a vehicle V, such as a vehicle equipped with only an engine as a power generation source, a hybrid vehicle (HEV, PHEV), or an electric vehicle (BEV, FCEV), and includes a mobile terminal 10 and a server 20 as a diagnostic device capable of exchanging information with the mobile terminal 10 through communication.

[0011] The mobile terminal 10 is used by a user of the abnormal sound diagnosis system 1, who is, for example, an operator at a vehicle dealership or a maintenance shop, when responding to a user (owner) of the vehicle V in which an abnormal sound has occurred, or when performing a reproduction test in which the vehicle V is driven (operated) on a roadway or a test bench to reproduce the abnormal sound. In this embodiment, the mobile terminal 10 is a smartphone including an SoC, a ROM, a RAM, a GPS module (location information acquisition unit), an auxiliary storage device (flash memory) M, a display unit 11, a communication module 12, a microphone (not shown), and the like. An abnormal sound diagnosis support application (program) is also installed in the mobile terminal 10. As shown in FIG. 1, the mobile terminal 10 includes a medical interview information acquisition unit 13, a sound acquisition unit 14, a vehicle state acquisition unit 15, a calculation processing unit 16, an extraction unit 17, and a display control unit 18, which are constructed by cooperation between the abnormal sound diagnosis support application (software) and hardware such as the SoC of the mobile terminal 10.

[0012] The display unit 11 of the mobile terminal 10 includes a touch panel type liquid crystal panel or an organic EL panel. The communication module 12 exchanges various information with the electronic control device of the vehicle V via short-distance wireless communication or a cable (dongle), and can exchange various information with the server 20 via a network such as the Internet. The medical interview information acquisition unit 13 acquires information indicating the state of the vehicle V at the time of the occurrence of the abnormal sound (hereinafter referred to as "medical interview information") provided by the user of the vehicle V via the display unit 11. The sound acquisition unit 14 acquires time axis data of the sound (sound pressure) when the reproduction test is performed by the operator. The vehicle state acquisition unit 15 acquires information indicating the state of the vehicle V (hereinafter referred to as "vehicle state data") in synchronization with the acquisition of the time axis data of the sound by the sound acquisition unit 14 when the reproduction test is performed. The vehicle state data includes a plurality of physical quantities (vehicle speed, engine speed, motor speed, etc.) corresponding to the items of the medical interview information. The calculation processing unit 16 executes an analysis process of the time axis data of the sound acquired by the sound acquisition unit 14. The extraction unit 17 narrows down the analysis results by the calculation processing unit 16 in accordance with the selection by the operator, etc. The display control unit 18 controls the display unit 11.

[0013] The server 20 of the abnormal sound diagnosis system 1 is a computer (information processing device) including a CPU, ROM, RAM, input / output devices, a communication module, etc., and is installed and managed, for example, by an automobile manufacturer that manufactures the vehicle V. The server 20 is configured with an abnormal sound diagnosis unit 21 that diagnoses abnormal sounds generated in the vehicle V by cooperation between hardware such as a CPU and a pre-installed abnormal sound diagnosis application. The abnormal sound diagnosis unit 21 includes a neural network (convolutional neural network) configured by supervised learning (machine learning) so as to diagnose the cause of the abnormal sound generated in the vehicle V and the part that is the source of the abnormal sound based on the interview information and sound time axis data acquired by the mobile terminal 10. Furthermore, in the server 20, when it is found that a new abnormal sound has occurred in the vehicle V, re-learning is performed for the abnormal sound diagnosis unit 21 using the sound time axis data acquired for the new abnormal sound and the contents of each item of the interview information as teacher data.

[0014] Furthermore, the server 20 includes a storage device 22 that stores an abnormal sound database that stores information on a plurality of abnormal sounds that are known to occur in the vehicle for each vehicle model. The abnormal sound database stores information such as time axis data of the sound, the cause of the abnormal sound, the parts that are the source of the sound, the contents of the medical examination information provided by the user of the vehicle V, and measures to eliminate the abnormal sound, for each of the plurality of abnormal sounds. The information for each vehicle model stored in the abnormal sound database includes, for example, a calculation formula (function) for deriving the frequency of an abnormal sound phenomenon that generates an abnormal sound in the vehicle, such as motor noise, engine chain noise, switching noise of an inverter, and transmission resonance. Furthermore, the server 20 updates the abnormal sound database based on information acquired from the vehicle V, etc., and information (reports) on newly discovered abnormal sounds transmitted from automobile manufacturers (developers, etc.), vehicle dealers, maintenance shops, etc.

[0015] Next, the abnormal sound diagnosis procedure performed by the abnormal sound diagnosis system 1 will be described.

[0016] When a worker at a vehicle dealership or a repair shop is requested by a user of a vehicle V to eliminate an abnormal sound, the worker listens to the inquiry information from the user and then executes a reproduction test to obtain information necessary for diagnosing the abnormal sound. When executing the reproduction test, the worker connects the mobile terminal 10 to an electronic control device of the vehicle V, and places or fixes the mobile terminal 10 or an external microphone connected to the mobile terminal 10 in an appropriate position on the vehicle V. The worker also starts an abnormal sound diagnosis support application and turns on the start switch of the vehicle V. Accordingly, the mobile terminal 10 acquires information such as the vehicle identification number or chassis number of the vehicle V from the electronic control device. Furthermore, the worker taps a recording start button displayed on the display unit 11 and drives (operates) the vehicle V on a roadway or a test stand to reproduce the driving state in which the abnormal sound occurred based on the inquiry information from the user of the vehicle V.

[0017] While the vehicle V is running (operating), the sound acquisition unit 14 of the mobile terminal 10 acquires time axis data of the sound emitted from the vehicle V at predetermined time intervals (micro time) and stores the data in the auxiliary storage device M, and the vehicle state acquisition unit 15 acquires vehicle state data specified by the worker in response to medical interview information from the user of the vehicle V at predetermined time intervals (micro time) from the electronic control device of the vehicle V in synchronization with the acquisition of the sound time axis data by the sound acquisition unit 14 and stores the vehicle state data in the auxiliary storage device M. Then, when the worker taps the recording stop button displayed on the display unit 11, the acquisition of the sound time axis data and vehicle state data is completed, and the mobile terminal 10 executes a series of processes shown in FIG.

[0018] 2, the mobile terminal 10 transmits to the server 20 vehicle identification information such as the vehicle identification number, and vehicle state data related to the rotation of the rotating elements of the vehicle V, such as the vehicle speed, engine RPM, and motor RPM obtained in the reproduction test (step S100). When this information is received by the server 20, the abnormal sound diagnosis unit 21 of the server 20 acquires the vehicle model of the vehicle V from the storage device 22 or a vehicle information database stored in another server, based on the vehicle identification number etc. from the mobile terminal 10, and acquires time series data of the frequency of the abnormal sound phenomenon for the acquired vehicle model.

[0019] More specifically, the abnormal sound diagnosis unit 21 acquires time-series data on the frequency of abnormal sound phenomena that occur in the vehicle V and that can be acquired from the vehicle condition data from the mobile terminal 10, based on information (calculation formula) corresponding to the vehicle model of the vehicle V stored in the abnormal sound database and the vehicle condition data from the mobile terminal 10. Furthermore, the abnormal sound diagnosis unit 21 acquires (calculates) for each abnormal sound phenomenon, information such as its name, order, and frequency calculation formula, as well as analytical values ​​such as the average value of the sound pressure (energy) of the abnormal sound phenomenon. The server 20 then transmits the time-series data on the frequency of the abnormal sound phenomenon acquired by the abnormal sound diagnosis unit 21, the information on the abnormal sound phenomenon, and the analytical value to the mobile terminal 10.

[0020] The mobile terminal 10 receives time series data of the frequency of the abnormal sound phenomenon from the server 20 (step S110). The calculation processing unit 16 of the mobile terminal 10 also acquires the time axis data of the sound acquired by the sound acquisition unit 14 (step S120), and performs STFT (Short-Time Fourier Transform) on the acquired time axis data of the sound to acquire a spectrogram (acoustic spectrogram) showing the relationship between time, frequency, and sound pressure (step S130). Next, the display control unit 18 of the mobile terminal 10 causes the display unit 11 to display the spectrogram acquired by the calculation processing unit 16, as shown in FIG. 3, and also causes the time series data of the frequency of the abnormal sound phenomenon from the server 20 to be displayed on the spectrogram (step S140). Furthermore, in step S140, the display control unit 18 causes the display unit 11 to display information such as the name and frequency calculation formula, the average sound pressure (energy) value of the abnormal sound phenomenon, and the ranking of the sound pressure level (in parentheses in FIG. 3) for each abnormal sound phenomenon.

[0021] In this embodiment, the spectrogram is a color map in which the horizontal axis is the time axis and the vertical axis is the frequency axis, and the relationship between time and sound pressure level for each frequency is shown by color coding the sound pressure level. In addition, the operator can switch between display / non-display of the time series data of the frequency of the abnormal sound phenomenon, the name of the abnormal sound phenomenon, the frequency calculation formula, the average value of the sound pressure, etc. by tapping the ON button or OFF button on the display unit 11. Furthermore, when the operator selects (specifies) a desired range (see the square frame in FIG. 3) of the spectrogram on the display unit 11, the average value of the sound pressure (energy) and the ranking of the sound pressure level of the abnormal sound phenomenon within the range selected by the operator are displayed on the display unit 11.

[0022] After the spectrogram is displayed on the display unit 11 of the mobile terminal 10, the operator selects (specifies) on the display unit 11 a range of the spectrogram to be diagnosed (analyzed) by the abnormal sound diagnosis unit 21 (server 20) (hereinafter referred to as a "diagnosis range"). In response to the operator's screen operation, the extraction unit 17 acquires the diagnosis range selected by the operator, and instructs the display control unit 18 to display the diagnosis range on the display unit 11 (step S150). After the process of step S150, the medical interview information acquisition unit 13 cooperates with the extraction unit 17 and the display control unit 18 to determine the medical interview information (step S160). In step S160, the extraction unit 17 reads out vehicle condition data within the diagnosis range, and extracts information to be provided to the server 20 as medical interview information from the read vehicle condition data. Also, in step S160, the display control unit 18 causes the display unit 11 to display a message instructing input of medical interview information. After the worker has completed inputting the medical interview information, the medical interview information acquisition unit 13 determines the information extracted by the extraction unit 17 and the information inputted by the worker as the final medical interview information.

[0023] After the inquiry information is confirmed, when the worker taps an information transmission button displayed on the display unit 11, information required for diagnosing the abnormal sound is transmitted from the communication module 12 of the mobile terminal 10 to the server 20 (step S170). In this embodiment, the information transmitted from the mobile terminal 10 to the server 20 includes at least the time axis data of the sound, the inquiry information, the vehicle state data, and information defining the diagnosis range selected by the worker. When the information required for diagnosing the abnormal sound is transmitted from the mobile terminal 10 to the server 20, the abnormal sound diagnosis unit 21 of the server 20 diagnoses the cause of the abnormal sound generated in the vehicle V based on the information provided from the mobile terminal 10, and transmits the diagnosis result to the mobile terminal 10. The diagnosis result includes the cause of the abnormal sound generated in the vehicle V, the part that is the source of the abnormal sound, and the measures to eliminate the abnormal sound read from the storage device 22. When the diagnosis result from the server 20 is received by the mobile terminal 10, the diagnosis result is displayed on the display unit 11 (step S180), and a series of processes executed by the mobile terminal 10 for diagnosing the abnormal sound is completed. By executing the process shown in FIG. 2, the worker can accurately explain the diagnosis results from the server 20 to the user or the like of the vehicle V and promptly proceed with measures to deal with the abnormal noise.

[0024] As described above, in the abnormal sound diagnosis system 1, the abnormal sound diagnosis unit 21 of the server 20 as an abnormal sound frequency acquisition unit acquires time series data of the frequency of an abnormal sound phenomenon that generates an abnormal sound in the vehicle V based on the vehicle identification information from the mobile terminal 10 and vehicle condition data synchronized with the time series data of the sound (steps S100, S110). In addition, the calculation processing unit 16 acquires a spectrogram showing the relationship between time, frequency, and sound pressure from the time series data of the sound (steps S120, S130). Furthermore, the display control unit 18 causes the display unit 11 to display the spectrogram, the time series data of the frequency of the abnormal sound phenomenon, and information on the abnormal sound phenomenon (step S140, FIG. 3). This allows the user of the abnormal sound diagnosis system 1 to appropriately select the range of the spectrogram to be diagnosed by the abnormal sound diagnosis unit 21 while referring to the frequency of the abnormal sound phenomenon displayed on the display unit 11 of the mobile terminal 10. As a result, even an operator with little experience in using the abnormal sound diagnosis system 1 can easily obtain from the server 20 accurate diagnosis results for abnormal sounds occurring in the vehicle V.

[0025] The information relating to the abnormal sound phenomenon occurring in the vehicle V may be stored in the auxiliary storage device M of the mobile terminal 10, in which case the process of step S100 in Fig. 3 may be omitted and the process of step S110 may be executed on the mobile terminal 10 side. The abnormal sound diagnosis support application installed on the mobile terminal 10 may be installed on a tablet terminal, a laptop or desktop personal computer, or the like, and the tablet terminal or the like may be used in place of the mobile terminal 10. Furthermore, the abnormal sound diagnosis system 1 may be configured as a single information processing device such as a personal computer. [Industrial Applicability]

[0026] The invention disclosed herein is extremely useful for diagnosing abnormal noises occurring in a vehicle. [Explanation of symbols]

[0027] 1 abnormal sound diagnosis system, 10 mobile terminal, 11 display unit, 12 communication module, 13 medical interview information acquisition unit, 14 sound acquisition unit, 15 vehicle state acquisition unit, 16 calculation processing unit, 17 extraction unit, 18 display control unit, 20 server, 21 abnormal sound diagnosis unit, 22 storage device, V vehicle.

Claims

[Claim 1] An abnormal sound diagnosis system for diagnosing an abnormal sound generated in a vehicle based on time-series data of a sound emitted from the vehicle, comprising: A processor that acquires a spectrogram showing the relationship between time, frequency, and sound pressure from the time-series data of the sound; an abnormal sound frequency acquisition unit that acquires time-series data on the frequency of an abnormal sound phenomenon that generates an abnormal sound in the vehicle, based on the identification information of the vehicle and vehicle state data that indicates the state of the vehicle and is acquired in synchronization with the sound data; a display control unit that displays on a display unit the spectrogram, the time series data of the frequency acquired by the abnormal sound frequency acquisition unit, and information on the abnormal sound phenomenon; a diagnosis unit that diagnoses a cause of an abnormal sound generated in the vehicle based on the time-series data of the sound and a selected range of the spectrogram; An abnormal sound diagnosis system comprising:

Images