Sound source candidate extraction system and sound source detection method
Through image data comparison and vehicle change point history analysis, the sound source candidates for abnormal noise in or outside the car are extracted, which solves the problems of reduced sound source detection accuracy and limited extraction range in the prior art, and achieves a higher sound source Candidate extraction accuracy and estimation accuracy.
Patent Information
- Application Number
- CN202111550679.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-12-17
- Filing Date
- 2021-12-17
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-12-17
AI Technical Summary
When the existing sound source detection devices are far away, it is difficult to accurately extract sound source candidates for abnormal noise propagating in or outside the car, and the extraction range of vibration sensors and microphones is limited.
The image data inside or outside the car is obtained by using a shooting device, and by comparing the image data changes before and after abnormal noise, the sound source candidates are extracted, and the vehicle change point history recorded by the vehicle change point storage unit is identified to identify possible sound source candidates.
The extraction accuracy of sound source candidates is improved, the work burden of inspectors is reduced, and the estimation accuracy of abnormal noise sound sources is enhanced.
Smart Images

Figure CN114646379B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a sound source candidate extraction system and a sound source detection method for detecting a sound source that causes abnormal noise propagating inside or outside a vehicle compartment. Background Art
[0002] Patent Document 1 discloses a sound source detection device for detecting a location where abnormal noise propagating in a vehicle compartment is generated. In the sound source detection device of Patent Document 1, sound is collected to generate sound data, and the sound data is analyzed to identify the location where the abnormal noise is generated.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2010-91282
[0006] Furthermore, when a sound source detection device such as that disclosed in Patent Document 1 is used to identify a sound source that is the cause of abnormal noise, the farther the distance between the sound source detection device and the propagation path of the abnormal noise is, the lower the estimation accuracy of the sound source achieved by the sound source detection device is, and the estimation of the sound source becomes difficult. Therefore, it is considered to extract sound source candidates of the sound source that is the cause of abnormal noise in advance, but if an attempt is made to extract sound source candidates using a vibration sensor or a microphone, there is a problem that the range that can be extracted is limited, and the sound source candidates cannot be easily extracted. Summary of the invention
[0007] The present invention is completed against the background of the above situation, and its purpose is to provide a sound source candidate extraction system for extracting sound source candidates of abnormal noise propagating inside or outside a vehicle cabin, and a sound source detection method using the sound source candidate extraction system.
[0008] The main purpose of the first invention is a sound source candidate extraction system, which (a) extracts sound source candidates of the sound source that is the cause of abnormal noise propagating inside or outside a vehicle, and is characterized in that it comprises: (b) a shooting device that obtains image data of the inside or outside the vehicle; and (c) an extraction device that extracts the sound source candidate according to changes in the second image data compared with the first image data based on first image data before the abnormal noise is generated and second image data when or after the abnormal noise is generated, which are obtained by the shooting device.
[0009] The gist of the second invention is that, in the first invention, the sound source candidate extraction system is characterized in that it further includes a vehicle change point storage unit, which stores a history of vehicle change points including image detection change points detected in the image data, and when the image detection change point is an image detection change point generated after the first image data is acquired by the shooting device and before the second image data is acquired by the shooting device, the extraction device regards that the image detection change point causes the change in the second image data from the first image data and extracts the image detection change point as the sound source candidate.
[0010] The gist of the third invention is that, in the second invention, the sound source candidate extraction system is characterized in that the history of the vehicle change points stored in the vehicle change point storage unit includes, in addition to the image detection change points, a recorded change point that is identified and recorded in the history of the vehicle change points independently of the image data.
[0011] The main purpose of the fourth invention is a sound source detection method, (a) using a sound source candidate extraction system to detect a sound source propagating inside or outside a vehicle, the sound source candidate extraction system comprising: a shooting device for acquiring image data of the inside or outside the vehicle; and an extraction device for extracting a sound source candidate of the sound source that is the cause of the abnormal noise according to changes in the second image data compared with the first image data, based on first image data before the abnormal noise is generated and second image data when or after the abnormal noise is generated acquired by the shooting device. The sound source detection method is characterized in that it comprises the following steps: (b) extracting the sound source candidate by the sound source candidate extraction system; and (c) acquiring vibration information or sound data of the sound source candidate by an acquisition device.
[0012] Effects of the Invention
[0013] According to the first to third inventions, based on first image data before abnormal noise is generated and second image data when or after abnormal noise is generated acquired by a shooting device, sound source candidates are extracted according to changes in the second image data compared with the first image data, thereby making it easy to extract sound source candidates.
[0014] According to the fourth invention, a process of extracting a sound source candidate of a sound source based on a change between the first image data and the second image data by the sound source candidate extraction system is performed, thereby making it possible to easily extract the sound source candidate. Furthermore, the sound source of the abnormal noise is estimated based on the vibration information or sound data of the sound source candidate acquired by the acquisition device, thereby making it possible to suppress the burden of the sound source detection work performed by the inspector from increasing and to improve the estimation accuracy of the sound source. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 The diagram is a diagram for explaining the schematic configuration of a vehicle to which the present invention is applied, and is a diagram for explaining the schematic configuration of a sound source detection system for detecting a sound source that causes abnormal noise propagating in a vehicle cabin.
[0016] Figure 2 This is a diagram showing an example of sound data measured when abnormal noise is generated during driving.
[0017] Figure 3 This is a diagram showing an example of a sound source candidate map used when extracting sound source candidates based on the driving state of a vehicle.
[0018] Figure 4 This is a graph showing the relationship between frequency and sound pressure when abnormal noise occurs.
[0019] Figure 5 The figure briefly shows the image data of the interior of the vehicle cabin acquired by the first camera provided on the upper part of the center rearview mirror.
[0020] Figure 6 This is a diagram showing the history of vehicle change points based on image analysis, which is stored every time a vehicle change point is extracted.
[0021] Figure 7 This is a simulated image of the interior of the vehicle that is displayed on the display monitor of the detection device.
[0022] Figure 8 This is a flowchart for explaining an inspection process performed when a sound source causing abnormal noise propagating in a vehicle cabin is detected using a sound source detection system, that is, a sound source detection method for detecting the sound source of abnormal noise.
[0023] Fig. 9 This is a flowchart for explaining the process until sound source candidates are extracted based on the driving state.
[0024] Fig.10 This is a flowchart for explaining a process of estimating whether a sound source candidate extracted based on the driving state is a sound source.
[0025] Fig.11 This is a flowchart for explaining a process of estimating whether a sound source candidate extracted based on a vehicle change point is a sound source.
[0026] Fig.12 It is a diagram showing the overall structure of a sound source detection system according to another embodiment of the present invention.
[0027] Fig.13 It is a diagram showing the overall structure of a sound source detection system according to still another embodiment of the present invention.
[0028] Fig.14 It is a diagram showing the overall structure of a sound source detection system according to still another embodiment of the present invention.
[0029] Description of Reference Numerals
[0030] 8. 300, 400, 500: Sound source detection system (sound source candidate extraction system)
[0031] 87a: First camera (shooting device)
[0032] 87b: Second camera (shooting device)
[0033] 87c: High-speed camera (acquisition device)
[0034] 87d: Acoustic Camera (Acquisition Device)
[0035] 94, 306, 406, 506: Sound source detection device (acquisition device)
[0036] 94b, 304, 404, 504: Control device for detection (extraction device). DETAILED DESCRIPTION
[0037] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that in the following embodiments, the drawings are appropriately simplified or deformed, and the size ratios and shapes of each part are not necessarily accurately depicted.
[0038] [Example 1]
[0039] Figure 1 The diagram is a diagram for explaining the schematic configuration of a vehicle 10 to which the present invention is applied, and is a diagram for explaining the schematic configuration of a sound source detection system 8 for detecting a sound source that causes abnormal noise propagating inside or outside the vehicle cabin of the vehicle 10 .
[0040] The vehicle 10 is a hybrid vehicle that includes an engine 14, a first rotating machine MG1, and a second rotating machine MG2, and uses the engine 14 and the second rotating machine MG2 as a driving force source for traveling. In addition, the vehicle 10 includes a power transmission device 12 on a power transmission path between the engine 14 and the drive wheel 28. The power transmission device 12 includes an electric continuously variable transmission unit 18 and a mechanical stepped transmission unit 20 that are arranged in series on a common axis in a box 16 that is a non-rotating member. The electric continuously variable transmission unit 18 is directly connected to the engine 14 or indirectly connected to the engine 14 via a damper that is not shown. The mechanical stepped transmission unit 20 is connected to the output side of the electric continuously variable transmission unit 18. In addition, the power transmission device 12 includes a differential gear device 24 connected to an output shaft 22 that is an output rotating member of the mechanical stepped transmission unit 20, a pair of axles 26 connected to the differential gear device 24, and the like.
[0041] In the power transmission device 12, the power output from the engine 14 and the second rotating machine MG2 is transmitted to the mechanical stepped transmission unit 20, and is transmitted from the mechanical stepped transmission unit 20 to the drive wheels 28 of the vehicle 10 via the differential gear device 24 and the like. Hereinafter, the electric continuously variable transmission unit 18 is referred to as the continuously variable transmission unit 18, and the mechanical stepped transmission unit 20 is referred to as the stepped transmission unit 20. In addition, as far as power is concerned, torque and force have the same meaning without special distinction. In addition, the continuously variable transmission unit 18, the stepped transmission unit 20, etc. are configured to be roughly symmetrical with respect to the common axis mentioned above, and Figure 1 The lower half of its axis is omitted.
[0042] The engine 14 is a mechanism that functions as a power source capable of generating a driving torque, and is, for example, a well-known internal combustion engine such as a gasoline engine or a diesel engine. The engine 14 is controlled by controlling an engine control device 50 such as a throttle actuator, a fuel injection device, and an ignition device provided in the vehicle 10 to control an engine torque Te, which is an output torque of the engine 14.
[0043] The first rotating machine MG1 and the second rotating machine MG2 are rotating electric machines having a function as an electric motor and a function as a generator, and are so-called electric generators. The first rotating machine MG1 and the second rotating machine MG2 are connected to a battery 54 as an electric storage device provided in the vehicle 10 via an inverter 52 provided in the vehicle 10, respectively, and the inverter 52 is controlled by a vehicle control control device 100 described later, thereby controlling the MG1 torque Tg and the MG2 torque Tm as the output torques of the first rotating machine MG1 and the second rotating machine MG2, respectively.
[0044] The continuously variable transmission unit 18 includes a first rotating machine MG1 and a differential mechanism 32 as a power distribution mechanism, and the differential mechanism 32 mechanically distributes the power of the engine 14 to the first rotating machine MG1 and the intermediate transmission member 30 as the output rotating member of the continuously variable transmission unit 18. The second rotating machine MG2 is connected to the intermediate transmission member 30 in a power-transmitting manner. The differential mechanism 32 is composed of a single pinion type planetary gear device, the engine 14 is connected to the carrier CA0 of the planetary gear device via a connecting shaft 34 in a power-transmitting manner, the first rotating machine MG1 is connected to the sun gear S0 in a power-transmitting manner, and the second rotating machine MG2 is connected to the ring gear R0 in a power-transmitting manner. The continuously variable transmission unit 18 is an electric continuously variable transmission that controls the differential state of the differential mechanism 32 by controlling the operating state of the first rotating machine MG1.
[0045] The step-variable transmission 20 is a mechanical transmission mechanism that constitutes a part of the power transmission path between the step-variable transmission 18 and the drive wheel 28. The step-variable transmission 20 is, for example, a known planetary gear type automatic transmission that includes a plurality of planetary gear devices, namely, a first planetary gear device 36 and a second planetary gear device 38, and a plurality of engagement devices, namely, a clutch C1, a clutch C2, a brake B1, and a brake B2, including a one-way clutch F1, and can be shifted to a plurality of gears (shift gears). Hereinafter, the clutch C1, the clutch C2, the brake B1, and the brake B2 are simply referred to as the engagement device CB unless otherwise specifically distinguished. The engagement hydraulic pressure PRcb supplied to the engagement device CB is controlled by a hydraulic control circuit 56 provided in the vehicle 10. In the step-variable transmission 20, when the gear to be shifted is determined based on the accelerator operation amount (accelerator opening θacc), the vehicle speed V, etc., the engagement state of each engagement device CB is switched in such a manner as to become the engagement mode of the engagement device CB predetermined according to the gear.
[0046] return Figure 1 The vehicle 10 is provided with a vehicle control device 100 as a controller, and the vehicle control device 100 includes a control device of the vehicle 10 associated with the control of the engine 14, the continuously variable transmission part 18, and the stepped transmission part 20. The vehicle control device 100 is configured to include a so-called microcomputer, for example, and the microcomputer includes a CPU, a RAM, a ROM, an input and output interface, etc. The CPU performs signal processing using the temporary storage function of the RAM and according to the program pre-stored in the ROM, thereby executing various controls of the vehicle 10. The vehicle control device 100 is configured to be divided into an engine control device, a transmission control device, etc. according to needs.
[0047] Various signals based on detection values obtained by various sensors provided in the vehicle 10 (e.g., an engine speed sensor 60, an output speed sensor 62, an MG1 speed sensor 64, an MG2 speed sensor 66, an accelerator opening sensor 68, a throttle opening sensor 70, a brake pedal sensor 71, a steering wheel sensor 72, a G (gravity) sensor 74, a yaw rate sensor 76, a battery sensor 78, an oil temperature sensor 79, a vehicle periphery information sensor 80, a vehicle position sensor 81, an antenna for external network communication 82, a navigation system 83, a driving assistance setting switch group 84, a shift position sensor 85, etc.) (e.g., an engine speed Ne, an output speed No corresponding to a vehicle speed V, an MG1 speed Ng which is a speed of the first rotating machine MG1, an MG2 speed Nm which is an AT input speed Ni, an accelerator opening θacc which is an acceleration operation amount of the driver indicating the magnitude of the acceleration operation of the driver, a throttle opening θth which is an opening of an electronic throttle, a brake contact signal which is a signal indicating a state in which a brake pedal for actuating a wheel brake is operated by the driver) are provided. The signal Bon, the brake operation amount Bra indicating the magnitude of the brake pedal depression operation performed by the driver corresponding to the brake pedal depression force, the steering angle θsw and the steering direction Dsw of the steering wheel equipped with the vehicle 10, the steering wheel connection signal SWon as a signal indicating the state of the steering wheel being held by the driver, the longitudinal acceleration Gx of the vehicle 10, the left and right acceleration Gy of the vehicle 10, the yaw angular velocity Ryaw as the rotational angular velocity of the vehicle 10 around the vertical axis, the battery temperature THbat of the battery 54, the battery charge and discharge current Ibat, the battery voltage Vbat, the working oil temperature THoil which is the temperature of the working oil of the hydraulic actuator supplied to the coupling device CB even when the coupling device CB is working, the vehicle surrounding information Iard, the position information Ivp, the communication signal Scom, the navigation information Inavi, the driving assistance setting signal Sset which is a signal indicating the setting performed by the driver in the driving assistance control such as automatic driving control and cruise control, the operating position POSsh of the shift lever equipped with the vehicle 10, etc. are respectively supplied to the control device 100 for vehicle control.
[0048] In addition, image data (image information) from the first camera 87a that acquires images inside the vehicle cabin and the second camera 87b that acquires images outside the vehicle cabin are supplied to the vehicle control device 100. The first camera 87a is provided, for example, on the center rearview mirror 96 (see FIG. Figure 5) and is configured to acquire image data of the interior of the vehicle. The second camera 87b is configured to acquire image data of the surroundings of the vehicle 10 or a portion of the surroundings. The second camera 87b is, for example, composed of a 360-degree camera or a plurality of cameras that can capture images of the surroundings of the vehicle 10. In addition, the first camera 87a and the second camera 87b may also use the vehicle-mounted cameras that constitute the vehicle surrounding information sensor 80. It should be noted that the first camera 87a and the second camera 87b correspond to the shooting devices of the present invention that acquire image data of the interior or exterior of the vehicle.
[0049] The vehicle surrounding information sensor 80 includes, for example, at least one of a laser radar, a radar, and a vehicle-mounted camera, and directly obtains information related to the road on which the vehicle is traveling and information related to objects existing around the vehicle. The laser radar is, for example, a plurality of laser radars that detect objects in front of the vehicle 10, objects on the side, objects behind the vehicle 10, etc., or a laser radar that detects objects around the entire vehicle 10, and outputs object information related to the detected objects as vehicle surrounding information Iard. The radar is, for example, a plurality of radars that detect objects in front of the vehicle 10, objects near the front, objects near the rear, etc., and outputs object information related to the detected objects as vehicle surrounding information Iard. The object information obtained by the laser radar and radar includes the distance and direction of the detected object from the vehicle 10. The vehicle-mounted camera is, for example, a monocular camera or a stereo camera that is provided on the inner side of the front windshield of the vehicle 10 and shoots the front and the interior of the vehicle 10, and outputs shooting information as vehicle surrounding information Iard. The shooting information includes information such as the lane of the driving road, signs on the driving road, and other vehicles, pedestrians, and obstacles on the driving road.
[0050] Various command signals (for example, an engine control command signal Se for controlling the engine 14, a rotating machine control command signal Smg for respectively controlling the first rotating machine MG1 and the second rotating machine MG2, a hydraulic control command signal Sat for controlling the working state of the coupling device CB, a communication signal Scom, a brake control command signal Sbra for controlling the braking torque generated by the wheel brakes, a steering control command signal Sste for controlling the steering of the wheels (especially the front wheels), an information notification control command signal Sinf for warning and reporting to the driver, etc.) are output from the vehicle control control device 100 to each device equipped in the vehicle 10 (for example, an engine control device 50, an inverter 52, a hydraulic control circuit 56, an antenna 82 for external network communication, a wheel braking device 86, a steering device 88, an information notification device 89, etc.).
[0051] The vehicle 10 further includes a transceiver 90 and a gateway ECU 92. The transceiver 90 is a device that communicates with a sound source detection device 94 and a server 200 to be described later.
[0052] The gateway ECU 92 has the same hardware configuration as the vehicle control device 100, for example, a relay device configured to rewrite the program and / or data stored in the rewritable ROM in the vehicle control device 100. The gateway ECU 92 is connected to the transceiver 90, and for example, wireless communication between the transceiver 90 and the sound source detection device 94 is used to exchange various information between the vehicle control device 100 and the sound source detection device 94. In addition, the gateway ECU 92 can also use wireless communication between the transceiver 90 and the server 200 to exchange various information between the vehicle control device 100 and the server 200.
[0053] The server 200 is a system on a network outside the vehicle 10. The server 200 receives, processes, analyzes, accumulates, or provides various information such as vehicle state information and vehicle phenomenon information by using wireless communication between the vehicle control device 100 and the sound source detection device 94. The server 200 transmits and receives various information between the vehicle control device 100 and the sound source detection device 94. The vehicle state information is, for example, information indicating the driving state of the vehicle 10 detected by various sensors, that is, the operating state of the vehicle 10. The driving state is, for example, the accelerator opening θacc, the vehicle speed V, etc., and is sent to the server 200 via the transceiver 90 and the gateway ECU 92. The vehicle phenomenon information is, for example, information indicating a phenomenon occurring in the vehicle 10. The phenomenon is the sound pressure SP indicating the magnitude of the sound in the vehicle cabin detected by the sound pressure detection unit 94a provided in the sound source detection device 94, the vibration felt by the passenger detected by the G sensor 74, etc. It should be noted that the vehicle state information can also be transmitted and received by wireless communication between the server 200 via the external network communication antenna 82.
[0054] The sound source detection device 94 has the function of collecting sounds in the vehicle cabin and detecting the sound source that is the cause of abnormal noise based on the collected sound data. The specific control function of the sound source detection device 94 will be described later.
[0055] The vehicle control control device 100 performs various controls in the vehicle 10. For example, the vehicle control control device 100 uses an AT gear shift map (not shown) to determine the gear shift of the step-variable transmission unit 20, and performs the gear shift control of the step-variable transmission unit 20 as needed, wherein the AT gear shift map is a relationship that is previously determined and stored through experiments or design, that is, a predetermined relationship. The AT gear shift map, for example, has a predetermined relationship of a gear shift line for determining the gear shift of the step-variable transmission unit 20 on a two-dimensional coordinate with the vehicle speed V and the required driving force Frdem as variables.
[0056] The vehicle control device 100 includes a function as an engine control unit that controls the operation of the engine 14, that is, an engine control unit, and a function as a rotating machine control unit that controls the operation of the first rotating machine MG1 and the second rotating machine MG2 via the inverter 52. Through these control functions, hybrid drive control by the engine 14, the first rotating machine MG1, and the second rotating machine MG2 is performed. The vehicle control device 100 calculates the requested driving force Frdem [N] of the drive wheel 28 as the drive request amount by applying the accelerator opening θacc and the vehicle speed V to a drive request amount map as a predetermined relationship, for example. As the drive request amount, in addition to the requested driving force Frdem, the requested driving torque Trdem [Nm] of the drive wheel 28, the requested driving power Prdem [W] of the drive wheel 28, the requested AT output torque of the output shaft 22, etc. may also be used.
[0057] The vehicle control device 100, for example, controls the engine 14 and controls the power generation Wg of the first rotating machine MG1 in such a manner that the engine speed Ne and the engine torque Te that will achieve the requested drive power Prdem are obtained, taking into account the engine optimum fuel consumption point, etc., when the continuously variable transmission unit 18 is operated as a continuously variable transmission, thereby performing continuously variable transmission control of the continuously variable transmission unit 18 to change the speed ratio γ0 of the continuously variable transmission unit 18.
[0058] The vehicle control device 100 selectively establishes the motor driving mode or the hybrid driving mode as a driving mode according to the driving state. For example, when the requested driving power Prdem is in the motor driving region that is smaller than a predetermined threshold, the vehicle control device 100 establishes the motor driving mode, and when the requested driving power Prdem is in the hybrid driving region that is greater than a predetermined threshold, the hybrid driving mode is established.
[0059] In addition, the vehicle control device 100 can perform manual driving control and automatic driving control as driving control of the vehicle 10. In the manual driving control, the vehicle 10 is driven based on the driving operation of the driver, and in the automatic driving control, the vehicle 10 is driven by automatically performing driving control without relying on the driving operation of the driver, for example, by automatically setting a target driving state based on a destination input by the driver, map information, etc., and automatically performing acceleration, deceleration, and steering based on the target driving state. When the automatic driving selection switch in the driving assistance setting switch group 84 is operated by the driver and the automatic driving is selected, the vehicle control device 100 establishes the automatic driving mode to perform the automatic driving control.
[0060] Furthermore, if abnormal noise propagates into the vehicle cabin during driving, the driver will feel uncomfortable. In order to eliminate the abnormal noise, it is necessary to grasp the sound source that is the cause of the abnormal noise, and the sound source that is the cause of the abnormal noise is detected using the sound source detection system 8 described below. The sound source detection system 8 has the following functions: extracting sound source candidates that are the cause of the abnormal noise propagating in the vehicle cabin, checking whether the extracted sound source candidates are the sound source, and thereby estimating the sound source. The sound source detection system 8 is configured to include a control device 100 for vehicle control, a first camera 87a, a second camera 87b, a sound source detection device 94, and a server 200. The control device 100 for vehicle control, the first camera 87a, and the second camera 87b are equipped in the vehicle 10. The sound source detection device 94 and the server 200 are external devices separated from the vehicle 10. It should be noted that the sound source detection system 8 has the function of extracting sound source candidates that are the cause of the abnormal noise propagating in the vehicle cabin, and therefore the sound source detection system 8 corresponds to the sound source candidate extraction system of the present invention.
[0061] The sound source detection device 94 (hereinafter, the detection device 94) includes: a sound pressure detection unit 94a, which is composed of a microphone or the like for detecting the sound pressure SP; a detection control device 94b, which controls the operation of the entire sound source detection system 8 including the detection device 94; and a display 94c, which is used to report various information to the inspector during the detection of the sound source of abnormal noise. The sound pressure detection unit 94a functions as, for example, an acquisition device (sound collection device), which is a device that collects the sound in the vehicle compartment and obtains the sound pressure SP acquired by the sound collection as sound data. The detection control device 94b is a control device that performs various controls for detecting the sound source, such as giving instructions to the inspector when detecting the sound source of abnormal noise, extracting sound source candidates that are likely to be the sound source, or estimating whether the sound source candidates are the sound source. The control function of the detection control device 94b will be described later. The display monitor 94c functions as a reporting device for reporting various information required when detecting a sound source (sound source candidates, measurement positions, etc.) to the inspector, for example, displaying sound source candidates or displaying the measurement positions of the detection device 94 corresponding to the sound source candidates.
[0062] Similar to the vehicle control device 100, the detection control device 94b is configured to include, for example, a so-called microcomputer having a CPU, a RAM, a ROM, an input / output interface, etc. The detection control device 94b functionally includes an abnormal noise determination unit 102 as an abnormal noise determination unit, a driving state acquisition unit 104 as a driving state acquisition unit, a first sound source candidate extraction unit 106 as a first sound source candidate extraction unit, a sound source candidate extraction control unit 108 as a sound source candidate extraction control unit, a second sound source candidate extraction unit 112 as a second sound source candidate extraction unit, a sound source estimation unit 114 as a sound source estimation unit, and a display control unit 116 as a display control unit. The control functions of each control unit are described below. It should be noted that the detection control device 94b corresponds to the extraction device of the present invention.
[0063] The abnormal noise determination unit 102 determines whether abnormal noise is generated based on the sound data collected by the detection device 94 or the separately provided microphone while the vehicle 10 is running. The measurement position (initial position) of the detection device 94 or the microphone when collecting sound is set to a position where abnormal noise generated in various parts can be detected. In addition, the measurement position is not limited to one place, and various abnormal noises can be detected by setting multiple measurement positions.
[0064] When the sound collection by the detection device 94 or the microphone is completed, the abnormal noise determination unit 102 analyzes the collected sound data and determines whether there is a time period during the travel of the vehicle 10 when the sound pressure SP is equal to or higher than a predetermined value A1. Figure 2 An example of sound data collected while driving is shown. Figure 2 In the figure, the horizontal axis represents the time during driving, and the vertical axis represents the sound pressure SP. Figure 2 In the case where the sound pressure SP becomes greater than or equal to the predetermined value A1 during the predetermined driving time period, the abnormal noise determination unit 102 detects that Figure 2 When the sound pressure SP shown becomes equal to or higher than a predetermined value A1, it is determined that abnormal noise has occurred. The predetermined value A1 is a value obtained and stored in advance through experiments or design, and is set to a threshold value at which the driver feels uncomfortable even in background noise.
[0065] On the other hand, when the abnormal noise determination unit 102 analyzes the sound data collected during driving and the sound pressure SP has not become greater than the specified value A1, it determines that no abnormal noise has been generated. At this time, the abnormal noise determination unit 102 outputs an instruction to the display control unit 116 to display the meaning that no abnormal noise has been generated on the display display 94c. When the display control unit 116 receives the above instruction, the meaning that no abnormal noise has been generated is displayed on the display display 94c. The display control unit 116 is a control unit that controls the display of the display display 94c of the detection device 94, and outputs the display corresponding to the instruction from each control unit headed by the abnormal noise determination unit 102 to the display display 94c.
[0066] Furthermore, the abnormal noise determination unit 102 not only determines the occurrence of abnormal noise based on the sound data collected while the vehicle 10 is running, but also determines that abnormal noise has occurred when receiving an indication (abnormal noise information) from the user (driver) that abnormal noise has occurred under a predetermined running state.
[0067] The driving state acquisition unit 104 has a function of acquiring the driving state when abnormal noise is generated. When collecting sound of the sound pressure SP, the driving state acquisition unit 104 stores the driving state of the vehicle 10 during the sound collection at any time through wireless communication from the vehicle control control device 100 via the transceiver 90, etc. In this embodiment, the vehicle speed V and the accelerator opening θacc are stored at any time as the associated value of the driving state of the vehicle 10. In addition, when the driving state acquisition unit 104 detects abnormal noise during sound collection, it acquires the abnormal noise generation time T (refer to Figure 2) in the vehicle. It should be noted that the output speed No may be obtained instead of the vehicle speed V, and the throttle opening θth or the requested driving force Frdem may be obtained instead of the accelerator opening θacc.
[0068] The first sound source candidate extraction unit 106 extracts sound source candidates that are the cause of abnormal noise based on the acquired driving state. Figure 3 The sound source candidate map shown is used to extract sound source candidates. Figure 3 This is an example of a sound source candidate map used when extracting sound source candidates of abnormal noise based on the driving state. Figure 3 In FIG. 1 , the horizontal axis represents the vehicle speed V, and the vertical axis represents the accelerator opening θacc (or the requested driving force Frdem). Figure 3 As shown, a plurality of sound source candidates corresponding to the running state (vehicle speed V, accelerator opening θacc) of the vehicle 10 are defined on the map.
[0069] For example, when the driving state when the abnormal noise is generated is a low vehicle speed V and a low accelerator opening θacc, Figure 3 The pump noise is extracted as a sound source candidate in the sound source candidate map. In addition, when the driving state when the abnormal noise is generated is a high vehicle speed V and a low accelerator opening θacc, the pump noise is extracted from the sound source candidate map. Figure 3 The gear noise B is extracted from the sound source candidates as a sound source candidate. In addition, even in the case of a deviation from the driving state set as a sound source candidate in the sound source candidate map, it can be extracted as a sound source candidate in the case of a driving state close to the driving state set as a sound source candidate. In addition, when there are multiple sound source candidates that are likely to be the sound source, the sound source candidate with the highest possibility of being the sound source is set as the first candidate, the sound source candidate with the second highest possibility of being the sound source is set as the second candidate, and the sound source candidates are ranked in order from the sound source candidate with the highest possibility of being the sound source. For example, a sound source candidate in the driving state of the sound source candidate specified in the sound source candidate map is set as the first candidate, and a sound source candidate located at a position close to the driving state is set as the second candidate.
[0070] Figure 3The sound source candidate map is obtained and stored in advance through experiments or designs, and is distinguished and stored according to vehicle types and driving forms. In the present embodiment, the sound source candidate map is stored in the detection control device 94b of the detection device 94. Alternatively, the sound source candidate map may be stored in the server 200 according to each vehicle type and driving form, and when extracting sound source candidates, the sound source candidate map corresponding to the vehicle 10 is sent from the server 200 to the detection device 94 through wireless communication, so that the sound source candidate map can be referred to at any time. In addition, when the sound source candidate map is updated to a new map, the map is sent from the server 200 to the detection control device 94b using wireless communication, so that the sound source candidate map stored in the detection control device 94b is updated to the new map.
[0071] If the first sound source candidate extraction unit 106 extracts one or more sound source candidates, it determines that the sound source candidate can be extracted. On the other hand, if the first sound source candidate extraction unit 106 cannot extract a sound source candidate, for example, if there is no sound source candidate with which the first sound source candidate can be extracted, it determines that the sound source candidate can be extracted. Figure 3 In the case of a sound source candidate that matches the sound source candidate in the sound source candidate map, it is determined that it is difficult to extract the sound source candidate.
[0072] The following is based on Figure 3 The following describes the detection of a sound source when a sound source candidate is extracted based on a sound source candidate map, that is, when a sound source candidate is extracted based on the driving state of the vehicle 10. When a sound source candidate is extracted based on the sound source candidate map, the control unit 108 determines a measurement position corresponding to the extracted sound source candidate. The control unit 108 stores a measurement position map that specifies the measurement position of the detection device 94 corresponding to the extracted sound source candidate, and determines the measurement position based on the measurement position map. When the measurement position is determined based on the measurement position map, the display control unit 116 displays the determined measurement position on the display 94c of the detection device 94, and reports to the inspector that the detection device 94 is set at the determined measurement position to collect the sound in the vehicle cabin. After the inspector sets the detection device 94 at the measurement position according to the display content of the display 94c, the sound in the vehicle cabin is collected (the sound pressure SP of the sound in the vehicle cabin is measured) to obtain sound data.
[0073] The measurement position map is obtained in advance by experiment or design, and the measurement position specified for each sound source candidate is set to a position where the protrusion amount S of the sound pressure SP measured by the detection device 94 when abnormal noise is generated from the sound source set as the sound source candidate becomes a predetermined value or more in the frequency band predicted to generate abnormal noise. Therefore, based on the sound data when sound is collected in a state where the detection device 94 is set at the determined measurement position, the protrusion amount S of the sound pressure SP in the frequency band predicted to generate abnormal noise (see Figure 4 ) becomes greater than a predetermined value, the control unit 108 determines that the sound source candidate is likely to be a sound source during sound source candidate extraction. Figure 4 It is a graph showing the frequency characteristics of sound, where the horizontal axis represents frequency [Hz] and the vertical axis represents sound pressure SP [dB]. Figure 4 As shown, the protrusion amount S of the sound pressure SP in the predetermined frequency band increases, and the sound based on the protrusion amount S is transmitted to the driver as abnormal noise. The predetermined value for determining whether the sound source candidate is the sound source is obtained in advance by experiment or design, and is set as the lower limit threshold value at which the driver feels uncomfortable during driving.
[0074] On the other hand, based on the sound data collected when the detection device 94 is set at the determined measurement position, when the projection amount S of the sound pressure SP in the frequency band predicted to generate abnormal noise is less than a predetermined value, the control unit 108 determines that the possibility of the sound source candidate being the sound source is low when extracting the sound source candidate. At this time, if there are other sound source candidates that are likely to be the sound source, it is determined whether the possibility of the sound source candidate being the sound source is high by the same method as the above method.
[0075] In addition, the measurement position is not limited to one place, and two or more measurement positions may be set. For example, when two measurement positions, a first measurement position and a second measurement position, are set, the first measurement position is set to a position where the protrusion amount S of the sound pressure SP measured when the abnormal noise is generated becomes greater than a specified value, and the second measurement position is a position at a specified distance from the first measurement position, and is set to a position where the protrusion amount S of the sound pressure SP measured when the abnormal noise is generated is smaller than the value measured at the first measurement position by a specified value. Therefore, when the protrusion amount S of the sound pressure SP when the detection device 94 is set at the second measurement position is smaller than the protrusion amount S of the sound pressure SP when the detection device 94 is set at the first measurement position by a specified value, it is determined that the sound source candidate is likely to be the sound source. In this way, by setting multiple measurement positions, the estimation accuracy of the sound source candidate is improved.
[0076] When the sound source candidate is extracted and the control unit 108 determines that the sound source candidate is highly likely to be the sound source, it issues an instruction to the display control unit 116 to display on the display monitor 94c that the sound source candidate is estimated to be the sound source, and reports to the inspector that the sound source candidate is estimated to be the sound source.
[0077] Next, a case where a sound source candidate is not extracted based on the driving state of the vehicle 10 is described. The vehicle control control device 100 equipped in the vehicle 10 functionally includes a vehicle change point storage unit 118 as a vehicle change point storage unit. The vehicle change point storage unit 118 uses the first camera 87a and the second camera 87b to acquire image data inside and outside the vehicle cabin at any time, and when a change is detected between the image data acquired last time and the image data acquired last time through image analysis, the change is stored as a vehicle change point. The vehicle change point storage unit 118 detects a change from the image data acquired last time based on the image analysis performed by the vehicle control control device 100 through AI (Artificial Intelligence), and extracts and stores the vehicle change point based on the change.
[0078] Figure 5 One form of the image data of the interior of the vehicle cabin acquired by the first camera 87a provided above the center rearview mirror 96 is briefly shown. Figure 5 (a) is the image data in the vehicle compartment acquired by the first camera 87a at a certain time point, Figure 5 (b) is to obtain Figure 5 After obtaining the image data of (a), and after the passenger seat in the vehicle is equipped with a cup holder (cup holder) 98, the image data is obtained. Figure 5 After the image data of (a) is obtained, the cup holder 98 is installed on the passenger seat side in the vehicle compartment, and the vehicle change point storage unit 118 detects the changes in the vehicle compartment to obtain the following information: Figure 5 In addition, the vehicle change point storage unit 118 uses AI to store the image data shown in (b). Figure 5 The image data before the change shown in (a) and Figure 5 The image data after the change shown in (b) is analyzed, and the change is extracted and stored as the vehicle change point. Figure 5 In the image data shown in (b), relative to Figure 5 Since the cup holder 98 is captured in the image data of (a), the vehicle change point storage unit 118 recognizes the cup holder 98 based on the change in the image, extracts the attachment of the cup holder 98 and stores it as a vehicle change point.
[0079] Figure 6 The history of vehicle change points stored each time a vehicle change point is extracted is shown. When a vehicle change point is extracted, an event number is added, and the date and time when the vehicle change point was extracted, the specific content of the vehicle change point, and the person who is considered to have caused the vehicle change point are stored. Figure 6Each record is stored based on the judgment result obtained by AI, or based on the operation record of the dealer. For example, when an accessory (accessory) is assembled, the assembly of the accessory is extracted through AI, such as Figure 6 As shown in the first one at the top of the , the event number (10010), the date and time when the change point is extracted (2025.10.1), the content of the vehicle change point (accessory installation), and the implementer (user) are stored. In addition, for example, when the wiper rubber is replaced by the dealer, the vehicle change point is extracted based on the operation history of the vehicle 10, such as Figure 6 As shown in the third one from the top, the event number (10202), the extracted date and time (2025.12.5), the content of the vehicle change point (wiper rubber replacement), and the implementer (dealer) are stored. In addition, for example, in the case where a part of the left rearview mirror is deformed due to an accident, the vehicle change point is extracted based on the accident history, such as Figure 6 As shown in the fifth one from the top, the event number (11402), the extracted date and time (2026.2.3), the vehicle change point (part of the left rearview mirror is deformed), and the implementer (accident) are stored. It should be noted that the assembly of the accessory and the assembly of the cup holder 98 correspond to the image detection change points of the present invention, and the replacement of the wiper rubber and the deformation of part of the left rearview mirror correspond to the recording change points of the present invention.
[0080] The second sound source candidate extraction unit 112 extracts sound source candidates based on the image data before the abnormal noise is generated and the image data when or after the abnormal noise is generated, which are acquired by the first camera 87a and the second camera 87b. Specifically, the second sound source candidate extraction unit 112 refers to the following: Figure 6 The vehicle change point history stored in this way sets the vehicle change points extracted before and after the abnormal noise occurs as sound source candidates.
[0081] For example, after obtaining Figure 5 The image data of (a) does not generate abnormal noise at the time point of acquisition. Figure 5 When the image (b) is obtained Figure 5In the case where abnormal noise is generated after the image of (b), there is a possibility that the abnormal noise is generated due to the attachment of the cup holder 98, that is, it can be considered that the attachment of the cup holder 98 is a possibility that the sound source. In this case, the second sound source candidate extraction unit 112 regards that the attachment of the cup holder 98 as a vehicle change point (image detection change point) causes a change in the image data when or after the abnormal noise is generated compared with the image data before the abnormal noise is generated, and extracts the attachment of the cup holder 98 as a sound source candidate. In this way, the second sound source candidate extraction unit 112 extracts the attachment of the cup holder 98 as a sound source candidate based on the following. Figure 5 The image data before the abnormal noise is generated as shown in (a) and Figure 5 The image data shown in (b) when or after the abnormal noise is generated, extracts the sound source candidate based on the change (vehicle change point) in the image data after the abnormal noise is generated compared with the image data before the abnormal noise is generated.
[0082] In addition, the second sound source candidate extraction unit 112 ranks the sound source candidates in order from the vehicle change point closest to the time point when the abnormal noise occurred in the history of vehicle change points. Therefore, the vehicle change point stored at the time point closest to the time point when the abnormal noise occurred is set as the first candidate, and the vehicle change point stored at the second closest time point is set as the second candidate. It should be noted that, if Figure 5 The image data before the abnormal noise is generated shown in (a) corresponds to the first image data of the present invention. Figure 5 The image data shown in (b) when or after abnormal noise has occurred corresponds to the second image data of the present invention.
[0083] When the second sound source candidate extraction unit 112 sets the first candidate, the sound source estimation unit 114 determines whether the possibility that the first candidate is the sound source is high. First, the sound source estimation unit 114 determines whether the set first candidate is a change in shape inside or outside the vehicle compartment. The sound source estimation unit 114 determines whether it is a change in shape inside or outside the vehicle compartment based on the vehicle change point set as the first candidate. In the case where the vehicle change point as the first candidate is a change in shape such as a dent in the vehicle body caused by an accident, the sound source estimation unit 114 determines that the first candidate is a change in shape.
[0084] At this time, the sound source estimation unit 114 determines whether the first candidate is likely to be the sound source based on whether abnormal noise is generated from the part whose shape has changed. The sound source estimation unit 114 issues an instruction to the display control unit 116 to display the display monitor 94c to check whether abnormal noise is generated from the part whose shape has changed. The inspector checks whether abnormal noise is generated from the part whose shape has changed according to the display of the display monitor 94c. For example, a detection device 94 or a microphone is arranged near the part whose shape has changed, and sound is collected by the sound pressure detection unit 94a or the microphone of the detection device 94, thereby acquiring sound data. It should be noted that the detection device 94 (especially the sound pressure detection unit 94a) or the microphone corresponds to the acquisition device for acquiring sound data of the present invention.
[0085] The sound source estimation unit 114 determines whether abnormal noise has been generated based on the collected sound data. In the case where the protrusion amount S of the sound pressure SP in the specified frequency band exceeds the specified value in the collected sound data, the sound source estimation unit 114 determines that abnormal noise has been generated from the part where the shape has changed, and determines that the possibility that the shape change is the sound source is high. At this time, the sound source estimation unit 114 issues an instruction to the display control unit 116 to display the meaning that the first candidate (shape change) is estimated as the sound source on the display display 94c of the detection device 94. On the other hand, when the sound source estimation unit 114 does not detect abnormal noise from the collected sound data, it determines that the possibility that the first candidate is the sound source is low. At this time, the sound source estimation unit 114 promotes the second candidate to the first candidate. In addition, the display control unit 116 displays an instruction on the display display 94c to check whether abnormal noise has been generated for the new first candidate, and reports to the inspector whether the new first candidate is the sound source.
[0086] Furthermore, when the first candidate is not a change in shape, the sound source estimation unit 114 determines whether the first candidate is likely to be the sound source based on whether abnormal noise is detected in a state where the component corresponding to the first candidate is removed or replaced. For example, when the first candidate is a cup holder 98 that can be removed or replaced, the sound source estimation unit 114 issues an instruction to the display control unit 116 to display an instruction to check whether abnormal noise is generated in a state where the cup holder 98 is removed or replaced with another cup holder on the display monitor 94c. After the inspector removes or replaces the cup holder 98 according to the instruction of the display monitor 94c, sound collection is performed by the detection device 94 or the microphone. When abnormal noise is not detected in a state where the cup holder 98 is removed or replaced based on the collected sound data, the sound source estimation unit 114 determines that the possibility that the attachment of the cup holder 98 is the sound source of the abnormal noise is high. This is because when the cup holder 98 is removed or replaced, abnormal noise is no longer detected, so the possibility that the cup holder 98 is the sound source is high. At this time, the display control unit 116 displays on the display monitor 94c that the attachment of the cup holder 98 is estimated as the sound source. It should be noted that, similarly to the case where the sound source candidate is a change in shape, the detection of abnormal noise is determined based on whether the protrusion amount S of the sound pressure SP exceeds a predetermined value in a predetermined frequency band.
[0087] On the other hand, when abnormal noise is detected even if the cup holder 98 is removed or replaced, the possibility that the attachment of the cup holder 98 is the sound source is low, so the sound source estimation unit 114 determines that the possibility that the attachment of the cup holder 98 is the sound source is low. In this case, the sound source estimation unit 114 promotes the second candidate to the first candidate. In addition, the sound source estimation unit 114 issues an instruction to the display control unit 116 to display an instruction on the display monitor 94c to check again whether abnormal noise has occurred with respect to the new first candidate.
[0088] In addition, for the sound source candidates other than the cup holder 98, similarly, by checking whether abnormal noise is generated in the state of being removed or replaced, it is checked whether the possibility of being the sound source is high. For example, in the case where the sound source candidate is a wheel cover of a tire, the wheel cover is removed, and it is determined whether the possibility of being the sound source is high based on whether abnormal noise is detected when the vehicle is driven in this state. In addition, in the case where the sound source candidate is tire replacement, the tire is replaced with another tire, and it is determined whether the possibility of tire replacement is high based on whether abnormal noise is detected when the vehicle is driven with the other tire. In addition, in the case where the sound source candidate is battery replacement, the battery is replaced, and it is determined whether the possibility of battery replacement is high based on whether abnormal noise is detected when the vehicle is driven in this state.
[0089] Furthermore, in the case of a component that may leave a mark when the cup holder 98 is removed, or has a defect caused by removal, the detection device 94 may be used to check whether abnormal noise is generated in the state where the component is attached. For example, when the cup holder 98 extracted as the first candidate is not removed, the sound source estimation unit 114 sets a position near the cup holder 98 as a first measurement position, and sets a position at a predetermined distance from the first measurement position as a second measurement position. The display control unit 116 displays the first measurement position and the second measurement position corresponding to the sound source candidate on the display monitor 94c, and notifies the inspector that the detection device 94 is set at the position to perform sound collection (measurement of sound pressure SP). The first measurement position is set to a position where it is predicted that the protrusion amount S of the sound pressure SP will exceed a predetermined value when the first candidate is the sound source of the abnormal noise. The second measurement position is a position at a predetermined distance from the first measurement position, and is set to a position where it is predicted that the protrusion amount S of the sound pressure SP when the abnormal noise is generated will be smaller than the first measurement position by a predetermined value.
[0090] Figure 7 This is a simulated image of the interior of the vehicle displayed on the display 94c of the detection device 94. Figure 7 In the figure, the area enclosed by a solid square represents the interior of the vehicle. Figure 7 In the figure, the dotted lines arranged above the paper surface represent simulated front wheels 120 corresponding to the front wheels of the vehicle 10, and the dotted lines arranged below the paper surface represent simulated rear wheels 122 corresponding to the rear wheels of the vehicle 10. The display monitor 94c displays the interior of the vehicle in a two-dimensional form, and depicts a simulated shift lever 124 that simulates a shift lever, a simulated steering wheel 126 that simulates a steering wheel, and the like. Figure 7 A simulated cup holder 128 is depicted in FIG. 1 , which represents the cup holder 98 as the first candidate. Figure 7 , position A corresponds to the first measurement position set based on the cup holder 98 as the first candidate, and position B corresponds to the second measurement position set based on the cup holder 98 .
[0091] The display control unit 116 displays the position A corresponding to the first measurement position on the display monitor 94c, and notifies the inspector that the detection device 94 is set at the position A to collect sound. Thus, the inspector sets the detection device 94 at the indicated position A according to the instruction of the display monitor 94c, and then collects sound. When the sound collection is completed, the display control unit 116 then displays the position B corresponding to the second measurement position on the display monitor 94c, and notifies the inspector that the detection device 94 is set at the position B to collect sound. The inspector sets the detection device 94 at the indicated position B according to the instruction of the display monitor 94c, and then collects sound.
[0092] When the sound collection is completed in the state where the detection device 94 is set at the first measurement position and the second measurement position, the sound source estimation unit 114 determines whether the possibility that the first candidate is the sound source is high based on the measured sound data. When the protrusion amount S of the sound pressure SP in the specified frequency band becomes greater than the specified value in the state where the detection device 94 is set at the position A corresponding to the first measurement position, and the protrusion amount S of the sound pressure SP in the specified frequency band is reduced by a specified value compared with the protrusion amount S at the first measurement position in the state where the detection device 94 is set at the position B corresponding to the second measurement position, the sound source estimation unit 114 determines that the possibility that the first candidate is the sound source is high. At this time, the display control unit 116 displays the meaning that the first candidate is estimated as the sound source on the display display 94c, and reports this meaning to the inspector.
[0093] On the other hand, if the result is different from the result predicted when the first candidate is the sound source, such as when the protrusion amount S of the sound pressure SP measured when the detection device 94 is set at the second measurement position is higher than the protrusion amount S measured when the detection device 94 is set at the first measurement position, the sound source estimation unit 114 determines that the possibility that the first candidate is the sound source is low. In this case, the sound source estimation unit 114 promotes the second candidate to the first candidate. In addition, the display control unit 116 displays an instruction on the display display 94c to check whether abnormal noise has been generated for the new first candidate, and notifies the inspector of the implementation of the re-inspection.
[0094] The above-mentioned abnormal noise is directly detected by the detection device 94 or the microphone, but the generation of abnormal noise can also be indirectly determined by measuring the vibration of the component corresponding to the first candidate. For example, the vibration of the component as the first candidate can be measured by a vibration sensor, and the generation of abnormal noise can be determined based on whether the component vibrates. Alternatively, a high-speed camera 87c (see Figure 1 ), based on the image data acquired by the high-speed camera 87c, the vibration is detected, and the generation of abnormal noise is determined according to the magnitude of the vibration. Alternatively, an acoustic camera 87d may be provided in the vehicle compartment (see Figure 1 ), and determine the generation of abnormal noise based on the data acquired by the acoustic camera 87d. In this case, the high-speed camera 87c or the acoustic camera 87d corresponds to the acquisition means for acquiring vibration information of the present invention.
[0095] Figure 8 This is a flowchart for explaining an inspection process performed when the sound source detection system 8 is used to detect a sound source causing abnormal noise propagating inside or outside the vehicle compartment, that is, a sound source detection method for detecting the sound source of abnormal noise.
[0096] First, in step ST1 (hereinafter, the step is omitted), a sound source candidate extraction process is performed to extract sound source candidates that are likely to be the sound source. Fig. 9 The following is a flowchart of the sound source candidate extraction process of ST1. Fig. 9 In FIG. 1 , ST21 surrounded by a dotted line is a process performed by an inspector, and ST22 to ST25 respectively correspond to control processes performed by the detection control device 94 b.
[0097] exist Fig. 9 In ST21, sound collection using the detection device 94 or the microphone is implemented when the vehicle 10 is in a driving state or a stopped state (idling state). Next, in ST22 corresponding to the control function of the abnormal noise determination unit 102, it is determined whether abnormal noise is detected from the collected sound data, or whether an indication related to abnormal noise (abnormal noise information) is received from the user. In the case where ST22 is denied, in ST25 corresponding to the control function of the display control unit 116, the display 94c of the detection device 94 displays that no abnormal noise is detected. In this case, the detection is not implemented. Figure 8 If ST22 is affirmative, in ST23 corresponding to the control function of the driving state acquisition unit 104, the driving state (vehicle speed V, accelerator opening θacc) of the vehicle 10 when the abnormal noise is generated is acquired. In ST24 corresponding to the control function of the first sound source candidate extraction unit 106, the driving state acquired in ST23 is applied to the Figure 3 The sound source candidate map is used to extract the sound source candidates and return them.
[0098] return Figure 8 In ST2 corresponding to the control function of the first sound source candidate extraction unit 106, it is determined whether a sound source candidate can be extracted based on whether a sound source candidate is extracted in ST1. If a sound source candidate is extracted in ST1, ST2 is affirmed and the process proceeds to ST3. On the other hand, if a sound source candidate is not extracted, for example, if a sound source candidate that matches the sound source candidate map is not found, ST2 is denied and the process proceeds to ST4.
[0099] In ST3, a first sound source estimating step of estimating whether the extracted sound source candidate is a sound source is executed. Fig.10 The first sound source estimation step of ST3 will be described using the flowchart of FIG. Fig.10 In FIG. 1 , ST32 surrounded by a dotted line is a process performed by an inspector, and ST31 and ST33 to ST35 correspond to control processes performed by the detection control device 94 b.
[0100] In ST31 corresponding to the control function of the control unit 108 and the display control unit 116 when extracting sound source candidates, a measurement position corresponding to the extracted first candidate is set, and the measurement position is displayed on the display 94c. In ST32, the inspector sets the probe device 94 at the measurement position, and performs sound collection in the state where the probe device 94 is set at the measurement position. Next, in ST33 corresponding to the control function of the control unit 108 when extracting sound source candidates, it is determined whether the sound source candidate is estimated as the sound source based on whether the protrusion amount S of the sound pressure SP in the frequency band where abnormal noise is generated when the sound source candidate is the sound source is greater than a prescribed value. When the protrusion amount S of the sound pressure SP is greater than a prescribed value, the sound source candidate is estimated as the sound source and the process proceeds to ST35. When the protrusion amount S is less than the prescribed value, it is determined that the possibility that the sound source candidate is the sound source is low and the process proceeds to ST34. Note that when two measurement positions based on the sound source candidate, namely the first measurement position and the second measurement position, are set, whether the sound source candidate is estimated as the sound source is determined based on the measurement results when the detection device 94 is installed at each measurement position.
[0101] In ST34 corresponding to the control function of the control unit 108 during sound source candidate extraction, the sound source candidate extracted as the second candidate is promoted to the first candidate, and the control from ST31 onwards is performed on the new first candidate. In ST35 corresponding to the control function of the display control unit 116, the fact that the first candidate is estimated as the sound source is displayed on the display monitor 94c.
[0102] return Figure 8 The control below ST4 corresponding to the case where no sound source candidate is extracted based on the driving state will be described. In ST4 corresponding to the control function of the second sound source candidate extraction unit 112, the sound source candidate is extracted from the sound source candidate stored at any time for each vehicle. Figure 6 In the history of vehicle change points shown in FIG. 1 , the vehicle change points stored before and after the abnormal noise is generated are extracted as sound source candidates. It should be noted that the sound source candidates are ranked in order from the vehicle change points close to the time point when the abnormal noise is generated. In ST5, a second sound source estimation process is performed to estimate whether the sound source candidate extracted in ST4 is the sound source. It should be noted that ST4 corresponds to the process of extracting sound source candidates of the sound source by the sound source candidate extraction system of the present invention.
[0103] use Fig.11 The second sound source estimation process of ST5 will be described using the flowchart of FIG. Fig.11In the figure, ST42, ST46 to ST47 surrounded by dotted lines are processes performed by the inspector, and ST41, ST43 to ST45, ST48 to ST50 correspond to control processes performed by the detection control device 94b. It should be noted that ST42 and ST47 correspond to the process of acquiring vibration information or sound data of a sound source candidate by the acquisition device of the present invention.
[0104] In ST41 corresponding to the control function of the sound source estimation unit 114, it is determined whether the extracted first candidate is a change in the shape of the vehicle interior or exterior. If ST41 is affirmative, the process proceeds to ST42, and if ST41 is negative, the process proceeds to ST46.
[0105] In ST42, a detection device 94, a microphone, an acoustic camera, etc. are used to check whether abnormal noise or vibration is detected in the component whose shape has changed as the first candidate. Next, in ST43 corresponding to the control function of the sound source estimation unit 114, it is determined whether abnormal noise or vibration is detected based on the inspection result of the abnormal noise or vibration measured in ST42. For example, when the protrusion amount S of the sound pressure SP and the magnitude of the vibration exceed their respective prescribed values (threshold values), it is determined that abnormal noise or vibration is detected. In the case where ST43 is affirmative, it is determined in ST44 corresponding to the control function of the sound source estimation unit 114 that the possibility of the first candidate being the sound source is high and returned. In the case where ST43 is negative, it is determined in ST45 corresponding to the control function of the sound source estimation unit 114 that the possibility of the first candidate being the sound source is low and returned.
[0106] If ST41 is denied, in ST46, the candidate component as the first candidate is replaced or removed, and then in ST47, in the state where the candidate component is replaced or removed, it is checked whether abnormal noise or vibration is detected using the detection device 94, a microphone, an acoustic camera, etc. In ST48 corresponding to the control function of the sound source estimation unit 114, it is determined whether abnormal noise or vibration is detected based on the inspection result of the abnormal noise or vibration measured in ST47. In the case where abnormal noise or vibration is detected, ST48 is affirmed, and in ST49 corresponding to the control function of the sound source estimation unit 114, it is determined that the possibility that the first candidate is the sound source is low and a return is made. This is because even if the candidate component is replaced or removed, the abnormal noise or vibration continues to be generated, so it can be considered that the abnormal noise is generated due to other factors. On the other hand, if abnormal noise or vibration is not detected, ST48 is denied, and in ST50 corresponding to the control function of the sound source estimation unit 114, it is determined that the possibility that the first candidate is the sound source is high and a return is made. This is because, when the candidate component is replaced or removed, abnormal noise or vibration is no longer detected, and thus the possibility that the candidate component is the sound source is high.
[0107] return Figure 8 In ST6 corresponding to the control function of the sound source estimating unit 114, it is determined that the possibility that the sound source candidate is the sound source is high because the negative result in ST5 is high. If ST6 is affirmative, the fact that the sound source candidate is estimated as the sound source is displayed on the display 94c in ST8 corresponding to the control function of the display control unit 116. If ST6 is negative, the second candidate is promoted to the first candidate in ST7 corresponding to the control function of the sound source estimating unit 114, and the process returns to ST5 to determine whether the new first candidate is estimated as the sound source.
[0108] As described above, according to the present embodiment, based on the image data before the abnormal noise is generated and the image data when the abnormal noise is generated or after the abnormal noise is generated acquired by the first camera 87a or the second camera 87b, the sound source candidate is extracted according to the change in the image data when the abnormal noise is generated or after the abnormal noise is generated compared with the image data before the abnormal noise is generated. In addition, the vehicle change point storage unit 118 stores the image detection change points detected in the image data (for example, Figure 6 In the case where the image detection change point is an image detection change point generated after the acquisition of image data before the abnormal noise is generated and when the abnormal noise is generated or before the acquisition of image data after the abnormal noise is generated, the detection control device 94b regards the image detection change point as causing the change and extracts the image detection change point as a sound source candidate. In addition, the vehicle change point history stored in the vehicle change point storage unit 118 includes, in addition to the image detection change point, a record change point (for example, Figure 6 The recorded change point is recognized and recorded in the history of the vehicle change point independently of the image data. Therefore, in the sound source detection system 8 as a sound source candidate extraction system in the present embodiment, the sound source candidates can be easily extracted. In addition, the process of extracting the sound source candidates of the sound source through the sound source detection system 8 is performed, thereby making it easy to extract the sound source candidates. Furthermore, the sound source of the abnormal noise is estimated based on the vibration information or sound data of the extracted sound source candidates, thereby suppressing the burden of the sound source detection work performed by the inspector and improving the estimation accuracy of the sound source.
[0109] Next, another embodiment of the present invention will be described. It should be noted that in the following description, the same reference numerals are given to the parts common to the above-mentioned embodiment, and the description thereof will be omitted.
[0110] [Example 2]
[0111] Fig.121 is a diagram showing the overall structure of a sound source detection system 300 according to another embodiment of the present invention. In this embodiment, a vehicle control control device 302 provided in a vehicle 10 has a control function of detecting a sound source that is a cause of abnormal noise. That is, the vehicle 10 is provided with a detection control device 304, and the detection control device 304 has the same function as the detection control device 94b of the first embodiment. The detection control device 304 may be provided separately from a plurality of control devices constituting the vehicle control control device 302, such as an engine control control device that controls the engine 14, or may be provided as one function of a common control device.
[0112] The sound source detection system 300 of the present embodiment is configured to include a sound source detection device 306, a vehicle control device 302, a vehicle display 308, a first camera 87a, a second camera 87b, and a server 200. The sound source detection device 306 (hereinafter, the detection device 306) has a function of measuring the sound pressure SP, but does not have various control functions such as a function of extracting a sound source candidate and a function of estimating whether a sound source candidate is a sound source. That is, the sound source detection device 306 functions exclusively as a sound collection device for measuring the sound pressure SP. The measurement result (sound data) measured by the detection device 306 is sent to the vehicle control device 302 of the vehicle 10 via the transceiver 90 and the gateway ECU 92. It should be noted that the sound source detection system 300 corresponds to the sound source candidate extraction system of the present invention, the detection control device 304 corresponds to the extraction device of the present invention, and the detection device 306 corresponds to the acquisition device of the present invention.
[0113] In addition, the server 200 and the vehicle control device 302 are configured to be able to transmit and receive information through wireless communication via the transceiver 90 and the gateway ECU 92. Figure 3 When the sound source candidate map is updated, the updated new map is sent from the server 200 to the vehicle control device 302. Figure 3 When the sound source candidate map of the server 200 is stored, when extracting the sound source candidate of the abnormal noise, the sound source candidate map corresponding to the vehicle type and driving mode is sent from the server 200 for reference. Figure 6 As shown, when the history of vehicle change points for each vehicle is stored in the server 200, the information is sent to the server 200 each time a vehicle change point is detected. When a sound source candidate is extracted from the vehicle change point, the history of the vehicle change point is sent from the server 200 to the control device 302 for vehicle control for reference.
[0114] In addition, in this embodiment, the detection control device 304 provided in the vehicle 10 has various control functions such as a function of extracting a sound source candidate based on the driving state in which abnormal noise is generated, a function of extracting a sound source candidate based on the history of vehicle change points, and a function of estimating whether the extracted sound source candidate is a sound source, and the above-mentioned various controls are performed by the detection control device 304. In addition, various information required for the detection of the sound source, such as the sound source candidate and the measurement position, is displayed on the vehicle display 308 provided in the vehicle compartment. That is, various information is reported to the inspector via the vehicle display 308. Thus, the inspector performs various processes for detecting the sound source according to the display content of the vehicle display 308 of the vehicle 10. It should be noted that various information required for the detection of the sound source can be displayed on the display display 306a provided in the detection device 306, or can be displayed on the display display 312 provided in the portable terminal 310 such as a personal computer carried by the inspector.
[0115] Even in the case where the sound source detection system 300 is configured as described above, the inspector can detect the sound source of the abnormal noise according to the display content of the vehicle display 308 based on the control operation of the detection control device 304 equipped in the vehicle control control device 302 of the vehicle 10, thereby inferring the sound source of the abnormal noise without increasing the burden on the inspector. It should be noted that the specific sound source detection process is basically the same as that of the above-mentioned embodiment 1, and therefore its description is omitted.
[0116] [Example 3]
[0117] Fig.13 4 is a diagram showing the overall structure of a sound source detection system 400 according to another embodiment of the present invention. In this embodiment, a server 402 has a function of detecting a sound source that causes abnormal noise. That is, the server 402 has a detection control device 404, and the detection control device 404 has the same function as the detection control device 94b of the above-mentioned embodiment 1.
[0118] The sound source detection system 400 of the present embodiment is configured to include a sound source detection device 406, a vehicle control control device 100, a first camera 87a, a second camera 87b, and a server 402. The sound source detection device 406 (hereinafter, the detection device 406) has a function of measuring the sound pressure SP, but on the other hand, does not have various control functions such as the function of extracting sound source candidates and the function of estimating whether the sound source candidates are the sound source. That is, the detection device 406 functions exclusively as a sound collection device for measuring the sound pressure SP. The sound data measured by the detection device 406 is sent to the server 402 via wireless communication. It should be noted that in Fig.13In the figure, communication devices such as transceivers for transmitting and receiving information between devices are omitted. In addition, the sound source detection system 400 corresponds to the sound source candidate extraction system of the present invention, the detection control device 404 corresponds to the extraction device of the present invention, and the detection device 406 corresponds to the acquisition device of the present invention.
[0119] In addition, the server 402 and the vehicle control device 100 of the vehicle 10 are configured to be able to transmit and receive various information by wireless communication. For example, the vehicle speed V, the accelerator opening θacc, and the history of vehicle change points, which indicate the driving state of the vehicle 10 during the sound collection transition period during driving, are transmitted to the server 402.
[0120] In addition, in this embodiment, the server 402 has various control functions such as a function of extracting a sound source candidate based on the driving state where the abnormal noise is generated, a function of extracting a sound source candidate based on the history of the vehicle change point, and a function of estimating whether the extracted sound source candidate is the sound source, and the above-mentioned various controls are performed by the server 402. The sound data measured by the sound source detection device 406 is transmitted to the server 402 through wireless communication, and the driving state of the vehicle 10 (vehicle speed V, accelerator opening θacc) when the abnormal noise is generated, the vehicle change point, etc. are transmitted to the server 402 through wireless communication. The server 402 performs various controls based on the various information. In addition, various information required for the inspector to detect the abnormal noise is displayed on, for example, a display 406a provided in the detection device 406. That is, the various information is transmitted from the server 402 to the detection device 406 through wireless communication, and the various information is displayed on the display 406a of the detection device 406. It should be noted that various information required for detecting the sound source may also be displayed on a vehicle display 410 provided in the vehicle compartment or on a display monitor 414 provided on a portable terminal 412 carried by an inspector.
[0121] Even in the case where the sound source detection system 400 is configured as described above, the inspector can detect the sound source of the abnormal noise according to the display content displayed on the display monitor 406a based on the control operation of the detection control device 404 equipped in the server 402, thereby inferring the sound source of the abnormal noise without increasing the burden on the inspector. It should be noted that the specific sound source detection process is basically the same as that of the above-mentioned embodiment 1, and therefore its description is omitted.
[0122] [Example 4]
[0123] Fig.14: is a diagram showing the overall structure of a sound source detection system 500 corresponding to another embodiment of the present invention. In this embodiment, a portable terminal 502 carried by an inspector has a function of detecting a sound source that causes abnormal noise. That is, the portable terminal 502 has a detection control device 504, and the detection control device 504 has the same function as the detection control device 94b of the above-mentioned embodiment 1.
[0124] The sound source detection system 500 of the present embodiment is configured to include a sound source detection device 506, a control device 100 for vehicle control, a server 200, a first camera 87a, a second camera 87b, and a portable terminal 502. The sound source detection device 506 of the present embodiment (hereinafter, the detection device 506) has a function of measuring the sound pressure SP, but on the other hand, does not have various control functions such as the function of extracting sound source candidates and the function of estimating whether the sound source candidates are the sound source. That is, the sound source detection device 506 functions exclusively as a sound collection device for measuring the sound pressure SP. The sound data measured by the detection device 506 is sent to the portable terminal 502 via wireless communication. It should be noted that in Fig.14 In the figure, communication devices such as transceivers for transmitting and receiving information between devices are omitted. In addition, the sound source detection system 500 corresponds to the sound source candidate extraction system of the present invention, the detection control device 504 corresponds to the extraction device of the present invention, and the detection device 506 corresponds to the acquisition device of the present invention.
[0125] In addition, the server 200 and the portable terminal 502 are configured to be able to send and receive information via wireless communication. Figure 3 When the sound source candidate map is updated, the updated new map is sent from the server 200 to the portable terminal 502. Figure 3 When the sound source candidate map of the server 200 is stored, when extracting the sound source candidate of the abnormal noise, the sound source candidate map corresponding to the vehicle type and driving mode is sent from the server 200 at any time for reference. Figure 6 When the history of vehicle change points for each vehicle is stored in the server 200, when extracting sound source candidates from the vehicle change points, the history of vehicle change points stored in the server 200 is referred to. In addition, the vehicle control device 100 and the portable terminal 502 are configured to be able to transmit and receive information by wireless communication. For example, the vehicle speed V, the accelerator opening θacc, and the history of vehicle change points, which are the driving state of the vehicle 10 during the sound collection transition period during driving, are sent to the portable terminal 502 at any time.
[0126] In addition, in this embodiment, the detection control device 504 provided in the portable terminal 502 has various control functions such as a function of extracting a sound source candidate based on the driving state in which abnormal noise is generated, a function of extracting a sound source candidate based on the history of vehicle change points, and a function of estimating whether the extracted sound source candidate is the sound source. In addition, various information required for the detection of the sound source is configured to be displayed on the display 508 provided in the portable terminal 502. Thus, the inspector estimates the sound source according to the display content of the display 508 of the portable terminal 502. It should be noted that the information required for the detection of the sound source can be displayed on the display provided in the detection device 506, and can also be displayed on the vehicle display provided in the vehicle 10.
[0127] Even in the case where the sound source detection system 500 is configured as described above, the inspector can detect the sound source of the abnormal noise according to the display content of the display monitor 508 based on the control operation of the detection control device 504 equipped in the portable terminal 502, thereby inferring the sound source of the abnormal noise without increasing the burden on the inspector. It should be noted that the specific sound source detection process is basically the same as that of the above-mentioned embodiment 1, and therefore its description is omitted.
[0128] As mentioned above, although the embodiment of the present invention was described in detail based on the drawings, the present invention is also applicable to other aspects.
[0129] For example, in the aforementioned embodiment, whether abnormal noise is generated during driving is checked. If sound source candidates cannot be extracted based on the driving state when the abnormal noise is generated, sound source candidates are extracted based on the vehicle change points. However, it is also possible to extract sound source candidates based on the vehicle change points without performing this process.
[0130] In the above-mentioned embodiment, various information is reported to the inspector through the display 94c of the detection device 94, but various information may be reported to the inspector through voice. In short, any means may be used as long as it reports various information to the inspector, and it may be changed as appropriate.
[0131] In addition, in the aforementioned embodiment, the sound pressure detection unit 94a, the detection control device 94b, and the display 94c of the detection device 94 are integrally configured, but it is not necessarily limited to the scheme that they are integrally configured. For example, the sound pressure detection unit 94a may be provided separately and configured so that data can be transmitted and received between the sound pressure detection unit 94a and the detection control device 94b via wireless communication or the like.
[0132] In addition, in the aforementioned embodiment, the first camera 87a for acquiring images inside the vehicle and the second camera 87b for acquiring images outside the vehicle are separately provided, but the first camera 87a and the second camera 87b may be constituted by a common 360-degree camera.
[0133] In addition, in the aforementioned embodiment, it is assumed that the generation of abnormal noise or vibration can be determined by a high-speed camera or an acoustic camera, but in this case, the camera can be shared by making the first camera 87a or the second camera 87b have the function of a high-speed camera or an acoustic camera. In this case, the first camera 87a or the second camera 87b functions as an acquisition device for acquiring vibration information or sound data of a sound source candidate of the present invention. Moreover, by sharing the first camera 87a and the second camera 87b, it is also possible to set a configuration in which each function is performed by one camera.
[0134] In addition, in the aforementioned embodiments, the sound source of the abnormal noise propagating in the vehicle compartment is detected, so the detection device 94, 306, 406, 506 is basically installed in the vehicle compartment, but for example, when the abnormal noise propagating outside the vehicle compartment is pointed out when the vehicle is stopped (idling), the detection device 94, 306, 406, 506 may be installed outside the vehicle compartment. That is, the present invention can also be applied to the case of detecting the sound source that causes the abnormal noise propagating outside the vehicle compartment.
[0135] In the first embodiment, when checking whether abnormal noise is generated without removing or replacing the sound source candidate, the first measurement position and the second measurement position are set, and the generation of abnormal noise is determined based on the sound data when the detection device 94 is set at the measurement position to collect sound. However, it is also possible to further set the first measurement position and the second measurement position as shown in FIG. Figure 7 The position C shown is set as the third measurement position, and the measurement result when the detection device 94 is set at the position C is added to estimate whether the sound source candidate is the sound source. The position C as the third measurement position is a position far enough from the sound source candidate, and is set to a position where the abnormal noise is hardly detected even when the sound source candidate generates abnormal noise. Therefore, when the abnormal noise is not detected when the detection device 94 is set at the third measurement position, it is estimated that the sound source candidate is the sound source. In this way, by further increasing the measurement positions of the detection device 94, the estimation accuracy of the sound source can be further improved.
[0136] Furthermore, in the aforementioned embodiment, the interior of the vehicle cabin is displayed in two dimensions on the display monitor 94c of the detection device 94, but the interior of the vehicle cabin may be displayed in three dimensions.
[0137] Furthermore, in the aforementioned first embodiment, the detection control device 94b executes all control processes executed when detecting a sound source, such as extraction of sound source candidates and estimation of sound sources, but a part of the control process executed when detecting a sound source may be executed by the server 200 or the vehicle control control device 100, such as extraction of sound source candidates or estimation of sound sources being executed in the server 200. In addition, in the second to fourth embodiments, it is also possible to configure that a part of the control process executed by the detection control devices 304, 404, 504 is executed by other control devices.
[0138] In addition, in the above-mentioned embodiment 1, it is assumed that the sound source detection system 8 includes the server 200, but if Figure 3 The sound source candidate map and the measured position map are pre-stored in the detection control device 94b, and no information is exchanged between the server 200 and the sound source detection system 8 may not include the server 200. In addition, the sound source detection systems 300 and 500 of the second and fourth embodiments may also be configured not to include a server.
[0139] In the first embodiment, various information is displayed on the display monitor 94c of the detection device 94 to report to the inspector, but various information may be displayed on a vehicle display provided in the vehicle 10 or on a display monitor of a portable terminal carried by the inspector.
[0140] For example, in the aforementioned embodiment, the sound source candidates are extracted based on the vehicle speed V (or its associated value) and the accelerator opening θacc (or its associated value), but the gear position of the step-variable transmission unit 20 or the gear ratio of the step-variable transmission unit 18 and the step-variable transmission unit 20 as a whole may also be considered. Alternatively, the sound source candidates may be extracted based on either the vehicle speed V (or its associated value) or the accelerator opening θacc (or its associated value).
[0141] In addition, in the aforementioned embodiment, the vehicle 10 is configured to include a power transmission device 12 in which the continuously variable transmission unit 18 and the stepped transmission unit 20 are connected in series, but the structure of the vehicle of the present invention is not necessarily limited to this. For example, the engine and the rotating machine may be directly connected without passing through the differential mechanism 32, etc., and a stepped transmission may be provided between the engine and the rotating machine and the drive wheels. In addition, it is not necessarily limited to a stepped transmission, and a belt-type continuously variable transmission or the like may also be used.
[0142] In addition, in the aforementioned embodiment, the vehicle 10 is a hybrid vehicle using the engine 14 and the second rotary machine MG2 as a driving force source, but the present invention is not necessarily limited to a hybrid vehicle. For example, it may be a vehicle using only the engine 14 as a driving force source, or it may be an electric vehicle using only the rotary machine as a driving force source. That is, in the present invention, the driving force source, driving form, etc. of the vehicle are not particularly limited.
[0143] Furthermore, in the aforementioned embodiment, the vehicle 10 is configured to be capable of automatic driving, but automatic driving is not necessarily required, and the vehicle may be driven only by manual driving.
[0144] It should be noted that the above content is merely one embodiment, and the present invention can be implemented in various ways with various changes and improvements added based on the knowledge of those skilled in the art.
Claims
1. A sound source candidate extraction system (8; 300; 400; 500) for extracting sound source candidates of sound sources that are the cause of abnormal noise propagating inside or outside a vehicle compartment, the sound source candidate extraction system (8; 300; 400; 500) being characterized by comprising: A photographing device (87a, 87b) for acquiring image data inside or outside the vehicle compartment; An extraction device (94b; 304; 404; 504) determines whether the abnormal noise has occurred based on sound data collected by a microphone or based on information from a user of the vehicle that the abnormal noise has occurred, and extracts the sound source candidate based on changes in the second image data compared with the first image data based on first image data obtained by the photographing device (87a, 87b) before the abnormal noise is determined to have occurred and second image data when or after the abnormal noise is determined to have occurred; and An acquisition device (94; 306; 406; 506) acquires the sound data of the sound source candidate, wherein: determining a first measurement position and a second measurement position at which the acquisition device is to be set based on the extracted sound source candidate, wherein the first measurement position is set to a position where it is predicted that the amount of protrusion of sound pressure will exceed a predetermined value when the sound source candidate is the sound source of the abnormal noise, and the second measurement position is a position at a predetermined distance from the first measurement position, Whether the sound source candidate is the sound source of the abnormal noise is estimated based on the sound data acquired by the acquisition device at the first measurement position and the second measurement position.
2. The sound source candidate extraction system (8; 300; 400; 500) according to claim 1, characterized in that: The apparatus further comprises a vehicle change point storage unit (118) for storing a history of vehicle change points including image detection change points detected in the image data. In the case where the image detection change point is an image detection change point generated after the first image data is acquired by the shooting device (87a, 87b) and before the second image data is acquired by the shooting device (87a, 87b), the extraction device (94b; 304; 404; 504) regards that the image detection change point causes the change in the second image data compared with the first image data and extracts the image detection change point as the sound source candidate.
3. The sound source candidate extraction system (8; 300; 400; 500) according to claim 2, characterized in that: The history of vehicle change points stored in the vehicle change point storage unit (118) includes, in addition to the image detection change points, recorded change points that are recognized independently of the image data and recorded in the history of vehicle change points.
4. A sound source detection method, using a sound source candidate extraction system (8; 300; 400; 500) to detect a sound source propagating inside or outside a vehicle compartment, The sound source candidate extraction system (8; 300; 400; 500) comprises: A photographing device (87a, 87b) for acquiring image data inside or outside the vehicle compartment; an extraction device (94b; 304; 404; 504) for determining whether the abnormal noise has occurred based on sound data collected by a microphone or based on information from a user of the vehicle that the abnormal noise has occurred, and for extracting a candidate sound source of the sound source that is the cause of the abnormal noise based on a change in the second image data from the first image data, based on first image data before the abnormal noise is determined to have occurred and second image data when or after the abnormal noise is determined to have occurred acquired by the photographing device (87a, 87b); and An acquisition device (94; 306; 406; 506) acquires the sound data of the sound source candidate, wherein: determining a first measurement position and a second measurement position at which the acquisition device is to be set based on the extracted sound source candidate, wherein the first measurement position is set to a position where it is predicted that the amount of protrusion of sound pressure will exceed a predetermined value when the sound source candidate is the sound source of the abnormal noise, and the second measurement position is a position at a predetermined distance from the first measurement position, The sound source detection method is characterized by comprising the following steps: Extracting the sound source candidates through the sound source candidate extraction system (8; 300; 400; 500); and Acquiring the sound data of the sound source candidate through the acquisition device (94; 306; 406; 506), Whether the sound source candidate is the sound source of the abnormal noise is estimated based on the sound data acquired by the acquisition device at the first measurement position and the second measurement position.
