In-vehicle sound control device

Abstract

To determine a position of a speaker incorporated in a headrest without providing a headrest sensor.SOLUTION: A speaker position determination device 18 is provided for determining the position of a speaker 21 incorporated in a headrest 10. The speaker position determination device 18 includes an infrared camera 14 being a camera which images the headrest 10, and an image processing unit 28 of a computation and determination unit 25 being a position determination device which determines the position of the speaker 21 on the basis of the image captured by the infrared camera 14. The image processing unit 28 determines the position of the speaker 21 on the basis of characteristic parts (a marker 41, a grill 42, a microphone hole 43 and the like) of the headrest 10 in the image.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] Book Disclosure The present invention relates to a speaker position determination device that determines the position of a speaker built into a headrest, and an in-vehicle acoustic control device that includes the same. [Background technology]

[0002] In recent years, efforts have been made to provide vulnerable transport users, such as the elderly and children, with access to sustainable transport systems. To achieve this, research and development into vehicle comfort has been attracting attention to further improve transport safety and convenience.

[0003] To improve the comfort of a vehicle, it is desirable to reduce noise in the vehicle interior. Therefore, active noise reduction devices that reduce noise by interfering with noise with a canceling sound that is in the opposite phase to the noise have been actively researched and developed.

[0004] Conventionally, there has been known an active noise control system that includes an adaptive filter to which a noise signal is input and an adaptive algorithm execution unit that adaptively updates the transfer function of the adaptive filter, and that outputs a noise cancellation signal from the adaptive filter from a speaker. For example, Patent Document 1 discloses that a plurality of auxiliary filters are provided, each having a transfer function set corresponding to the position of the occupant's ear, which is the noise cancellation position, and that a microphone output (microphone error signal) output from a microphone is corrected using the output of an auxiliary filter selected according to the position of the occupant's ear, and then the adaptive algorithm execution unit adaptively updates the transfer function of the adaptive filter using this microphone error signal.

[0005] Furthermore, Patent Document 1 discloses that the position of the user's head is detected from an image captured by a camera and the output of a sensor that detects the position of the seat in the front-rear direction and the tilt of the backrest. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent No. 7262899 Summary of the Invention [Problem to be solved by the invention]

[0007] However, the system described in Patent Document 1 requires sensors to detect the seat position and the tilt of the backrest in order to detect the head position, which increases the number of parts. Furthermore, in recent years, vehicle passenger seats with built-in speakers in the headrest have been developed. The position of the speaker changes depending on the seat position and the tilt of the backrest. Therefore, when generating a canceling sound from this speaker, it is necessary to accurately determine not only the position of the passenger's ears but also the position of the speaker that generates the canceling sound.

[0008] Although headrests are generally configured to be adjustable in height, they generally do not have a sensor to detect the headrest height (hereinafter referred to as a headrest sensor). Therefore, in order to determine the position of the speaker installed in the headrest, a separate headrest sensor must be installed.

[0009] In view of the above background, an object of the present invention is to determine the position of a speaker built into a headrest without providing a headrest sensor, thereby effectively reducing noise, and ultimately to contribute to the development of a sustainable transportation system. [Means for solving the problem]

[0010] In order to solve the above problem, one aspect of the present invention is a speaker position determination device (18) that determines the position of a speaker (21) built into a headrest (10), and includes a camera (14) that captures an image of the headrest, and a position determination device (25, 28) that determines the position of the speaker based on the image captured by the camera, and the position determination device determines the position of the speaker based on characteristic features (41, 42, 43) that the headrest has in the image.

[0011] According to this aspect, the speaker position can be determined from the camera image, so the speaker position can be determined without providing a headrest sensor. Also, sensors for detecting the seat position, backrest angle, etc. are not required.

[0012] In the above aspect, the characteristic portion may include at least three characteristic points (41) provided on the surface of the headrest (10) so as to be equidistant from the center (21C) of the speaker (21), and the position determination device (25) may determine the center of a polygon having the characteristic points as vertices as the center position of the speaker.

[0013] According to this aspect, the center position of the speaker can be determined from the positions of at least three feature points. Furthermore, even if the speaker is located further back in the headrest than the feature points, the center position of the speaker can be determined from the arrangement of the feature points.

[0014] In the above aspect, the characteristic portion may include a grill (42) provided on the surface of the headrest (10) and covering the speaker (21), and the position determination device (25) may determine the position of the speaker based on the position of the grill.

[0015] According to this aspect, the position of the speaker can be determined by using the grill, so there is no need to provide a separate marker, and the degree of freedom in design is improved.

[0016] In the above aspect, the headrest (10) has a built-in microphone (22), a microphone hole (43) is provided on the surface of the headrest, and the position determination device (25) determines the position of the speaker (21) based on the position of the microphone hole.

[0017] According to this aspect, the position of the speaker can be determined by utilizing the microphone hole for picking up sound with the microphone, so there is no need to provide a separate marker, and the degree of freedom in design is improved.

[0018] Furthermore, in order to solve the above-mentioned problems, one aspect of the present invention is an in-vehicle acoustic control device (1), which includes the speaker position determination device (18) of the above-mentioned aspect and control devices (23, 24) that control the speaker (21) to output a canceling sound (y) to cancel out noise (d) inside the vehicle, wherein the camera (14) is arranged to further capture an image of the head of an occupant sitting in an occupant seat (6) on which the headrest (10) is provided, the position determination device (25) further determines the position of the occupant's head from the image, and the control device controls the speaker to output the canceling sound based on the position of the occupant's head and the position of the speaker.

[0019] According to this aspect, the camera captures an image of the headrest and the occupant's head, and both the head position and the speaker position can be determined from the image, so that sound cancellation can be controlled without providing any sensors other than the camera.

[0020] In the above aspect, the position determination device (25) determines whether or not there is an obstruction (44, 45) blocking the path from the speaker (21) to the occupant's ear in the image, and the control device controls the speaker based on the presence or absence of the obstruction.

[0021] Since the camera captures an image of the speaker and the occupant's head, if there is an obstruction between them, the obstruction will appear in the image. According to this aspect, it is possible to determine the presence or absence of an obstruction from the image without providing any sensors other than the camera. thingBy controlling the noise cancellation based on the presence or absence of noise, it is possible to cancel noise more accurately.

[0022] In the above aspect, the system includes a microphone (22) that generates an error signal (e) from the noise (d) and the cancellation sound (y), a control filter (31) that generates a control signal (u) for controlling the speaker (21), and an adaptive update unit (38) that adaptively updates the control filter based on the error signal, and the adaptive update unit may stop adaptive updating of the control filter when the obstruction (44, 45) is present.

[0023] When the speaker or microphone is blocked, the acoustic characteristics from the speaker to the microphone deviate significantly from the model characteristics set in the control device. According to this aspect, the adaptive update unit stops adaptive updating of the control filter, thereby preventing the error signal from increasing, causing excessive cancellation of the sound, and preventing the adaptive update control of the control filter from becoming unstable.

[0024] In the above aspect, a grill (42) covering the speaker (21) is provided on the surface of the headrest (10), and the position determination device (25) may determine that the obstructing object (44, 45) is present when the grill is obstructed in the image.

[0025] According to this aspect, it is possible to determine the presence or absence of an obstruction by a simple method of determining whether or not the speaker grill is obstructed.

[0026] In the above aspect, a microphone (22) is provided in the headrest (10), a microphone hole (43) is provided on the surface of the headrest, and the position determination device (25) determines that the obstruction (44, 45) is present when the microphone hole is obstructed in the image.

[0027] According to this aspect, the presence or absence of an obstruction can be determined by the simple method of determining whether or not the microphone hole is obstructed.

[0028] In the above aspect, the position determination device (25) may determine that the obstructing object (44, 45) is present when the occupant's ear is obstructed in the image.

[0029] According to this aspect, the presence or absence of an obstruction can be determined by a simple method of determining whether or not the ears are obstructed in an image captured to determine the position of the head. [Effects of the Invention]

[0030] According to the above aspect, it is possible to determine the position of the speaker built into the headrest, and thereby to effectively reduce noise. [Brief explanation of the drawings]

[0031] [Figure 1] FIG. 1 is a schematic diagram showing a vehicle to which an in-vehicle acoustic control device according to a first embodiment is applied; [Figure 2] A functional block diagram showing an in-vehicle acoustic control device according to a first embodiment. [Figure 3] Illustration of speaker and ear positions [Figure 4] An explanatory diagram of a first example of a location determination method [Figure 5] FIG. 2 is an explanatory diagram of a second example of a location determination method; [Figure 6] An explanatory diagram of a third example of a location determination method [Figure 7] FIG. 4 is an explanatory diagram of a fourth example of a location determination method. [Figure 8] Correlation diagram between relative distance and correction coefficient [Figure 9] Correlation diagram between relative distance and update state of adaptive filter [Figure 10] Illustration of the effect of obstructions [Figure 11] 1 is an explanatory diagram of a first example of a method for determining a location and an obstruction; [Figure 12] FIG. 2 is an explanatory diagram of a second example of a method for determining a location and an obstruction; [Figure 13] A functional block diagram showing an in-vehicle acoustic control device according to a second embodiment. [Figure 14] A functional block diagram showing an in-vehicle acoustic control device according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0032] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this specification, the "^" (hat) next to various symbols indicates an identified value or an estimated value. The "^" is placed above various symbols in the drawings, but is placed after various symbols in the text.

[0033] First Embodiment First, a first embodiment of the present invention will be described with reference to FIGS.

[0034] <Vehicle 3> 1 is a schematic diagram showing a vehicle 3 to which an in-vehicle acoustic control device according to a first embodiment (hereinafter abbreviated as "acoustic control device 1") is applied. The vehicle 3 is, for example, a four-wheeled automobile.

[0035] A plurality of passenger seats 6 are arranged in the passenger compartment 4 of the vehicle 3. The passenger seats 6 are arranged side by side, left and right, and front and rear. FIG. 1 shows only the driver's seat 6. Each passenger seat 6 (hereinafter simply referred to as "passenger seat 6") has a seat cushion 7 and a reclining portion 8 (backrest) that is arranged at the rear of the seat cushion 7 and rotates relative to the seat cushion 7. The reclining portion 8 has a seat back 9 and a headrest 10 fixed to the upper end of the seat back 9. In another embodiment, the headrest 10 may be slidably provided at the upper end of the seat back 9.

[0036] An infrared camera 14 is provided on an instrument panel 13 of the vehicle 3. The infrared camera 14 is disposed facing rearward so as to capture an image of the head of an occupant (driver) seated in the driver's seat and the headrest 10. The infrared camera 14 is preferably disposed in front of the occupant's head, and may be provided on the rearview mirror, shield glass, roof lining, etc. of the vehicle 3.

[0037] <Sound control device 1> The acoustic control device 1 controls the acoustics within the cabin 4 of the vehicle 3, and also functions as an active noise control device for reducing noise d generated within the cabin 4. More specifically, the acoustic control device 1 generates a canceling sound y that is in the opposite phase to the noise d, and reduces the noise d by causing the generated canceling sound y to interfere with the noise d.

[0038] For example, the noise d that is the target of reduction by the acoustic control device 1 is road noise caused by vibration of the wheels 15 due to force from the road surface S. A vibration sensor 16 that detects vibration corresponding to the noise d is provided in a portion of the vehicle 3 near the wheels 15. The vibration sensor 16 outputs a reference signal r that indicates vibration corresponding to the noise d. Note that the noise d that is the target of reduction by the acoustic control device 1 may be noise other than the above-mentioned road noise (for example, drivetrain noise caused by vibration of a drive source such as an internal combustion engine or an electric motor).

[0039] The acoustic control device 1 includes a plurality of speakers 21 (an example of a noise cancellation output device, only one is shown) that output a cancellation sound y to cancel out a noise d, and a plurality of microphones 22 (only one is shown) that generate an error signal e based on the noise d and the cancellation sound y. The acoustic control device 1 also includes a control device 23 that controls the plurality of speakers 21 based on the error signal e.

[0040] <Speaker 21> Each speaker 21 (hereinafter simply referred to as "speaker 21") is provided in a manner that it is built into the headrest 10 of the reclining portion 8 of the passenger seat 6. Two speakers 21 are arranged at positions corresponding to the left and right ears of a passenger seated in the passenger seat 6 (positions behind the ears).

[0041] <Mic 22> Each microphone 22 (hereinafter simply referred to as "microphone 22") is provided in a manner that it is built into the headrest 10 of the reclining portion 8 of the passenger seat 6. The two microphones 22 are arranged at positions corresponding to the left and right ears of the passenger seated in the passenger seat 6, for example, at positions near and below the speaker 21.

[0042] <Control device 23> The control device 23 is configured by a computer having an arithmetic processing unit (a processor such as a CPU or an MPU) and a storage device (memory such as a ROM or a RAM). The control device 23 may be configured as a single piece of hardware, or may be configured as a unit consisting of multiple pieces of hardware.

[0043] Referring to FIG. 2, the control device 23 has, as functional components, a speaker control unit 24 and a calculation and determination unit 25. The speaker control unit 24 generates a control signal u for the speaker 21 and drives the speaker 21 via a power amplifier 26. The calculation and determination unit 25 constitutes computer hardware of a speaker position determination device 18 that determines the position of the speaker 21. The calculation and determination unit 25 determines the position of the occupant's ear in addition to the position of the speaker 21. The calculation and determination unit 25 further estimates the distance between the speaker 21 and the occupant's ear (hereinafter sometimes referred to as relative distance L). Note that the speaker position determination device 18 also includes the above-mentioned infrared camera 14 as other hardware. Although not shown, the control device 23 has these functional components for each speaker 21 or each occupant seat 6.

[0044] First, the calculation and determination unit 25 will be described, and then the speaker control unit 24 will be described.

[0045] <Calculation judgment unit 25> The calculation and determination unit 25 has an image processing unit 28 and a relative distance calculation unit 29 as functional components.

[0046] <Image processing unit 28> The image processing unit 28 calculates the head position and head angle of the occupant by using a known image processing technique to process the image captured by the infrared camera 14. The image processing unit 28 also determines the positions of the occupant's left and right ears from the head position and head angle.

[0047] The positions of the left and right ears are as shown in Figure 3, with the front-to-back position d ea and vertical position h ea The front-rear position d ea is expressed by the distance rearward from a vertical reference plane set at a predetermined front-rear position in the passenger compartment 4. ea is represented by the distance upward from a predetermined horizontal reference plane (for example, a horizontal plane passing through the rotation axis of the reclining unit 8). The positions of the left and right ears may further include left and right positions. The left and right positions are represented by the distance from the center of the width direction of the passenger seat 6 to the side. The image processing unit 28 outputs the calculated positions of the left and right ears of the passenger to the relative distance calculation unit 29.

[0048] The image processing unit 28 also determines the position of the speaker 21 built into the headrest 10 by calculation. The position of the speaker 21 is determined by the front-rear position d sp and vertical position h sp The front and rear positions d of the speaker 21 are included and specified by these. sp is the front and back position of the ears d ea The vertical position h of the speaker 21 is expressed as the distance from the common vertical reference plane to the rear. sp is the vertical position of the ear h ea The position of the speaker 21 does not change in the left-right direction. If the passenger seat 6 is configured so that the position of the speaker 21 can change in the left-right direction, the position of the speaker 21 may further include left and right positions. In this case, the left and right positions are represented, for example, by the distance from the center of the vehicle 3 in the width direction to the side. The image processing unit 28 outputs the calculated position of the speaker 21 to the relative distance calculation unit 29.

[0049] Next, a specific example of a method for determining the position of the speaker 21 will be described.

[0050] Fig. 4 is an explanatory diagram of a first example of a position identification method. Fig. 4(A) shows a headrest 10 that is close to the infrared camera 14, and Fig. 4(B) shows a headrest 10 that is far from the infrared camera 14. The image processing unit 28 extracts feature points of the headrest 10 from the image. In the illustrated example, the feature points are four markers 41 provided along the outline of the headrest 10. The image processing unit 28 first determines the front-to-rear position of the headrest 10 from the relative positions of the four markers 41.

[0051] Specifically, the left-right distance of the marker 41 on the screen corresponds to the distance from the infrared camera 14, and becomes smaller as the headrest 10 is further rearward. Therefore, the image processing unit 28 calculates the front-rear position of the headrest 10 from the left-right distance of the marker 41 on the screen.

[0052] Once the front-rear position is identified, the image processing unit 28 can calculate the up-down position of the headrest 10 from the position of the marker 41 on the screen. The image processing unit 28 holds data indicating the relationship between the position of the headrest 10 and the position (center position) of the speaker 21, and determines the position of the speaker 21 based on the calculated headrest 10.

[0053] In this way, the image processing unit 28 of the calculation and determination unit 25 determines the position of the speaker 21 based on the characteristic parts of the headrest 10 in the image. According to this embodiment, the speaker position can be determined from the image of the infrared camera 14, so sensors for detecting the seat position, backrest angle, etc. are not required.

[0054] Although the headrest 10 is generally configured so that its height can be adjusted up and down, it is generally not provided with a sensor for detecting the headrest height. Therefore, even if the passenger seat 6 is provided with seat sensors (front-rear position sensor and reclining angle sensor), the position of the headrest 10 or the speaker 21 built into the headrest 10 cannot be determined by the seat sensors alone. In contrast, the speaker position determination device 18 of this embodiment can determine the position of the speaker 21 without requiring a sensor for detecting the headrest height.

[0055] In another example, the markers 41 may not be provided on the headrest 10. The image processing unit 28 may extract, for example, the outline of the headrest 10, or a pattern or a seam of a mark that appears on the surface of the headrest 10 as feature points, and identify the position of the headrest 10 from a plurality of feature points.

[0056] FIG. 5 is an explanatory diagram of a second example of a position identification method. FIG. 5(A) shows a headrest 10 that is close to the infrared camera 14, and FIG. 5(B) shows a headrest 10 that is far from the infrared camera 14. As with the example of FIG. 4, the image processing unit 28 extracts feature points of the headrest 10 from the image. In the illustrated example, the feature points are three markers 41 provided around each speaker 21. These markers 41 are provided on the surface of the headrest 10 so as to be equidistant from the center 21C of the speaker 21. The image processing unit 28 first determines the front-to-rear position of the speaker 21 from the relative positions of the three markers 41.

[0057] Specifically, the distance between the markers 41 on the screen and the area of the triangle with the marker 41 as a vertex correspond to the distance from the infrared camera 14, and become smaller as the headrest 10 is further rearward. Therefore, the image processing unit 28 calculates the front-to-rear position of the headrest 10 (i.e., the marker 41) from the positional relationship of the markers 41 on the screen.

[0058] Once the front-rear positions are identified, the image processing unit 28 can calculate the up-down position of the headrest 10 (i.e., the markers 41) from the positions of the markers 41 on the screen. The position of the center 21C of the speaker 21 is the center of the three markers 41, and the image processing unit 28 determines the position of the speaker 21 based on the calculated positions of the markers 41.

[0059] In another example, four or more markers 41 may be provided around each speaker 21 on the headrest 10. When the number of markers 41 is large, even if some of the markers 41 are hidden by the head of the occupant or the like, the position of the speaker 21 can be determined from the visible markers 41.

[0060] Figure 6 shows the first method of location identification. 3 6A shows the headrest 10 positioned close to the infrared camera 14 and facing forward toward the infrared camera 14, while FIG. 6B shows the headrest 10 positioned farther away from the infrared camera 14 and tilted toward the infrared camera 14. In other words, the reclining section 8 in FIG. 6B is tilted further rearward than in FIG. 6A.

[0061] The feature points in the illustrated example are four markers 41 provided around each speaker 21 so as to be equidistant from the center 21C of each speaker 21. The feature points in the illustrated example are four markers 41 provided along the contour of the headrest 10. The image processing unit 28 first determines the front-to-rear position of the headrest 10 from the relative positions of the four markers 41.

[0062] Specifically, the left-right distance of the marker 41 on the screen corresponds to the distance from the infrared camera 14. Therefore, the image processing unit 28 calculates the front-rear position of the headrest 10 from the left-right distance of the marker 41 on the screen. Once the front-rear position is identified, the image processing unit 28 can calculate the up-down position of the headrest 10 from the position of the marker 41 on the screen.

[0063] Furthermore, image processing unit 28 calculates the tilt angle of headrest 10 from the ratio between the distance between markers 41 lined up on the left and right and the distance between markers 41 lined up above and below. Image processing unit 28 holds data indicating the relationship between the positions of markers 41 and the position (center position) of speaker 21. When speaker 21 is placed further back than the surface of headrest 10, image processing unit 28 can accurately determine the position of speaker 21 based on the tilt angle of headrest 10 and the distance from the surface of headrest 10 to speaker 21.

[0064] 5 and 6, at least three markers 41 are provided at positions on the surface of the headrest 10 that are equidistant from the center 21C of the speaker 21. The image processing unit 28 of the calculation and determination unit 25 determines the center of a polygon having the feature points as vertices as the center position of the speaker 21, and can determine the center position of the speaker 21 from the positions of at least three feature points. Furthermore, even if the speaker 21 is located further back in the headrest 10 than the feature points, the center position of the speaker 21 can be determined from the arrangement of the feature points.

[0065] 7 is an explanatory diagram of a fourth example of a position identification method. In this example, two grills 42 that cover corresponding speakers 21 are provided on the surface of headrest 10. In addition, two microphone holes 43 are provided below grills 42 on the surface of headrest 10 at positions that match two microphones 22 built into headrest 10. Image processing unit 28 extracts grills 42 from the image and determines the position of grill 42, and determines the position of speaker 21 based on the position of grill 42. Image processing unit 28 also extracts microphone holes 43 from the image and determines the position of microphone hole 43, and determines the position of speaker 21 based on the position of microphone hole 43.

[0066] More specifically, the image processing unit 28 stores data indicating the shape and size of the grilles 42, the distance between the grilles 42, and the positional relationship between the grilles 42 and the corresponding speakers 21. Typically, the center positions of the grilles 42 and the speakers 21 coincide with each other. The image processing unit 28 extracts the outline of each grill 42 from the image and first identifies the front-to-rear position of the grill 42 based on the extracted width dimension of each grill 42 or the distance between the two grilles 42. Once the front-to-rear positions have been identified, the image processing unit 28 calculates the vertical position of the center of the grill 42 from the position of the grill 42 on the screen, thereby identifying the position of the grill 42. The image processing unit 28 then determines the position of the grill 42, specifically the center position of the outline of the grill 42, as the position of the speaker 21.

[0067] When the speaker 21 is located farther away from the grille 42, the image processing unit 28 may calculate the inclination angle of the grille 42 and the headrest 10 from the ratio between the width and height of the grille 42. In this case, the image processing unit 28 determines the position of the speaker 21 from the position of the grille 42 determined by calculation (the center position of the outline) by taking into account the inclination of the headrest 10 and the distance between the grille 42 and the speaker 21.

[0068] The image processing unit 28 also has data indicating the distance between the microphone holes 43 and the positional relationship between the microphone holes 43 and the speakers 21 disposed nearby. The image processing unit 28 first identifies the front-to-back positions of the microphone holes 43 based on the distance between the microphone holes 43 extracted from the image. Once the front-to-back positions have been identified, the image processing unit 28 calculates the up-down positions of the microphone holes 43 from the positions of the microphone holes 43 on the screen, thereby identifying the positions of the microphone holes 43. The image processing unit 28 then determines the positions of the speakers 21 from the positions of the microphone holes 43 determined by the calculation and the above-mentioned positional relationship.

[0069] The image processing unit 28 may determine the position of the speaker 21 using the grille 42 as a characteristic part, or may determine the position of the speaker 21 using the microphone hole 43 as a characteristic part. Furthermore, the image processing unit 28 may determine the position of the speaker 21 using both the grille 42 and the microphone hole 43 as characteristic parts.

[0070] In this way, image processing unit 28 of calculation and determination unit 25 can use grille 42 to determine the center of the outline of grille 42 as the center position of speaker 21, eliminating the need to provide separate markers 41 shown in Figures 3 to 6, and improving design freedom. Also, image processing unit 28 can use microphone hole 43 to determine the position of speaker 21 based on the position of microphone hole 43. In this case, too, there is no need to provide separate markers 41, improving design freedom.

[0071] In addition to determining the position of the speaker 21, the image processing unit 28 also determines whether there is an object blocking the path from the speaker 21 to the ears of the passenger. The determination of the presence or absence of an object will be described in detail later.

[0072] <Relative distance calculation unit 29> Referring to FIG. 2, the relative distance calculation unit 29 calculates the position of the speaker 21 (front-rear position d sp , vertical position h sp ) and the position of the passenger's left and right ears (front and rear position d ea , vertical position h ea ), the relative distance L from the speaker 21 to the corresponding ear is calculated. The relative distance calculation unit 29 outputs the calculated relative distance L to the speaker control unit 24.

[0073] <Speaker control unit 24> The speaker control unit 24 has, as functional components, a control signal generation unit 31, a control signal correction unit 32, a reference signal correction unit 33, and an adaptive correction unit 34. The control signal correction unit 32 has a correction unit 36 and a coefficient setting unit 37. The adaptive correction unit 34 has an adaptive update unit 38 and an update determination unit 39.

[0074] <Control signal generating unit 31> The control signal generating unit 31 of the control device 23 is configured with a control filter W. The control filter W is configured with, for example, an FIR filter (finite impulse response filter). In other embodiments, the control filter W may be configured with a SAN filter (single frequency adaptive notch filter) or the like.

[0075] A reference signal r corresponding to the noise d is input to the control signal generating unit 31 from the vibration sensor 16. In another embodiment, the reference signal r may be generated by, for example, a reference microphone (not shown) that generates the reference signal r from the noise d, instead of being generated by the vibration sensor 16. Alternatively, the reference signal r may be input to the control signal generating unit 31 from a component other than the vibration sensor 16 or the reference microphone.

[0076] The control signal generator 31 generates a control signal u for controlling the speaker 21 by filtering the reference signal r using a control filter W. The control filter W has a transfer function that is pre-identified so that, when the occupant's ear is located within a normal distance range from the speaker 21, the canceling sound y reaching the occupant's ear from the speaker 21 has a phase difference of 180° with respect to the noise d reaching the occupant, and has the same volume. The normal distance range will be described later. The control signal generator 31 outputs the generated control signal u to the control signal corrector 32.

[0077] <Control signal correction unit 32> The control signal corrector 32 of the control device 23 corrects the control signal u input from the control signal generator 31 based on the relative distance L from the speaker 21 to the ear of the occupant. Specifically, in the control signal corrector 32, the corrector 36 is configured with a multiplier and has a correction coefficient G. The corrector 36 corrects the control signal u with the correction coefficient G, that is, corrects the control signal u by multiplying the control signal u by the correction coefficient G, and outputs a corrected control signal u'. The correction coefficient G is a volume coefficient of the cancellation sound y to be generated by the speaker 21.

[0078] As the relative distance L between the speaker 21 and the ear of the occupant increases (as the ear moves away from the speaker 21), the canceling sound y that reaches the ear from the speaker 21 decreases. In response to this, the correction unit 36 is provided with a correction coefficient G that increases as the relative distance L increases, and corrects the control signal u with the correction coefficient G. In this way, the correction unit 36 can correct the control signal u using the simple method of correcting the decrease in the canceling sound y with the correction coefficient G, and therefore the memory capacity and calculation amount of the control device 23 can be reduced compared to when multiple auxiliary filters are provided.

[0079] The correction unit 36 outputs the generated corrected control signal u' to the power amplifier 26. The power amplifier 26 supplies power according to the corrected control signal u' to the speaker 21 to drive the speaker 21. As a result, the speaker 21 generates the canceling sound y according to the corrected control signal u' output from the control signal correction unit 32.

[0080] The correction coefficient G of the correction unit 36 is set by a coefficient setting unit 37. The coefficient setting unit 37 sets the correction coefficient G so that it increases as the relative distance L from the speaker 21 to the ear of the occupant increases. Specifically, the coefficient setting unit 37 is provided with a gain map shown in the correlation diagram of the relative distance L and the correction coefficient G shown in FIG. 8. The coefficient setting unit 37 refers to this gain map and sets the correction coefficient G in the correction unit 36 according to the input relative distance L.

[0081] In this gain map, the correction coefficient G is set to monotonically increase as the relative distance L increases. Furthermore, when the relative distance L is in a range from a first threshold value A to a second threshold value B (hereinafter referred to as a normal range AB), the correction coefficient G is set to 1. The normal range AB is a value corresponding to a normal range of ear positions of an occupant who is far from the speaker 21. For example, the first threshold value A may be 100 mm, and the second threshold value B may be 175 mm. When the relative distance L is 0, the correction coefficient G may be, for example, 0.1 or 0.2.

[0082] 2, when the ear is separated from speaker 21 within a normal distance range (when relative distance L is within normal range AB), coefficient setting unit 37 sets correction coefficient G of correction unit 36 to 1. When relative distance L is smaller than first threshold value A, coefficient setting unit 37 sets correction coefficient G of correction unit 36 to a value smaller than 1. When relative distance L is larger than second threshold value B, coefficient setting unit 37 sets correction coefficient G of correction unit 36 to a value larger than 1.

[0083] <Reference signal correction unit 33> The reference signal correction unit 33 is configured with a secondary path filter C^. The secondary path filter C^ is a filter that indicates an estimated value of a transfer function of a secondary path from the speaker 21 to the microphone 22. The secondary path filter C^ is configured with, for example, an FIR filter. In other embodiments, the secondary path filter C^ may be configured with a SAN filter or the like.

[0084] The reference signal correction unit 33 generates a cancellation estimation signal y^ indicating an estimated value of the cancellation y by filtering the reference signal r using the secondary path filter C^. The reference signal correction unit 33 outputs the generated cancellation estimation signal y^ to the adaptive update unit 38 of the adaptive correction unit 34.

[0085] <Adaptive correction unit 34> The adaptive update unit 38 of the adaptive correction unit 34 uses an adaptive algorithm such as an LMS algorithm to adaptively update the control filter W that constitutes the control signal generation unit 31. More specifically, the adaptive update unit 38 adaptively updates the control filter W so that the error signal e output from the microphone 22 is minimized.

[0086] The update determination unit 39 of the adaptive correction unit 34 determines whether or not to perform an update by the adaptive update unit 38, based on the relative distance L between the speaker 21 and the ear. Specifically, as shown in FIG. 9 , the update determination unit 39 determines that the adaptive update is on (permitted, i.e., update is performed) when the relative distance L is within a normal range AB from a first threshold value A to a second threshold value B. Otherwise, the update determination unit 39 determines that the adaptive update is off (not permitted, i.e., update is stopped). The update determination unit 39 outputs the determination result to the adaptive update unit 38.

[0087] The adaptive update unit 38 switches between performing and stopping adaptive updating of the control filter W constituting the control signal generator 31, depending on the determination result by the update determination unit 39. The adaptive update unit 38 performs adaptive updating of the control filter W only when the determination result is permission. When the determination result is permission, the adaptive update unit 38 stops adaptive updating of the control filter W. While the adaptive updating is stopped, the control filter W performs filtering on the reference signal r using the transfer function identified in advance.

[0088] In this embodiment, as described above, in each passenger seat 6, two speakers 21 are provided at positions corresponding to the ears of the passenger, and a speaker control unit 24 is provided for each speaker 21. Then, the control signal correction unit 32 of the control device 23 corrects the control signal u output from the control filter W based on the relative distance L, and controls the speaker 21 based on the corrected control signal u'. In other words, the control signal u is corrected directly based on the relative distance L from the speaker 21 to the passenger's ear. Therefore, the control is simple, and the cancellation y quickly follows changes in the position of the passenger's ear.

[0089] Furthermore, the acoustic control device 1 is equipped with the above-described speaker position determination device 18, and the infrared camera 14 is positioned so as to capture images of the headrest 10 and the occupant's head, so that the calculation and determination unit 25 can determine both the position of the speaker 21 and the position of the occupant's head from the images. This allows the control device 23 to drive the speaker 21 based on the position of the occupant's head and the position of the speaker 21, and perform noise cancellation control, without providing any sensors other than the camera.

[0090] Next, the determination of the presence or absence of an obstruction will be described. Fig. 10 is an explanatory diagram of the influence of an obstruction. Fig. 10(A) shows a normal state in which there is no obstruction in the path from the speaker 21 to the occupant's ears. Fig. 10(B) shows a blocked state in which a seat cover 44 is present as an obstruction in the path from the speaker 21 to the occupant's ears, and Fig. 10(C) shows a blocked state in which headphones 45 are present as an obstruction in the same path.

[0091] In the normal state shown in Fig. 10(A), the speaker control unit 24 corrects the control signal u based on the relative distance L, so that the noise d is effectively canceled by the canceling sound y at the position of the occupant's ear. However, in the obstructed states shown in Fig. 10(B) and (C), the volume of the canceling sound y transmitted from the speaker 21 to the occupant's ear decreases, and the canceling effect of the canceling sound y on the noise d decreases. Therefore, the image processing unit 28 of the speaker position determination device 18 in Fig. 2 determines whether or not there is an obstruction, and the speaker control unit 24 controls the speaker 21 based on the presence or absence of an obstruction.

[0092] In other words, since the infrared camera 14 captures an image of the speaker 21 and the head of the occupant, if there is an obstruction between them, the obstruction will appear in the image. Therefore, the acoustic control device 1 of this embodiment determines the presence or absence of an obstruction from the image without using any sensor other than the camera, and thing By controlling the canceling sound y based on the presence or absence of noise, the noise d can be canceled more accurately. Details are explained below.

[0093] In Europe (Euro-NCAP: European New Car Assessment Programme), the inclusion of a function that detects when the driver is looking away and issues a warning is evaluated highly. For this reason, driver monitor cameras are becoming standard equipment. The camera may be used to image-detect the position of the occupant's head, the position of the speaker 21, the presence or absence of an obstruction, etc. This eliminates the need to provide a dedicated camera.

[0094] Fig. 11 is an explanatory diagram of a first example of a method for identifying a position and determining an obstructing object. As shown in Fig. 11(A), in this example, similar to the fourth example in Fig. 7, two grills 42 that cover the speaker 21 are provided on the surface of the headrest 10, and two microphone holes 43 are provided below the grills 42. These are used as feature parts for determining the position of the speaker 21.

[0095] On the other hand, as shown in Fig. 11(B), when a seat cover 44 is placed over the headrest 10, the seat cover 44 blocks the path from the speaker 21 to the ears of the occupant. The seat cover 44 also covers the grille 42 and microphone hole 43, which are characteristic features for determining the position, making them invisible. Therefore, the image processing unit 28 in Fig. 2 cannot determine the position of the speaker 21 from the characteristic features.

[0096] In this case, the image processing unit 28 determines that an obstruction exists on the path from the speaker 21 to the occupant's ear, because the grille 42, which is a characteristic feature, is obstructed and cannot be extracted. In other words, the image processing unit 28 can determine the presence or absence of an obstruction by the simple method of determining whether the grille 42 of the speaker 21 is obstructed.

[0097] Furthermore, because the microphone hole 43, which is a characteristic feature, is blocked and cannot be extracted, the image processing unit 28 determines that there is an obstruction on the path from the speaker 21 to the ears of the occupant. In other words, the image processing unit 28 can determine the presence or absence of an obstruction by the simple method of determining whether the microphone hole 43 is blocked or not.

[0098] Fig. 12 is an explanatory diagram of a second example of the method for identifying a position and determining whether an obstruction is present. As shown in Fig. 12(A), in this example, as in the fourth example of Fig. 7, two grills 42 that cover the speaker 21 are provided on the surface of the headrest 10, and two microphone holes 43 are provided below the grills 42. These are used as feature parts for determining the position of the speaker 21.

[0099] On the other hand, as shown in Fig. 12(B), when the occupant wears headphones 45, the headphones 45 block the path from the speaker 21 to the occupant's ears. The headphones 45 also cover a part of the grille 42, which is a characteristic feature for determining the position, making it difficult to see, and also cover the occupant's ears, making them invisible. In such a case, the image processing unit 28 in Fig. 2 may not be able to determine the position of the speaker 21 from the characteristic feature.

[0100] Since the image processing unit 28 cannot extract part of the grille 42 and therefore cannot extract the occupant's ear, it determines that there is an obstruction on the path from the speaker 21 to the occupant's ear. In other words, the image processing unit 28 can determine the presence or absence of an obstruction by the simple method of determining whether the occupant's ear is obstructed.

[0101] 2 determines whether or not there is an obstruction, it outputs the determination result to the speaker control unit 24. When the determination result that there is an obstruction is input to the speaker control unit 24, the update determination unit 39 of the speaker control unit 24 determines that the adaptive update is off (not permitted, i.e., the update is stopped) regardless of whether or not the relative distance L is within the normal range AB. Therefore, the adaptive update unit 38 stops the adaptive update of the control filter W.

[0102] When the speaker 21 or the microphone 22 is blocked, the acoustic characteristics C from the speaker 21 to the microphone 22 deviate significantly from the model characteristics set in the secondary path filter C^ that constitutes the reference signal correction unit 33. In this embodiment, the adaptive update unit 38 stops adaptive updating of the control filter W, thereby preventing the error signal e from becoming large, causing the cancellation y to become excessive, and preventing the adaptive update control of the control filter W from becoming unstable.

[0103] Furthermore, when the determination result that there is an obstruction is input to the speaker control unit 24, the coefficient setting unit 37 of the control signal correction unit 32 sets the correction coefficient G to a value larger than the value corresponding to the relative distance L shown in Fig. 8. For example, the coefficient setting unit 37 sets the correction coefficient G to 1.5 times the value shown in Fig. 8. This increases the volume of the canceling sound y propagated from the speaker 21 to the ears of the occupants, which is reduced by the obstruction, and therefore improves the effect of canceling out the noise d by the canceling sound y.

[0104] In this way, the speaker control unit 24 controls the speaker 21 based on the presence or absence of an obstruction, thereby making it possible to more accurately cancel out the noise d.

[0105] In this embodiment, when the speaker control unit 24 receives a determination that an obstruction is present, the update determination unit 39 stops adaptively updating the control filter W and the coefficient setting unit 37 increases the correction coefficient G. However, the speaker control unit 24 may perform control other than this. For example, the speaker control unit 24 may stop outputting the cancellation sound y itself. Stopping the output of the cancellation sound y itself prevents the audible noise d from being amplified due to a change in the acoustic characteristic C. Alternatively, the update determination unit 39 may stop adaptively updating the control filter W, and the coefficient setting unit 37 may set the correction coefficient G to the normal value shown in FIG. 8.

[0106] Second Embodiment Next, a second embodiment of the present invention will be described with reference to Fig. 13. Elements that are the same as or similar to those in the first embodiment are given the same reference numerals, and duplicated explanations will be omitted. Unless otherwise specified, the same applies to the following embodiments.

[0107] The acoustic control device 1 of this embodiment does not include a microphone 22, and differs from the first embodiment in the configuration of the speaker control unit 24 of the control device 23. Specifically, the speaker control unit 24 does not include a reference signal correction unit 33 (FIG. 2) and an adaptive correction unit 34 (FIG. 2). In other words, the speaker control unit 24 does not adaptively update the control filter W, and the control signal correction unit 32 corrects the coefficient of the control signal u based on the relative distance L from the speaker 21 to the ear of the passenger.

[0108] When the speaker control unit 24 receives a determination result that an obstruction is present, the coefficient setting unit 37 of the speaker control unit 24 sets the correction coefficient G to a value greater than the value corresponding to the relative distance L shown in Fig. 8. This increases the volume of the canceling sound y transmitted from the speaker 21 to the ears of the passengers, which is reduced by the obstruction, and improves the canceling effect of the noise d by the canceling sound y.

[0109] Alternatively, when it is determined that an obstruction is present, the coefficient setting unit 37 may stop the output of the cancellation sound y itself by setting the correction coefficient G to 0. By stopping the output of the cancellation sound y itself, it is possible to prevent the audible noise d from being amplified due to a change in the acoustic characteristic C.

[0110] Third Embodiment Next, a third embodiment of the present invention will be described with reference to Fig. 14. The acoustic control device 1 of this embodiment differs from the first embodiment in the configuration of the control device 23. Specifically, the speaker control unit 24 does not include the control signal correction unit 32 (Fig. 2), and the calculation and determination unit 25 of the speaker position determination device 18 does not include the relative distance calculation unit 29. That is, in the calculation and determination unit 25, the image processing unit 28 determines the position of the speaker 21 by extracting the grille 42 or the microphone hole 43, but the position determination is performed to determine the presence or absence of an obstruction. When the image processing unit 28 determines the presence or absence of an obstruction, it outputs the determination result to the speaker control unit 24.

[0111] When the determination result that there is an obstruction is input to the speaker control unit 24, the update determination unit 39 of the speaker control unit 24 determines that the adaptive update is off (not permitted, i.e., the update is stopped). Therefore, the adaptive update unit 38 stops the adaptive update of the control filter W.

[0112] When the speaker 21 or the microphone 22 is blocked, the acoustic characteristics C from the speaker 21 to the microphone 22 deviate significantly from the model characteristics set in the secondary path filter C^ that constitutes the reference signal corrector 33. In this embodiment as well, the adaptive updater 38 stops adaptive updating of the control filter W, thereby preventing the error signal e from becoming large, causing the cancellation y to become excessive, and preventing the adaptive update control of the control filter W from becoming unstable.

[0113] Although the description of the specific embodiment has been completed, the present invention is not limited to the above embodiment and its modifications, and can be implemented in a wide variety of modifications. For example, while an infrared camera 14 is used to photograph the headrest 10, the camera is not limited to this. A thermal camera capable of detecting heat, a camera that photographs using natural light, or the like may also be used. Furthermore, while one camera is provided on the instrument panel 13 in the above embodiment, multiple cameras may be provided on the instrument panel 13, or the multiple cameras may be provided in different locations. Furthermore, the specific configuration, arrangement, quantity, and materials of each component and part may be modified as appropriate without departing from the spirit and scope of the present invention. Furthermore, some or all of the configurations of the above embodiment may be combined with each other. Meanwhile, not all of the components shown in the above embodiment are necessarily required, and may be selected as appropriate. [Explanation of symbols]

[0114] 1: Acoustic control device (on-board acoustic control device) 6: Passenger seat 10: Headrest 14: Infrared camera 18: Speaker position determination device 21: Speaker 21C: Center 22:Mike 23: Control device 24: Speaker control section 25: Calculation judgment unit (position judgment device) 28: Image processing section 31: Control signal generator (control filter W) 32: Control signal correction unit 34: Adaptive correction unit 37: Coefficient setting section 38: Adaptive update section 39:Update judgment section 41: Marker (feature part) 42: Grill (features) 43: Microphone hole (feature part) 44: Seat cover (shield) 45: Headphones (shield) G: Correction coefficient L: Relative distance W: Control filter d: Noise e: error signal u: control signal y :Cancellation sound

Claims

1. A speaker position determination device that determines the position of a speaker built into a headrest, the speaker position determination device comprising: a camera that captures an image of the headrest and an occupant's head; and a position determination device that determines the position of the speaker and the position of the occupant's head based on the image captured by the camera, the position determination device determining the position of the speaker based on a characteristic part of the headrest in the image; a control device that controls the speaker to output a canceling sound for canceling noise inside the vehicle based on the position of the head of the occupant and the position of the speaker; a microphone for generating an error signal from the noise and the cancellation sound; the control device includes a control filter that generates a control signal for controlling the speaker, and an adaptive update unit that adaptively updates the control filter based on the error signal; the position determination device determines whether or not there is an obstacle blocking a path from the speaker to the ear of the occupant in the image; The adaptive update unit stops adaptive updating of the control filter when the obstruction is present.

2. the characteristic portion includes at least three characteristic points provided on a surface of the headrest so as to be equidistant from the center of the speaker; The in-vehicle acoustic control device according to claim 1 , wherein the position determining device determines the center of a polygon having the characteristic points as vertices as the center position of the speaker.

3. the feature includes a grill provided on a surface of the headrest and covering the speaker; The in-vehicle acoustic control device according to claim 1 , wherein the position determining device determines the position of the speaker based on the position of the grille.

4. The headrest has a built-in microphone, A microphone hole is provided on the surface of the headrest, The in-vehicle acoustic control device according to claim 1 , wherein the position determining device determines the position of the speaker based on the position of the microphone hole.

5. A grill covering the speaker is provided on the surface of the headrest, The in-vehicle acoustic control device according to claim 1 , wherein the position determining device determines that the obstructing object is present when the grille is obstructed in the image.

6. A microphone is provided in the headrest, A microphone hole is provided on the surface of the headrest, The in-vehicle acoustic control device according to claim 1 , wherein the position determining device determines that the obstructing object is present when the microphone hole is obstructed in the image.

7. The in-vehicle acoustic control device according to claim 1 , wherein the position determining device determines that the obstructing object is present when the occupant's ear is obstructed in the image.

Images