Acoustic control device and acoustic control program

Abstract

To provide an acoustic control device which can output the acoustics according to situation of a crew member.SOLUTION: An acoustic control device 10 comprises a picked-up image acquisition part 11 which acquires a picked-up image imaging an inside of a passenger compartment 41 of a vehicle, a sound noise acquisition part 12 which acquires a noise signal corresponding to sound noise generated within the passenger compartment 41, a driving source rotational frequency acquisition part 13 which acquires a driving source rotational frequency signal corresponding to rotational frequency of a driving source, a crewman analysis part 14 which analyses about disposition, condition and action of a crewman existing within the passenger compartment 41 on the basis of the picked-up image, an acoustic control part 15 which controls reverse phase sound becoming a phase opposed to the phase of the noise against the crewman or identical phase sound becoming a phase identical to the phase of the noise against the crewman on the basis of the noise signal, the driving source rotational frequency signal and analysis result and an acoustic signal generation part 16 which generates the acoustic signal corresponding to the reverse phase sound or the identical phase sound controlled by the acoustic control part 15 and outputs the generated acoustic signal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an acoustic control device and an acoustic control program. [Background technology]

[0002] Conventionally, there have been provided acoustic control technologies that cancel out noise generated inside a vehicle cabin. Such conventional acoustic control technologies are disclosed in, for example, Patent Document 1. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2019 / 106748 Summary of the Invention [Problem to be solved by the invention]

[0004] The acoustic control technology disclosed in Patent Document 1 generates information indicating the position of the occupant's head based on an image obtained from an image sensor, and generates a control signal for controlling the acoustics at the position of the occupant's head based on the picked-up sound signal and the information indicating the position of the occupant's head.

[0005] However, the sound control technology disclosed in Patent Document 1 estimates only the position of the occupant's head and controls the sound for the occupant based on the estimation result. The situations of occupants in a vehicle vary depending on their positions, states, actions, etc. Therefore, the sound control technology disclosed in Patent Document 1 may not adequately control the sound for the occupant.

[0006] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a sound control device that can output sound according to the state of the occupants. [Means for solving the problem]

[0007] The acoustic control device according to the present disclosure includes an image acquisition unit that acquires an image of the interior of the vehicle cabin, a noise acquisition unit that acquires a noise signal corresponding to noise generated within the vehicle cabin, a drive source rotation speed acquisition unit that acquires a drive source rotation speed signal corresponding to the rotation speed of a drive source mounted in the vehicle, an occupant analysis unit that analyzes the position, state, and behavior of occupants present within the vehicle cabin based on the image acquired by the image acquisition unit, an acoustic control unit that controls an anti-phase sound that is anti-phase to the phase of the noise for the occupant, or an in-phase sound that is the same phase as the phase of the noise for the occupant, based on the noise signal acquired by the noise acquisition unit, the drive source rotation speed signal acquired by the drive source rotation speed acquisition unit, and the analysis results of the occupant analysis unit, and an acoustic signal generation unit that generates an acoustic signal corresponding to the anti-phase sound or in-phase sound controlled by the acoustic control unit, and outputs the generated acoustic signal. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to output sound according to the state of the occupant. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing the configuration of an acoustic control system to which an acoustic control device according to a first embodiment is applied. [Figure 2] 1 is a schematic diagram showing the installation positions of various in-vehicle devices mounted on a vehicle; [Figure 3] 3 is a flowchart showing an acoustic control method according to the first embodiment. [Figure 4] 10 is a first specific example of the operation of the acoustic control device according to the first embodiment. [Figure 5] 10 is a second specific example of the operation of the acoustic control device according to the first embodiment. [Figure 6] 10 is a third specific example of the operation of the acoustic control device according to the first embodiment. [Figure 7] 10 is a fourth specific example of the operation of the acoustic control device according to the first embodiment. [Figure 8]8A and 8B are diagrams illustrating an example of a hardware configuration of the acoustic control apparatus according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0011] Embodiment 1 An acoustic control device 10 according to the first embodiment will be described with reference to FIGS.

[0012] First, the configuration of an acoustic control system 100 to which an acoustic control device 10 according to embodiment 1 is applied will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a block diagram showing the configuration of an acoustic control system 100 to which an acoustic control device 10 according to embodiment 1 is applied. Fig. 2 is a schematic diagram showing the installation positions of various in-vehicle devices mounted on a vehicle.

[0013] The acoustic control system 100 according to the first embodiment shown in FIG. 1 is applied to, for example, a vehicle. This vehicle is, for example, a gasoline vehicle, a hybrid vehicle, or an electric vehicle. A gasoline vehicle is equipped with an engine as a drive source. A hybrid vehicle is equipped with an engine and a motor as a drive source. An electric vehicle is equipped with a motor as a drive source. For this reason, low-frequency noise may be generated inside a passenger compartment 41 of the vehicle due to transmission of vibration noise, exhaust noise, and the like from the drive source.

[0014] The acoustic control system 100 has a so-called active noise control (ANC) function that controls the acoustics in the vehicle cabin 41 (see FIG. 2). Specifically, the acoustic control system 100 can not only cancel out the noise detected in the vehicle cabin 41, but also enhance the noise. This will be described in detail later.

[0015] As shown in FIG. 2, the vehicle in which the acoustic control system 100 is installed is, for example, a five-seater vehicle. A passenger compartment 41 of this vehicle is provided with a driver's seat 42, a passenger seat 43, a rear right seat 44, a rear left seat 45, and a rear center seat 46. Passengers in the vehicle can sit in each of the seats 42 to 46. Of the passengers in the vehicle, the passenger sitting in the driver's seat 42 is the driver. In other words, the term "passengers" includes the driver. Note that the vehicle in which the acoustic control system 100 is installed is not limited to a five-seater vehicle.

[0016] The driver's seat 42 and the passenger seat 43 are provided at the front of the vehicle in the passenger compartment 41. The driver's seat 42 is located on the right side in the vehicle width direction in the passenger compartment 41. The passenger seat 43 is located on the left side in the vehicle width direction in the passenger compartment 41.

[0017] The rear right seat 44, the rear left seat 45, and the rear center seat 46 are provided at the rear side of the vehicle in the passenger compartment 41. The rear right seat 44 is located behind the driver's seat 42 and on the right side in the vehicle width direction in the passenger compartment 41. The rear left seat 45 is located behind the passenger seat 43 and on the left side in the vehicle width direction in the passenger compartment 41. The rear center seat 46 is located behind the driver's seat 42 and the passenger seat 43 and in the center in the vehicle width direction in the passenger compartment 41. In other words, the rear center seat 46 is located between the rear right seat 44 and the rear left seat 45 in the vehicle width direction in the passenger compartment 41.

[0018] 1, the acoustic control system 100 includes an acoustic control device 10, an image pickup device 21, a sound collection device 22, a drive source control device 23, and an acoustic output unit 31. The acoustic control device 10, the image pickup device 21, the sound collection device 22, the drive source control device 23, and the acoustic output unit 31 constitute in-vehicle equipment.

[0019] As shown in FIG. 2, the imaging device 21 is provided, for example, at the front end of a ceiling surface 47 that forms the vehicle interior 41. The imaging device 21 is arranged so as to face the inside of the vehicle interior 41. The imaging device 21 is, for example, an infrared camera or a visible light camera. The imaging device 21 may be shared with a so-called "Driver Monitoring System (DMS)" that is installed in a vehicle to monitor the status of occupants in the vehicle interior 41.

[0020] The imaging device 21 captures images of the interior of the vehicle cabin 41. The imaging device 21 is installed so as to be able to capture an image of the interior of the vehicle cabin 41 including at least the area where the upper half of the occupant's body should be present. The area where the upper half of the occupant's body should be present in the vehicle cabin 41 is, for example, the spatial area near the front of the backrests and headrests of each of the seats 42 to 46. The imaging device 21 outputs the captured image to the sound control device 10.

[0021] As shown in Fig. 2, the sound collection device 22 is attached to a predetermined position on the ceiling surface 47. The sound collection device 22 detects sounds generated within the vehicle interior 41 and converts the detected sounds into electrical signals. That is, the sound collection device 22 detects noise generated within the vehicle interior 41 and converts the detected noise into a noise signal. The sound collection device 22 then outputs the converted noise signal to the sound control device 10. The sound collection device 22 is, for example, a microphone.

[0022] Here, there are five sound collection devices 22: microphones 22a, 22b, 22c, and 24d corresponding to driver's seat 42, passenger seat 43, rear right seat 44, and rear left seat 45, and microphone 22e corresponding to the entire vehicle interior 41 and rear center seat 46. Note that sound collection devices 22 may have six microphones in total, by adding one microphone corresponding only to rear center seat 46 to microphones 22a to 22e.

[0023] Microphones 22a to 22e are each attached to ceiling surface 47. Specifically, microphone 22a is disposed approximately directly above driver's seat 42. Microphone 22b is disposed approximately directly above passenger seat 43. Microphone 22c is disposed approximately directly above rear right seat 44. Microphone 22d is disposed approximately directly above rear left seat 45. Microphone 22e is disposed in the center of ceiling surface 47. "Approximately directly above" means that microphones 22a to 22d may be disposed so that at least a portion of corresponding seats 42 to 45 overlap in the vertical direction. In this way, by disposing microphones 22a to 22d approximately directly above their corresponding seats 42 to 45, noises near the corresponding seats 42 to 45 can be effectively detected. Furthermore, by disposing microphone 22e in the center of ceiling surface 47, noises mainly in the center of passenger compartment 41 can be detected.

[0024] The microphones 22a to 22d detect noise near the corresponding seats 42 to 45, and the microphone 22e detects noise in the center of the vehicle interior 41. The microphones 22a to 22e convert the detected noise into noise signals and output the converted noise signals to the sound control device 10.

[0025] The drive source control device 23 is, for example, an electronic control unit (ECU) that controls all systems and devices of the vehicle. The drive source control device 23 controls the rotation speed of the drive source mounted on the vehicle. The drive source control device 23 outputs a drive source rotation speed signal corresponding to the rotation speed of the drive source to the acoustic control device 10. Note that the acoustic control system 100 may be provided with a sensor that detects the rotation speed of the drive source instead of the drive source control device 23.

[0026] 2, the acoustic output unit 31 is attached at a predetermined position in the vehicle interior 41. When the acoustic output unit 31 receives an acoustic signal transmitted from the acoustic control device 10, it converts the acoustic signal into sound and outputs the converted sound toward the vehicle interior 41. The sound output by the acoustic output unit 31 is sound that is in the opposite phase or the same phase as the noise detected by each of the microphones 22a to 22e. The acoustic output unit 31 is, for example, a speaker or a woofer.

[0027] Here, the sound output unit 31 has a total of five speakers: four speakers 31a to 31d and one woofer 31e. The speakers 31a to 31d and the woofer 31e are each installed inside the vehicle interior 41. The speaker 31a corresponds to the microphone 22a and the driver's seat 42. This speaker 31a is provided in the driver's side door that forms the vehicle interior 41. The driver's side door is located on the right side of the driver's seat 42 in the vehicle width direction. The speaker 31b corresponds to the microphone 22b and the passenger seat 43. This speaker 31b is provided in the passenger's side door that forms the vehicle interior 41. The passenger's side door is located on the left side of the passenger seat 43 in the vehicle width direction.

[0028] The speaker 31c corresponds to the microphone 22c and the rear right seat 44. The speaker 31c is provided in the rear right seat door that forms the passenger compartment 41. The rear right seat door is located on the right side of the rear right seat 44 in the vehicle width direction. The speaker 31d corresponds to the microphone 22d and the rear left seat 45. The speaker 31d is provided in the rear left seat door that forms the passenger compartment 41. The rear left seat door is located on the right side of the rear left seat 45 in the vehicle width direction. The woofer 31e corresponds to the microphones 22a to 22e and each of the seats 42 to 46 or the center of the passenger compartment 41. The woofer 31e is provided on the vehicle rear side of the rear center seat 46.

[0029] The sound output by the speaker 31a is sound that is in the opposite phase or the same phase as the noise detected by the microphone 22a. The sound output by the speaker 31b is sound that is in the opposite phase or the same phase as the noise detected by the microphone 22b. The sound output by the speaker 31c is sound that is in the opposite phase or the same phase as the noise detected by the microphone 22c. The sound output by the speaker 31d is sound that is in the opposite phase or the same phase as the noise detected by the microphone 22d. The sound output by the woofer 31e is sound that is in the opposite phase or the same phase as the noise detected by at least one of the microphones 22a to 22e.

[0030] In this way, the speakers 31a to 31d and the woofer 31e are arranged to the sides and behind the corresponding seats 42 to 46, and can output sounds that are in phase with or out of phase with the noise detected by the corresponding microphones 22a to 22e. As a result, the speakers 31a to 31d and the woofer 31e can cancel out noise generated near the corresponding seats 42 to 46 and in the center of the vehicle interior 41. Alternatively, the speakers 31a to 31d and the woofer 31e can enhance noise generated near the corresponding seats 42 to 46 and in the center of the vehicle interior 41. Furthermore, the woofer 31e can cancel out or enhance noise over a wide area centered on the center of the vehicle interior 41.

[0031] As shown in FIG. 1, the acoustic control device 10 includes an image acquisition unit 11, a noise acquisition unit 12, a drive source rotation speed acquisition unit 13, an occupant analysis unit 14, an acoustic control unit 15, and an acoustic signal generation unit 16.

[0032] The captured image acquisition unit 11 acquires captured images from the imaging device 21. The captured image acquisition unit 11 transmits the acquired captured images to the occupant analysis unit .

[0033] The noise acquisition unit 12 acquires a noise signal from the sound collection device 22. The noise acquisition unit 12 transmits the acquired noise signal to the acoustic control unit 15.

[0034] The drive source rotation speed acquisition unit 13 acquires a drive source rotation speed signal from the drive source control device 23. The drive source rotation speed acquisition unit 13 transmits the acquired drive source rotation speed signal to the acoustic control unit 15.

[0035] The occupant analysis unit 14 acquires the captured image from the captured image acquisition unit 11. Based on the acquired captured image, the occupant analysis unit 14 analyzes, i.e., detects, the location of the occupants present in the vehicle compartment 41, the state of the occupants present in the vehicle compartment 41, and the behavior of the occupants present in the vehicle compartment 41. The occupant analysis unit 14 transmits the analysis result to the acoustic control unit 15.

[0036] The acoustic control unit 15 acquires a noise signal from the noise acquisition unit 12. The acoustic control unit 15 acquires a drive-source rotation speed signal from the drive-source rotation speed acquisition unit 13. The acoustic control unit 15 acquires an analysis result from the occupant analysis unit 14. Based on the acquired noise signal, drive-source rotation speed signal, and analysis result, the acoustic control unit 15 controls an anti-phase sound that is in the opposite phase to the phase of the noise for the occupant, or an in-phase sound that is in the same phase as the phase of the noise for the occupant. The anti-phase sound is a cancellation sound that cancels out the noise. The in-phase sound is an enhancement sound that emphasizes the noise. The acoustic control unit 15 transmits an instruction signal corresponding to the anti-phase sound or an instruction signal corresponding to the in-phase sound to the acoustic signal generation unit 16.

[0037] The acoustic signal generation unit 16 acquires an instruction signal corresponding to an antiphase sound or an instruction signal corresponding to an in-phase sound from the acoustic control unit 15. The acoustic signal generation unit 16 generates an acoustic signal according to the instruction signal corresponding to the antiphase sound and transmits the generated acoustic signal to the acoustic output unit 31. Alternatively, the acoustic signal generation unit 16 generates an acoustic signal according to the instruction signal corresponding to an in-phase sound and transmits the generated acoustic signal to the acoustic output unit 31.

[0038] Next, the operation of the acoustic control device 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the acoustic control method according to the first embodiment.

[0039] In step ST11, the captured image acquisition unit 11 acquires a captured image from the imaging device 21. Next, the captured image acquisition unit 11 transmits the acquired captured image to the occupant analysis unit .

[0040] In step ST12, the noise acquiring unit 12 acquires a noise signal from the sound collecting device 22. Next, the noise acquiring unit 12 transmits the acquired noise signal to the acoustic control unit 15.

[0041] In step ST13, the drive-source rotation speed acquisition unit 13 acquires a drive-source rotation speed signal from the drive-source control device 23. Next, the drive-source rotation speed acquisition unit 13 transmits the acquired drive-source rotation speed signal to the acoustic control unit 15.

[0042] In step ST14, the occupant analysis unit 14 acquires the captured image from the captured image acquisition unit 11. Next, the occupant analysis unit 14 analyzes the location of the occupants present in the vehicle compartment 41, the state of the occupants present in the vehicle compartment 41, and the behavior of the occupants present in the vehicle compartment 41, based on the acquired captured image. Next, the occupant analysis unit 14 transmits the analysis result to the acoustic control unit 15.

[0043] In step ST15, the acoustic control unit 15 acquires the noise signal, the drive-source rotation speed signal, and the analysis result. Next, based on the acquired noise signal, drive-source rotation speed signal, and the analysis result, the acoustic control unit 15 controls an anti-phase sound that is anti-phase to the phase of the noise perceived by the occupant, or an in-phase sound that is the same phase as the phase of the noise perceived by the occupant. Next, the acoustic control unit 15 transmits an instruction signal corresponding to the anti-phase sound or the in-phase sound to the acoustic signal generation unit 16.

[0044] In step ST16, the acoustic signal generation unit 16 acquires an instruction signal corresponding to an antiphase sound or an instruction signal corresponding to an in-phase sound from the acoustic control unit 15. Next, the acoustic signal generation unit 16 generates an acoustic signal according to the instruction signal corresponding to the antiphase sound and transmits this generated acoustic signal to the acoustic output unit 31. Alternatively, the acoustic signal generation unit 16 generates an acoustic signal according to the instruction signal corresponding to an in-phase sound and transmits this generated acoustic signal to the acoustic output unit 31.

[0045] Then, the operation of the acoustic control device 10 ends.

[0046] Next, a specific example of the operation of the acoustic control device 10 according to the first embodiment will be described with reference to Figures 4 to 7. Note that in Figures 4 to 7, the speakers 31a to 31d and the woofer 31e are not shown.

[0047] 4 shows a first specific example of the operation of the acoustic control device 10 according to Embodiment 1. In this Fig. 4, it is assumed that passengers are seated in the seats 42 to 46.

[0048] The occupant analysis unit 14 analyzes whether an occupant is seated in each of the seats 42 to 46 based on the captured image. The audio control unit 15 controls antiphase sound, which is the opposite phase to the noise phase for each occupant, based on the noise signal, the drive source rotation speed signal, and the analysis results. The audio signal generation unit 16 generates an audio signal in accordance with an instruction signal corresponding to the antiphase sound, and transmits the generated audio signal to the speakers 31a to 31d and the woofer 31e.

[0049] Therefore, the speakers 31a to 31d output anti-phase sounds (canceling sounds) that are opposite in phase to the phase of the noise detected by the microphones 22a to 22d corresponding to the seats 42 to 45. Furthermore, the woofer 31e outputs anti-phase sounds (canceling sounds) that are opposite in phase to the phase of the noise detected by the microphone 22e corresponding to the center of the vehicle interior 41. The woofer 31e can output low-frequency sounds with high sound pressure over a wide range, and therefore can provide a noise-canceling effect for all five occupants.

[0050] 4 indicate output ranges of the antiphase sounds output from the speakers 31a to 31d and the woofer 31e. The output ranges S1 to S4 of the antiphase sounds cover the seats 42 to 45. Furthermore, the output range S5 of the antiphase sound covers the seats 42 to 45 and also covers the rear center seat 46.

[0051] Fig. 5 shows a second specific example of the operation of the acoustic control device 10 according to embodiment 1. Fig. 5 assumes that only the driver, who is an occupant, is seated in the driver's seat 42.

[0052] The occupant analysis unit 14 analyzes, based on the captured image, that only the driver is seated in the driver's seat 42. The acoustic control unit 15 controls the antiphase sound, which is the antiphase of the noise for the driver, based on the noise signal, the drive source rotation speed signal, and the analysis results. The acoustic signal generation unit 16 generates an acoustic signal according to an instruction signal corresponding to the antiphase sound, and transmits the generated acoustic signal to the speaker 31a and the woofer 31e.

[0053] As a result, the speaker 31a and the woofer 31e output an antiphase sound (canceling sound) that is the opposite phase to the phase of the noise detected by the microphone 22a corresponding to the driver's seat 42. At this time, the output range S1 of the antiphase sound covers the driver's seat 42. Furthermore, the output range S5 of the antiphase sound includes the output range S1 of the antiphase sound and covers the driver's seat 42 over an even wider range and with greater sound pressure. As a result, the acoustic control device 10 can enhance the noise cancelling effect for the driver. Note that a different control method may be used to output the antiphase sound using either the speaker 31a or the woofer 31e alone.

[0054] Fig. 6 shows a third specific example of the operation of the acoustic control device 10 according to the first embodiment. Fig. 6 illustrates a case where the state and behavior of an occupant are grasped. As an example, the operation will be described when the state and behavior of an occupant sitting in the rear left seat 45 is analyzed and a relevant event is determined. Examples of relevant events include when the occupant's level of alertness is lower than a predetermined value (asleep), when the occupant is making a call on a mobile phone, when the occupant is feeling uncomfortable (in this case, the occupant's discomfort is analyzed from the pulse rate, blood pressure, facial expression, etc.), when the occupant is an elderly person or an infant, etc.

[0055] The occupant analysis unit 14 analyzes the occupant sitting in the rear left seat 45 based on the captured image. If the occupant analysis unit 14 determines that the state and behavior of the occupant constitute the relevant event, the audio control unit 15 controls an antiphase sound that is the antiphase of the noise for the occupant based on the noise signal, the drive source rotation speed signal, and the analysis results. The audio signal generation unit 16 generates an audio signal in response to an instruction signal corresponding to the antiphase sound, and transmits the generated audio signal to the speaker 31d and the woofer 31e.

[0056] As a result, the speaker 31d and the woofer 31e output an antiphase sound (canceling sound) that is the opposite phase to the phase of the noise detected by the microphone 22d corresponding to the rear left seat 45. At this time, the output range S4 of the antiphase sound covers the rear left seat 45. Furthermore, the output range S5 of the antiphase sound includes the output range S4 of the antiphase sound and covers the rear left seat 45 over an even wider range and with greater sound pressure. As a result, the acoustic control device 10 can increase the noise cancelling effect for the occupant sitting in the rear left seat 45. Note that a different control method may be used to output the antiphase sound using either the speaker 31d or the woofer 31e alone.

[0057] The same operation can also be performed when an occupant is seated in any of the seats 42 to 44, 46 other than the rear left seat 45. However, from the viewpoint of safe driving, if the driver seated in the driver's seat 42 has a level of alertness lower than a predetermined value (is asleep), the control of the antiphase sound is not performed.

[0058] Fig. 7 shows a fourth specific example of the operation of the acoustic control device 10 according to embodiment 1. Fig. 7 assumes that the driver, who is a passenger seated in the driver's seat 42, has a low level of alertness or concentration.

[0059] The occupant analysis unit 14 analyzes, based on the captured image, that a driver is seated in the driver's seat 42. The occupant analysis unit 14 also analyzes that the driver's alertness or concentration is lower than a predetermined value. The audio control unit 15 controls an in-phase sound that is in phase with the noise for the driver based on the noise signal, the drive source rotation speed signal, and the analysis results. The audio signal generation unit 16 generates an audio signal according to an instruction signal corresponding to the in-phase sound, and transmits the generated audio signal to the speaker 31a and the woofer 31e.

[0060] Therefore, the speaker 31a and the woofer 31e output an in-phase sound (emphasized sound) that is in phase with the noise detected by the microphone 22a corresponding to the driver's seat 42. At this time, the output range S1' of the in-phase sound covers the driver's seat 42. Furthermore, the output range S5' of the in-phase sound includes the output range S1 of the anti-phase sound and covers the driver's seat 42 over an even wider range and with greater sound pressure. As a result, the acoustic control device 10 can increase the effect of emphasizing noise on the driver. Therefore, the acoustic control device 10 can restore the driver's level of alertness or concentration. Note that the output of the in-phase sound may be performed by either the speaker 31a or the woofer 31e.

[0061] Furthermore, when the driver's level of alertness or concentration has recovered, the acoustic control device 10 can stop outputting the in-phase sound, or switch from output control of the in-phase sound to output control of the anti-phase sound, as necessary.

[0062] Next, an example of the hardware configuration of the acoustic control device 10 according to the first embodiment will be described with reference to Fig. 8. Figs. 8A and 8B are diagrams showing an example of the hardware configuration of the acoustic control device 10 according to the first embodiment.

[0063] 8A, the acoustic control device 10 is configured by a computer, and the computer has a processor 51 and a memory 52. ​​The memory 52 stores programs for causing the computer to function as the captured image acquisition unit 11, the noise acquisition unit 12, the drive source rotation speed acquisition unit 13, the occupant analysis unit 14, the acoustic control unit 15, and the acoustic signal generation unit 16. The processor 51 reads and executes the programs stored in the memory 52, thereby realizing the functions of the captured image acquisition unit 11, the noise acquisition unit 12, the drive source rotation speed acquisition unit 13, the occupant analysis unit 14, the acoustic control unit 15, and the acoustic signal generation unit 16.

[0064] 8B, the acoustic control device 10 may include a processing circuit 53. In this case, the processing circuit 53 may be realized by the captured image acquisition unit 11, the noise acquisition unit 12, the drive source rotation speed acquisition unit 13, the occupant analysis unit 14, the acoustic control unit 15, and the acoustic signal generation unit 16.

[0065] Alternatively, the acoustic control device 10 may have a processor 51, a memory 52, and a processing circuit 53 (not shown). In this case, some of the functions of the captured image acquisition unit 11, the noise acquisition unit 12, the drive source rotation speed acquisition unit 13, the occupant analysis unit 14, the acoustic control unit 15, and the acoustic signal generation unit 16 may be realized by the processor 51 and the memory 52, and the remaining functions may be realized by the processing circuit 53.

[0066] The processor 51 is, for example, one that uses at least one of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, a microcontroller, and a digital signal processor (DSP).

[0067] The memory 52 uses, for example, at least one of a semiconductor memory or a magnetic disk. More specifically, the memory 52 uses at least one of a random access memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a solid state drive (SSD), or a hard disk drive (HDD).

[0068] The processing circuit 53 uses, for example, at least one of an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), an SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration).

[0069] As described above, the acoustic control device 10 according to the first embodiment includes an image acquisition unit 11 that acquires an image of the interior of the vehicle cabin 41, a noise acquisition unit 12 that acquires a noise signal corresponding to noise generated in the vehicle cabin 41, a drive-source rotation speed acquisition unit 13 that acquires a drive-source rotation speed signal corresponding to the rotation speed of a drive source mounted in the vehicle, an occupant analysis unit 14 that analyzes the position, state, and behavior of occupants present in the vehicle cabin 41 based on the image acquired by the image acquisition unit 11, an acoustic control unit 15 that controls an anti-phase sound that is anti-phase to the phase of the noise for the occupant, or an in-phase sound that is the same phase as the phase of the noise for the occupant, based on the noise signal acquired by the noise acquisition unit 12, the drive-source rotation speed signal acquired by the drive-source rotation speed acquisition unit 13, and the analysis results of the occupant analysis unit 14, and an acoustic signal generation unit 16 that generates an acoustic signal corresponding to the anti-phase sound or in-phase sound controlled by the acoustic control unit 15, and outputs the generated acoustic signal. Therefore, the sound control device 10 can output sound according to the state of the occupant.

[0070] In the acoustic control device 10 according to the first embodiment, the occupant analysis unit 14 analyzes the occupants seated in each of the seats 42 to 46 in the vehicle interior 41, the acoustic control unit 15 controls anti-phase sounds that are in the opposite phase to the phase of the noise detected by the sound collection devices 22 corresponding to each of the seats 42 to 46, and the acoustic signal generation unit 16 outputs acoustic signals corresponding to the anti-phase sounds to the acoustic output units 31 corresponding to each of the seats 42 to 46. Therefore, the acoustic control device 10 can exert a noise cancellation effect on the occupants no matter where they are seated.

[0071] In the acoustic control device 10 according to the first embodiment, the occupant analysis unit 14 analyzes the occupants seated in the seats 42 to 46 in the vehicle interior 41, and when the occupant analysis unit 14 determines that the alertness level of an occupant seated in any of the seats 43 to 46 other than the driver's seat 42 in the vehicle interior 41 is lower than a predetermined value, or that the occupant is talking on a mobile phone, or that the occupant is feeling uncomfortable, the acoustic control unit 15 controls an anti-phase sound that is the opposite phase to the phase of the noise detected by the sound collection devices 22 corresponding to the seats 43 to 46, and the acoustic signal generation unit 16 outputs an acoustic signal corresponding to the anti-phase sound to the acoustic output units 31 corresponding to the seats 43 to 46. Therefore, the acoustic control device 10 can exert a noise cancellation effect on the occupant no matter where the occupant is seated.

[0072] In the acoustic control device 10 according to the first embodiment, the occupant analysis unit 14 analyzes the driver seated in the driver's seat 42 in the vehicle interior 41 and the driver's level of alertness or concentration. When the occupant analysis unit 14 determines that the driver's level of alertness or concentration is lower than a predetermined value, the acoustic control unit 15 controls an in-phase sound that is in phase with the phase of the noise detected by the sound collection device 22 corresponding to the driver's seat 42, and the acoustic signal generation unit 16 outputs an acoustic signal corresponding to the in-phase sound to the acoustic output unit 31 corresponding to the driver's seat 42. This allows the acoustic control device 10 to enhance the effect of emphasizing noise for the driver. As a result, the acoustic control device 10 is able to restore the driver's level of alertness or concentration.

[0073] It should be noted that, within the scope of the present disclosure, any of the components of the embodiments may be modified or omitted. [Explanation of symbols]

[0074] 10 Acoustic control device, 11 Image acquisition unit, 12 Noise acquisition unit, 13 Drive source rotation speed acquisition unit, 14 Occupant analysis unit, 15 Acoustic control unit, 16 Acoustic signal generation unit, 21 Imaging device, 22 Sound collection device, 22a to 22e Microphone, 23 Drive source control device, 31 Acoustic output unit, 31a to 31d Speaker, 31e Woofer, S1 to S5 Output range of antiphase sound, S1', S5' Output range of inphase sound, 41 Vehicle interior, 42 Driver's seat, 43 Passenger seat, 44 Rear right seat, 45 Rear left seat, 46 Rear center seat, 47 Ceiling surface, 51 Processor, 52 Memory, 53 Processing circuit, 100 Acoustic control system.

Claims

1. an image acquisition unit that acquires an image of the interior of the vehicle; a noise acquisition unit that acquires a noise signal corresponding to noise generated in the vehicle interior; a drive source rotation speed acquisition unit that acquires a drive source rotation speed signal corresponding to the rotation speed of a drive source mounted on the vehicle; an occupant analysis unit that analyzes the position, state, and behavior of an occupant present in the vehicle cabin based on the captured image acquired by the captured image acquisition unit; an acoustic control unit that controls an anti-phase sound that is an anti-phase sound of the noise for the occupant, or an in-phase sound that is an in-phase sound of the noise for the occupant, based on the noise signal acquired by the noise acquisition unit, the drive-source rotation speed signal acquired by the drive-source rotation speed acquisition unit, and the analysis result obtained by the occupant analysis unit; an acoustic signal generating unit that generates an acoustic signal corresponding to the antiphase sound or the inphase sound controlled by the acoustic control unit and outputs the generated acoustic signal; An acoustic control device characterized by:

2. the occupant analysis unit analyzes an occupant seated in a seat in the vehicle interior, the acoustic control unit controls an antiphase sound that has an antiphase to a phase of the noise detected by the sound collection device corresponding to the seat, The acoustic signal generating unit outputs an acoustic signal corresponding to the antiphase sound to the acoustic output unit corresponding to the seat.

2. The acoustic control device according to claim 1.

3. the occupant analysis unit analyzes an occupant seated in a seat in the vehicle interior, the acoustic control unit controls an antiphase sound that is an antiphase of a phase of a noise detected by a sound collection device corresponding to the seat when the occupant analysis unit analyzes that the alertness level of an occupant seated in a seat other than the driver's seat in the vehicle cabin is lower than a predetermined value, or when the occupant is talking on a mobile phone, or when the occupant is feeling uncomfortable; The acoustic signal generating unit outputs an acoustic signal corresponding to the antiphase sound to the acoustic output unit corresponding to the seat.

2. The acoustic control device according to claim 1.

4. the occupant analysis unit analyzes a driver who will be an occupant seated in a driver's seat in the vehicle cabin and the driver's alertness or concentration level, when the occupant analysis unit analyzes that the driver's alertness or concentration is lower than a predetermined value, the acoustic control unit controls an in-phase sound that has the same phase as a phase of a noise detected by a sound collection device corresponding to the driver's seat, The acoustic signal generating unit outputs an acoustic signal corresponding to the in-phase sound to the acoustic output unit corresponding to the driver's seat.

2. The acoustic control device according to claim 1.

5. Computer, an image acquisition unit that acquires an image of the interior of the vehicle; a noise acquisition unit that acquires a noise signal corresponding to noise generated in the vehicle interior; a drive source rotation speed acquisition unit that acquires a drive source rotation speed signal corresponding to the rotation speed of a drive source mounted on the vehicle; an occupant analysis unit that analyzes the position, state, and behavior of an occupant present in the vehicle cabin based on the captured image acquired by the captured image acquisition unit; an acoustic control unit that controls an anti-phase sound that is an anti-phase sound of the noise for the occupant, or an in-phase sound that is an in-phase sound of the noise for the occupant, based on the noise signal acquired by the noise acquisition unit, the drive-source rotation speed signal acquired by the drive-source rotation speed acquisition unit, and the analysis result obtained by the occupant analysis unit; an acoustic signal generating unit that generates an acoustic signal corresponding to the antiphase sound or the inphase sound controlled by the acoustic control unit and outputs the generated acoustic signal; An acoustic control program that functions as a

Images