Vehicle control device and vehicle control method
The vehicle control device addresses passenger anxiety in autonomous driving by implementing noise reduction strategies, such as quieter power sources and noise canceling techniques, to create a more comfortable environment during autonomous driving periods.
Patent Information
- Application Number
- PCT/JP2024/013963
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-21
- Filing Date
- 2024-04-04
- Publication Date
- 2024-11-14
AI Technical Summary
Passengers in vehicles operating under autonomous driving control without driver monitoring experience anxiety due to increased noise levels, which existing technologies fail to adequately address.
A vehicle control device and method that implement noise reduction control by switching to quieter power sources, adjusting interior noise levels, and using noise canceling and masking techniques during autonomous driving periods when the driver is not monitoring the surroundings.
The solution effectively reduces interior noise, thereby alleviating passenger anxiety during autonomous driving by suppressing power generation noise and using audio and acoustic controls to create a quieter environment.
Smart Images

Figure JP2024013963_14112024_PF_FP_ABST
Abstract
Description
Vehicle control device and vehicle control method CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is based on Patent Application No. 2023-078776 filed in Japan on May 11, 2023, and Patent Application No. 2023-156250 filed in Japan on September 21, 2023, and the contents of the base applications are incorporated by reference in their entirety.
[0002] The disclosure in this specification relates to a vehicle control technology used in a vehicle that can travel under autonomous driving control without the driver having to monitor the surroundings.
[0003] Patent Literature 1 describes a vehicle control system that controls automatic driving of a vehicle. A vehicle equipped with the vehicle control system of Patent Literature 1 is assumed to be inhabited by not only a driver but also occupants (hereinafter referred to as passengers) who are not involved in driving.
[0004] Japanese Patent Application Laid-Open No. 2023-47867
[0005] In a vehicle that runs by autonomous driving such as that described in Patent Document 1, passengers are likely to feel uneasy about whether the autonomous driving control is being performed correctly. In particular, when the vehicle is running by autonomous driving control that does not require the driver to monitor the surroundings, and the driver is not monitoring the surroundings, if the noise inside the vehicle increases due to driving, passengers may become more uneasy about the autonomous driving control.
[0006] The present disclosure aims to provide a vehicle control device and a vehicle control method that can reduce the anxiety that passengers who are not involved in driving feel about autonomous driving control.
[0007] In order to achieve the above object, one disclosed aspect is a vehicle control device used in a vehicle that can be driven by autonomous driving control without the driver having to monitor the surroundings, the vehicle control device comprising: a control grasping unit that grasps that the driving control state of the vehicle has been switched to a state in which the vehicle is driven by autonomous driving control; and a noise reduction control unit that performs noise reduction control to make the interior of the vehicle quieter during the automatic driving period in which the vehicle is driven by autonomous driving control than during the monitoring period in which the driver has to monitor the surroundings.
[0008] Another disclosed aspect is a vehicle control method used in a host vehicle that can run under autonomous driving control without the driver having to monitor the surroundings, the vehicle control method including, in processing performed by at least one processing unit, the steps of: recognizing that the driving control state of the host vehicle has been switched to a state in which the host vehicle runs under autonomous driving control; and implementing noise reduction control to make the interior of the host vehicle quieter during an automatic driving period in which the host vehicle runs under autonomous driving control than during a monitoring period in which the driver has an obligation to monitor the surroundings.
[0009] In these aspects, during the automatic driving period in which the host vehicle is driven by the autonomous driving control, noise reduction control is implemented to reduce noise inside the vehicle cabin. Therefore, under driving conditions in which the driver is not monitoring the surroundings, it is possible to reduce the anxiety that passengers who are not involved in driving may feel about the autonomous driving control due to noise inside the vehicle cabin caused by driving.
[0010] It should be noted that the reference numerals in parentheses in the claims merely indicate examples of correspondence with specific configurations in the embodiments described below, and do not limit the technical scope in any way. Furthermore, claims not explicitly stated in the claims may be combined together unless there is a particular problem with the combination.
[0011] 1 is a diagram showing an overall picture of an in-vehicle network including an autonomous driving ECU according to a first embodiment of the present disclosure. FIG. 1 is a block diagram showing details of an autonomous driving ECU. FIG. 2 is a flowchart showing details of a mode switching process performed by the autonomous driving ECU. FIG. 3 is a flowchart showing details of a power control process performed by the autonomous driving ECU in cooperation with the cruise control ECU. FIG. 4 is a flowchart showing details of a window control process performed by the autonomous driving ECU in cooperation with the body ECU. FIG. 5 is a flowchart showing details of a vehicle interior control process performed by the autonomous driving ECU in cooperation with an HMI control device. FIG. 6 is a block diagram showing details of an autonomous driving ECU according to a second embodiment of the present disclosure. FIG. 7 is a diagram showing an example of output timing of background sound output during an autonomous driving period. FIG. 8 is a diagram showing an example of output timing of background sound output during an autonomous driving period. FIG. 9 is a flowchart showing details of an autonomous driving notification process performed by the autonomous driving ECU. FIG. 10 is a flowchart showing details of a behavior change notification process performed by the autonomous driving ECU. FIG. 11 is a flowchart showing details of an emergency vehicle notification process performed by the autonomous driving ECU. FIG. 12 is a flowchart showing details of a driver change notification process performed by the autonomous driving ECU. FIG. 13 is a flowchart showing details of a tranquility control process performed by the autonomous driving ECU.
[0012] Hereinafter, several embodiments will be described with reference to the drawings. Note that corresponding components in each embodiment are given the same reference numerals, and redundant description may be omitted. When only a portion of the configuration is described in each embodiment, the configuration of another embodiment described previously can be applied to the remaining portion of the configuration. Furthermore, in addition to the combinations of configurations explicitly stated in the description of each embodiment, configurations of several embodiments can also be partially combined together even if not explicitly stated, as long as there is no particular problem with the combination.
[0013] (First embodiment) The functions of a vehicle control device according to a first embodiment of the present disclosure are realized by an automatic driving ECU (Electronic Control Unit) 50b shown in Figures 1 and 2. The automatic driving ECU 50b is mounted on a vehicle (hereinafter, referred to as the host vehicle Am) together with a driving assistance ECU 50a. The automatic driving ECU 50b and the driving assistance ECU 50a, etc., constitute an automatic driving system 50 of the host vehicle Am. By mounting the automatic driving system 50, the host vehicle Am becomes an automatic driving vehicle equipped with an automatic driving function and is capable of traveling using the automatic driving function (autonomous driving control).
[0014] The driving assistance ECU 50a is an in-vehicle ECU that implements driving assistance functions that assist the driver in driving operations in the automated driving system 50. The driving assistance ECU 50a enables advanced driving assistance or partial automated driving at approximately Level 2, according to the automated driving levels defined by the Society of Automotive Engineers. The automated driving performed by the driving assistance ECU 50a is automated driving with a periphery monitoring obligation, which requires the driver to visually monitor the area around the vehicle. For example, driving assistance functions such as ACC (Adaptive Cruise Control), LTC (Lane Trace Control), and LCA (Lane Change Assist) are implemented by the driving assistance ECU 50a.
[0015] The autonomous driving ECU 50b is an in-vehicle ECU that realizes an autonomous driving function that can take over driving operations from the driver. The autonomous driving ECU 50b is capable of autonomous driving at level 3 or higher, where the system is the main controller. Level 3 autonomous driving performed by the autonomous driving ECU 50b is eyes-off autonomous driving, where the driver is not required to monitor the surroundings and does not need to monitor the area around the vehicle. The autonomous driving ECU 50b may be capable of autonomous driving at level 4 or higher. Level 4 autonomous driving is fully autonomous driving, where all driving tasks are performed by the system, and is brain-off autonomous driving, where the driver is not requested to take over driving.
[0016] In the autonomous driving system 50, the control state of the autonomous driving function is switched among a plurality of control states including at least driving assistance control by the driving assistance ECU 50a, which requires monitoring of the surroundings, and autonomous driving control by the autonomous driving ECU 50b, which does not require monitoring of the surroundings. In the following description, autonomous driving control of level 2 or lower by the driving assistance ECU 50a will be referred to as "driving assistance control," and autonomous driving control of level 3 or higher by the autonomous driving ECU 50b will be referred to as "autonomous driving control."
[0017] During the autonomous driving period in which the host vehicle Am is driven by the autonomous driving control of the autonomous driving ECU 50b, the driver may be permitted to perform a predetermined specific action other than driving (hereinafter referred to as a second task). The driver is legally permitted to perform the second task until a driving change request is made by the autonomous driving ECU 50b in cooperation with the HMI (Human Machine Interface) control device 100. For example, actions such as watching entertainment content such as videos, operating a device such as a smartphone, and eating are considered as second tasks.
[0018] The driving assistance ECU 50a and the autonomous driving ECU 50b are communicatively connected to a communication bus 99 of an in-vehicle network 1 mounted in the host vehicle Am. The communication bus 99 is connected to an in-vehicle monitor device 29, a periphery monitoring sensor 30, a locator 35, a navigation ECU 38, an in-vehicle communication device 39, a driving control ECU 40, a body ECU 43, an HMI control device 100, and the like. These nodes connected to the communication bus 99 can communicate with each other. Certain nodes among these ECUs, etc. may be directly electrically connected to each other and be able to communicate without going through the communication bus 99.
[0019] The interior monitor device 29 includes a plurality of interior cameras for capturing images of the interior of the vehicle Am and a control unit for controlling the plurality of interior cameras. The interior cameras may be visible light cameras or near-infrared cameras combined with near-infrared light sources. At least one of the interior cameras is installed so as to be able to capture an image of a passenger (driver) seated in the driver's seat and functions as a driver monitor.
[0020] The in-vehicle monitor device 29 provides the HMI control device 100, the automatic driving ECU 50b, etc. with images captured by the interior camera or the results of analyzing the captured images as in-vehicle monitor information. The in-vehicle monitor information includes information indicating the number of passengers on board, information on the type of each passenger (adult, child, elderly, etc.), and information indicating the status of each passenger (whether sleeping or not). Furthermore, the in-vehicle monitor information includes driver status information indicating the position and line of sight of the driver, etc.
[0021] The perimeter monitoring sensor 30 is an autonomous sensor that monitors the environment surrounding the host vehicle Am. The perimeter monitoring sensor 30 includes, for example, one or more of a camera unit, a millimeter-wave radar, a lidar, and a sonar. The perimeter monitoring sensor 30 is capable of detecting moving objects and stationary objects within a detection range around the host vehicle. The perimeter monitoring sensor 30 provides detection information of objects around the host vehicle to the driving assistance ECU 50a, the autonomous driving ECU 50b, etc.
[0022] The locator 35 includes a GNSS (Global Navigation Satellite System) receiver, an inertial sensor, etc. The locator 35 sequentially determines the position and traveling direction of the host vehicle Am by combining positioning signals received from multiple positioning satellites by the GNSS receiver, measurement results from the inertial sensor, and vehicle speed information output to the communication bus 99. The locator 35 sequentially outputs position information and direction information of the host vehicle Am based on the positioning results to the communication bus 99 as locator information.
[0023] The locator 35 further includes a map database that stores map data. The map database is primarily composed of a large-capacity storage medium that stores a large amount of three-dimensional map data and two-dimensional map data. The three-dimensional map data is a so-called high-definition (HD) map and includes road information necessary for autonomous driving. Specifically, the three-dimensional map data includes three-dimensional road shape information and detailed information about each lane. The locator 35 can update the three-dimensional map data and two-dimensional map data to the latest information through external communication via the on-board communication device 39. The locator 35 reads map data about the area around the current location from the map database and provides it to the driving assistance ECU 50a, the autonomous driving ECU 50b, etc., along with locator information.
[0024] The navigation ECU 38 acquires information about a destination specified by a passenger such as a driver based on operation information acquired from the HMI control device 100. The navigation ECU 38 acquires vehicle position information and direction information from the locator 35 and sets a route from the current position to the destination. The navigation ECU 38 provides route information indicating the set route to the destination to the driving assistance ECU 50a, the autonomous driving ECU 50b, the HMI control device 100, etc. The navigation ECU 38 works in conjunction with the HMI system 10 (described later) to provide route guidance to the destination by combining screen displays and voice messages, etc., and notifying the driver of the direction of travel of the vehicle Am at intersections, branching points, etc.
[0025] Here, a user terminal such as a smartphone or a tablet may be connected to the in-vehicle network 1 or the HMI control device 100. Such a user terminal may provide vehicle position information, direction information, map data, etc. to the driving assistance ECU 50a, the automatic driving ECU 50b, etc., instead of the locator 35. Furthermore, the user terminal may provide route information to a destination to the driving assistance ECU 50a, the automatic driving ECU 50b, the HMI control device 100, etc., instead of the navigation ECU 38. Furthermore, the user terminal may play video content, etc., instead of the HMI system 10 described below, or together with the HMI system 10.
[0026] The in-vehicle communication device 39 is an external communication unit mounted on the host vehicle Am and functions as a V2X (Vehicle to Everything) communication device. The in-vehicle communication device 39 transmits and receives information via wireless communication with roadside devices installed on the side of the road. As an example, the in-vehicle communication device 39 receives congestion information, traffic regulation information, and the like from the roadside devices. The congestion information and traffic regulation information are, for example, VICS (registered trademark) information. The in-vehicle communication device 39 may further receive, from the roadside devices, traffic signal information indicating the lighting patterns of traffic signals, as well as detection information of stopped vehicles, parked vehicles, pedestrians, cyclists, and the like. The in-vehicle communication device 39 provides the received congestion information, traffic regulation information, traffic signal information, detection information, and the like to the navigation ECU 38, the autonomous driving ECU 50b, the HMI control device 100, and the like.
[0027] The cruise control ECU 40 is an electronic control device that mainly includes a microcontroller. The cruise control ECU 40 generates vehicle speed information indicating the current traveling speed of the host vehicle Am based on detection signals from wheel speed sensors provided at the hub portions of each wheel, and sequentially outputs the generated vehicle speed information to the communication bus 99. The cruise control ECU 40 has at least the functions of a brake control ECU, a drive control ECU, and a steering control ECU. The cruise control ECU 40 continuously controls the braking force of each wheel, the output control of the power generation device 41, and the steering angle based on any one of an operation command based on the driver's driving operation, a control command from the driving assistance ECU 50a, and a control command from the automatic driving ECU 50b.
[0028] The power generating device 41 is mounted on the host vehicle Am and generates power for propelling the host vehicle Am. The power generating device 41 is, for example, a hybrid power unit including multiple power sources, such as an internal combustion engine that burns fuel such as gasoline or diesel, and a motor generator for driving. The power generating device 41 may include only one of the internal combustion engine and the motor generator, in other words, may be configured mainly with a single power source.
[0029] The cruise control ECU 40 switches the drive mode of the host vehicle Am based on operation information acquired from the HMI control device 100. The cruise control ECU 40 has drive mode options preset, such as normal mode, eco mode, comfort mode, and sport mode. The cruise control ECU 40 changes the driving characteristics of the host vehicle Am based on the switching of the drive mode. The eco mode is a drive mode that prioritizes fuel economy or electricity consumption over the standard normal mode. The comfort mode is a drive mode that prioritizes ride comfort over the normal mode. The sport mode is a drive mode that prioritizes driving performance over the normal mode. The state of the drive mode set in the cruise control ECU 40 is notified to the driver by switching the display mode by the HMI control device 100. For example, when the drive mode is the sport mode, a tachometer is displayed on the meter display 21.
[0030] The body ECU 43 is an electronic control device that mainly includes a microcontroller. The body ECU 43 has a function of controlling various on-board devices installed in the host vehicle Am. A power window (hereinafter, PW) actuator 44 is connected to the body ECU 43 as one of the various on-board devices. The body ECU 43 controls the operation of the PW actuator 44 based on a user operation input to a power window switch provided on a door of the host vehicle Am, thereby opening and closing (raising and lowering) the side window of the host vehicle Am.
[0031] The HMI control device 100, together with a plurality of display devices, an audio device 24, an ambient light 25, an operation device 26, an in-vehicle acoustic sensor 27, etc., constitutes an HMI system 10. The HMI system 10 has an input interface function that accepts operations by a passenger such as a driver of the vehicle Am, and an output interface function that presents information to the driver.
[0032] The display devices present information to the driver's vision by displaying images, etc. The display devices include a meter display 21, a center information display (hereinafter referred to as CID) 22, and a head-up display (hereinafter referred to as HUD) 23. The CID 22 has a touch panel function and detects touch operations on the display screen by the driver, etc.
[0033] The audio device 24 has multiple speakers installed in the vehicle cabin. The audio device 24 reproduces, for example, notification sounds or voice messages through the speakers. The ambient lights 25 are provided on the instrument panel, steering wheel, etc. The ambient lights 25 present information to the driver's peripheral vision through ambient displays that change the color of their emitted light.
[0034] The operation device 26 is an input unit that accepts user operations by the driver or the like. User operations related to activation and deactivation of the autonomous driving function, user operations related to setting a destination for route guidance, etc. are input to the operation device 26. Furthermore, user operations related to the implementation of noise reduction control, which will be described later, are input to the operation device 26. The operation device 26 includes a steering switch provided on the spokes of the steering wheel, an operation lever provided on the steering column, and a voice input device that recognizes what the driver is saying.
[0035] The interior acoustic sensor 27 is configured to mainly include a microphone element such as a MEMS microphone or a condenser microphone. The interior acoustic sensor 27 detects sounds occurring within the vehicle cabin by converting vibrations in the air within the vehicle cabin into an electrical signal using the microphone element. The interior acoustic sensor 27 mainly detects noise transmitted from outside the vehicle into the vehicle cabin. Multiple interior acoustic sensors 27 may be provided within the vehicle cabin so as to detect noise from multiple locations within the vehicle cabin.
[0036] The HMI control device 100 is a computer that mainly includes a control circuit equipped with a processing unit 11, RAM 12, storage unit 13, input / output interface 14, and a bus connecting these. The HMI control device 100 functions as a presentation control device and comprehensively controls the presentation of information using a plurality of display devices, an audio device 24, ambient light 25, etc. The HMI control device 100 presents information related to autonomous driving in cooperation with the autonomous driving system 50. For example, when the autonomous driving ECU 50b plans to end autonomous driving control, the HMI control device 100 issues a notification requesting the driver to take over driving.
[0037] The HMI control device 100 acquires operation information indicating the content of user operations from the CID 22, the operation device 26, etc. The HMI control device 100 provides operation information of user operations related to the autonomous driving function, information related to noise inside the vehicle cabin detected by the interior acoustic sensor 27 (hereinafter referred to as interior noise information), etc. to the autonomous driving ECU 50b. The HMI control device 100 also provides operation information of a user operation for setting a destination of the host vehicle Am to the navigation ECU 38.
[0038] The HMI control device 100 has a noise canceling function and a noise masking function in addition to a function for playing content such as videos and music. The HMI control device 100 is provided with a noise canceling control unit 81 for realizing the noise canceling function and an onomatopoeia generating unit 82 for realizing the noise masking function. The noise canceling control unit 81 and the onomatopoeia generating unit 82 may be configured to output sound into the vehicle cabin using a speaker of the audio device 24, or may be configured to output sound into the vehicle cabin using a dedicated speaker.
[0039] The noise canceling control unit 81 and the onomatopoeia generation unit 82 acquire the waveform of noise inside the vehicle cabin detected by the interior acoustic sensor 27. The noise canceling control unit 81 outputs sound waves with a waveform that is in opposite phase to the noise from the speaker into the vehicle cabin. The noise canceling control unit 81 reduces the noise inside the vehicle cabin by canceling out at least a portion of the noise with the opposite phase sound waves. The onomatopoeia generation unit 82 analyzes the waveform of the noise and generates onomatopoeia with a frequency and volume that makes the noise less audible to the occupants. The onomatopoeia generation unit 82 outputs the generated onomatopoeia from the speaker into the vehicle cabin, masking the noise with the onomatopoeia, thereby reducing the noise inside the vehicle cabin as perceived by the occupants.
[0040] Next, the automatic driving ECU 50b will be described in further detail.
[0041] The autonomous driving ECU 50b has a higher computing power than the driving assistance ECU 50a and can perform at least driving control equivalent to ACC, LTC, and LCA. In situations where the autonomous driving control is temporarily suspended, the autonomous driving ECU 50b may be able to perform driving assistance control in which the driver is responsible for monitoring the surroundings, in place of the driving assistance ECU 50a.
[0042] The autonomous driving ECU 50b is a computer that mainly includes a control circuit equipped with a processing unit 51, RAM 52, storage unit 53, input / output interface 54, and a bus connecting these units. The processing unit 51 accesses the RAM 52 to execute various processes (instructions) for implementing the autonomous driving control method and vehicle control method according to the present disclosure. The storage unit 53 stores various programs (autonomous driving control program, vehicle control program, etc.) executed by the processing unit 51. As the processing unit 51 executes the programs, the autonomous driving ECU 50b is configured with an information linkage unit 61, an environment recognition unit 62, an action determination unit 63, a control execution unit 64, an equipment control unit 65, etc. as functional units for implementing the autonomous driving function and vehicle control function (see FIG. 2 ).
[0043] The information linking unit 61 provides information to the HMI control device 100 and acquires information from the HMI control device 100 and the in-vehicle monitor device 29. The information linking unit 61 has an HMI information acquisition unit 71, a notification request unit 72, and an in-vehicle monitoring unit 73 as sub-functional units for information linking with the HMI control device 100 and the in-vehicle monitor device 29.
[0044] The HMI information acquisition unit 71 grasps the content of user operations input by the driver or the like to the CID 22 and the operation device 26, etc., based on operation information acquired from the HMI control device 100. The HMI information acquisition unit 71 grasps, for example, a level 2 transition operation that instructs a transition from manual driving to driving assistance control, and a level 3 transition operation that instructs a transition from driving assistance control to autonomous driving control. The HMI information acquisition unit 71 also grasps an approval operation that approves the implementation of noise reduction control, which will be described later. In addition, the HMI information acquisition unit 71 grasps the status of content playback by the audio device 24.
[0045] The notification request unit 72 enables the HMI control device 100 to issue a notification synchronized with the operating state of the autonomous driving function by outputting a notification implementation request to the HMI control device 100. For example, when the end of autonomous driving control is scheduled, the notification request unit 72 outputs a notification implementation request requesting a driver change to the HMI control device 100. The notification request unit 72 also outputs a notification implementation request related to noise reduction control, which will be described later, to the HMI control device 100.
[0046] The interior monitoring unit 73 monitors the situation inside the vehicle cabin using interior monitor information acquired from the interior monitoring device 29 and interior noise information acquired from the HMI control device 100. Specifically, the interior monitoring unit 73 continuously monitors the driver's driving posture, line of sight, whether or not the driver is monitoring the surroundings, whether or not the driver is performing a second task, and the driver's level of alertness. Furthermore, the interior monitoring unit 73 detects any abnormalities in the driver's physical condition. Additionally, based on the interior monitor information, the interior monitoring unit 73 determines whether or not there are specific types of passengers in the vehicle cabin who would benefit from noise reduction through noise reduction control, such as children and sleeping passengers. Note that the passengers who would benefit from noise reduction are not limited to the above-mentioned children and sleeping passengers, and may be changed as appropriate.
[0047] The environment recognition unit 62 recognizes the driving environment of the host vehicle Am by combining the locator information and map data acquired from the locator 35 with the detection information acquired from the perimeter monitoring sensor 30 and the in-vehicle communication device 39. The environment recognition unit 62 acquires vehicle speed information indicating the current driving speed from the communication bus 99 as information indicating the state of the host vehicle Am.
[0048] The environment recognition unit 62 has a target recognition unit 74 and a road recognition unit 75 as sub-functional units for recognizing the driving environment. The target recognition unit 74 recognizes the relative positions and relative speeds of dynamic targets around the vehicle, such as other vehicles traveling around the vehicle Am. The target recognition unit 74 recognizes the approach of emergency vehicles, such as police vehicles, fire engines, and ambulances, to the vehicle Am. The road recognition unit 75 acquires road information related to the road on which the vehicle Am is traveling or is scheduled to travel. The environment recognition unit 62 sequentially provides the information recognized by the target recognition unit 74 and the road recognition unit 75, i.e., the recognition results of the driving environment, to the action determination unit 63.
[0049] The behavior determination unit 63 cooperates with the driving assistance ECU 50a and the HMI control device 100 to control the autonomous driving system 50 and driving handovers between drivers. When the autonomous driving ECU 50b has control of driving operations, the behavior determination unit 63 generates a planned driving line for the host vehicle Am to travel on, based on the results of recognition of the driving environment by the environment recognition unit 62, and outputs the generated planned driving line to the control execution unit 64. The behavior determination unit 63 has a control switching unit 76 and an evacuation control unit 77 as sub-functional units for controlling the operating state of the autonomous driving function.
[0050] The control switching unit 76 cooperates with the driving assistance ECU 50a to switch the driving control state of the host vehicle Am among manual driving (control off), level 2 driving assistance control in which the driver is obligated to monitor the surroundings, and level 3 autonomous driving control in which the driver is not obligated to monitor the surroundings. When the control switching unit 76 switches the driving control state of the host vehicle Am using the automatic driving function, it grasps the current driving control state after switching. The control switching unit 76 provides control state information indicating the current driving control state to the information linkage unit 61 and the like. The control state information is provided to the HMI control device 100 and the like via the information linkage unit 61.
[0051] The evacuation control unit 77 performs emergency evacuation control based on the occurrence of an abnormality related to the host vehicle Am. The emergency evacuation control is vehicle control that stops the host vehicle Am at an evacuation location. The evacuation location is set within the lane in which the host vehicle Am is traveling or on the side of the road (shoulder) of the road in which the host vehicle Am is traveling. The evacuation control unit 77 may be able to set the evacuation location in an emergency parking lane, a roadside strip, a parking area, etc. The evacuation control unit 77 decides to perform emergency evacuation control when the in-vehicle monitoring unit 73 detects an abnormality in the driver's physical condition or when the target recognition unit 74 detects the approach of an emergency vehicle.
[0052] When the autonomous driving ECU 50b has control of the driving operation, the control execution unit 64 cooperates with the cruise control ECU 40 to execute acceleration / deceleration control, steering control, and the like of the host vehicle Am in accordance with the planned driving line generated by the action determination unit 63. Specifically, the control execution unit 64 generates control commands based on the planned driving line and outputs the generated control commands to the cruise control ECU 40 one after another.
[0053] The equipment control unit 65 controls the operation of various in-vehicle equipment mounted on the host vehicle Am in association with the operation of the autonomous driving function by outputting control commands to the body ECU 43. The equipment control unit 65 cooperates with the body ECU 43 and controls the PW actuator 44 to adjust the open / closed state of each window of the host vehicle Am during the autonomous driving period.
[0054] [Level 3 Noise Reduction Control During Autonomous Driving] In the autonomous vehicle described above, the driver does not perform driving operations or monitor the surroundings during the autonomous driving period. At this time, the autonomous driving system 50 may perform control to increase the rotation speed of the internal combustion engine or motor generator of the power generation device 41, for example, when accelerating to a vehicle speed set by the autonomous driving control. In such a situation, passengers who are not participating in driving may feel uneasy about whether the autonomous driving is being controlled correctly due to the noise inside the vehicle cabin caused by the operation of the internal combustion engine or motor generator.
[0055] For this reason, the behavior determination unit 63 of the autonomous driving ECU 50b is further provided with a noise reduction control unit 78 as a sub-functional unit based on the vehicle control program. During an automatic driving period in which the host vehicle Am is driving under autonomous driving control, the noise reduction control unit 78 performs noise reduction control to reduce noise inside the vehicle cabin of the host vehicle Am, rather than during a monitoring period in which the driver is required to monitor the surroundings. The monitoring period includes a period in which the host vehicle Am is driving under driving assistance control including hands-on control or hands-off control, and a period in which the host vehicle Am is driving manually. The noise reduction control unit 78 performs power control and vehicle interior control as noise reduction control. Details of the power control and vehicle interior control, and details of notifications related to the noise reduction control will be described below.
[0056] <Power Control for Noise Reduction> Power control is vehicle control that suppresses vibrations of the power generation device 41, which cause noise inside the vehicle cabin. The noise reduction control unit 78 cooperates with the control execution unit 64 and the driving control ECU 40 to perform power selection control and power suppression control as power control for noise reduction.
[0057] The power selection control is a vehicle control that, when the power generating device 41 mounted on the host vehicle Am includes multiple power sources such as an internal combustion engine and a motor generator, prioritizes the operation of a quieter power source (i.e., a motor generator) among the multiple power sources. As the power selection control, the noise reduction control unit 78 stops the internal combustion engine and runs the host vehicle Am in a so-called EV mode using the power generated by the motor generator. When the power generating device 41 includes multiple (two) motor generators for running, the noise reduction control unit 78 may, as the power selection control, operate only the motor generator that produces the least vibration and noise among the multiple motor generators.
[0058] Power suppression control is vehicle control that suppresses the rotational speed (number of revolutions) of the internal combustion engine or motor generator included as a power source in the power generating device 41. The silent control unit 78 realizes power suppression control by applying shift control that shifts up at a low rotational speed, acceleration control that suppresses acceleration to a low level, or the like.
[0059] When the evacuation control unit 77 performs emergency evacuation control due to the approach of an emergency vehicle, the silence control unit 78 suspends the power selection control and the power suppression control. Furthermore, when the evacuation control unit 77 performs emergency evacuation control due to the occurrence of a driver abnormality, the silence control unit 78 determines whether the power selection control and the power suppression control will interfere with the emergency evacuation control. When the silence control unit 78 determines that the power selection control and the power suppression control will not interfere with the emergency evacuation control, the silence control unit 78 continues to perform (continue) the power selection control and the power suppression control even during the evacuation travel period in which the host vehicle Am travels under the emergency evacuation control. On the other hand, when the silence control unit 78 determines that the power selection control and the power suppression control will interfere with the emergency evacuation control, the silence control unit 78 suspends the power selection control and the power suppression control during the evacuation travel period. For example, when emergency evacuation control is planned that requires acceleration or maintaining a high speed, such as when a lane change is required to move to an evacuation location, the power selection control and the power suppression control are suspended.
[0060] Silence control unit 78 can relax the power suppression control. Specifically, silence control unit 78 relaxes the power suppression control when content is being played by audio device 24 inside the vehicle. As the volume of the content being played increases, silence control unit 78 relaxes the power suppression control, allowing the internal combustion engine or the motor generator to operate at a high rotational speed.
[0061] In addition, if implementing the power suppression control would prevent the traveling speed of the host vehicle Am from reaching a high set vehicle speed (e.g., 200 km / h) set by the driver, the silence control unit 78 relaxes the power suppression control until the set vehicle speed is reached. After reaching the set vehicle speed, the silence control unit 78 determines whether the set vehicle speed can be maintained even if relaxation of the power suppression control is ended. If the set vehicle speed can be maintained, the silence control unit 78 ends relaxation of the power suppression control. On the other hand, if the set vehicle speed cannot be maintained, the silence control unit 78 continues relaxing the power suppression control, allowing cruising at the set vehicle speed.
[0062] <Vehicle Interior Control for Silence Reduction> Vehicle interior control is vehicle control that reduces noise generated in the vehicle interior or makes the noise less audible. The silence control unit 78 cooperates with the information linkage unit 61 and the HMI control device 100, or the device control unit 65 and the body ECU 43, and performs volume adjustment control, noise canceling control, noise masking control, and opening / closing control as vehicle interior control for silence reduction.
[0063] The volume adjustment control is a control to increase the volume of content being played by the audio device 24 in the vehicle cabin. When content is being played by the audio device 24, the silence control unit 78 cooperates with the notification request unit 72 to request the HMI control device 100 to gradually increase the volume of the content being played. As the volume adjustment control, the HMI control device 100 increases the volume of the audio device 24 by a predetermined level. Upon completion of the volume adjustment control, the HMI control device 100 reduces the volume of the audio device 24 to the level before the control started.
[0064] As described above, noise canceling control is a control that reproduces, in the vehicle cabin, a sound with a waveform that is in opposite phase to the noise. The noise canceling control unit 81 adjusts the degree of noise canceling effect for each passenger in the vehicle cabin. Specifically, the noise canceling control unit 81 makes the noise canceling effect for the driver sitting in the driver's seat lower than the noise canceling effect for passengers sitting in other seats. In other words, noise from the passenger seats is reduced more than noise from the driver's seat.
[0065] As described above, the noise masking control is a control for reproducing an onomatopoeic sound in the vehicle cabin to mask the noise. In response to a request from the notification request unit 72, the onomatopoeic sound generator 82 outputs an onomatopoeic sound that makes the noise in the vehicle cabin less audible to the occupants, thereby reducing the noise perceived by the occupants including the driver.
[0066] The opening / closing control is a control for adjusting the open / closed state of the windows provided in the host vehicle Am to reduce noise inside the vehicle cabin. For example, when a specific window is wide open or when only one window is open, noise associated with driving is likely to be generated. In response to a request from the equipment control unit 65, the body ECU 43 adjusts the open / closed state of each window while maintaining a balance between the left and right windows so as to prevent noise inside the vehicle cabin. In principle, the body ECU 43 controls to close each window. As opening / closing control, the body ECU 43 may also adjust all windows to a fully closed state.
[0067] <Notification Related to Noise Reduction Control> The notification request unit 72 cooperates with the HMI control device 100 to issue a notification (hereinafter referred to as an inquiry notification) inquiring of the driver as to whether or not to implement noise reduction control. The inquiry notification as to whether or not noise reduction control is required is issued based on a switch from driving assistance control or the like to autonomous driving control, and before the driver starts the second task. Specifically, the HMI control device 100 issues the inquiry notification using the CID 22 on which video content or the like related to the second task is displayed, before playback of the video content or the like starts. If the driver approves the implementation of noise reduction control in response to the inquiry notification, the noise reduction control unit 78 implements noise reduction control.
[0068] [Processes Related to Noise Reduction Control] Next, the details of the mode switching process, power control process, window control process, and vehicle interior control process performed by the autonomous driving system 50 to realize the noise reduction control described above will be further explained based on Figures 3 to 6 and with reference to Figures 1 and 2.
[0069] 3 is a process for switching between a silent mode in which silent control is performed and a normal mode in which silent control is not performed. The mode switching process is started by the autonomous driving ECU 50b when the control switching unit 76 switches the control state (autonomous driving level) of the autonomous driving function.
[0070] In S11 of the mode switching process, the control execution unit 64 determines the current drive mode set in the cruise control ECU 40. In S12, the silence control unit 78 determines whether the current drive mode is set to a sport mode that prioritizes driving performance. If the drive mode is set to the sport mode (S12: YES), the silence control unit 78 sets the drive mode to a normal mode in which silence control is not performed in S19. As a result, when the tachometer is displayed on the meter display 21, silence control is not performed.
[0071] On the other hand, if the drive mode is set to a mode other than the sport mode (S12: NO), the control switching unit 76 determines the driving control state of the host vehicle Am, i.e., the current autonomous driving level, in S13. For example, if a control transition to real-time driving control has been performed, the control switching unit 76 determines in S13 that the driving control state of the host vehicle Am has been switched to a state in which the host vehicle Am drives under autonomous driving control.
[0072] In S14, the control switching unit 76 determines whether the driving control state of the host vehicle Am is at autonomous driving level 3 or higher. If the driving control state of the host vehicle Am is below level 3 (S14: NO), the silencing control unit 78 sets the host vehicle Am to a normal mode in which silencing control is not performed in S19. On the other hand, if the driving control state of the host vehicle Am is at level 3 or higher (S14: YES), the interior monitoring unit 73 determines the situation inside the vehicle based on the interior monitor information and interior noise information in S15. In S15, the interior monitoring unit 73 determines at least the type of occupant in the vehicle cabin.
[0073] In S16, the interior monitoring unit 73 determines whether a specific type of occupant for whom noise reduction is useful is present in the vehicle cabin. If a specific type of occupant, such as a child or a sleeping occupant, is present in the vehicle cabin (S16: YES), the noise reduction control unit 78 sets the vehicle to a noise reduction mode in S20, which implements noise reduction control. On the other hand, if a specific type of occupant is not present in the vehicle cabin (S16: NO), the notification request unit 72 issues an inquiry notification based on switching to autonomous driving control in S17.
[0074] In S18, the HMI information acquisition unit 71 determines whether operation information of a user operation approving the implementation of silencing control has been acquired from the HMI control device 100. If the HMI information acquisition unit 71 has acquired operation information (S18: YES), i.e., if the implementation of silencing control has been approved by the driver, the silencing control unit 78 sets the mode to a silencing mode in which silencing control is implemented in S20. On the other hand, if operation information is not acquired within a predetermined time (S18: NO), i.e., if the implementation of silencing control has not been approved by the driver, the silencing control unit 78 sets the mode to a normal mode in which silencing control is not implemented in S19.
[0075] 4 is a process for switching between performing and stopping the power selection control and the power suppression control. The power control process is repeatedly performed by the automatic driving ECU 50b during the automatic traveling period.
[0076] In S31 of the power control process, the silence control unit 78 determines the control mode set in the mode switching process (see FIG. 3). In S32, the silence control unit 78 determines whether the control mode is set to the silence mode. If the control mode is set to the normal mode (S32: NO), the silence control unit 78 turns off the silence control (power control) including the power selection control and the power suppression control in S37.
[0077] On the other hand, if the control mode is set to the silent mode (S32: YES), the target recognition unit 74 recognizes the approach of an emergency vehicle to the host vehicle Am in S33. If the approach of an emergency vehicle is recognized (S33: YES), the silent control unit 78 turns the silent control off in S37. This stops the power suppression control and the like. On the other hand, if an emergency vehicle is not approaching the host vehicle Am (S33: NO), the silent control unit 78 determines in S34 whether emergency evacuation control is being performed.
[0078] If emergency evacuation control is being performed (S34: YES), the silence control unit 78 (action determination unit 63) determines in S35 whether power control for noise reduction will interfere with the emergency evacuation control. If it is determined that power control may interfere with the emergency evacuation control (S35: YES), the silence control unit 78 turns off the silence control, including the power selection control and the power suppression control, in S37. On the other hand, if emergency evacuation control is not being performed (S34: NO), or if it is determined that power control is not likely to interfere with the emergency evacuation control (S35: NO), the silence control unit 78 turns on the silence control in S36. This allows the power selection control, which preferentially operates the quiet motor generator, and the power suppression control, which suppresses the rotational speed of the power generation device 41.
[0079] In S38, the behavior determination unit 63 determines whether the traveling speed of the host vehicle Am reaches the set speed while the power suppression control is being implemented. If the traveling speed of the host vehicle Am will not reach the set vehicle speed if the power suppression control is implemented (S38: YES), the silence control unit 78 relaxes the power suppression control in S40. In this case, the power selection control may also be interrupted. The silence control unit 78 continues to at least relax the power suppression control until the traveling speed of the host vehicle Am reaches the set vehicle speed.
[0080] If the traveling speed of the host vehicle Am reaches the set vehicle speed even when the power suppression control is implemented (S38: NO), in S39 the HMI information acquisition unit 71 determines the state of content playback by the audio device 24 in the vehicle cabin. If content playback is being performed in the vehicle cabin (S39: YES), the silence control unit 78 relaxes the power suppression control in S40. In this case, the power suppression control may be turned off. On the other hand, if content playback is not being performed in the vehicle cabin (S39: NO), the silence control unit 78 stops relaxing the power suppression control in S41.
[0081] 5 is a process for adjusting the open / closed state of the window to reduce noise inside the vehicle cabin by performing open / close control. The window control process is repeatedly performed by the autonomous driving ECU 50b during the autonomous driving period.
[0082] In S51 of the window control process, the silence control unit 78 determines the control mode set in the mode switching process (see FIG. 3 ). In S52, the silence control unit 78 determines whether the control mode has been switched to the silence mode. If the control mode has not been switched to the silence mode (NO in S52), the window control process ends. On the other hand, if the control mode has been switched to the silence mode (YES in S52), the silence control unit 78 determines the open / closed state of the windows provided in the host vehicle Am through the device control unit 65 and the body ECU 43 in S53. Furthermore, in S54, the silence control unit 78 cooperates with the device control unit 65 and the body ECU 43 to perform window opening / closing control to reduce noise inside the vehicle cabin.
[0083] 6 is a process for controlling the execution of vehicle interior control in cooperation with the HMI control device 100. The vehicle interior control process is repeatedly performed by the autonomous driving ECU 50b during the autonomous driving period.
[0084] In S61 of the interior control process, the silent control unit 78 determines the control mode set in the mode switching process (see FIG. 3). In S62, the silent control unit 78 determines whether the control mode has been switched to the silent mode. If the control mode has not been switched to the silent mode (S62: NO), the interior control process ends.
[0085] On the other hand, if the silent mode has been switched to (S62: YES), the behavior determination unit 63 determines in S63 whether the traveling speed of the host vehicle Am will reach the set speed while the power suppression control is being implemented. If the traveling speed of the host vehicle Am will not reach the set vehicle speed if the power suppression control is implemented (S63: YES), in S64 the notification request unit 72 cooperates with the HMI control device 100 to issue a notification indicating that the set vehicle speed will not be reached as a warning of insufficient vehicle speed. The warning of insufficient vehicle speed in S64 may be issued even when the power suppression control is relaxed (see S40 in FIG. 4 ).
[0086] Furthermore, the silence control unit 78 cooperates with the notification request unit 72 and the HMI control device 100 to perform volume adjustment control (S65), noise canceling control (S66), and noise masking control (S67). The order in which each control is performed may be changed as appropriate. In addition, some controls may not be performed.
[0087] In the first embodiment described above, noise reduction control is performed during an automatic driving period in which the host vehicle Am is driven by the autonomous driving control, and the interior of the host vehicle Am can be made quieter. Therefore, in a driving state in which the driver is not monitoring the surroundings, it is possible to suppress the anxiety that passengers who are not involved in driving may feel about the autonomous driving control due to noise inside the vehicle cabin caused by driving.
[0088] Additionally, in the first embodiment, power suppression control that suppresses the rotation speed of the power generating device 41 mounted on the host vehicle Am is implemented as noise reduction control. Such power suppression control can effectively reduce noise inside the vehicle cabin that accompanies driving. As a result, passenger anxiety can be further reduced.
[0089] In the first embodiment, the state of content playback by the audio device 24 in the vehicle cabin is monitored, and if content playback is occurring in the vehicle cabin, the power suppression control is relaxed. If media content is being played in the vehicle cabin, passengers are less likely to feel uneasy even if the cabin is a little noisy. Therefore, the power suppression control may be relaxed to allow the cabin to become noisy.
[0090] Furthermore, in the first embodiment, the approach of an emergency vehicle to the host vehicle Am is detected. When the approach of the emergency vehicle is detected, the power suppression control is stopped. Therefore, travel control to avoid the emergency vehicle can be quickly implemented without being hindered by the power suppression control.
[0091] Furthermore, in the first embodiment, when emergency evacuation control is implemented based on the occurrence of an abnormality related to the host vehicle Am, the silence control unit 78 determines whether the power suppression control will interfere with the emergency evacuation control. If it is determined that the power suppression control will not interfere with the emergency evacuation control, the power suppression control is implemented during the evacuation travel period in which the host vehicle Am travels under the emergency evacuation control. As a result, the power generation device 41 is prevented from rotating at high speed, making the interior of the vehicle quieter during the evacuation travel period. As a result, it is possible to provide passengers with a sense of security even during the evacuation travel period.
[0092] In addition, in the first embodiment, if the power suppression control is implemented and the traveling speed of the host vehicle Am does not reach the set vehicle speed set by the driver, a notification is issued indicating that the set vehicle speed will not be reached. This notification allows the passenger to correctly understand the control state of the host vehicle Am. As a result, the passenger's anxiety regarding the autonomous traveling control can be alleviated.
[0093] In the first embodiment, if the power suppression control is implemented and the traveling speed of the host vehicle Am does not reach the set vehicle speed set by the driver, the power suppression control is relaxed until the set vehicle speed is reached. Therefore, in a situation where high-speed cruising is required, a situation in which passengers are likely to feel uneasy about the autonomous driving control due to a lack of vehicle speed caused by the power suppression control can be avoided.
[0094] Additionally, in the first embodiment, the volume adjustment control for increasing the volume of content playback by the audio device 24 in the vehicle cabin is implemented as noise reduction control. As a result, the passengers' attention is directed to the audio of the content, making it difficult for them to perceive noise in the vehicle cabin.
[0095] In the first embodiment, noise canceling control using the noise canceling control unit 81 that suppresses noise inside the vehicle cabin is performed as silencing control. In this noise canceling control, noise in the passenger seats where passengers other than the driver are seated is reduced more than noise in the driver's seat where the driver is seated. This allows the driver to understand the operating state of the power generating device 41 from the sound information. Meanwhile, the passengers can spend time in a quiet environment where noise is canceled. Note that noise canceling control corresponds to "noise reduction control."
[0096] Furthermore, in the first embodiment, whether or not a specific type of occupant for whom noise reduction is useful, specifically a child or a sleeping occupant, is present in the vehicle cabin is determined. If such an occupant is present in the vehicle cabin, noise reduction control is implemented. Therefore, a situation in which noise in the vehicle cabin causes discomfort to a child or a sleeping occupant can be avoided.
[0097] Additionally, in the first embodiment, a sound dummy device that outputs dummy sounds to make noises in the vehicle cabin less audible to the passengers is used for noise reduction control. In this way, the noise perceived by the passengers can be reduced by generating dummy sounds that cancel out abnormal noises and masking the noise. As a result, the passengers' anxiety can be alleviated.
[0098] In the first embodiment, the noise reduction control is an opening / closing control that adjusts the open / closed state of the windows provided in the host vehicle Am to reduce noise inside the vehicle cabin. This opening / closing control can reduce noise generated by opening the windows too much or by opening only one window.
[0099] Furthermore, in the first embodiment, upon switching to autonomous driving control, a notification is issued to inquire of the driver as to whether or not to implement noise reduction control. Then, if the driver approves the implementation of noise reduction control, the noise reduction control is implemented. Therefore, during the autonomous driving period, in situations where noise reduction is not necessary, it is possible to avoid the implementation of noise reduction control based on the intention of a passenger such as a driver.
[0100] Additionally, in the first embodiment, when the power generating device 41 mounted on the host vehicle Am includes multiple power sources, the power selection control is implemented as noise reduction control. In this power selection control, a quiet power source that generates less noise among the multiple power sources, i.e., a motor generator, is preferentially operated. This control can also effectively reduce noise inside the vehicle cabin caused by the operation of the power generating device 41.
[0101] In the first embodiment, when the drive mode of the host vehicle Am is set to a sport mode that prioritizes driving performance, the implementation of noise reduction control during the autonomous driving period is stopped. As a result, when the driver desires to drive aggressively, it is possible to avoid a situation in which noise reduction is implemented against the driver's will.
[0102] In the first embodiment, the autonomous driving ECU 50b corresponds to the "vehicle control device," the HMI information acquisition unit 71 corresponds to the "reproduction recognition unit," the notification request unit 72 corresponds to the "notification implementation unit," and the interior monitoring unit 73 corresponds to the "interior recognition unit." Also, the target recognition unit 74 corresponds to the "exterior recognition unit," the control switching unit 76 corresponds to the "control recognition unit," the noise canceling control unit 81 corresponds to the "noise suppression device," and the imitation sound generation unit 82 corresponds to the "imitation sound device."
[0103] Second Embodiment A second embodiment of the present disclosure is a modified example of the first embodiment. In the second embodiment, the content of the acoustic control in the vehicle cabin performed by cooperation between the HMI control device 100 and the autonomous driving ECU 50b is different from that in the first embodiment. Hereinafter, the details of the HMI control device 100 and the autonomous driving ECU 50b of the second embodiment will be described with reference to FIG. 7 .
[0104] The HMI control device 100 has a function for playing content such as videos and music, as well as a background sound output function and a sound field control function. The HMI control device 100 is provided with a BGM (background music) output unit 86 for realizing the background sound output function and a sound field control unit 87 for realizing the sound field control function. The BGM output unit 86 and the sound field control unit 87 may be configured to output sound into the vehicle cabin using speakers of the audio device 24, or may be configured to output sound into the vehicle cabin using dedicated speakers.
[0105] The BGM output unit 86 generates audio signals for outputting the automatic driving BGM, the driving assistance BGM, and the driving changeover BGM into the cabin of the host vehicle Am. The BGM output unit 86 outputs the generated audio signals to the audio device 24. The audio device 24 plays each BGM using a speaker in accordance with the input audio signals.
[0106] The autonomous driving BGM is background sound that indicates that autonomous driving control is being performed. The driving assistance BGM is background sound that indicates that driving assistance control is being performed. The autonomous driving BGM and driving assistance BGM are set for each autonomous driving level. That is, if the autonomous driving ECU 50b is capable of performing autonomous driving at levels 4 and 3, the BGM output unit 86 is provided with autonomous driving BGM corresponding to autonomous driving level 4 and autonomous driving BGM corresponding to autonomous driving level 3. Furthermore, the BGM output unit 86 is provided with driving assistance BGM corresponding to autonomous driving level 2 and driving assistance BGM corresponding to autonomous driving level 1.
[0107] The autonomous driving BGM and driving assistance BGM use melodies that represent the individual corporate brands, such as the vehicle manufacturer that produces the vehicle Am or the provider that provides mobility services using the vehicle Am. The autonomous driving BGM and driving assistance BGM associated with each autonomous driving level are similar but different from each other. Specifically, each BGM has a different pitch or tempo. As an example, the higher the autonomous driving level, the lower the pitch of the BGM is set. Furthermore, the higher the autonomous driving level, the faster the tempo of the BGM is set.
[0108] Here, if the autonomous driving ECU 50b is capable of remotely performing autonomous driving, the BGM output unit 86 may be provided with autonomous driving BGM corresponding to remote autonomous driving. The BGM output unit 86 may also be provided with separate driving assistance BGM corresponding to hands-off level 2 and hands-on level 2. Furthermore, the higher the autonomous driving level, the higher the pitch of the BGM may be set. Similarly, the higher the autonomous driving level, the slower the tempo of the BGM may be set.
[0109] The driving change BGM is a change notification background sound that notifies the driver of a change in driving control state (autonomous driving level) from autonomous driving control to driving assistance control. The driving change BGM is output as a notice before the driving control state is changed. The driving change BGM may also be output as a change completion notification after the driving control state is changed. The driving change BGM may be BGM separate from the autonomous driving BGM and driving assistance BGM, or may be autonomous driving BGM or driving assistance BGM linked to the changed driving control state.
[0110] The sound field control unit 87 uses multiple speakers connected to the audio device 24 to create a sound field in the vehicle cabin that makes it appear as if sound is coming from a location where no actual sound source exists. The sound field control unit 87 determines a three-dimensional virtual position of a source of sound to be output into the vehicle cabin based on commands, etc., obtained from the autonomous driving ECU 50b. The sound field control unit 87 performs signal processing on the audio signal to be output, corresponding to the virtual sound source position, based on modeling data, such as the sound propagation characteristics from each speaker and the reflection pattern within the vehicle cabin. The sound field control unit 87 outputs the processed audio signal to the audio device 24 and plays it through each speaker. The sound field control unit 87 can perform signal processing on audio signals of content such as video and music, audio signals of background music generated by the background music output unit 86, and audio signals of onomatopoeia generated by the onomatopoeia generation unit 82. The sound field control unit 87 determines the number and positions of occupants in the vehicle cabin and adjusts the virtual sound source position according to the number and positions of the occupants.
[0111] The autonomous driving ECU 50b utilizes the functions of the HMI control device 100 to output background sounds related to autonomous driving, control the interior of the vehicle to reduce noise, and issue a normal notification after noise is generated. Details of these functions will be explained below in order.
[0112] <Output of background sounds related to autonomous driving> The notification request unit 72 cooperates with the BGM output unit 86 to play autonomous driving BGM and driving assistance BGM inside the vehicle cabin. As described above, the control switching unit 76 grasps the autonomous driving level linked to the driving control state currently being executed. The notification request unit 72 switches the autonomous driving BGM and driving assistance BGM to be output in accordance with the autonomous driving level currently being executed grasped by the control switching unit 76, and changes the mode of BGM played inside the vehicle cabin.
[0113] Specifically, when the autonomous driving ECU 50b starts autonomous driving control corresponding to autonomous driving level 3, the notification request unit 72 outputs autonomous driving BGM indicating that autonomous driving control is being performed after the start of this autonomous driving control (see FIG. 8 ). The notification request unit 72 may start outputting the autonomous driving BGM after an autonomous driving start notification that notifies the start of autonomous driving, or may start outputting the autonomous driving BGM substantially simultaneously with the autonomous driving start notification. In these cases, the autonomous driving start notification is a text message displayed on the meter display 21, HUD 23, or the like. Furthermore, the display of such a text message may be omitted, and the autonomous driving BGM that starts when autonomous driving control starts may also serve as the autonomous driving start notification.
[0114] The notification request unit 72 continues outputting the autonomous driving BGM for a predetermined time (several to approximately 10 seconds) and then ends it. The notification request unit 72 may continue outputting the autonomous driving BGM while autonomous driving control is continuing. As an example, if the host vehicle Am is a personally owned vehicle (hereinafter referred to as POV), the autonomous driving BGM ends after a predetermined time. On the other hand, if the host vehicle Am is a service vehicle that provides mobility services, the autonomous driving BGM continues to be played continuously.
[0115] The notification request unit 72 notifies the passenger of changes in the behavior of the host vehicle Am due to autonomous driving control using autonomous driving BGM (see FIG. 8 ). The notification request unit 72 uses the autonomous driving BGM to notify the passenger of, for example, the timing of acceleration exceeding a predetermined acceleration and the timing of a lane change or a right or left turn. If the autonomous driving BGM is stopped, the notification request unit 72 starts (resumes) output of the autonomous driving BGM when a change in the behavior of the host vehicle Am occurs. Furthermore, if the autonomous driving BGM is being played continuously, the notification request unit 72 increases the volume of the autonomous driving BGM when a change in the behavior of the host vehicle Am occurs. The playback or increase in volume of the autonomous driving BGM begins before a change in behavior occurs and continues until the behavior of the host vehicle Am stabilizes. As a result, powertrain noise and tire noise associated with an increase in rotational speed are masked by the autonomous driving BGM, making them less noticeable to the passenger.
[0116] In a scene in which an emergency vehicle approaches the host vehicle Am while autonomous driving control is being executed, the notification request unit 72 adjusts the directionality of the autonomous driving background music in cooperation with the sound field control unit 87 to indicate the relative direction of the emergency vehicle to the occupants of the host vehicle Am (see FIG. 8 ). As described above, the target recognition unit 74 recognizes the approach of the emergency vehicle to the host vehicle Am. The target recognition unit 74 can use the exterior acoustic sensor 31 to detect the emergency vehicle. The exterior acoustic sensor 31 is configured to mainly include a microphone element such as a MEMS microphone or a condenser microphone. The notification request unit 72 outputs a command to the sound field control unit 87 specifying the position of a virtual sound source so as to indicate the relative position of the emergency vehicle recognized by the target recognition unit 74. As an example, the notification request unit 72 starts playing autonomous driving background music in a manner that does not clarify the position of the sound source, and then lastly outputs sound from a speaker in the direction from which the emergency vehicle is approaching, and makes a virtual sound source appear in the direction of the emergency vehicle to the passengers. The passengers can grasp the relative position of the emergency vehicle from the direction from which the autonomous driving background music is playing.
[0117] When a change in the driving control state of the host vehicle Am is scheduled, the notification request unit 72 suppresses output of the automatic driving BGM and the driving assistance BGM. When a change in the driving control state that will end the autonomous driving control is scheduled, the notification request unit 72 outputs driving change BGM and notifies the occupants of the change in the driving control state.
[0118] As an example, when the end of autonomous driving control corresponding to autonomous driving level 3 is scheduled, the notification request unit 72 issues a driver change request to the driver in the vehicle cabin (see FIG. 9 ). When transitioning from autonomous driving control to driving assistance control is performed, the notification request unit 72 restricts the output of driver change BGM until a predetermined time (several seconds to approximately 10 seconds, hereinafter referred to as the BGM limit time) has elapsed after the driver ends the second task in response to the driver change request. During the BGM limit time, the notification request unit 72 may suspend the output of driver change BGM and put the driver change BGM into a standby state for playback into the vehicle cabin, or may start playback of the driver change BGM at a very low volume. At the BGM limit time, the driver resumes recognizing the environment outside the vehicle and grips the steering wheel. The notification request unit 72 may continue restricting the output until the interior monitoring unit 73 detects that the driver has resumed gripping the steering wheel.
[0119] The notification request unit 72 starts outputting the driver change BGM after the BGM time limit has elapsed. If the driver change BGM is being played at a low volume during the BGM time limit, the notification request unit 72 changes the playback volume of the driver change BGM to a normal volume after the BGM time limit has elapsed. After autonomous driving control ends, the notification request unit 72 starts outputting driving assistance BGM in place of the driver change BGM. Note that if background sound linked to the changed driving control state is used as the driver change BGM, the notification request unit 72 continues outputting the driving assistance BGM during the switching period when switching from autonomous driving control to driving assistance control.
[0120] The notification request unit 72 changes the output duration of the driver change BGM according to the changed autonomous driving level. When the driving control state transitions to driving assistance control corresponding to autonomous driving level 2 (see FIG. 9 ), after the transition to driving assistance control, the notification request unit 72 continues to output the driver change BGM for a predetermined time (several seconds to approximately 10 seconds). On the other hand, when the driving control state transitions to driving assistance control or manual driving corresponding to autonomous driving level 1, after the autonomous driving control is turned off, the notification request unit 72 does not output the driver change BGM, or outputs the driver change BGM for a shorter time than when transitioning to autonomous driving level 2. When the driver change BGM repeats a predetermined melody, the notification request unit 72 may sound the driver change BGM only once after the autonomous driving control is turned off.
[0121] <Vehicle Interior Control for Silence Reduction> The silence control unit 78 cooperates with the information linkage unit 61 and the HMI control device 100 to perform volume adjustment control, sound field control, and the like for silencing in the silence mode.
[0122] During the autonomous driving period, the quietness control unit 78 changes the quietness level in the vehicle cabin in accordance with the content of the second task identified by the in-vehicle monitoring unit 73. The in-vehicle monitoring unit 73 identifies the content of the second task being performed by the driver based on in-vehicle monitor information and the like obtained from the in-vehicle monitor device 29. The in-vehicle monitoring unit 73 determines the task state of the driver, for example, whether the driver is in a web conference (call), watching content such as a movie, operating a device, or eating.
[0123] The silence control unit 78 increases or decreases the volume of the sound reproduced in the vehicle cabin according to the content of the second task. For example, when the driver is in a web conference, the silence control unit 78 lowers the volume of notification sounds and background sounds not related to the web conference to make the vehicle cabin quiet. Also, when the driver is watching content, the silence control unit 78 adjusts the volume of sounds related to the content so that it is louder than the volume set for notification sounds and background sounds.
[0124] The silence control unit 78 cooperates with the notification request unit 72 and the sound field control unit 87 to perform sound field control as a vehicle interior control that makes noise less audible. The interior monitoring unit 73 grasps the positional relationship between the noise source and the occupants of the vehicle Am. The silence control unit 78 adjusts the directionality of the interior sound output by the audio device 24 in the vehicle cabin based on the positional relationship grasped by the interior monitoring unit 73. The silence control unit 78 changes the position of a virtual sound source, such as the autonomous driving background music and content audio, through sound field control by the sound field control unit 87, and sets the virtual sound source at a position that is in the direction of the noise source relative to the occupants. As a result, the position (direction) of the interior sound is the same as the position (direction) of the noise source as seen by the occupants. As a result, noise generated by the internal combustion engine and the motor generator is masked by the interior sound, making it less noticeable to the occupants.
[0125] <Normal Notification Due to Normal Noise Generation> If, during an autonomous driving period, the control execution unit 64 and the driving control ECU 40 perform power generation control and this power generation control is normal, the notification request unit 72 performs a normal notification after the power generation control is completed. The power generation control is a control that increases the noise of the power generation device 41 mounted on the host vehicle Am. Specifically, the power generation control is acceleration control that causes the rotational speed of the internal combustion engine or motor generator included in the power generation device 41 to exceed the noise threshold. The power generation control is performed, for example, in merging sections and uphill sections.
[0126] The normal notification is a notification indicating that the power generation control was normal. The normal notification is made after the power generation control that caused the noise to increase is completed, in other words, when the noise emitted by the power generation device 41 becomes quieter. The normal notification is started, for example, after the completion of merging or after the end of an uphill slope. The normal notification is made by displaying on the meter display 21 and the CID 22, as well as by using a voice message. For example, a message such as "Control that increases noise has been performed" is presented to both the driver and passengers as the normal notification.
[0127] The notification request unit 72 does not issue a normal notification every time, but omits the normal notification as appropriate depending on the state of the occupant. The notification request unit 72 issues a normal notification only when the interior monitoring unit 73 detects that the occupant is anxious about the power generation control. The interior monitoring unit 73 uses various measurement information to determine whether the occupant of the host vehicle Am is in an anxious state, feeling anxious. The interior monitoring unit 73 determines whether the occupant is in an anxious state based on, for example, the content of the occupant's speech or the degree of trembling of the occupant's voice collected by the interior acoustic sensor 27. The interior monitoring unit 73 acquires the occupant's heart rate from vital sensors installed in the driver's seat and passenger seat, or from a wearable device worn by the occupant. The interior monitoring unit 73 determines whether the occupant is in an anxious state based on an increase in the occupant's heart rate. The notification request unit 72 issues a normal notification when the occupant is in an anxious state about the power generation control. On the other hand, if the occupant does not become anxious about the power generation control, the notification request unit 72 suppresses (cancels) the normal notification.
[0128] [Processes Related to Vehicle Interior Acoustic Control] To achieve the vehicle interior acoustics described above, the autonomous driving ECU 50b performs an autonomous driving notification process, a behavior change notification process, an emergency vehicle notification process, a driver change notification process, a quietness control process, and a normal noise notification process. Details of each process performed primarily by the autonomous driving ECU 50b will be further described below based on Figures 10 to 15 and with reference to Figures 7 to 9.
[0129] 10 is a process for notifying the passenger of the start of autonomous driving control of autonomous driving level 3 or higher. The autonomous driving notification process is continuously performed by the autonomous driving ECU 50b when the autonomous driving control is in a standby state.
[0130] In S211 of the autonomous driving notification processing, the control switching unit 76 grasps the control schedule for switching the autonomous driving level. Based on the grasped control schedule, the control switching unit 76 determines in S212 whether switching to autonomous driving level 3 or higher is scheduled. If manual driving or driving assistance control is to be continued (S212: NO), S211 and S212 are repeated to wait for a transition to autonomous driving control.
[0131] On the other hand, if switching to autonomous driving control is scheduled (S212: YES), the notification request unit 72 issues an autonomous driving start notification (see FIG. 8) in conjunction with the switch to autonomous driving control in S213. Furthermore, in S214, which is after the start of autonomous driving control, the notification request unit 72 starts outputting autonomous driving BGM (see FIG. 8) that indicates that autonomous driving control is being performed. The notification request unit 72 refers to the autonomous driving level grasped by the control switching unit 76, and changes the mode of the autonomous driving BGM output in S214 depending on the current autonomous driving level.
[0132] 11 is a process for notifying the occupants of an event that causes a behavior change in the host vehicle Am by using autonomous driving BGM. The behavior change notification process starts when the autonomous driving period starts and is continuously performed until the end of the autonomous driving period.
[0133] In S221 of the behavior change notification process, the behavior determination unit 63 grasps the schedule for vehicle control in the autonomous driving control. In S222, the behavior determination unit 63 determines whether a change in vehicle behavior is scheduled. If no change in vehicle behavior is scheduled (S222: NO), S221 and S222 are repeated to wait for a behavior change. On the other hand, if a change in vehicle behavior is scheduled (S222: YES), the notification request unit 72 outputs autonomous driving BGM to notify the user of the behavior change in S223 (see FIG. 8 ). According to S223, output of the autonomous driving BGM is started at the timing when a change in the behavior of the host vehicle Am occurs due to autonomous driving control. In S223, notification control may be implemented to increase the volume of the autonomous driving BGM.
[0134] 12 is a process for notifying passengers of an approaching emergency vehicle using autonomous driving background music. Similar to the behavior change notification process (see FIG. 11), the emergency vehicle notification process starts when the autonomous driving period starts and is continuously performed until the end of the autonomous driving period.
[0135] In S231 of the emergency vehicle notification process, the target recognition unit 74 recognizes the approach of an emergency vehicle to the host vehicle Am. If no emergency vehicle is approaching (S231: NO), S231 is repeated to wait for the approach of the emergency vehicle. On the other hand, if the approach of an emergency vehicle is recognized (S231: YES), the target recognition unit 74 recognizes the relative direction of the emergency vehicle in S232. Next, in S233, the interior monitoring unit 73 recognizes the positions of occupants in the vehicle cabin. The order of execution of S232 and S233 may be changed.
[0136] In S234, the notification request unit 72 cooperates with the sound field control unit 87 to perform sound field control of the autonomous driving BGM. If the output of the autonomous driving BGM has been interrupted, the notification request unit 72 resumes the output of the autonomous driving BGM in S234. The notification request unit 72 adjusts the directionality of the autonomous driving BGM being played based on the positional relationship between the emergency vehicle and the occupants determined in S232 and S233. The notification request unit 72 shows the occupants the relative direction of the emergency vehicle by setting a virtual sound source position in the direction in which the emergency vehicle is approaching (see FIG. 8 ). When the emergency vehicle approaches within a predetermined distance, the notification request unit 72 ends the autonomous driving BGM so as not to prevent the occupants from hearing the siren sound of the emergency vehicle.
[0137] 13 is a process for notifying the occupant of the end of autonomous driving control. The driver change notification process is continuously performed by the autonomous driving ECU 50b when autonomous driving control is in an execution state.
[0138] In S241 of the driver change notification process, the control switching unit 76 grasps the control schedule for switching the autonomous driving level. Based on the grasped control schedule, the control switching unit 76 determines in S242 whether autonomous driving control at autonomous driving level 3 or higher is scheduled to continue. If autonomous driving control is scheduled to continue (S242: YES), S241 and S242 are repeated to wait for the autonomous driving control to end. On the other hand, if autonomous driving control is scheduled to end (S242: NO), the notification request unit 72 makes a driver change request to the driver in S243 (see FIG. 9 ). If autonomous driving background music is being played, the output of the autonomous driving background music is suppressed in S243.
[0139] In S244, the in-vehicle monitoring unit 73 grasps the driver's state. In S245, the in-vehicle monitoring unit 73 determines whether the driver has finished the second task. If the second task is continuing (S245: NO), S244 and S245 are repeated to wait for the second task to end. On the other hand, if the end of the second task has been grasped (S245: YES), the notification request unit 72 determines in S246 whether a predetermined BGM time limit has elapsed since the end of the second task. Based on the determination in S246, the notification request unit 72 limits the output of the driver change BGM until the BGM time limit has elapsed.
[0140] When the BGM time limit has elapsed (S246: YES), the control switching unit 76 determines the new autonomous driving level based on the control schedule determined in S241 in S247. If a transition to autonomous driving level 2 is scheduled (S247: YES), the notification request unit 72 outputs the driver change BGM normally in S248 (see FIG. 9 ). In this case, the output of the driver change BGM continues until a predetermined time has elapsed after the driver change. On the other hand, if a transition to autonomous driving level 1 or manual driving is scheduled (S247: NO), the notification request unit 72 outputs the driver change BGM in a more restricted manner than usual in S249. In this case, the notification request unit 72 may stop outputting the driver change BGM or may end the playback of the driver change BGM in a shorter time than usual.
[0141] 14 is a process for adjusting the volume and sound field of the interior sound reproduced in the vehicle cabin during the autonomous driving period. The emergency vehicle alert process starts when the autonomous driving period starts and is repeatedly performed until the autonomous driving period ends.
[0142] In S261 of the driver change notification process, the silence control unit 78 determines the mode of the vehicle interior control set in the mode switching process (see FIG. 3). In S262, the silence control unit 78 determines whether the control mode is set to the silence mode (see S20 in FIG. 3). If the control mode is set to the normal mode (see S19 in FIG. 3) (S262: NO), the silence control process is temporarily terminated.
[0143] On the other hand, if the control mode is set to the silent mode, the notification request unit 72 performs volume adjustment control according to the content of the second task in S263. Furthermore, in S264, the interior monitoring unit 73 determines the positional relationship between the noise source and the occupant. The notification request unit 72 then performs sound field control using the sound field control unit 87 to adjust the directionality of the interior sound, and sets a virtual sound source of the interior sound at a position that is in the direction of the noise source relative to the occupant. The order of performing S263 and S264 above may be changed as appropriate.
[0144] 15 is a process for issuing a normal notification after an increase in noise occurs in the power generation device 41. The normal noise notification process starts at the start of the automatic operation period and is repeatedly executed until the end of the automatic operation period.
[0145] In S271 of the normal noise notification processing, the behavior determination unit 63 determines whether or not the noise of the power generation device 41 has increased due to the implementation of power generation control. If power generation control accompanied by an increase in noise is not implemented (S271: NO), the behavior determination unit 63 waits for the implementation of power generation control accompanied by an increase in noise. Then, if power generation control is implemented (S271: YES), the behavior determination unit 63 determines in S272 whether or not the power generation control has ended. If power generation control is continuing (S272: NO), the behavior determination unit 63 waits for the end of the power generation control.
[0146] When the behavior determination unit 63 determines that the power generation control has ended (S272: YES), the interior monitoring unit 73 determines in S273 whether the occupant's anxious state was detected during the implementation period of the power generation control. If the occupant's anxious state has not been detected (S273: NO), the normal noise notification process is temporarily terminated. On the other hand, if the occupant's anxious state has been detected (S273: YES), the notification request unit 72 performs a normal notification in S274. As described above, the normal notification is performed only when the occupant's anxious state is detected.
[0147] (Summary of the Second Embodiment) In the second embodiment described so far, noise reduction control is performed during the autonomous driving period, and the interior of the vehicle Am can be reduced in noise. As a result, the same effect as in the first embodiment can be achieved, and it is possible to reduce the anxiety that passengers who are not involved in driving may feel about the autonomous driving control.
[0148] Additionally, in the second embodiment, if power generation control that increases the noise of the power generation unit 41 mounted on the vehicle Am is performed during an automatic traveling period, after the power generation control is completed, a normal notification is issued to indicate that the power generation control was normal. Therefore, even if the noise of the power generation unit 41 inevitably increases due to merging, climbing a slope, etc., the anxiety felt by the occupants can be quickly alleviated.
[0149] In the second embodiment, whether or not the occupant of the vehicle Am is in an anxious state where they feel anxious is determined. If the occupant is not in an anxious state in response to the power generation control, the normal notification is suppressed. As a result, it is possible to avoid a situation where the occupant feels annoyed by repeated normal notification.
[0150] Furthermore, in the second embodiment, after the autonomous driving control starts, autonomous driving background music (BGM) is output, indicating that the autonomous driving control is being performed. As described above, the autonomous driving background music played in the vehicle cabin allows the passengers to recognize that the autonomous driving control has started normally. As a result, anxiety about the autonomous driving control can be reduced. The autonomous driving background music corresponds to "autonomous driving background sound."
[0151] Additionally, in the second embodiment, when a change in the driving control state is scheduled, the output of the automatic driving background music is suppressed. As a result, the passenger can grasp the scheduled change in the driving control state from the change in the automatic driving background music with ample time to spare. Therefore, the passenger's anxiety caused by the change in the driving control state can be suppressed.
[0152] In the second embodiment, when a change in the driving control state is scheduled, driver change BGM is output to notify the driver of the change in the driving control state. By outputting such driver change BGM, the passenger can more clearly understand the scheduled change in the driving control state. As a result, the passenger's anxiety caused by the change in the driving control state can be reduced. The driver change BGM corresponds to a "change notification background sound."
[0153] Furthermore, in the second embodiment, the autonomous driving level associated with the planned changed driving control state is identified. Then, the output time of the driver-switching BGM is changed according to the changed autonomous driving level. As a result, the passenger can recognize the changed autonomous driving level from the output time of the driver-switching BGM. As a result, the passenger's anxiety after the change in driving control state can be reduced.
[0154] In addition, in the second embodiment, whether the driver in the vehicle cabin is performing a second task that has been previously permitted during the autonomous driving period is determined. When the autonomous driving control is switched to the driving assistance control, the output of the driving changeover BGM is restricted until a predetermined time has elapsed after the second task ends. As a result, the driving changeover BGM is less likely to interfere with the driver's awareness of the external environment that begins after the second task ends. As a result, the driving changeover BGM can reliably support a smooth driver handover.
[0155] In the second embodiment, when a change in the behavior of the vehicle Am occurs, a process of starting output of the autonomous driving BGM or a process of increasing the volume of the autonomous driving BGM that is being output is performed. Therefore, noise caused by the change in behavior is less noticeable to the passengers due to the autonomous driving BGM. As a result, the passengers' anxiety in situations where noise occurs can be reduced.
[0156] Furthermore, in the second embodiment, the approach of an emergency vehicle to the host vehicle Am is detected. Then, by adjusting the directionality of the autonomous driving background music, the relative direction of the emergency vehicle is indicated to the occupants of the host vehicle Am. Such sound field control makes it possible to promptly indicate the location of the emergency vehicle to the occupants. As a result, it is possible to avoid a situation in which the occupants feel uneasy due to the sudden approach of an emergency vehicle.
[0157] Additionally, in the second embodiment, the autonomous driving level associated with the current driving control state is identified. The mode of the autonomous driving BGM is then changed according to the autonomous driving level. As a result, the passenger can understand the current driving control state from the mode of the autonomous driving BGM. In this way, passengers can easily understand the driving control state, thereby reducing their anxiety about the autonomous driving control.
[0158] In the second embodiment, the positional relationship between the noise source and the occupants of the vehicle Am is determined. Then, the directivity of the interior sound output by the audio device 24 in the vehicle cabin is adjusted, and a virtual sound source of the interior sound is set at a position that is in the direction of the noise source relative to the occupants. This noise reduction control makes it difficult for the occupants to recognize the noise due to the interior sound. As a result, the occupants' anxiety caused by the noise can be reduced.
[0159] (Other Embodiments) Although multiple embodiments of the present disclosure have been described above, the present disclosure should not be construed as being limited to the above-described embodiments, and can be applied to various embodiments and combinations within the scope that does not deviate from the gist of the present disclosure.
[0160] The host vehicle Am equipped with the autonomous driving ECU 50b according to the first modification of the above embodiment is operated as a driverless vehicle that provides mobility services without a specific driver on board. The operation of the driverless vehicle is remotely monitored by a remote management center located remotely from the host vehicle. In the first modification, the autonomous driving ECU 50b also functions as a vehicle control device and performs noise reduction control.
[0161] Additionally, in Modification 1, the interior monitoring unit 73 determines whether the interior of the vehicle is quiet or not, using interior noise information detected by the interior acoustic sensor 27. If the noise accompanying the running of the host vehicle Am is greater than a predetermined criterion and the interior of the vehicle is not quiet, the notification request unit 72 issues a notification regarding the quietness (hereinafter, a noise notification) to the remote management center. Based on the noise notification, a manager at the remote management center can check whether any abnormalities have occurred in the driverless vehicle.
[0162] In a second modification of the above embodiment, the host vehicle Am is provided with an exterior acoustic sensor that detects sounds outside the vehicle. The exterior acoustic sensor has substantially the same configuration as the interior acoustic sensor 27, converts sounds outside the vehicle into an electrical signal, and provides the output signal to the autonomous driving ECU 50b. The autonomous driving ECU 50b acquires the output signal of the exterior acoustic sensor as one piece of detection information. In this second modification, the target recognition unit 74 can recognize the approach of an emergency vehicle by detecting the siren of the emergency vehicle using the output signal of the exterior acoustic sensor.
[0163] In Modification 3 of the above embodiment, only one of the power control and the interior control for noise reduction is performed. Furthermore, in Modification 4 of the above embodiment, only one of the power selection control and the power suppression control is performed as the power control. Furthermore, in Modification 5 of the above embodiment, at least one of the interior controls, namely, the volume adjustment control, the noise canceling control, the noise masking control, the opening / closing control, and the sound field control, is omitted. As in Modification 5, the content of the interior control for noise reduction may be changed as appropriate. Additionally, the content of the interior control to be performed may be preset based on an operation by a user, such as a driver.
[0164] In a sixth modification of the above embodiment, the process of requesting the driver's approval for the implementation of silencing control is omitted. In this sixth modification, the silencing control unit 78 determines the implementation of silencing control based on switching to autonomous driving level 3. Furthermore, the process of determining the type of occupant may be omitted.
[0165] The music (melody) used for the automatic driving background music (BGM), the driving assistance background music (BGM), and the driving changeover background music (BGM) used in the second embodiment may be changed as appropriate. For example, at least two of the automatic driving background music (BGM), the driving assistance background music (BGM), and the driving changeover background music (BGM) may be the same. Furthermore, these background sounds may be changeable based on a user operation of the host vehicle Am.
[0166] At least some of the functions of the vehicle control device according to the present disclosure may be implemented in an on-board ECU different from the autonomous driving ECU 50b. In a seventh modification of the above embodiment, at least some of the functions of the vehicle control device are implemented in the cruise control ECU 40, and the cruise control ECU 40 performs the mode switching process and the power control process. In this seventh modification, the cruise control ECU 40, or a system including the cruise control ECU 40 and the autonomous driving ECU 50b, corresponds to the "vehicle control device."
[0167] In Modification 8 of the above embodiment, at least some of the functions of the vehicle control device are implemented in the HMI control device 100, and the HMI control device 100 performs mode switching processing and interior control processing. In Modification 8, the HMI control device 100 or a system including the HMI control device 100 and the autonomous driving ECU 50b corresponds to the "vehicle control device."
[0168] The configuration of the system that realizes the autonomous driving function may be modified as appropriate. As an example, in Modification 9 of the above embodiment, the functions of the driving assistance ECU 50a and the autonomous driving ECU 50b are provided by a single autonomous driving ECU. That is, the autonomous driving ECU 50b of Modification 9 is equipped with the functions of the driving assistance ECU 50a. Furthermore, in Modification 10 of the above embodiment, the functions of the driving assistance ECU 50a, the autonomous driving ECU 50b, and the HMI control device 100 are provided by a single integrated ECU. In Modification 10, the integrated ECU corresponds to the "vehicle control device."
[0169] In the above embodiments, the functions provided by the autonomous driving ECU can be provided by software and hardware that executes the software, software alone, hardware alone, or a combination of these. Furthermore, when such functions are provided by electronic circuits as hardware, the functions can also be provided by digital circuits including multiple logic circuits or analog circuits. Furthermore, the software for realizing such functions may include, at least in part, code automatically generated by, for example, a neural network or language model trained using real-world camera footage.
[0170] Each processing unit in the above embodiments is hardware for arithmetic processing coupled to a RAM. The processing unit includes at least one arithmetic core, such as a central processing unit (CPU) and a graphics processing unit (GPU). The processing unit may further include a field-programmable gate array (FPGA), a neural network processing unit (NPU), and an IP core with other dedicated functions. Such processing units may be individually mounted on a printed circuit board, or may be mounted on an application-specific integrated circuit (ASIC), an FPGA, or the like.
[0171] In the above embodiments, the form of the storage medium (non-transitory tangible storage medium) that stores various programs and the like may be changed as appropriate. Furthermore, the storage medium is not limited to a configuration provided on a circuit board, but may be provided in the form of a memory card or the like, inserted into a slot, and electrically connected to a control circuit such as an autonomous driving ECU. Furthermore, the storage medium may be an optical disk, hard disk drive, solid state drive, or the like that serves as a source from which programs are copied or distributed to the autonomous driving ECU or the like.
[0172] Vehicles equipped with the above-described autonomous driving system and HMI system are not limited to ordinary private passenger cars, but may also be rental cars, manned taxis, ride-sharing vehicles, freight vehicles, buses, etc. Furthermore, vehicles equipped with the autonomous driving system and HMI system may be right-hand drive vehicles or left-hand drive vehicles. Furthermore, the traffic environment in which the vehicle travels may be one based on left-hand traffic or one based on right-hand traffic. Vehicle control according to the present disclosure may be optimized as appropriate according to the road traffic laws of each country and region, as well as the position of the vehicle's steering wheel.
[0173] The controller and methods described herein may be implemented by a special-purpose computer comprising a processor programmed to perform one or more functions embodied in a computer program. Alternatively, the apparatus and methods described herein may be implemented by special-purpose hardware logic circuitry. Alternatively, the apparatus and methods described herein may be implemented by one or more special-purpose computers comprising a processor executing a computer program in combination with one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by a computer on a computer-readable non-transitory storage medium.
[0174] (Disclosure of Technical Ideas) This specification discloses multiple technical ideas described in the following multiple clauses. Some clauses may be described in a multiple dependent form, with the subsequent clause alternatively referring to the preceding clause. Furthermore, some clauses may be described in a multiple dependent form, with the subsequent clause referring to another multiple dependent clause. These multiple dependent clauses define multiple technical ideas.
[0175] (Technical Idea 1) A vehicle control device used in a host vehicle (Am) that can travel under autonomous driving control without the driver having to monitor their surroundings, the vehicle control device comprising: a control recognition unit (76) that recognizes that the driving control state of the host vehicle has been switched to a state in which the host vehicle travels under the autonomous driving control; and a noise reduction control unit (78) that implements noise reduction control to make the interior of the host vehicle quieter during an automatic driving period in which the host vehicle travels under the autonomous driving control than during a monitoring period in which the driver has to monitor their surroundings. (Technical Idea 2) The vehicle control device according to Technical Idea 1, wherein the noise reduction control unit implements power reduction control that reduces the rotation speed of a power generation unit (41) mounted on the host vehicle. (Technical Idea 3) The vehicle control device according to Technical Idea 2, further comprising: a playback recognition unit (71) that recognizes the state of content playback by an audio device (24) in the vehicle cabin, and the noise reduction control unit relaxes the power reduction control when the content is being played back in the vehicle cabin. (Technical Idea 4) The vehicle control device according to Technical Idea 2 or 3, further comprising an outside-vehicle grasping unit (74) that grasps the approach of an emergency vehicle to the host vehicle, wherein the silence control unit halts the power suppression control when the approach of the emergency vehicle is grasped. (Technical Idea 5) The vehicle control device according to any one of Technical Ideas 2 to 4, further comprising an evacuation control unit (77) that implements emergency evacuation control based on the occurrence of an abnormality related to the host vehicle, wherein the silence control unit determines whether the power suppression control will interfere with the emergency evacuation control, and when it determines that the power suppression control will not interfere with the emergency evacuation control, implements the power suppression control during an evacuation travel period in which the host vehicle travels under the emergency evacuation control. (Technical Idea 6) The vehicle control device according to any one of Technical Ideas 2 to 5, further comprising a notification implementation unit (72) that implements a notification indicating that the set vehicle speed will not be reached, when implementation of the power suppression control would cause the travel speed of the host vehicle to fall short of a set vehicle speed set by the driver.(Technical Idea 7) The vehicle control device according to any one of Technical Ideas 2 to 6, wherein, if implementing the power suppression control would cause the traveling speed of the host vehicle to fall short of a set vehicle speed set by the driver, the silence control unit relaxes the power suppression control until the set vehicle speed is reached. (Technical Idea 8) The vehicle control device according to any one of Technical Ideas 1 to 7, further comprising: a notification implementation unit (72) that, if power generation control that increases the noise of a power generation device (41) mounted on the host vehicle is performed during the autonomous traveling period, issues a normal notification indicating that the power generation control was normal after the power generation control is completed. (Technical Idea 9) The vehicle control device according to Technical Idea 8, further comprising: an interior recognition unit (73) that recognizes whether an occupant of the host vehicle is in an anxiety state in which they feel anxious, and the notification implementation unit suppresses the normal notification if the occupant does not fall into the anxiety state in response to the power generation control. (Technical Idea 10) The vehicle control device according to any one of Technical Ideas 1 to 9, further comprising an announcement implementation unit (72) that outputs, after the autonomous driving control is started, autonomous driving background sound indicating that the autonomous driving control is being performed. (Technical Idea 11) The vehicle control device according to Technical Idea 10, wherein the announcement implementation unit suppresses output of the autonomous driving background sound when a change to the driving control state is scheduled. (Technical Idea 12) The vehicle control device according to Technical Idea 10 or 11, wherein the announcement implementation unit outputs change notification background sound that notifies the driver of the change to the driving control state when a change to the driving control state is scheduled. (Technical Idea 13) The vehicle control device according to Technical Idea 12, wherein the control understanding unit understands an autonomous driving level linked to the driving control state after the planned change, and the announcement implementation unit changes the output time of the change notification background sound in accordance with the changed autonomous driving level.(Technical Idea 14) The vehicle control device according to Technical Idea 12 or 13, further comprising an interior-of-vehicle grasping unit (73) that grasps whether the driver is performing a specific action other than driving that has been previously permitted during the autonomous driving period, wherein the notification implementation unit, when transitioning from the autonomous driving control to the driving control state in which the driver is obligated to monitor the surroundings, limits output of the change notification background sound until a predetermined time has elapsed after the driver finishes performing the specific action. (Technical Idea 15) The vehicle control device according to any one of Technical Ideas 10 to 14, wherein the notification implementation unit starts output of the autonomous driving background sound or increases the volume of the autonomous driving background sound that is being output when a change occurs in the behavior of the host vehicle due to the autonomous driving control. (Technical Idea 16) The vehicle control device according to any one of Technical Ideas 10 to 15, further comprising an exterior-of-vehicle grasping unit (74) that grasps the approach of an emergency vehicle to the host vehicle, wherein the notification implementation unit adjusts the directionality of the autonomous driving background sound to indicate the relative direction of the emergency vehicle to an occupant of the host vehicle. (Technical Idea 17) The vehicle control device according to any one of Technical Ideas 10 to 16, wherein the control grasping unit grasps an autonomous driving level linked to the driving control state currently being executed, and the notification implementation unit changes the manner of the autonomous driving background sound according to the autonomous driving level. (Technical Idea 18) The vehicle control device according to any one of Technical Ideas 1 to 17, further comprising a vehicle interior grasping unit (73) that grasps a positional relationship between a noise source and an occupant of the vehicle, and wherein the silencing control unit implements, as the silencing control, sound field control that adjusts directionality of the interior vehicle sound output by an audio device (24) in the vehicle cabin and sets a virtual sound source of the interior vehicle sound in a position that is in the direction of the noise source with respect to the occupant. (Technical Idea 19) The vehicle control device according to any one of Technical Ideas 1 to 18, wherein the silencing control unit implements, as the silencing control, volume adjustment control that increases the volume of content playback by the audio device (24) in the vehicle cabin.(Technical Idea 20) The vehicle control device according to any one of Technical Ideas 1 to 19, wherein the silencing control unit implements, as the silencing control, noise canceling control using a noise suppression device (81) that suppresses noise inside the vehicle cabin to reduce noise in a passenger seat where a passenger other than the driver is seated to a greater extent than noise in a driver's seat where the driver is seated. (Technical Idea 21) The vehicle control device according to any one of Technical Ideas 1 to 20, further comprising a vehicle interior recognition unit (73) that recognizes whether a specific type of passenger for whom silencing is useful is present in the vehicle cabin, and the silencing control unit implements the silencing control when the specific type of passenger is present in the vehicle cabin. (Technical Idea 22) The vehicle control device according to any one of Technical Ideas 1 to 21, wherein the silencing control unit uses, for the silencing control, a sound dummy device (82) that outputs sound dummy sounds that make the noise inside the vehicle cabin less audible to the passengers. (Technical Idea 23) The vehicle control device according to any one of Technical Ideas 1 to 22, wherein the silencing control unit performs opening and closing control of a window provided in the host vehicle in order to reduce noise inside the vehicle cabin as the silencing control. (Technical Idea 24) The vehicle control device according to any one of Technical Ideas 1 to 23, further comprising: a notification implementation unit (72) that issues a notification regarding silencing to a remote management center that is remote from the host vehicle when noise accompanying the host vehicle's traveling is greater than a predetermined judgment criterion. (Technical Idea 25) The vehicle control device according to any one of Technical Ideas 1 to 24, further comprising: a notification implementation unit (72) that issues a notification to the driver inquiring about whether or not to implement the silencing control based on the switch to autonomous traveling control, and the silencing control unit performs the silencing control when the implementation of the silencing control is approved by the driver. (Technical Idea 26) The vehicle control device according to any one of Technical Ideas 1 to 25, wherein, when a power generating device (41) mounted on the host vehicle includes a plurality of power sources, the silencing control unit performs power selection control to preferentially operate a quiet power source that generates less noise among the plurality of power sources as the silencing control.(Technical Idea 27) The vehicle control device according to any one of Technical Ideas 1 to 26, wherein the silencing control unit suspends implementation of the silencing control during the automatic driving period when the drive mode of the host vehicle is set to a sport mode that prioritizes driving performance. (Technical Idea 28) A vehicle control program used in a host vehicle (Am) that can run by autonomous driving control without the driver being obligated to monitor their surroundings, the vehicle control program causing at least one processing unit (51) to execute processes including: grasping that the driving control state of the host vehicle has been switched to a state in which the host vehicle runs by the autonomous driving control (S13), and implementing silencing control to make the interior of the host vehicle quieter than during a monitoring period in which the driver is obligated to monitor their surroundings (S20).
Claims
1. A vehicle control device used in a host vehicle (Am) capable of driving under autonomous driving control with no obligation on the driver to monitor the surroundings, comprising: a control grasping unit (76) that grasps that the driving control state of the host vehicle has been switched to a state in which the vehicle is driven under the autonomous driving control; and a noise reduction control unit (78) that, during an automatic driving period in which the host vehicle is driven under the autonomous driving control, implements noise reduction control to reduce noise inside the vehicle cabin more than during a monitoring period in which the driver is obligated to monitor the surroundings.
2. A vehicle control device as described in claim 1, wherein the noise reduction control section implements power suppression control for suppressing the rotation speed of a power generating device (41) mounted on the host vehicle as the noise reduction control.
3. A vehicle control device as described in claim 2, further comprising a playback grasp unit (71) that grasps the state of content playback by an audio device (24) inside the vehicle cabin, wherein the silent control unit relaxes the power suppression control when the content playback is being performed inside the vehicle cabin.
4. A vehicle control device as described in claim 2, further comprising an outside detection unit (74) that detects the approach of an emergency vehicle to the vehicle, wherein the silent control unit stops the power suppression control when the approach of the emergency vehicle is detected.
5. A vehicle control device as described in claim 2, further comprising an evacuation control unit (77) that implements emergency evacuation control based on the occurrence of an abnormality related to the host vehicle, wherein the silent control unit determines whether the power suppression control interferes with the emergency evacuation control, and if it is determined that the power suppression control does not interfere with the emergency evacuation control, implements the power suppression control during an evacuation driving period in which the host vehicle travels according to the emergency evacuation control.
6. A vehicle control device as described in claim 2, further comprising an alarm implementation unit (72) that issues an alarm indicating that the set vehicle speed will not be reached if the power suppression control is implemented and the driving speed of the vehicle does not reach the set vehicle speed set by the driver.
7. A vehicle control device as described in claim 2, wherein, when implementing the power suppression control, the silent control unit relaxes the power suppression control until the vehicle's traveling speed reaches the set vehicle speed set by the driver.
8. A vehicle control device as described in claim 1, further comprising: a notification execution unit (72) that, when power generation control that increases the noise of a power generation device (41) mounted on the vehicle is performed during the automatic driving period, issues a normal notification after the power generation control is completed, indicating that the power generation control was normal control.
9. A vehicle control device as described in claim 8, further comprising an in-vehicle grasping unit (73) for grasping whether an occupant of the vehicle is in an anxious state in which the occupant feels uneasy, and wherein the notification implementation unit suppresses the normal notification if the occupant does not enter the anxious state in response to the power generation control.
10. The vehicle control device as described in claim 1, further comprising an alarm implementation unit (72) that outputs an autonomous driving background sound indicating that the autonomous driving control is being performed after the autonomous driving control is started.
11. A vehicle control device as described in claim 10, wherein the notification implementation unit suppresses output of the autonomous driving background sound when a change in the driving control state is scheduled.
12. The vehicle control device according to claim 10, wherein the notification execution unit outputs a change notification background sound that notifies the driver of a change in the driving control state when a change in the driving control state is scheduled.
13. A vehicle control device as described in claim 12, wherein the control grasping unit grasps the autonomous driving level linked to the driving control state after the planned change, and the notification implementation unit changes the output time of the change notification background sound in accordance with the autonomous driving level after the change.
14. A vehicle control device as described in claim 12, further comprising an in-vehicle grasping unit (73) that grasps whether the driver is performing a specific action other than driving that has been previously permitted during the autonomous driving period, wherein the notification execution unit limits the output of the change notification background sound until a predetermined time has elapsed after the driver finishes the specific action when a transition is made from the autonomous driving control to the driving control state in which the driver has the obligation to monitor the surroundings.
15. A vehicle control device as described in claim 10, wherein the notification implementation unit starts outputting the autonomous driving background sound at the time when a change occurs in the behavior of the vehicle due to the autonomous driving control, or increases the volume of the autonomous driving background sound that is being output.
16. A vehicle control device as described in claim 10, further comprising an outside vehicle grasping unit (74) that grasps the approach of an emergency vehicle to the vehicle, wherein the notification implementation unit adjusts the directionality of the autonomous driving background sound and indicates the relative direction of the emergency vehicle to occupants of the vehicle.
17. A vehicle control device as described in claim 10, wherein the control grasping unit grasps the autonomous driving level associated with the driving control state currently being executed, and the notification implementation unit changes the manner of the autonomous driving background sound according to the autonomous driving level.
18. A vehicle control device as described in claim 1, further comprising an interior grasping unit (73) that grasps the positional relationship between a noise source and an occupant of the vehicle, wherein the noise reduction control unit implements sound field control as the noise reduction control, by adjusting the directionality of the interior sound output by an audio device (24) in the vehicle cabin and setting a virtual sound source of the interior sound at a position in the direction of the noise source with respect to the occupant.
19. A vehicle control device as claimed in claim 1, wherein the silencing control unit implements volume adjustment control for increasing the volume of content played by an audio device (24) in the vehicle cabin as the silencing control.
20. A vehicle control device as described in claim 1, wherein the noise reduction control unit implements, as the noise reduction control, a noise reduction control that uses a noise suppression device (81) that suppresses noise inside the vehicle cabin to reduce noise in a passenger seat where passengers other than the driver are seated to a greater extent than the noise in the driver's seat where the driver is seated.
21. A vehicle control device as described in claim 1, further comprising an interior recognition unit (73) that recognizes whether or not a specific type of occupant for whom noise reduction is useful is present in the vehicle cabin, wherein the noise reduction control unit performs the noise reduction control when the specific type of occupant is present in the vehicle cabin.
22. A vehicle control device as described in claim 1, wherein the silencing control section uses a sound dummy device (82) for silencing control, the sound dummy device outputting a sound that makes noise inside the vehicle cabin less audible to passengers.
23. A vehicle control device as described in claim 1, wherein the noise reduction control unit implements opening / closing control for adjusting the open / closed state of a window provided in the host vehicle in order to reduce noise inside the vehicle cabin.
24. A vehicle control device as described in claim 1, further comprising an alarm implementation unit (72) that issues an alarm regarding quietness to a remote management center located remotely from the vehicle when noise accompanying the traveling of the vehicle is greater than a predetermined judgment criterion.
25. A vehicle control device as described in claim 1, further comprising: a notification implementation unit (72) that issues a notification to inquire of the driver whether or not to implement the noise reduction control based on the switch to autonomous driving control, wherein the noise reduction control unit implements the noise reduction control if the implementation of the noise reduction control is approved by the driver.
26. A vehicle control device as described in claim 1, wherein the noise reduction control unit, when a power generating device (41) mounted on the vehicle includes multiple power sources, implements a power selection control as the noise reduction control, which preferentially operates a quiet power source that generates less noise among the multiple power sources.
27. A vehicle control device as described in claim 1, wherein the noise reduction control unit stops implementing the noise reduction control during the automatic driving period when the drive mode of the vehicle is set to a sports mode that prioritizes driving performance.
28. A vehicle control method used in a host vehicle (Am) capable of traveling under autonomous driving control with no obligation on the driver to monitor the surroundings, the vehicle control method including the steps of: grasping that the driving control state of the host vehicle has been switched to a state in which the vehicle travels under the autonomous driving control (S13); and, during an automatic driving period in which the host vehicle travels under the autonomous driving control, implementing noise reduction control to reduce noise inside the vehicle cabin more than during a monitoring period in which the driver is obligated to monitor the surroundings (S20), in processing performed by at least one processing unit (51).
Citation Information
Patent Citations
Noise reduction device
JP1994012083A
Device for reducing noise in automobile compartment
JP1995030347A
Control device for vehicle
JP2007278078A
Active type sound control system for vehicle
JP2008230341A
On-vehicle information display control device
JP2015217798A
