Function control device and function control program

The function control device and program address inappropriate driver behaviors by monitoring and restricting automatic driving functions, enhancing safety through behavior awareness and transition to driving support control.

JP7578052B2Active Publication Date: 2024-11-06DENSO CORP

Patent Information

Application Number
JP2021064912
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-06
Publication Date
2024-11-06
Estimated Expiration
2041-04-06

AI Technical Summary

Technical Problem

Existing automatic driving control systems do not address inappropriate driver behaviors such as unfastening seatbelts or falling asleep during automatic driving, which can compromise vehicle safety.

Method used

A function control device and program that monitors driver behavior during automatic driving, restricting inappropriate actions and transitioning to driving support control if such behaviors are detected, and providing notifications and proposals to improve driver behavior.

Benefits of technology

Enhances driver awareness of inappropriate behaviors, improving safety by restricting automatic driving functions and encouraging better driver conduct during automatic driving periods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578052000001
    Figure 0007578052000001
  • Figure 0007578052000002
    Figure 0007578052000002
  • Figure 0007578052000003
    Figure 0007578052000003
Patent Text Reader

Abstract

To provide a function control device, etc. which can improve an inappropriate behavior of a driver in a period of traveling by an automatic driving function.SOLUTION: An automatic driving ECU is used in an own vehicle to operate as a function control device which performs control related to an automatic driving function. The automatic driving ECU grasps an inappropriate behavior of a driver whose execution in a control travel period is considered as inappropriate in the control travel period in which the own vehicle travels by the automatic driving function. Then, the next use of the automatic driving function by the driver is restricted when the inappropriate behavior by the driver is grasped in the control travel period.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The disclosure in this specification relates to a function control device and a function control program. [Background technology]

[0002] The automatic driving control device disclosed in Patent Document 1 includes a driving execution unit that executes automatic driving of a vehicle. This automatic driving control device judges whether or not the driver has driving ability before starting automatic driving, and prohibits automatic driving if it judges that the driver does not have driving ability. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-115356 A Summary of the Invention [Problem to be solved by the invention]

[0004] When a vehicle is driven by the autonomous driving function, there is a concern that the driver may take inappropriate actions, such as unfastening the seat belt or falling asleep. The autonomous driving control device disclosed in Patent Document 1 does not make the driver aware of such inappropriate actions and improve them.

[0005] The present disclosure aims to provide a function control device and a function control program that can improve inappropriate behavior of a driver while driving using an autonomous driving function. [Means for solving the problem]

[0006] In order to achieve the above object, one disclosed aspect is a function control device that is used in a host vehicle (Am) that can run using an autonomous driving function that can perform driving assistance control with a driver's obligation to monitor the surroundings and autonomous driving control without the driver's obligation to monitor the surroundings, and that performs control related to the autonomous driving function, the function control device including: a driver behavior recognition unit (72, 86) that continuously recognizes specific behavior of the driver that is deemed inappropriate to be performed during a controlled driving period in which the host vehicle runs using the autonomous driving function, the controlled driving period including at least a period before a switching condition from autonomous driving control to driving assistance control is established; and when a specific behavior by the driver is recognized during the controlled driving period, After the conditions for switching from autonomous driving control to driving assistance control are met Next time you use the Autopilot feature In this study, the transition to autonomous driving control was based on the driver's transition operation. and a control limiting unit (78, 82) that limits the Another disclosed aspect is a function control device that is used in a host vehicle (Am) that can run using an autonomous driving function that can perform driving assistance control with the driver's obligation to monitor the surroundings, and autonomous driving control without the driver's obligation to monitor the surroundings, and that performs control related to the autonomous driving function, the function control device comprising: a driver behavior grasping unit (72, 86) that continuously grasps specific behavior of the driver that is deemed inappropriate to be performed during a controlled driving period in which the host vehicle runs using the autonomous driving function, the controlled driving period including at least a period before a condition for switching from autonomous driving control to driving assistance control is satisfied; and a control restriction unit (78, 82) that, when a specific behavior by the driver is grasped during the controlled driving period, restricts actions other than driving that are permitted to the driver during the autonomous driving period under autonomous driving control in the next use of the autonomous driving function after the condition for switching from autonomous driving control to driving assistance control is satisfied.

[0007] Another disclosed aspect is a function control program for performing control related to the automatic driving function, which is used in a host vehicle (Am) that can run using an automatic driving function that can perform driving assistance control with a driver's obligation to monitor the surroundings and autonomous driving control without the driver's obligation to monitor the surroundings, and the program continuously grasps specific behavior of the driver that is deemed inappropriate to be performed during a controlled driving period during which the host vehicle runs using the automatic driving function, the controlled driving period including at least a period before a switching condition from the autonomous driving control to the driving assistance control is satisfied (S10 1) If a specific behavior by the driver is identified during the controlled driving period, After the conditions for switching from autonomous driving control to driving assistance control are met Next time you use the Autopilot feature In this case, driving is performed under autonomous driving control based on the driver's transition operation. Limit (S10 7) The function control program causes at least one processing unit (11, 51) to execute a process including the steps of: Also, one disclosed aspect is a function control program used in a host vehicle (Am) capable of driving by an automatic driving function capable of implementing driving assistance control with an obligation for the driver to monitor the surroundings and autonomous driving control without the driver being obligated to monitor the surroundings, and which performs control related to the automatic driving function, the function control program causing at least one processing unit (11, 51) to execute processing including: continuously grasping specific behavior of the driver that is deemed inappropriate to be performed during a controlled driving period in which the host vehicle is driven by the automatic driving function and which includes at least a period before a switching condition from autonomous driving control to driving assistance control is satisfied (S301); and, if a specific behavior by the driver is grasped during the controlled driving period, restricting actions other than driving that are permitted to the driver during the automatic driving period under autonomous driving control in the next use of the automatic driving function after the switching condition from autonomous driving control to driving assistance control is satisfied (S307).

[0008] In these aspects, if a specific inappropriate behavior of the driver is identified during a controlled driving period in which the vehicle is driven by the automatic driving function, the next use of the automatic driving function is restricted. If the use of the automatic driving function is restricted in this manner, the driver can recognize that there was inappropriate behavior in the previous controlled driving period. As a result, it is possible to improve the driver's inappropriate behavior during the controlled driving period.

[0009] The reference numbers in parentheses above and in the claims merely indicate an example of a corresponding relationship with a specific configuration in an embodiment described later, and do not limit the technical scope in any way. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram showing an overall view of an in-vehicle network including an autonomous driving system and an HMI system according to a first embodiment of the present disclosure. FIG. [Diagram 2] FIG. 2 is a block diagram showing details of an autonomous driving ECU. [Diagram 3] FIG. 1 is a block diagram showing details of the HCU. [Figure 4] 10 is a flowchart showing details of a limit setting process performed by an autonomous driving ECU or an HCU. [Diagram 5] 5 is a flowchart showing details of a driving control switching process performed by an autonomous driving ECU. [Figure 6] 10 is a flowchart showing details of a proposal execution process performed by an autonomous driving ECU or HCU. [Figure 7] 13A and 13B are diagrams illustrating examples of displaying a notification of usage restrictions and a suggestion for improving behavior. [Figure 8] 10 is a flowchart showing details of a limit setting process performed by an autonomous driving ECU or an HCU. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, a number of embodiments will be described with reference to the drawings. In addition, by assigning the same reference numerals to corresponding components in each embodiment, duplicated descriptions may be omitted. When only a part of the configuration is described in each embodiment, the configuration of the other embodiment described above can be applied to the other parts of the configuration. In addition to the combination of configurations explicitly stated in the description of each embodiment, configurations of multiple embodiments can be partially combined together even if not explicitly stated, as long as there is no particular problem with the combination.

[0012] First embodiment The function of the function control device according to the first embodiment of the present disclosure is realized by an automatic driving ECU (Electronic Control Unit) 50b shown in Fig. 1 and Fig. 2. The automatic driving ECU 50b is mounted on a vehicle (hereinafter, the host vehicle Am) together with a driving assistance ECU 50a and a human machine interface control unit (HCU) 100. The automatic driving ECU 50b, together with the driving assistance ECU 50a and the like, configures an automatic driving system 50 of the host vehicle Am. By mounting the automatic driving system 50, the host vehicle Am becomes an automatic driving vehicle equipped with an automatic driving function.

[0013] In the autonomous driving system 50, the driving assistance ECU 50a is an in-vehicle ECU that realizes a driving assistance function that assists the driver in driving operations. The driving assistance ECU 50a enables advanced driving assistance or partial autonomous driving control at about level 2 in the autonomous driving levels defined by the Society of Automotive Engineers. The autonomous driving performed by the driving assistance ECU 50a is an autonomous driving with a surrounding monitoring obligation that requires the driver to visually monitor the surroundings of the vehicle.

[0014] The autonomous driving ECU 50b is an in-vehicle ECU that realizes an autonomous driving function that can take over driving operations from the driver. The autonomous driving ECU 50b can perform autonomous driving of level 3 or higher, where the system is the main controller. The autonomous driving performed by the autonomous driving ECU 50b does not require monitoring of the surroundings of the vehicle, that is, it is eyes-off autonomous driving with no obligation to monitor the surroundings.

[0015] During an automatic driving period in which the vehicle Am is automatically driven by the automatic driving function of level 3 or higher by the automatic driving ECU 50b, the driver may be permitted to perform a specific action other than driving that is prescribed in advance (hereinafter, a second task). The second task is legally permitted to the driver until a request for performing driving operation by cooperation between the automatic driving ECU 50b and the HCU 100, that is, a request for a driving changeover occurs. For example, actions such as watching entertainment content such as video content, operating a device such as a smartphone, and eating are assumed as second tasks.

[0016] The autonomous driving ECU 50b may be capable of implementing autonomous driving control of level 4 or higher. In the following description, autonomous driving control of level 2 or lower by the driving assistance ECU 50a may be referred to as "driving assistance control," and autonomous driving control of level 3 or higher by the autonomous driving ECU 50b may be referred to as "autonomous driving control."

[0017] The driving assistance ECU 50a, the autonomous driving ECU 50b, and the HCU 100 are communicatively connected to a communication bus 99 of an in-vehicle network 1 mounted on the host vehicle Am. A driver monitor 29, a surroundings monitoring sensor 30, a locator 35, an in-vehicle communication device 39, a driving control ECU 40, and the like are connected to the communication bus 99. These nodes connected to the communication bus 99 are capable of communicating with each other. Certain nodes among these devices and ECUs may be directly electrically connected to each other and be capable of communicating with each other without going through the communication bus 99.

[0018] The driver monitor 29 includes a near-infrared light source, a near-infrared camera, and a control unit for controlling them. The driver monitor 29 is installed, for example, on the upper surface of the steering column or the upper surface of the instrument panel with the near-infrared camera facing the headrest of the driver's seat. The near-infrared camera is configured integrally with the meter display 21 or the center information display (hereinafter, CID) 22 described later, and may be provided on either screen.

[0019] The driver monitor 29 uses a near-infrared camera to capture an image of the driver's head illuminated with near-infrared light from a near-infrared light source. The image captured by the near-infrared camera is analyzed by a control unit. The control unit extracts information such as the position of the driver's eye point and the line of sight from the captured image. The driver monitor 29 provides the driver status information extracted by the control unit to the HCU 100, the autonomous driving ECU 50b, etc.

[0020] The periphery monitoring sensor 30 is an autonomous sensor that monitors the environment surrounding the host vehicle Am. The periphery monitoring sensor 30 can detect moving objects and stationary objects within a detection range around the host vehicle. The periphery monitoring sensor 30 can detect at least a vehicle ahead, a vehicle behind, a vehicle on one side, and the like that are traveling around the host vehicle Am. The periphery monitoring sensor 30 provides detection information of objects around the host vehicle to the driving assistance ECU 50a, the autonomous driving ECU 50b, and the like.

[0021] The periphery monitoring sensor 30 includes, for example, one or more of a camera unit 31, a millimeter wave radar 32, a lidar 33, and a sonar 34. The camera unit 31 may be configured to include a monocular camera or may be configured to include a compound eye camera. The camera unit 31 is mounted on the host vehicle Am so as to be able to capture an image of the range ahead of the host vehicle Am. The host vehicle Am may also be equipped with a camera unit 31 capable of capturing images of the lateral and rear ranges of the host vehicle Am. The camera unit 31 outputs at least one of the imaging data capturing the image of the surroundings of the host vehicle and the analysis result of the imaging data as detection information.

[0022] The millimeter wave radar 32 irradiates millimeter waves or quasi-millimeter waves toward the surroundings of the vehicle. The millimeter wave radar 32 outputs detection information generated by a process of receiving waves reflected by moving objects, stationary objects, etc. The lidar 33 irradiates laser light toward the surroundings of the vehicle. The lidar 33 outputs detection information generated by a process of receiving laser light reflected by moving objects, stationary objects, etc. present within the irradiation range. The sonar 34 emits ultrasonic waves toward the surroundings of the vehicle. The sonar 34 outputs detection information generated by a process of receiving ultrasonic waves reflected by moving objects, stationary objects, etc. present in the vicinity of the vehicle.

[0023] Locator 35 includes a GNSS (Global Navigation Satellite System) receiver, an inertial sensor, etc. Locator 35 sequentially determines the position and traveling direction of host vehicle Am by combining the positioning signal received by the GNSS receiver, the measurement results of the inertial sensor, and the vehicle speed information output to communication bus 99, etc. Locator 35 sequentially outputs position information and direction information of host vehicle Am based on the positioning results to communication bus 99 as locator information.

[0024] Locator 35 further has a map database (hereinafter, map DB) 36 that stores map data. Map DB 36 is mainly composed of a large-capacity storage medium that stores a large amount of 3D map data and 2D map data. The 3D map data includes information necessary for advanced driving assistance and automated driving, such as 3D shape information of roads and detailed information on each lane. Locator 35 reads map data of the area around the current position from map DB 36, and provides it to driving assistance ECU 50a, automated driving ECU 50b, etc. together with locator information.

[0025] The in-vehicle communication device 39 is an external communication unit mounted on the host vehicle Am, and functions as a V2X (Vehicle to Everything) communication device. The in-vehicle communication device 39 transmits and receives information to and from roadside devices installed on the side of the road via wireless communication. As an example, the in-vehicle communication device 39 receives congestion information around the current position of the host vehicle Am and in the traveling direction from the roadside device. The congestion information is VICS (registered trademark) information or the like. The in-vehicle communication device 39 provides the received congestion information to the autonomous driving ECU 50b or the like.

[0026] The driving control ECU 40 is an electronic control device mainly including a microcontroller. The driving control ECU 40 has at least the functions of a brake control ECU, a drive control ECU, and a steering control ECU. The driving control ECU 40 continuously performs brake force control for each wheel, output control of the in-vehicle power source, and steering angle control based on one of an operation command based on the driver's driving operation, a control command from the driving assistance ECU 50a, and a control command from the automatic driving ECU 50b. In addition, the driving control ECU 40 generates vehicle speed information indicating the current driving speed of the host vehicle Am based on detection signals from wheel speed sensors provided at the hubs of each wheel, and sequentially outputs the generated vehicle speed information to the communication bus 99.

[0027] Next, the HCU 100, the driving assistance ECU 50a, and the automatic driving ECU 50b will be described in detail with reference to FIGS.

[0028] The HCU 100 constitutes an HMI (Human Machine Interface) system 10 together with a plurality of display devices, an audio device 24, an operation device 26, etc. The HMI system 10 has an input interface function that accepts operations by an occupant such as a driver of the host vehicle Am, and an output interface function that presents information to the driver.

[0029] The display device presents information to the driver's vision by displaying images or the like. The display devices include a meter display 21, a CID 22, and a head-up display (hereinafter, HUD) 23. The CID 22 has a touch panel function and detects touch operations on the display screen by the driver or the like. The audio device 24 has multiple speakers installed in the vehicle cabin in an arrangement surrounding the driver's seat, and reproduces notification sounds, voice messages, or the like through the speakers in the vehicle cabin.

[0030] The operation device 26 is an input unit that accepts user operations by a driver or the like. User operations related to, for example, activation and deactivation of an automatic driving function are input to the operation device 26. As an example, a driver input instructing a transition from driving assistance control to autonomous driving control (hereinafter, level 3 transition operation) is input to the operation device 26. The operation device 26 includes a steer switch provided on the spokes of the steering wheel, an operation lever provided on the steering column, and a voice input device that recognizes the contents of the driver's speech.

[0031] The HCU 100 functions as a presentation control device that comprehensively manages the presentation of information related to autonomous driving to the driver. The HCU 100 requests the driver to take over driving based on a request to perform driving operation by the autonomous driving ECU 50b. In addition, as described above, the HCU 100 cooperates with the autonomous driving ECU 50b to allow the driver to perform a second task and can play video content related to the second task without interfering with the request to take over driving.

[0032] The HCU 100 mainly includes a processing unit 11, a RAM 12, a storage unit 13, an input / output interface 14, and a control circuit including a bus connecting these. The processing unit 11 is hardware for arithmetic processing coupled to the RAM 12. The processing unit 11 includes at least one arithmetic core such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processing unit 11 may further include an FPGA (Field-Programmable Gate Array), an NPU (Neural network Processing Unit), and an IP core having other dedicated functions. The RAM 12 may include a video RAM for generating video data. The processing unit 11 accesses the RAM 12 to execute various processes for the presentation control process. The storage unit 13 includes a non-volatile storage medium. The storage unit 13 stores various programs (presentation control programs, etc.) executed by the processing unit 11.

[0033] The HCU 100 has a plurality of functional units that perform integrated control of information presentation to the driver by executing a presentation control program stored in the storage unit 13 using the processing unit 11. Specifically, the HCU 100 has functional units such as an information acquisition unit 81, an information linking unit 82, a driver behavior grasping unit 86, and a presentation control unit 88 (see FIG. 3).

[0034] The information acquisition unit 81 acquires vehicle information indicating the state of the host vehicle Am from the communication bus 99. The vehicle information includes, for example, vehicle speed information provided to the communication bus 99 by the cruise control ECU 40. In addition, the information acquisition unit 81 acquires operation information indicating the content of a user operation from the CID 22, the operation device 26, etc.

[0035] The information linking unit 82 links with an information linking unit 61 (described later) of the autonomous driving ECU 50b, and enables information sharing between the autonomous driving system 50 and the HCU 100. The information linking unit 82 provides the autonomous driving ECU 50b with operation information grasped by the information acquisition unit 81, driver behavior information (described later) grasped by the driver behavior grasping unit 86, and the like.

[0036] The information linking unit 82 obtains control status information indicating the state of the autonomous driving function to grasp the operating state of autonomous driving by the autonomous driving system 50. Based on the control status information, the information linking unit 82 grasps whether the driver is obligated to monitor the surroundings in the driving control performed by the autonomous driving function, in other words, whether the driving control being performed is driving assistance control or autonomous driving control.

[0037] The information linking unit 82 acquires a request for notification output by a notification request unit 73 (described later) of the autonomous driving ECU 50b. The information linking unit 82 acquires, from the autonomous driving ECU 50b, a request for requesting the driver to take over driving, a request for notification of control transition related to a transition from driving assistance control to autonomous driving control, and the like. Based on the request for notification, the information linking unit 82 controls the content and timing of each notification in cooperation with the presentation control unit 88.

[0038] The driver behavior grasping unit 86 grasps the state and behavior of the driver based on the driver status information acquired from the driver monitor 29. As an example, the driver behavior grasping unit 86 grasps task information indicating the contents of the second task being performed by the driver. For example, the task information is information such as operating a smartphone, gazing at the screen of the CID 22, operating the touch panel of the CID 22, etc. The driver behavior grasping unit 86 may further grasp monitoring information indicating whether the driver is monitoring the surroundings of the host vehicle Am, and posture information indicating whether the driver's driving posture is appropriate. In addition, the driver behavior grasping unit 86 may further acquire driving operation information indicating operations such as steering operation, accelerator operation, and brake operation by the driver, as well as fastening and unfastening information of the seat belt, etc.

[0039] The driver behavior grasping unit 86 detects specific behaviors (hereinafter, inappropriate behaviors) that are determined to be performed by the driver during a controlled driving period in which the host vehicle Am is driven by driving control by the automatic driving function, using the driver status information, driving operation information, and fastening / removal information. The inappropriate behaviors are defined in advance according to the automatic driving level of the driving control performed by the automatic driving function. That is, one or more inappropriate behaviors are set for each of the inappropriate behaviors during the controlled driving period in which the host vehicle Am is driven by driving assistance control (hereinafter, driving assistance period) and the controlled driving period in which the host vehicle Am is driven by autonomous driving control (hereinafter, automatic driving period). The driver behaviors that are inappropriate behaviors may be changed as appropriate. The driver behavior grasping unit 86 detects behaviors such as unfastening a seat belt, losing posture, falling asleep, and performing steering operations that do not result in an override as inappropriate behaviors during the automatic driving period. The driver behavior grasping unit 86 provides inappropriate behavior information indicating inappropriate behavior of the driver, in addition to the task information and monitoring information, as driver behavior information, to the information linking unit 82 and the presentation control unit 88. The driver behavior information is provided to the autonomous driving ECU 50b through the information linking unit 82.

[0040] The presentation control unit 88 performs integrated control of the provision of information to the driver using each display device and the audio device 24. The presentation control unit 88 provides content and presents information according to the operating state of the autonomous driving. When the information linking unit 82 determines that autonomous driving control is being performed with eyes off, which does not require monitoring of the surroundings, the presentation control unit 88 enables the playback of video content, etc. In addition, the presentation control unit 88 requests a driver to take over and notifies the driver of a control transition, etc., based on an implementation request acquired by the information linking unit 82.

[0041] The driving assistance ECU 50a is a computer mainly including a control circuit equipped with a processing unit, a RAM, a storage unit, an input / output interface, and a bus connecting these, etc. The driving assistance ECU 50a realizes driving assistance functions such as ACC (Adaptive Cruise Control), LTC (Lane Trace Control), and LCA (Lane Change Assist) by executing a program in the processing unit. As an example, the driving assistance ECU 50a performs driving assistance control to drive the host vehicle Am along the host vehicle lane by coordinating the functions of ACC and LTC.

[0042] The autonomous driving ECU 50b has a higher computing power than the driving assistance ECU 50a and can at least perform driving control equivalent to ACC, LTA, and LCA. The autonomous driving ECU 50b is a computer mainly including a processing unit 51, a RAM 52, a storage unit 53, an input / output interface 54, and a control circuit including a bus connecting these, as in the case of the HCU 100. The processing unit 11 executes various processes for realizing the autonomous driving control method and the function control method of the present disclosure by accessing the RAM 12. The storage unit 13 stores various programs (autonomous driving control program, function control program, etc.) executed by the processing unit 11. By executing the programs by the processing unit 51, the autonomous driving ECU 50b is configured with an information linking unit 61, an environment recognition unit 62, an action determination unit 63, a control execution unit 64, etc. as a plurality of functional units for realizing the autonomous driving function, etc.

[0043] The information linking unit 61 provides information to the information linking unit 82 of the HCU 100 and acquires information from the information linking unit 82. Through the linkage between these information linking units 61, 82, the autonomous driving ECU 50b and the HCU 100 share the information they have acquired. The information linking unit 61 generates control status information indicating the operation state of the autonomous driving function, and provides the generated control status information to the information linking unit 82. The information linking unit 61 has an input grasping unit 71, a driver grasping unit 72, and a notification request unit 73 as sub-functional units for information linkage.

[0044] The input grasping unit 71 acquires driver operation information from the information linking unit 82. Based on the operation information, the input grasping unit 71 grasps a user operation input to the CID 22, the operation device 26, etc. As an example, the input grasping unit 71 grasps a level 3 transition operation that instructs a transition from driving assistance control to autonomous driving control.

[0045] The driver ascertaining unit 72 acquires driver behavior information from the information linking unit 82. The driver ascertaining unit 72 ascertains the driver's behavior during the driving assistance period and the automatic driving period based on the driver behavior information. The driver ascertaining unit 72 ascertains whether or not the driver monitors the surroundings, and the contents of the second task performed by the driver. In addition, the driver ascertaining unit 72 ascertains whether or not the driver has performed a predefined inappropriate behavior during each of the driving assistance period and the automatic driving period. The driver ascertaining unit 72 may have the function of the driver behavior ascertaining unit 86 of the HCU 100. In detail, the driver ascertaining unit 72 may acquire driver status information from the driver monitor 29 and detect the performance of an inappropriate behavior by the driver, similar to the driver behavior ascertaining unit 86.

[0046] The notification request unit 73 enables the HCU 100 to issue a notification synchronized with the operation state of the autonomous driving function by outputting a notification execution request to the information linking unit 82. As described above, the notification request unit 73 transmits, to the information linking unit 82, a request to execute a driving changeover request, a request to execute a control transition notification, and the like, as a request to execute a notification related to autonomous driving.

[0047] In addition, the notification request unit 73 transmits implementation requests such as a usage restriction notification, a driving assistance use suggestion, and a behavior improvement suggestion to the information linking unit 82. The usage restriction notification is a notification to the driver that driving by autonomous driving control is restricted due to inappropriate behavior by the driver. The driving assistance use suggestion is information presentation that suggests to the driver that driving by driving assistance control is used when using the automatic driving function when driving by autonomous driving control is prohibited. The behavior improvement suggestion is information presentation that suggests to the driver to improve behavior when inappropriate behavior by the driver is identified during the controlled driving period (automatic driving period).

[0048] The environment recognition unit 62 recognizes the driving environment of the host vehicle Am by combining the locator information and map data acquired from the locator 35 with the detection information acquired from the periphery monitoring sensor 30. The environment recognition unit 62 has an other vehicle grasping unit 74, an area grasping unit 75, and a traffic congestion grasping unit 76 as sub-functional units for recognizing the driving environment.

[0049] The other vehicle grasping unit 74 grasps the relative positions and relative speeds of dynamic targets around the host vehicle, such as other vehicles. The other vehicle grasping unit 74 grasps at least the vehicles ahead and behind traveling in the same lane as the host vehicle Am (hereinafter, the host vehicle lane), and the vehicles to the side traveling in the adjacent lanes adjacent to the host vehicle lane.

[0050] The area ascertaining unit 75 ascertains information related to the road on which the host vehicle Am is traveling. Specifically, the area ascertaining unit 75 ascertains whether the road on which the host vehicle Am is traveling or the road on which the host vehicle Am is to travel is within a preset permitted area or limited permitted area. Information indicating whether the area is a permitted area or a limited permitted area may be recorded in the map data stored in the map DB 36, or may be included in the received information received by the in-vehicle communication device 39.

[0051] Here, the permission area and the limited permission area may correspond to an operational design domain in which automated driving without the driver's obligation to monitor the surroundings is legally permitted. In detail, the automated driving without the obligation to monitor the surroundings includes, as a plurality of implementation modes, congestion limited control implemented only during driving in congestion (hereinafter, congestion level 3), and area limited control implemented only within a specific area (hereinafter, area level 3). On roads within the permission area, both congestion level 3 and area level 3 are permitted to be implemented, and on roads within the limited area, only congestion level 3 is permitted to be implemented. On roads that are not included in either the permission area or the limited permission area (hereinafter, non-permitted area), automated driving without the obligation to monitor the surroundings is prohibited.

[0052] The traffic congestion grasping unit 76 grasps traffic congestion around the host vehicle Am by combining information on other vehicles grasped by the other vehicle grasping unit 74 and vehicle speed information provided by the cruise control ECU 40. The traffic congestion grasping unit 76 judges whether or not a traffic congestion state has occurred, predicts the end of the traffic congestion, and judges whether or not the traffic congestion has been resolved. The traffic congestion grasping unit 76 may use traffic congestion information received by the in-vehicle communication device 39 for judgments related to traffic congestion.

[0053] The traffic jam grasping unit 76 determines that the area around the vehicle is in a traffic jam state when the current vehicle speed of the vehicle Am is equal to or lower than the traffic jam speed (for example, about 10 km / h) and there is a vehicle ahead traveling in the vehicle lane. After determining that the area around the vehicle is in a traffic jam state, the traffic jam grasping unit 76 predicts that the traffic jam around the vehicle will be resolved if the vehicle speed of the vehicle Am exceeds the traffic jam speed. After predicting that the traffic jam will be resolved, the traffic jam grasping unit 76 cancels the prediction that the traffic jam will be resolved if the vehicle speed of the vehicle Am again becomes equal to or lower than the traffic jam speed. On the other hand, after predicting that the traffic jam will be resolved around the vehicle, the traffic jam grasping unit 76 determines that the traffic jam has been resolved if the vehicle speed of the vehicle Am or the vehicle ahead exceeds the traffic jam resolution speed (for example, about 60 km / h).

[0054] The behavior determination unit 63 cooperates with the HCU 100 to control the autonomous driving system 50 and the driving changeover between the driver. When the autonomous driving system 50 has control of the driving operation, the behavior determination unit 63 generates a planned driving line for the host vehicle Am to travel on the basis of the recognition result of the driving environment by the environment recognition unit 62, and outputs the generated planned driving line to the control execution unit 64. The behavior determination unit 63 has a control switching unit 78 as a sub-functional unit for controlling the operating state of the autonomous driving function.

[0055] The control switching unit 78 cooperates with the driving assistance ECU 50a to switch between driving assistance control with the driver's obligation to monitor the surroundings and autonomous driving control without the driver's obligation to monitor the surroundings by performing a driving control switching process (see FIG. 5) described later. In addition, when the vehicle Am is driven by the autonomous driving control, the control switching unit 78 switches the driving control state among a plurality of states including area level 3 and congestion level 3. For example, when the input of a level 3 transition operation by the driver is grasped by the input grasping unit 71, the control switching unit 78 switches the driving control state from the driving assistance control to the autonomous driving control. In addition, when the entry of the vehicle Am into congestion is grasped by the congestion grasping unit 76 in the permitted area or the limited permitted area, the control switching unit 78 switches the driving control state from the driving assistance control to the autonomous driving control of congestion level 3.

[0056] In addition, if the control switching unit 78 detects inappropriate behavior by the driver during the controlled driving period, it restricts the driver from using the autonomous driving function next time. Specifically, if the control switching unit 78 detects inappropriate behavior by the driver during the current autonomous driving period, it prohibits driving by autonomous driving control in area level 3 the next time the driver uses the autonomous driving function. On the other hand, even if the control switching unit 78 detects inappropriate behavior by the driver, driving by congestion level 3 in a congestion driving scene and driving by driving assistance control are both permitted.

[0057] When the autonomous driving ECU 50b has control of driving operations, the control execution unit 64 cooperates with the cruise control ECU 40 to execute acceleration / deceleration control, steering control, and the like of the host vehicle Am according to the planned driving line generated by the action determination unit 63. Specifically, the control execution unit 64 generates control commands based on the planned driving line and sequentially outputs the generated control commands to the cruise control ECU 40.

[0058] As described above, when the driver performs an inappropriate behavior, the autonomous driving ECU 50b restricts the use of the autonomous driving function. The details of the restriction setting process that realizes the restriction on the use of the autonomous driving function, the driving control switching process that switches the driving control state depending on the presence or absence of the restriction on the use, and the proposal execution process that proposes behavior improvement to the driver will be described below in order based on Figures 4 to 6 and with reference to Figures 1 to 3 and 7.

[0059] 4 is a process for setting and releasing restrictions on the use of an autonomous driving function. The restriction setting process is started by the autonomous driving ECU 50b that has started Level 3 autonomous driving control.

[0060] In S101 of the restriction setting process, the driver ascertaining unit 72 ascertains the driver's behavior based on the driver behavior information. In S101, inappropriate behavior of the driver is particularly ascertained. In S102, the control switching unit 78 ascertains whether or not a switching condition from autonomous driving control to driving assistance control is satisfied. If it is determined in S102 that the switching condition is not satisfied, the process returns to S101, and the driver's behavior is continued to be ascertained. By repeating S101 and S102, the presence or absence of inappropriate behavior of the driver during the controlled driving period (automated driving period) is continuously ascertained.

[0061] If it is determined in S102 that the switching condition is satisfied, the control switching unit 78 determines in S103 whether or not a restriction is set on the use of the autonomous driving control of level 3. If it is determined in S103 that a use restriction is set on the autonomous driving control, the control switching unit 78 determines in S104 whether or not the driver's inappropriate behavior has been recognized by the driver behavior recognition unit 86. In S104, it is determined whether or not the driver's behavior has improved in the immediately preceding automatic driving period. If the driver's inappropriate behavior has been recognized in the immediately preceding automatic driving period, the control switching unit 78 determines that the driver's behavior has not improved, and ends the current restriction setting process. As a result, the state in which the use of the autonomous driving control is restricted is maintained. On the other hand, if the driver's inappropriate behavior has not been recognized in the immediately preceding automatic driving period, the control switching unit 78 determines that the driver's behavior has improved. In this case, the control switching unit 78 relaxes or releases the use restriction on the autonomous driving control in S105, and ends the current restriction setting process.

[0062] If it is determined in S103 that no limit on the use of the autonomous driving control has been set, the control switching unit 78 determines in S106 whether or not the driver's inappropriate behavior has been recognized by the driver behavior recognition unit 86. If the driver did not behave inappropriately in the immediately preceding autonomous driving period, the control switching unit 78 ends the current limit setting process. On the other hand, if the driver's inappropriate behavior was recognized in the immediately preceding autonomous driving period, the control switching unit 78 changes the setting in S107 to make the transition conditions to the autonomous driving control stricter, and ends the current limit setting process. As a result, the next time the autonomous driving function is used, driving using the autonomous driving control of area level 3 is prohibited.

[0063] 5 is a process for switching the driving control state of the autonomous driving function between the driving assistance control described above and the autonomous driving control including traffic jam level 3 and area level 3. The driving control switching process is started mainly by the control switching unit 78 after the autonomous driving function is activated, and is repeatedly performed until the autonomous driving function is stopped.

[0064] In S121 of the driving control switching process, the control switching unit 78 determines whether or not the current driving area of ​​the host vehicle Am recognized by the area recognition unit 75 is a non-permitted area. If the host vehicle Am is driving in a non-permitted area, the control switching unit 78 determines in S127 whether or not to implement or continue driving assistance control. On the other hand, if the host vehicle Am is driving in a permitted area or a restricted permitted area, the control switching unit 78 determines in S122 whether or not the input recognition unit 71 has recognized a level 3 transition operation.

[0065] If a level 3 transition operation is not detected, the control switching unit 78 determines in S127 whether to implement or continue driving assistance control. On the other hand, if a level 3 transition operation is detected, the control switching unit 78 determines in S123 whether or not a traffic jam has been detected by the traffic jam detection unit 76. If a traffic jam around the host vehicle has been detected, the control switching unit 78 determines in S129 whether to implement or continue autonomous driving control at level 3 in traffic jam. In this way, even if a restriction on the use of autonomous driving control is set due to the driver's inappropriate behavior, autonomous driving at level 3 in traffic jam is permitted in a traffic jam driving scene in which the host vehicle Am is driving in a traffic jam.

[0066] If congestion around the vehicle is not detected, the control switching unit 78 determines in S124 whether or not the current driving area of ​​the vehicle Am is an permitted area. If the vehicle Am is driving in a restricted permitted area, the control switching unit 78 determines in S127 whether or not to implement or continue driving assistance control. On the other hand, if the vehicle Am is driving in a permitted area, the control switching unit 78 determines in S125 whether or not a restriction is set on the use of the autonomous driving control. If no restriction is set on the use of the autonomous driving control, the control switching unit 78 determines in S128 whether or not to implement or continue area level 3 autonomous driving control.

[0067] If restrictions are set on the use of autonomous driving control, the control switching unit 78 instructs the notification request unit 73 to output a request to implement a driving assistance usage suggestion proposing the use of driving assistance control in S126, and further determines whether to implement or continue driving assistance control in S127.

[0068] According to the above driving control switching process, even in a congestion relief scene where a transition from congestion level 3 to area level 3 is possible based on the elimination of congestion in the permitted area, a transition from congestion level 3 to driving assistance control at level 2 or lower is implemented based on the setting of usage restrictions. In addition, in conjunction with the forced transition to driving assistance control, a driving assistance use proposal proposing the use of driving assistance control is implemented by the HCU 100 that has acquired the implementation request. Note that, if the driver decides not to use the driving assistance control in response to the driving assistance use proposal, the driver can end the driving assistance control by implementing an override such as accelerator operation and start driving by manual driving.

[0069] The proposal execution process shown in Fig. 6 is performed mainly by the notification request unit 73 based on the driver recognition unit 72's recognition of the level 3 transition operation. In S141 of the proposal execution process, the notification request unit 73 determines whether or not a restriction is set on the use of the autonomous driving control. If no restriction is set on the use of the autonomous driving control, the notification request unit 73 ends this proposal execution process. In this case, the HCU 100 does not implement a behavior improvement proposal for the driver.

[0070] On the other hand, when a restriction is set on the use of the autonomous driving control, the notification request unit 73 outputs a request for implementing a use restriction notification to the information linking unit 82 in S142. The presentation control unit 88 notifies the driver that the use of the autonomous driving control is restricted based on the acquisition of the request for implementing the use restriction notification by the information linking unit 82. Specifically, the presentation control unit 88 plays a voice message such as "The use of the autonomous driving function is restricted" in the vehicle cabin using the audio device 24. In addition, the presentation control unit 88 displays a message window MW1 (see FIG. 7) including a text message such as "The use of the autonomous driving function is restricted" as a virtual image within the viewing angle VA of the HUD 23. The display device that displays the message window MW1 may be the meter display 21, the CID 22, or the like.

[0071] Furthermore, in S143, the notification request unit 73 outputs a request to implement the behavior improvement proposal to the information linking unit 82. Based on the acquisition of the request to implement the behavior improvement proposal by the information linking unit 82, the presentation control unit 88 presents information associated with the inappropriate behavior identified during the previous autonomous driving period to the driver. As an example, when an inappropriate behavior that causes poor driving posture is identified, the presentation control unit 88 notifies the driver to maintain an appropriate driving posture during the autonomous driving period. Specifically, the presentation control unit 88 plays a voice message such as "Please maintain your driving posture even during autonomous driving" in the vehicle cabin using the audio device 24.

[0072] In addition, the presentation control unit 88 displays a message window MW2 and a score bar SD using a display device such as the meter display 21 (see FIG. 7). A text message such as "Please maintain your driving posture even during automatic driving" is displayed in the message window MW2. The score bar SD is a display that visualizes and indicates what kind of behavior of the driver was inappropriate. The score bar SD displays the item name indicating each behavior defined as inappropriate behavior and the score of each behavior. In detail, when the behavior of unfastening the seat belt, a loss of posture, falling asleep, and a steering operation that does not result in an override are specified as inappropriate behavior, "seat belt", "driving posture", "falling asleep", and "driving operation" are displayed as item names. Furthermore, a bar-shaped image portion indicating the degree to which each behavior was performed relative to the criteria for inappropriate behavior is displayed adjacent to the item name. As described above, when a loss of driving posture is an inappropriate behavior, the item name of "driving posture" and the bar-shaped image portion of the score bar SD are highlighted. Furthermore, the item name and bar-shaped image portion corresponding to the inappropriate behavior may be displayed within the field of view VA of the HUD 23 as a specific score bar SDs.

[0073] For example, if the act of undoing the seat belt is detected as an inappropriate behavior, a message such as "Please keep your seat belt fastened even during automated driving" is presented to the driver by voice and image. Also, if falling asleep during the automated driving period is detected as an inappropriate behavior, a message such as "Falling asleep during automated driving is prohibited" is presented to the driver by voice and image. Furthermore, if steering operation that does not result in an override is detected as an inappropriate behavior, a message such as "Please be careful with steering operation during automated driving" is presented to the driver by voice and image.

[0074] The notification control unit 88 may sequentially issue the use restriction notification and the behavior improvement suggestion, or may issue the use restriction notification and the behavior improvement suggestion in parallel. Furthermore, the notification control unit 88 may concurrently issue the use restriction notification and the behavior improvement suggestion based on the suggestion execution process, and the driving support use suggestion based on the driving control switching process.

[0075] In the first embodiment described above, if the driver's inappropriate behavior is identified during the controlled driving period in which the vehicle is driven by the automatic driving function, the next use of the automatic driving function is restricted. If the use of the automatic driving function is restricted in this manner, the driver can recognize that the driver engaged in inappropriate behavior during the previous controlled driving period. As a result, it becomes possible to improve the driver's inappropriate behavior during the period in which the vehicle is driven by the automatic driving function.

[0076] In addition, the autonomous driving function of the first embodiment can implement driving assistance control in which the driver is obligated to monitor the surroundings, and autonomous driving control in which the driver is not obligated to monitor the surroundings. If the control switching unit 78 detects inappropriate behavior by the driver during the autonomous driving period, it prohibits driving using the autonomous driving control the next time the autonomous driving function is used. As described above, if the use of the autonomous driving control is prohibited due to inappropriate behavior, it is possible to guide the driver using the autonomous driving function to change his or her behavior.

[0077] In the first embodiment, even if an inappropriate behavior by the driver is detected during the automatic driving period, the next time the automatic driving function is used, driving with driving assistance control is permitted. In other words, even under conditions where the autonomous driving control can be implemented, only the implementation of driving assistance control is permitted. As a result, it is possible to set a penalty for the driver while ensuring the convenience of the automatic driving function, and to guide the driver to change the inappropriate behavior.

[0078] Furthermore, in the first embodiment, when a restriction is set for the use of the autonomous driving control, a notification indicating the existence of the restriction is made to the driver. Specifically, when driving by the autonomous driving control is prohibited, when the driver inputs a level 3 transition operation, the presentation control unit 88 makes a usage restriction notification and notifies the driver that the transition to the autonomous driving control will not occur. According to the above, the driver can reliably grasp the current state in which the restriction of the automatic driving function is set. As a result, the effect of making the driver aware that he / she has taken an undesirable inappropriate action and guiding the driver to change the action is more easily achieved.

[0079] In addition, in the first embodiment, if an inappropriate behavior by the driver is identified during the automatic driving period, a driving assistance use suggestion is implemented to suggest to the driver that the driving be performed under driving assistance control the next time the automatic driving function is used. Specifically, even if the driver inputs a level 3 transition operation, the presentation control unit 88 notifies the driver that driving will continue under driving assistance control. This notification also allows the driver to be aware of the inappropriate behavior that was performed during the previous automatic driving period. As a result, the effect of voluntarily encouraging behavior improvement is more easily achieved.

[0080] In the first embodiment, even if an inappropriate behavior by the driver is detected during the automatic driving period, the vehicle Am is permitted to drive using the autonomous driving control at Level 3 during congestion in a congestion driving scene in which the vehicle Am is driving in a traffic jam. Such a function of autonomous driving control at Level 3 during congestion is the most convenient function for the driver. Therefore, by not prohibiting the use of Level 3 during congestion, a situation in which the convenience for the driver is significantly impaired can be avoided.

[0081] Furthermore, in the first embodiment, even if driving at congestion level 3 is permitted in a congestion driving scene, driving at area level 3 is restricted. As a result, even in a congestion relief scene where transition to area level 3 is possible if no usage restriction is set, the control switching unit 78 forcibly transitions from congestion level 3 to driving assistance control based on the usage restriction setting. As a result of the above, it is possible to encourage improvement of inappropriate behavior by imposing a penalty on the driver while ensuring the convenience of the automated driving function.

[0082] In addition, in the first embodiment, if an inappropriate behavior by the driver is identified during the controlled driving period, a behavior improvement suggestion is made to the driver. As a result, the driver can understand which behavior was inappropriate and make appropriate improvements. Therefore, even if the use of the autonomous driving function is restricted, the convenience for the driver is unlikely to be impaired.

[0083] In addition, in the first embodiment, if an improvement in the driver's behavior is detected during the controlled driving period in which the use of the automatic driving function is restricted, the restriction on the next use of the automatic driving function is relaxed. As a result, the driver will proactively change inappropriate behavior in order to obtain the benefit of the relaxed usage restriction. As a result, it is possible to ensure the convenience of the automatic driving function while allowing the driver to understand how to use the automatic driving function appropriately.

[0084] In the first embodiment, the inappropriate behavior of the driver corresponds to the “specific behavior”, and the permitted area corresponds to the “specific area”. In addition, the autonomous driving ECU 50b corresponds to the “function control device”, the driver grasping unit 72 corresponds to the “driver behavior grasping unit”, the notification request unit 73 corresponds to the “notification control unit” and the “improvement suggestion unit”, and the control switching unit 78 corresponds to the “control limiting unit”.

[0085] Second Embodiment The second embodiment of the present disclosure is a modified example of the first embodiment. In the second embodiment, the functions of the function control device implemented in the autonomous driving ECU 50b in the first embodiment are implemented in the HCU 100 shown in Figs. 1 to 3. In addition to a presentation control program, a function control program is stored in the storage unit 53 of the HCU 100. Each functional unit of the HCU 100 can perform a restriction setting process (see Fig. 4) and a proposal execution process (see Fig. 6) based on the function control program.

[0086] The restriction setting process is mainly performed by the information linking unit 82 of the HCU 100. The information linking unit 82 links with the driver behavior grasping unit 86 to grasp the driver's behavior, particularly inappropriate behavior (S101). The information linking unit 82 refers to the control status information acquired from the automatic driving ECU 50b, and continues grasping the driver's behavior until the condition for switching from the autonomous driving control to the driving assistance control is satisfied (S102: YES).

[0087] The information linking unit 82 determines whether or not a restriction has been set on the use of the autonomous driving control by the control switching unit 78 (S103), and if a restriction on use has been set (S103: YES), it further determines whether or not the driver's behavior has improved (S104). If the driver's behavior ascertaining unit 86 has ascertained an improvement in the driver's behavior (S104: YES), the information linking unit 82 outputs a release request to the information linking unit 61 (S105). Based on the above release request, the control switching unit 78 performs a process of releasing the setting of the usage restriction.

[0088] On the other hand, if the use restriction of the autonomous driving control is not set, the information linking unit 82 judges whether or not there was inappropriate behavior during the immediately preceding autonomous driving period (S106). If the driver behavior grasping unit 86 does not grasp the inappropriate behavior (S106: NO), the information linking unit 82 ends the current restriction setting process. On the other hand, if the driver behavior grasping unit 86 grasps the inappropriate behavior (S106: YES), the information linking unit 82 outputs a restriction setting request to the information linking unit 61 to request stricter conditions for transition to the autonomous driving control (S107). Based on the above restriction setting request, the control switching unit 78 sets the use of area level 3 to be prohibited. Note that, even in the second embodiment, the use of driving assistance control at level 2 or lower and the use of autonomous driving control at level 3 during congestion are permitted even under the condition in which restrictions are set.

[0089] The proposal execution process is mainly performed by the presentation control unit 88. The presentation control unit 88 starts the proposal execution process when a level 3 transition operation is input based on the operation information acquired by the information acquisition unit 81. The presentation control unit 88 determines whether or not a usage limit is set for the autonomous driving control based on the control status information acquired by the information linking unit 82 (S141). If no usage limit is set (S141: NO), the presentation control unit 88 ends the current proposal execution process.

[0090] On the other hand, if a usage restriction is set (S141: YES), the presentation control unit 88 sequentially performs a usage restriction notification (S142) and a behavior improvement suggestion (S143) using the display device and the audio device 24 (see FIG. 7). In the second embodiment, a driving assistance usage suggestion is also performed in conjunction with the behavior improvement suggestion.

[0091] The second embodiment described so far also has the same effect as the first embodiment, and by making the driver recognize that there was inappropriate behavior in the previous controlled driving period, it is possible to improve the driver's inappropriate behavior during the controlled driving period. Note that in the second embodiment, the HCU 100 corresponds to the "function control device", the information linking unit 82 corresponds to the "control limiting unit", and the presentation control unit 88 corresponds to the "notification control unit" and the "improvement suggesting unit".

[0092] Third embodiment The third embodiment of the present disclosure is another modified example of the first embodiment. In the third embodiment, when an inappropriate behavior of a driver is recognized, a setting change is implemented to narrow the permitted range of the second task as a usage restriction of the autonomous driving function. Hereinafter, details of the restriction setting process (see FIG. 8) of the third embodiment for changing the permitted range of the second task will be described with reference to FIGS. 1 to 3.

[0093] The restriction setting process is mainly performed by the control switching unit 78 of the autonomous driving ECU 50b, as in the first embodiment. The control switching unit 78 cooperates with the driver recognition unit 72 and recognizes the driver's behavior, particularly inappropriate behavior, based on the driver behavior information provided by the HCU 100 (S301). The control switching unit 78 continues to recognize the driver's behavior until the autonomous driving control currently being performed is terminated (S301 and S302).

[0094] The control switching unit 78 determines whether or not a limit is set on the allowable range of the second task (S303), and if the allowable range is already limited (S303: YES), it further determines whether or not the driver's behavior has improved (S304). If the driver grasping unit 72 has grasped an improvement in the driver's behavior (S304: YES), the control switching unit 78 relaxes or removes the restriction on the allowable range (S305). On the other hand, if the driver's behavior has not improved, the control switching unit 78 maintains the restriction on the allowable range and ends the current restriction setting process.

[0095] On the other hand, if the permitted range of the second task is not limited (S303: NO), the control switching unit 78 determines whether or not there was inappropriate behavior during the immediately preceding autonomous driving period (S306). If the driver grasping unit 72 has not grasped any inappropriate behavior (S306: NO), the control switching unit 78 ends the current restriction setting process without placing any restrictions on the permitted range. On the other hand, if the driver grasping unit 72 has grasped any inappropriate behavior (S306: YES), the control switching unit 78 narrows the permitted range of the second task and ends the current restriction setting process. As a result, the second task permitted to the driver in the next autonomous driving period is restricted.

[0096] If the control switching unit 78 detects an inappropriate behavior of the driver during the current automatic driving period, the control switching unit 78 does not permit the operation of devices that are not attached to the vehicle Am during the next automatic driving period. Even in this case, the control switching unit 78 permits the operation of devices that are attached to the vehicle Am. For example, the control switching unit 78 permits the viewing of video content played by the CID 22, but does not permit the operation of a smartphone or the like that would require the driver's hands to be occupied.

[0097] Here, in the operation control switching process (see FIG. 5) of the third embodiment, the processes of S125 and S126 are omitted. Also, in the proposal execution process (see FIG. 6) of the third embodiment, a task restriction notification is implemented (S142) to indicate that the permitted range of the second task is restricted, as a notification equivalent to the use restriction notification.

[0098] The third embodiment described so far also has the same effect as the first embodiment, and by making the driver aware that he or she engaged in inappropriate behavior during the previous controlled driving period, it becomes possible to improve the driver's inappropriate behavior during the controlled driving period.

[0099] In addition, in the third embodiment, if an inappropriate behavior by the driver is detected during the autonomous driving period, the second task permitted to the driver is restricted the next time the autonomous driving function is used. As described above, if a penalty that reduces the convenience of the autonomous driving period is set, it becomes possible to guide the driver to change the inappropriate behavior.

[0100] (Fourth embodiment) The fourth embodiment of the present disclosure is a modified example of the third embodiment. In the fourth embodiment, the function of the function control device implemented in the autonomous driving ECU 50b in the third embodiment is implemented in the HCU 100. In the fourth embodiment, the information linking unit 82 mainly performs the restriction setting process (see FIG. 8) based on the function control program executed in the HCU 100.

[0101] If the driver behavior grasping unit 86 has grasped an inappropriate behavior (S306: YES), the information linking unit 82 changes the settings to narrow the permitted range of the second task (S307). The information linking unit 82 may disallow multiple second tasks in stages, or may disallow multiple second tasks all at once. As a result of the above, if the driver behavior grasping unit 86 has grasped the execution of a disallowed second task, the information linking unit 82 requests the autonomous driving ECU 50b to end the autonomous driving control.

[0102] When the driver behavior grasping unit 86 grasps an improvement in the driver behavior (S304: YES) in a state where a restriction that narrows the permitted range of the second task is set, the information linking unit 82 relaxes the set restriction of the permitted range (S305). Relaxing the restriction of the permitted range may be a process of gradually permitting some of the multiple disallowed second tasks, or may be a process of permitting all of the multiple disallowed second tasks.

[0103] The fourth embodiment described so far also has the same effect as the third embodiment, and by making the driver aware that he or she engaged in inappropriate behavior during the previous controlled driving period, it becomes possible to improve the driver's inappropriate behavior during the controlled driving period.

[0104] (Other embodiments) Although several embodiments of the present disclosure have been described above, the present disclosure should not be construed as being limited to the above-described embodiments, and can be applied to various embodiments and combinations within the scope not departing from the gist of the present disclosure.

[0105] In the first and second embodiments, if the driver behaves in an undesirable and inappropriate manner during the automatic driving period, the next transition to area level 3 is prohibited. In other words, the transition condition to level 3 is tightened by adding a condition of being in a traffic jam to the transition condition. In contrast, in the modified example 1 of the above embodiment, if the driver behaves in an inappropriate manner, the next transition to automatic driving control is completely prohibited. That is, the restriction on the use of the automatic driving function in the modified example 1 prohibits not only the transition to area level 3 but also the transition to level 3 during a traffic jam. In such modified example 1, the transition restriction to level 3 may be lifted or relaxed based on, for example, an improvement in the driver's behavior during the driving assistance (level 2) period, multiple uses of driving assistance control under a condition where level 3 can be implemented, the passage of a predetermined time after the transition is prohibited, etc.

[0106] In addition, in the second modification of the above embodiment, if the driver behaves inappropriately during the automatic driving period, not only the next use of the autonomous driving control but also the next use of the driving assistance control is prohibited.

[0107] In the above first and second embodiments, when transition to area level 3 is prohibited, transition to driving assist control is performed after the driving assist use suggestion is made, regardless of the driver's reaction. In contrast, in the modified example 3 of the above embodiment, transition to area level 3 is permitted if the driver again inputs a level 3 transition operation to instruct transition to area level 3 after the driving assist use suggestion is made. That is, in the modified example 3, the transition condition is tightened so that driver operation is required, as a usage restriction.

[0108] In the fourth modification of the above embodiment, inappropriate behavior is detected even during a driving assistance period of level 2 or lower. The types of inappropriate behavior during the driving assistance period are set to be greater than the types of inappropriate behavior during the automated driving period. If inappropriate behavior of the driver is detected during the driving assistance period, the next use of driving assistance control is prohibited.

[0109] In the fifth modification of the above embodiment, the autonomous driving ECU 50b performs autonomous driving control at level 4. If the autonomous driving ECU 50b detects inappropriate behavior during the autonomous driving period at level 4, it prohibits the next use of level 4. Incidentally, inappropriate behavior at level 4 is considered to be continuing to sleep (not waking up) even when there is a call from the system, removing the seat belt, losing posture that is outside the detection range of the driver monitor 29, etc.

[0110] In the first and second embodiments, if the driver behaves inappropriately, a behavior improvement suggestion is implemented the next time the function is used. On the other hand, in the sixth modification of the above embodiment, a behavior improvement suggestion is implemented when the driver's inappropriate behavior is recognized. In this case, the next use of the function is also restricted depending on whether or not the behavior has been improved.

[0111] In the seventh modification of the above embodiment, when the use of the autonomous driving control is restricted, even if a level 3 transition operation is performed, the use restriction notification is not implemented. As in the seventh modification, each notification to the driver may be omitted as appropriate. In addition, the content of each notification may be changed as appropriate.

[0112] In the eighth modification of the above embodiment, the degree of restriction on the use of the autonomous driving function is changed according to the type and level of inappropriate behavior detected during the autonomous driving period. For example, if the driver falls asleep, the use of level 3 is completely prohibited, and if the driver has poor posture, only the use of area level 3 is prohibited.

[0113] In the 9th modification of the above embodiment, each function of the driving assistance ECU 50a and the automatic driving ECU 50b is provided by one automatic driving ECU. That is, the automatic driving ECU 50b of the 9th modification is implemented with the functions of the driving assistance ECU 50a. In this automatic driving ECU 50b, functional units such as an environment recognition unit 62, a behavior determination unit 63, a control execution unit 64, an information acquisition unit 81, a driver behavior grasping unit 86, and a presentation control unit 88 are constructed based on a function control program. That is, in the 9th modification, the functional units corresponding to the information linking units 61 and 82 are omitted.

[0114] In a tenth modification of the above embodiment, the functions of the driving assistance ECU 50a, the autonomous driving ECU 50b, and the HCU 100 are provided by a single integrated ECU. In the tenth modification, the integrated ECU corresponds to the "function control device."

[0115] In the above embodiment, each function provided by the autonomous driving ECU and HCU can be provided by software and hardware that executes the software, software only, hardware only, or a combination of these. Furthermore, when such a function is provided by an electronic circuit as hardware, each function can also be provided by a digital circuit including a large number of logic circuits, or an analog circuit.

[0116] Each processing unit in the above embodiment may be individually mounted on a printed circuit board, or may be mounted on an ASIC (Application Specific Integrated Circuit) and an FPGA. The form of a storage medium (non-transitory tangible storage medium) that stores various programs and the like may also be changed as appropriate. Furthermore, the storage medium is not limited to a configuration provided on a circuit board, and may be provided in the form of a memory card or the like, inserted into a slot, and electrically connected to a control circuit of an autonomous driving ECU or HCU. The storage medium may also be an optical disk or a hard disk drive that is a source from which a program is copied to an autonomous driving ECU or HCU.

[0117] The vehicle equipped with the above-mentioned automatic driving system and HMI system is not limited to a general private passenger car, but may be a rental car vehicle, a manned taxi vehicle, a ride-sharing vehicle, a freight vehicle, a bus, etc. In addition, the vehicle equipped with the automatic driving system and HMI system may be a right-hand drive vehicle or a left-hand drive vehicle. Furthermore, the traffic environment in which the vehicle runs may be a traffic environment based on left-hand traffic or a traffic environment based on right-hand traffic. The contents of the automatic driving control, information presentation control, and function control according to the present disclosure may be appropriately optimized according to the road traffic laws of each country and region, and further the steering wheel position of the vehicle, etc.

[0118] The control unit and the method described herein may be implemented by a special-purpose computer having a processor programmed to execute one or more functions embodied in a computer program. Alternatively, the device and the method described herein may be implemented by a special-purpose hardware logic circuit. Alternatively, the device and the method described herein may be implemented by one or more special-purpose computers configured by a combination of a processor that executes a computer program and one or more hardware logic circuits. The computer program may also be stored in a computer-readable non-transitory tangible recording medium as instructions to be executed by the computer. [Explanation of symbols]

[0119] Am: vehicle; 11, 51: processing unit; 50b: autonomous driving ECU (function control device); 72: driver recognition unit (driver behavior recognition unit); 73: notification request unit (notification control unit, improvement proposal unit); 78: control switching unit (control restriction unit); 82: information linking unit (control restriction unit); 86: driver behavior recognition unit; 88: presentation control unit (notification control unit, improvement proposal unit); 100: HCU (presentation control device)

Claims

1. A function control device is used in a vehicle (Am) that can run by an automatic driving function that can perform driving assistance control with a driver's obligation to monitor the surroundings and autonomous driving control without the driver's obligation to monitor the surroundings, and performs control related to the automatic driving function, A driver behavior grasping unit (72, 86) that continuously grasps a specific behavior of the driver that is determined to be inappropriate to be performed during a controlled driving period during which the vehicle is driven by the automatic driving function, the controlled driving period including at least a period before a switching condition from the autonomous driving control to the driving assistance control is satisfied; a control limiting unit (78, 82) that, when the specific behavior of the driver is grasped during the controlled driving period, limits a transition to the autonomous driving control based on a transition operation of the driver in the next use of the automatic driving function after the switching condition from the autonomous driving control to the driving assistance control is satisfied; A function control device comprising:

2. 2. The function control device according to claim 1, wherein, when the specific behavior by the driver is detected during an automatic driving period in which the vehicle is driven by the autonomous driving control, the control restriction unit prohibits driving by the autonomous driving control the next time the automatic driving function is used.

3. The function control device according to claim 2 , wherein the control restriction unit permits driving under the driving assistance control the next time the autonomous driving function is used, even if the specific behavior by the driver is detected during the autonomous driving period.

4. The function control device according to claim 2 or 3, further comprising a notification control unit (73, 88) that notifies the driver that the driving under the autonomous driving control is restricted.

5. The function control device according to claim 1, further comprising an alert control unit (73, 88) that, when the specific behavior by the driver is detected during an automatic driving period in which the vehicle is driven by the autonomous driving control, suggests to the driver that the vehicle be driven by the driving assistance control the next time the automatic driving function is used.

6. The function control device according to claim 5 , wherein the notification control unit notifies the driver that the driving under the autonomous driving control is restricted.

7. The function control device according to any one of claims 2 to 6, wherein the control restriction unit allows driving using the autonomous driving control in a traffic jam driving scene in which the vehicle is driving in a traffic jam when the autonomous driving function is next used, even if the specific behavior by the driver is detected during the autonomous driving period.

8. The autonomous driving function includes an area-limited control that is limited to a specific area and a traffic jam-limited control that is limited to driving during traffic jams, The function control device according to claim 7 , wherein the control restriction unit restricts the driving under the area limitation control even when the driving under the congestion limitation control is permitted in the congestion driving scene.

9. The function control device according to claim 7, wherein when the specific behavior by the driver is detected during an automatic driving period in which the vehicle is driven by the autonomous driving control, the control restriction unit restricts actions other than driving that are permitted to the driver during the automatic driving period under the autonomous driving control in the next use of the autonomous driving function.

10. A function control device is used in a vehicle (Am) that can run by an automatic driving function that can perform driving assistance control with a driver's obligation to monitor the surroundings and autonomous driving control without the driver's obligation to monitor the surroundings, and performs control related to the automatic driving function, A driver behavior grasping unit (72, 86) that continuously grasps a specific behavior of the driver that is determined to be inappropriate to be performed during a controlled driving period during which the vehicle is driven by the automatic driving function, the controlled driving period including at least a period before a switching condition from the autonomous driving control to the driving assistance control is satisfied; a control restriction unit (78, 82) that restricts actions other than driving permitted to the driver during an automatic driving period in the autonomous driving control in the next use of the automatic driving function after the switching condition from the autonomous driving control to the driving assistance control is satisfied when the specific behavior by the driver is grasped during the controlled driving period; A function control device comprising:

11. The function control device according to any one of claims 1 to 10, further comprising an improvement suggestion unit that suggests an improvement to the driver's behavior when the specific behavior by the driver is recognized during the controlled driving period.

12. The driver behavior grasping unit grasps whether or not the driver's behavior has improved during the controlled driving period, The function control device according to claim 11, wherein if an improvement in the driver's behavior is detected during the controlled driving period in which the use of the autonomous driving function is restricted, the restriction on the next use of the autonomous driving function is relaxed.

13. A function control program for use in a vehicle (Am) that can run using an automatic driving function capable of performing driving assistance control with a driver's obligation to monitor the surroundings and autonomous driving control without the driver's obligation to monitor the surroundings, and that performs control related to the automatic driving function, During a controlled driving period in which the vehicle is driven by the automatic driving function and which includes at least a period before a switching condition from the autonomous driving control to the driving assistance control is satisfied, a specific behavior of the driver that is determined to be inappropriate to be performed during the controlled driving period is continuously grasped (S101); When the specific behavior of the driver is detected during the controlled driving period, the next time the automatic driving function is used after the switching condition from the autonomous driving control to the driving assistance control is satisfied, the driving under the autonomous driving control based on the transition operation of the driver is restricted (S107). A function control program that causes at least one processing unit (11, 51) to execute a process including the steps of:

14. A function control program for use in a vehicle (Am) that can run using an automatic driving function capable of performing driving assistance control with a driver's obligation to monitor the surroundings and autonomous driving control without the driver's obligation to monitor the surroundings, and that performs control related to the automatic driving function, During a controlled driving period in which the vehicle is driven by the automatic driving function and which includes at least a period before a switching condition from the autonomous driving control to the driving assistance control is satisfied, a specific behavior of the driver that is determined to be inappropriate to be performed during the controlled driving period is continuously grasped (S301); When the specific behavior of the driver is detected during the controlled driving period, the driver is restricted from performing actions other than driving during the automatic driving period in the automatic driving control in the next use of the automatic driving function after the switching condition from the autonomous driving control to the driving assistance control is satisfied (S307). A function control program that causes at least one processing unit (11, 51) to execute a process including the steps of:

Citation Information

Patent Citations

  • Automatic drive control device, automatic drive control method, and program

    JP2016115356A

  • Vehicle control system

    JP2020164077A

  • Vehicle control device and vehicle control method

    WO2019017216A1

Cited By

  • Driving assistance device, driving assistance method, and program

    JP2026172456A

  • Driving assistance device, driving assistance method, and program

    JP7937417B1