Electronic control device and control method

Abstract

To provide a driving control system that can flexibly and safely control driving in response to sensor performance degradation due to changes in the external environment and performance requirements of the road environment.SOLUTION: An electronic controller mounted on a vehicle includes: a sensor detection information acquisition unit for acquiring detection information of a first external field sensor and detection information of a second external field sensor mounted on the vehicle; a sensor detection information integration unit that identifies a correspondence relationship between an environmental element indicated in the detection information of the first external field sensor and an environmental element indicated in the detection information of the second external field sensor; and a sensor detectable area determination unit that determines a relationship between the relative position and detection capability at the first external field sensor based on the detection status of the first external field sensor with respect to the environmental elements detected by the second external field sensor in the integrated detection information and determines a detectable area of the first external field sensor based on the relationship.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to an electronic control device and a control method. [Background technology]

[0002] In recent years, in order to realize comfortable and safe autonomous driving of a vehicle, a technology has been proposed that detects a performance degradation of an external sensor of a vehicle and performs a function degradation of the autonomous driving or a safe stop. For example, Patent Document 1 discloses a means for detecting a performance degradation due to dirt or a failure of an external sensor, and suppressing a driving speed or safely stopping the vehicle. Specifically, Patent Document 1 describes that "an autonomous vehicle that detects obstacles and a driving path using a sensor and drives autonomously is provided with a sensor state evaluation means for evaluating a state of degradation in performance of the sensor, a speed / steering angle limit value setting means for setting a limit value for the driving speed and steering angle based on the state of degradation in performance of the sensor, and a driving obstacle evaluation means for evaluating the effect on the operation of other vehicles when the vehicle is stopped at the current position, and is characterized in that when the sensor performance is degraded, the vehicle drives to a point where it does not interfere with the operation of other vehicles within the set speed and steering angle limit values, and then stops." [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2015 / 068249 Summary of the Invention [Problem to be solved by the invention]

[0004] The invention described in Patent Document 1 uses the presence or absence of changes in the pixel output values ​​of the camera to detect performance degradation due to dirt on the camera or a malfunction, and determines the operating mode, such as degraded operation or safety stop, depending on the condition.

[0005] On the other hand, the performance degradation of the external sensor may occur not only due to dirt or failure of the sensor itself, but also due to changes in the external environment. For example, when a camera or LiDAR (Light Detection And Ranging) is used as an external sensor, the distance performance at which an obstacle can be detected decreases in bad weather such as heavy rain or fog. In addition, even when a millimeter wave radar, which is said to be resistant to bad weather, is used as an external sensor, it is known that the detection performance of distant obstacles during heavy rain is lower than normal. In this way, when the performance degradation of the external sensor occurs due to external environmental factors, the method disclosed in Patent Document 1 cannot detect the performance degradation of the external sensor.

[0006] In addition, the state of the external environment changes continuously from moment to moment, and the degree of performance degradation of the external sensor also changes continuously in response to this. However, when the driving mode is determined by discretely judging the level of performance degradation of the external sensor as in Patent Document 1, it is difficult to flexibly control driving in response to changes in the external environment. As a result, the driving mode is set to a safer side, which may limit the conditions under which autonomous driving can continue more than would otherwise be the case.

[0007] In order to solve the problems in the conventional technology as described above, the present invention aims to provide an electronic control device that can continue to flexibly and safely control driving even when sensor performance deteriorates due to changes in the external environment, in particular when the range in which objects can be effectively detected becomes narrower. [Means for solving the problem]

[0008] An electronic control device according to a first aspect of the present invention is mounted on a vehicle and includes a sensor detection information acquisition unit that acquires detection information of a first external sensor and detection information of a second external sensor mounted on the vehicle, a sensor detection information integration unit that specifies a correspondence relationship between an environmental element indicated in the detection information of the first external sensor and an environmental element indicated in the detection information of the second external sensor, and a sensor detectable area determination unit that determines a relationship between a relative position and detection capability of the first external sensor based on a detection state of the first external sensor with respect to an environmental element detected by the second external sensor, and determines a detectable area of ​​the first external sensor based on the relationship. The second external sensor is mounted on the vehicle, the sensor detection information integration unit generates integrated detection information indicating environmental elements detected by both the first external sensor and the second external sensor and for which the correspondence has been identified, the sensor detectable area determination unit determines a detectable area of ​​the first external sensor based on a change in a detection state of the first external sensor with respect to the environmental elements indicated in the integrated detection information, the detectable area of ​​the first external sensor being a grid-like map in which a predetermined area is divided into a grid shape to express the detection capability of the first external sensor in each unit area, and the sensor detectable area determination unit determines the detection capability of each unit area of ​​the grid-like map based on the detection state of the first external sensor with respect to the environmental elements detected by the second external sensor in the integrated detection information. . Effect of the Invention

[0009] According to the present invention, it is possible to continue driving control flexibly and safely in response to deterioration of sensor performance due to changes in the external environment and performance requirements of the road environment. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a functional block diagram showing a configuration of a vehicle system including a driving control device according to an embodiment of the present invention; [Diagram 2] A conceptual diagram of the detectable area of ​​the external sensors 4 mounted on the vehicle 2. [Diagram 3] FIG. 13 is a diagram showing an example of a sensor detection information data group 31. [Figure 4] FIG. 1 shows an example of an integrated detection information data set 34. [Diagram 5] FIG. 1 is a diagram showing an example of a sensor detectable area data group 35 according to a first embodiment; [Figure 6] FIG. 2 is a diagram showing the correlation between functions realized by the driving control device according to the embodiment; [Figure 7] 1 is a flowchart for explaining a process executed by the sensor detectable area determination unit 13 according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a method for calculating a sensor detectable area in S712 of FIG. 7; [Figure 9]FIG. 13 is a diagram showing an example of driving environment detection performance requirement information used by the driving control mode determination unit 14. [Figure 10] A flowchart for explaining the process executed by the driving control mode determination unit 14. [Figure 11] FIG. 13 is a diagram showing an example of a sensor detectable area data group 35 according to the second embodiment; [Figure 12] 11 is a flowchart for explaining a process executed by the sensor detectable area determining unit 13 according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS EXAMPLES

[0011] --First embodiment-- Hereinafter, a first embodiment of a cruise control device 3, which is an electronic control device, will be described with reference to FIGS.

[0012] (System Configuration) FIG. 1 is a functional block diagram showing a configuration of a vehicle system 1 including a cruise control device 3 according to an embodiment of the present invention. The vehicle system 1 is mounted on a vehicle 2. The vehicle system 1 recognizes the conditions of obstacles such as roads on which the vehicle 2 is traveling and surrounding vehicles around the vehicle 2, and then performs appropriate driving assistance and cruise control. As shown in FIG. 1, the vehicle system 1 includes a cruise control device 3, an external sensor group 4, a vehicle sensor group 5, a map information management device 6, an actuator group 7, an HMI (Human Machine Interface) device group 8, and the like. The cruise control device 3, the external sensor group 4, the vehicle sensor group 5, the map information management device 6, the actuator group 7, and the HMI device group 8 are connected to each other by an in-vehicle network N. In the following, the vehicle 2 may be referred to as a "self-vehicle" 2 to distinguish it from other vehicles.

[0013] The driving control device 3 is an ECU (Electronic Control Unit). The driving control device 3 generates driving control information for driving assistance or automatic driving of the vehicle 2 based on various input information provided from an external sensor group 4, a vehicle sensor group 5, etc., and outputs the information to an actuator group 7, etc. The driving control device 3 has a processing unit 10, a storage unit 30, and a communication unit 40. The processing unit 10 is configured to include, for example, a CPU (Central Processing Unit) which is a central processing unit. However, in addition to the CPU, the processing unit 10 may be configured to include a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), etc., or may be configured to include any one of them.

[0014] The processing unit 10 has, as its functions, an information acquisition unit 11, a sensor detection information integration unit 12, a sensor detectable area determination unit 13, a driving control mode determination unit 14, a driving control information generation unit 15, an HMI information generation unit 16, and an information output unit 17. The processing unit 10 realizes these functions by executing a predetermined operation program stored in the storage unit 30.

[0015] The information acquisition unit 11 acquires various information from other devices connected to the driving control device 3 via the in-vehicle network N, and stores the information in the storage unit 30. For example, the information acquisition unit 11 acquires information on observation points around the vehicle 2 detected by the external sensor group 4, and information on environmental elements around the vehicle 2, such as obstacles, road markings, signs, and traffic lights, estimated based on the information on the observation points, and stores the information in the storage unit 30 as a sensor detection information data group 31 representing the detection information of the external sensor group 4. The information acquisition unit 11 also acquires information related to the movement, state, and the like of the vehicle 2 detected by the vehicle sensor group 5, etc., and stores the information in the storage unit 30 as a vehicle information data group 32. The information acquisition unit 11 also acquires information related to the driving environment and driving route of the vehicle 2 from the map information management device 6, etc., and stores the information in the storage unit 30 as a driving environment data group 33.

[0016] The sensor detection information integrator 12 generates integrated detection information related to environmental elements such as obstacles, road markings, signs, and traffic lights around the vehicle 2 based on the sensor detection information data group 31 acquired by the information acquirer 11 and stored in the memory unit 30. The process performed by the sensor detection information integrator 12 corresponds to a function generally called sensor fusion, for example. The integrated detection information generated by the sensor detection information integrator 12 is stored in the memory unit 30 as an integrated detection information data group 34.

[0017] The sensor detectable area determination unit 13 determines a sensor detectable area indicating the detectable area of ​​the external sensor group 4 based on the sensor detection information data group 31 acquired by the information acquisition unit 11 and stored in the storage unit 30. For example, the sensor detectable area is determined to be the detectable area of ​​an individual sensor included in the external sensor group 4, or the detectable area of ​​a combination of multiple individual sensors of the same type. Hereinafter, a combination of external sensors (including individual sensors) for which a sensor detectable area is determined is referred to as a "sensor group." The sensor detectable area determination unit 13 determines a sensor detectable area for each sensor group, and stores information on each determined sensor detectable area in the storage unit 30 as a sensor detectable area data group 35.

[0018] The sensor detectable area means an area where the sensor group can detect an environmental element such as an obstacle, road marking, sign, or signal with a sufficiently high probability when the environmental element exists within the area. In other words, the sensor detectable area is an area where the probability of the sensor group not detecting the environmental element is sufficiently low, and if the sensor group does not detect an environmental element such as an obstacle to be detected in this area, it can be considered that the environmental element to be detected does not exist within the area. Each sensor constituting the external sensor group 4 often statically defines a sensor detectable area as a product specification, but in reality, the sensor detectable area changes depending on the external environment. The sensor detectable area determination unit 13 dynamically estimates the sensor detectable area of ​​each sensor group from information such as the detection state, detection accuracy, and detection position of each sensor group in the integrated detection information generated by the sensor detection information integration unit 12.

[0019] The driving control mode determination unit 14 determines a driving control mode of the vehicle system 1 in which the vehicle 2 can travel safely, based on the system states (failure state, passenger instruction mode, etc.) of the vehicle system 1 and the driving control device 3, the performance requirements of the external sensor group 4 required for the driving environment, and the state of the sensor detectable area determined by the sensor detectable area determination unit 13. Information on the driving control mode determined by the driving control mode determination unit 14 is stored in the storage unit 30 as a part of the system parameter data group 38.

[0020] The driving control information generating unit 15 generates driving control information for the vehicle 2 based on the sensor detectable area generated by the sensor detectable area determining unit 13, the integrated detection information generated by the sensor detection information integrating unit 12, the driving control mode determined by the driving control mode determining unit 14, and the like. For example, the driving control information generating unit 15 plans a trajectory along which the vehicle 2 should travel based on these pieces of information, and determines a control command value to be output to the actuator group 7 for tracking the planned trajectory. Then, the driving control information is generated using the determined planned trajectory and control command value, and the determination result of the driving control mode by the driving control mode determining unit 14. The driving control information generated by the driving control information generating unit 15 is stored in the storage unit 30 as a driving control information data group 36.

[0021] The HMI information generating unit 16 generates HMI information of the vehicle 2 based on the sensor detectable area generated by the sensor detectable area determining unit 13, the integrated detection information generated by the sensor detection information integrating unit 12, the driving control mode determined by the driving control mode determining unit 14, etc. For example, information is generated for notifying the occupant of the current driving control mode state or a change in the driving control mode by voice, a screen, etc. Also, information is generated for notifying the occupant of the sensor detectable area in the vehicle 2 and the integrated detection information by a screen, etc. The HMI information generated by the HMI information generating unit 16 is stored in the storage unit 30 as an HMI information data group 37.

[0022] The information output unit 17 outputs the driving control information generated by the driving control information generation unit 15 to other devices connected to the driving control device 3 via the in-vehicle network N. For example, the driving control device 3 outputs driving control information including a control command value determined by the driving control information generation unit 15 to the actuator group 7 to control the driving of the vehicle 2. Also, for example, the driving control device 3 outputs driving control information including the driving control mode determined by the driving control mode determination unit 14 to other devices to enable the vehicle system 1 as a whole to transition to a consistent system mode.

[0023] The storage unit 30 includes, for example, a storage device such as a hard disk drive (HDD), a flash memory, or a read only memory (ROM), and a memory such as a random access memory (RAM). The storage unit 30 stores the program processed by the processing unit 10, a data group required for the processing, and the like. The storage unit 30 is also used as a main memory when the processing unit 10 executes a program, and temporarily stores data required for the program's calculation. In this embodiment, as information for realizing the function of the driving control device 3, a sensor detection information data group 31, a vehicle information data group 32, a driving environment data group 33, an integrated detection information data group 34, a sensor detectable area data group 35, a driving control information data group 36, an HMI information data group 37, a system parameter data group 38, and the like are stored in the storage unit 30.

[0024] The sensor detection information data group 31 is a collection of data related to detection information by the external sensor group 4 and its reliability. The detection information is, for example, information on environmental elements such as obstacles, road markings, signs, and signals that the external sensor group 4 identifies based on the observation information of the sensing, and the observation information itself of the external sensor group 4 (point cloud information of LiDAR, FFT information of millimeter wave radar, camera image, parallax image of stereo camera, etc.). The reliability of the detection information corresponds to the information on the environmental elements detected by the sensor and the accuracy (existence probability) that the observation information actually exists, and differs depending on the type of sensor and the product specifications. For example, if the sensor is one that observes with reflected waves such as LiDAR or millimeter wave radar, it may be expressed using the reception strength or signal-to-noise ratio (SN ratio), or it may be calculated according to how many continuous observations were made in a time series, or any index related to the accuracy of the detection information may be used. An example of data expression of the sensor detection information in the sensor detection information data group 31 will be described later in FIG. 3. The sensor detection information data group 31 is acquired from the external sensor group 4 by the information acquisition unit 11 and stored in the storage unit 30.

[0025] The vehicle information data group 32 is a collection of data related to the movement, state, etc. of the vehicle 2. The vehicle information data group 32 includes vehicle information detected by the vehicle sensor group 5 and the like and acquired by the information acquisition unit 11, such as the position of the vehicle 2, the traveling speed, the steering angle, the amount of accelerator operation, the amount of brake operation, and the like.

[0026] The driving environment data group 33 is a collection of data related to the driving environment of the vehicle 2. The data related to the driving environment is information related to the roads around the vehicle 2, including the road on which the vehicle 2 is driving. This includes, for example, information related to the driving route of the vehicle 2, roads on the driving route or around the vehicle 2, and the shape and attributes (travel direction, speed limit, driving regulations, etc.) of the lanes that make up the roads.

[0027] The integrated detection information data group 34 is a collection of integrated detection information data related to environmental elements around the vehicle 2, which is determined in an integrated manner based on detection information from the external sensor group 4. The integrated detection information data group 34 is generated and stored by the sensor detection information integration unit 12 based on information from the sensor detection information data group 31.

[0028] The sensor detectable area data group 35 is a collection of data related to a sensor detectable area, which is an area in which environmental elements such as obstacles can be detected for each sensor group of the external sensor group 4. An example of the expression of data related to the sensor detectable area in the sensor detectable area data group 35 will be described later with reference to Fig. 4. The sensor detectable area data group 35 is generated and stored by the sensor detectable area determination unit 13 based on information in the sensor detection information data group 31 and information in the integrated detection information data group 34.

[0029] The driving control information data group 36 is a data group related to plan information for controlling the driving of the vehicle 2, and includes the planned trajectory of the vehicle 2, control command values ​​to be output to the actuator group 7, etc. These pieces of information in the driving control information data group 36 are generated and stored by the driving control information generator 15.

[0030] The HMI information data group 37 is a data group related to HMI information for controlling the HMI device group 8 mounted on the vehicle 2, and includes information for notifying the occupants of the state of the driving control mode and its changes, the state of the sensors of the vehicle 2, the detection status of environmental elements, etc. via the HMI device group 8. This information in the HMI information data group 37 is generated and stored by the HMI information generation unit 16.

[0031] The system parameter data group 38 is a collection of data related to the system states (driving control mode, failure state, passenger instruction mode, etc.) of the vehicle system 1 and the driving control device 3, and detection performance requirements required for the driving environment.

[0032] The communication unit 40 has a communication function with other devices connected via the in-vehicle network N. When the information acquisition unit 11 acquires various information from other devices via the in-vehicle network N, or when the information output unit 17 outputs various information to other devices via the in-vehicle network N, the communication function of the communication unit 40 is used. The communication unit 40 includes, for example, a network card conforming to a communication standard such as IEEE802.3 or CAN (Controller Area Network). The communication unit 40 transmits and receives data between the driving control device 3 and other devices in the vehicle system 1 based on various protocols.

[0033] In this embodiment, the communication unit 40 and the processing unit 10 are described separately, but a part of the processing of the communication unit 40 may be executed in the processing unit 10. For example, a configuration may be adopted in which a hardware device equivalent in the communication processing is located in the communication unit 40, and other device drivers, communication protocol processing, and the like are located in the processing unit 10.

[0034] The external sensor group 4 is a collection of devices that detect the state around the vehicle 2. Examples of the external sensor group 4 include various sensors such as a camera device, a millimeter wave radar, LiDAR, and sonar. The external sensor group 4 outputs the sensing observation information and information on environmental elements such as obstacles, road markings, signs, and traffic lights identified based on the observation information to the cruise control device 3 via the in-vehicle network N. An "obstacle" is, for example, another vehicle other than the vehicle 2, a pedestrian, an object that has fallen onto the road, the edge of the road, etc. An "road marking" is, for example, a white line, a pedestrian crossing, a stop line, etc.

[0035] The vehicle sensor group 5 is a collection of devices that detect various conditions of the vehicle 2. Each vehicle sensor detects, for example, the position information, driving speed, steering angle, accelerator operation amount, brake operation amount, etc. of the vehicle 2, and outputs the information to the cruise control device 3 via the in-vehicle network N.

[0036] The map information management device 6 is a device that manages and provides digital map information around the vehicle 2 and information about the driving route of the vehicle 2. The map information management device 6 is configured, for example, by a navigation device. The map information management device 6 is provided with digital road map data of a predetermined area including the periphery of the vehicle 2, and is configured to identify the current position of the vehicle 2 on the map, i.e., the road and lane on which the vehicle 2 is traveling, based on the position information of the vehicle 2 output from the vehicle sensor group 5. In addition, the identified current position of the vehicle 2 and map data of the surrounding area are output to the driving control device 3 via the in-vehicle network N.

[0037] The actuator group 7 is a group of devices that control control elements such as steering, braking, and accelerator that determine the movement of the vehicle. The actuator group 7 controls the movement of the vehicle based on operation information of the steering wheel, brake pedal, accelerator pedal, etc. by the driver and control command values ​​output from the cruise control device 3.

[0038] The HMI device group 8 is a collection of devices having an HMI (Human Machine Interface) for the vehicle system 1 to exchange information with the occupant. Examples of HMI include audio interfaces such as microphones and speakers, and screen interfaces such as displays and panels. The HMI device group 8 equipped with such HMI outputs information to the vehicle system 1 based on instructions from the occupant via the HMI, and notifies the occupant of information based on HMI information output from the driving control device 3, etc.

[0039] (sensor detectable area) 2 is a conceptual diagram of a sensor detectable area by a group of external sensors 4 mounted on a vehicle 2. Fig. 2 is an example for explaining the sensor detectable area, but in reality, the group of external sensors 4 are installed so as to satisfy the detection performance requirements of the autonomous driving function of the vehicle system 1.

[0040] In the example of FIG. 2, seven sensors (external sensors 4-1 to 4-7) are installed on the vehicle 2, and the rough sensor detectable areas of each are shown as areas 111 to 117. For example, the external sensor 4-1 corresponding to the area 111 is a long-distance millimeter wave radar, the external sensor 4-2 corresponding to the area 112 is a camera-based sensor, the external sensors 4-3 to 4-6 corresponding to the areas 113 to 116 are short-distance millimeter wave radars, and the external sensor 4-7 corresponding to the area 117 is a LiDAR. Here, for simplicity, the sensor detectable areas 111 to 117 are expressed as sectors centered on the vehicle 2, but in reality, the sensor detectable areas can be expressed in any shape according to the detection range of each sensor. The size and shape of the sensor detectable areas change depending on the external environment.

[0041] Although details will be described later, the driving control device 3 compares the detection results in the overlapping area of ​​the detection ranges of the multiple external sensors and determines the effective detection range of the external sensor. For example, in FIG. 2, the area 111 of the long-distance millimeter wave radar and the area 112 of the camera-based sensor overlap. Here, since the outer edge of the area 112 of the camera-based sensor in the distance direction is included in the area 111 of the long-distance millimeter wave radar, the performance degradation in the distance direction of the camera-based sensor can be identified by comparing with the detection result of the long-distance millimeter wave radar. Similarly, the outer edge of the area 111 of the long-distance millimeter wave radar in the angle direction is included in the area 112 of the camera-based sensor, so the performance degradation in the angle direction of the long-distance millimeter wave radar can be identified by comparing with the detection result of the camera-based sensor.

[0042] (Sensor detection information) 3 is a diagram showing an example of sensor detection information stored in the sensor detection information data group 31. Here, an example of the data structure of the sensor detection information of the external sensor 4-1 (long-distance millimeter wave radar) and an example of the data structure of the sensor detection information of the external sensor 4-2 (camera-based sensor) are shown.

[0043] The sensor detection information data of the external sensor 4-1 and the external sensor 4-2 includes a detection time 301, a detection ID 302, a detection position 303, a detection type 304, a presence probability 305, and the like.

[0044] The detection time 301 is information about the timing at which the detection information of the entry was detected. This information may be time information, or if the external sensor is a sensor that detects periodically, it may be a number indicating which period the detection information of the entry corresponds to.

[0045] The detection ID 302 is an ID for identifying each detection information entry. This may be set so that a common ID is assigned to the same detection target in a time series, or may be set like a serial number for each period.

[0046] The detection position 303 is information about the position of the environmental element corresponding to the detection information in the entry. In Fig. 3, polar coordinates expressed by the distance r and the angle θ in the reference coordinate system of the sensor are used, but a Cartesian coordinate system may also be used.

[0047] The detection type 304 indicates the type of the environmental element indicated by the detection information in the entry, for example, a vehicle, a pedestrian, a white line, a sign, a traffic light, a road edge, an unknown, and the like.

[0048] The existence probability 305 is information indicating the probability that the environmental element corresponding to the detection information of the entry actually exists. For example, in the case of millimeter wave radar or LiDAR, when the S / N ratio decreases, it becomes difficult to distinguish between the reflected wave from the environmental element to be detected and noise, and the possibility of false detection increases. In the process of identifying each environmental element, the external sensor group 4 calculates and sets the existence probability (or an index equivalent thereto) based on the S / N ratio, the detection state in time series, etc.

[0049] (Integrated detection information) 4 is a diagram showing an example of the integrated detection information stored in the integrated detection information data group 34. Here, an example of a data structure resulting from integrating the sensor detection information of the external sensor 4-1 and the sensor detection information of the external sensor 4-2 shown in FIG.

[0050] The integrated detection information data includes an integrated detection time 401, an integrated detection ID 402, an integrated detection position 403, an integrated detection type 404, an integrated presence probability 405, a sensor source 406, and the like.

[0051] The integrated detection time 401 is information indicating at what point in time the integrated detection information of the entry represents the detection state. The detection time 301 of the sensor detection information often differs depending on the external sensor. Also, since there is a delay between when the external sensor detects and when the driving control device 3 acquires it, it indicates a past state. Therefore, in order to reduce the influence of the time difference and delay, it is preferable that the sensor detection information integration unit 12 integrates the sensor detection information by correcting the predetermined time based on the detection time 301 of the sensor detection information and the vehicle information such as the speed and angular velocity included in the vehicle information data group 32. The time to be corrected is set as the integrated detection time 401.

[0052] The integrated detection ID 402 is an ID for identifying each integrated detection information entry, and is set so as to assign a common ID to the same detection target (environmental element) in time series.

[0053] The integrated detected position 403 is information on the position of the environmental element indicated by the integrated detected information of the entry. In Fig. 4, the position is expressed by x and y in the vehicle coordinate system (a coordinate system in which the center of the rear wheel axle is the origin, the front of the vehicle is the positive direction of x, and the left of the vehicle is the positive direction of y), but it may be expressed in another coordinate system.

[0054] The integrated detection type 404 indicates the type of the environmental element indicated by the integrated detection information of the entry, such as a vehicle, a pedestrian, a white line, a sign, a traffic light, a road edge, or an unknown.

[0055] The integrated existence probability 405 is information indicating the probability that the environmental element corresponding to the integrated detection information of the entry actually exists.

[0056] The sensor source 406 is information indicating which sensor detection information the integrated detection information of the entry was generated based on. By comparing the sensor detection information data group 31 with the information of the sensor source 406, it is possible to identify the entry of the sensor detection information used to estimate the integrated detection information of the entry. The sensor source 406 is expressed, for example, by a combination of a sensor identifier and a detection ID. If it is necessary to identify an entry in time-series data, the detection time 301 may be further combined.

[0057] (Sensor detectable area data set) 5 is a diagram showing an example structure of some of the data stored in the sensor detectable area data group 35. The sensor detectable area data group 35 is generated for each sensor group of the external sensor group 4. Here, an example structure of data generated for a specific sensor group is shown.

[0058] The sensor detectable area data includes a sensor group 501, a detection type 502, a detectable distance 503, a detectable angle range 504, and the like. The sensor group 501 is an identifier of the sensor group that is the subject of the sensor detectable area information of the entry. The detection type 502 is information indicating which type of environmental element is the detection target of the sensor detectable area information of the entry, such as a vehicle, a pedestrian, a white line, a sign, a traffic light, a road edge, and an unknown. The detectable distance 503 and the detectable angle range 504 are the distance and the angle range, respectively, in which the sensor group 501 of the entry is estimated to be able to detect the detection type 502. For example, the sensor group "4-2" in Fig. 5 is capable of detecting vehicles up to 50 m ahead and pedestrians up to 30 m ahead. Here, the sensor detectable area is expressed in the form of a combination of detectable distance and detectable angle range, but the form of expression is not limited to this. For example, the sensor detectable angle range may be divided into a predetermined unit, and the detectable distance in each divided range may be expressed. External sensors may have performance differences depending on the detection angle. For example, the performance of camera-based sensors decreases at the boundary of the angle of view. If it is necessary to take such performance differences into consideration, it is desirable to express the detectable distance according to the detection angle.

[0059] (System Operation) The operation of the vehicle system 1 will be described with reference to FIGS. FIG. 6 is a diagram showing the correlation between the functions realized by the driving control device 3. As shown in FIG. The information acquisition unit 11 acquires necessary information from other devices via the in-vehicle network N, and passes it to a downstream processing unit. Specifically, the information acquisition unit 11 acquires a sensor detection information data group 31 from the external sensor group 4, a vehicle information data group 32 from the vehicle sensor group 5, and a driving environment data group 33 from the map information management device 6, and passes them to a downstream processing unit. Each data group may be passed via a storage unit 30 (not shown), for example.

[0060] The sensor detection information integration unit 12 generates an integrated detection information data group 34 that integrates the detection information of the multiple external sensors based on the sensor detection information data group 31 and the vehicle information data group 32 acquired from the information acquisition unit 11, and stores the integrated detection information data group 34 in the storage unit 30. Then, the sensor detection information integration unit 12 outputs the generated integrated detection information data group 34 to the sensor detectable area determination unit 13 and the driving control information generation unit 15.

[0061] The sensor detectable area determination unit 13 determines a detectable area for each sensor group of the external sensor group 4 based on the sensor detection information data group 31 acquired from the information acquisition unit 11 and the integrated detection information data group 34 acquired from the sensor detection information integration unit 12, stores the data in the memory unit 30 as a sensor detectable area data group 35, and passes it on to a subsequent processing unit.

[0062] The driving control mode determination unit 14 determines the driving control mode of the vehicle 2 based on the driving environment data group 33 acquired from the information acquisition unit 11, the sensor detectable area data group 35 acquired from the sensor detectable area determination unit 13, and the system states (failure state, passenger instruction mode, etc.) of the vehicle system 1 and the driving control device 3 stored in the system parameter data group 38 and detection performance requirements required for the driving environment. Then, the determination result is stored in the storage unit 30 as a part of the system parameter data group 38, and output to the driving control information generation unit 15. Note that information related to the system parameter data group 38 can be generated by an external device of the driving control device 3 or each processing unit, but is omitted in FIG. 6.

[0063] The driving control information generation unit 15 determines the driving control mode of the vehicle 2 based on the determination result of the driving control mode of the vehicle 2 included in the integrated detection information data group 34 acquired from the sensor detection information integration unit 12, the sensor detectable area data group 35 acquired from the sensor detectable area determination unit 13, the vehicle information data group 32 and the driving environment data group 33 acquired from the information acquisition unit 11, and the system parameter data group 38 acquired from the driving control mode determination unit 14, and plans a driving control trajectory, and generates control command values ​​and the like that follow the trajectory. Then, the driving control information data group 36 including this information is generated, and is stored in the storage unit 30 and output to the information output unit 17.

[0064] The HMI information generation unit 16 generates an HMI information data group 37 for notifying occupants of the integrated detection information, the sensor detectable area, and the state and state changes of the driving control mode based on the integrated detection information data group 34 acquired from the sensor detection information integration unit 12, the sensor detectable area data group 35 acquired from the sensor detectable area determination unit 13, and the judgment result of the driving control mode of the vehicle 2 contained in the system parameter data group 38 acquired from the driving control mode judgment unit 14, and stores the data in the memory unit 30 and outputs it to the information output unit 17.

[0065] The information output unit 17 outputs driving control information for the vehicle 2 based on the driving control information data group 36 acquired from the driving control information generation unit 15 and the HMI information data group 27 acquired from the HMI information generation unit 16. For example, the information output unit 17 outputs driving control information including a control command value to the actuator group 7, or outputs driving control information including a current driving control mode to another device.

[0066] (Sensor detection information integration processing) The sensor detection information integration unit 12 generates an integrated detection information data group 34 that integrates the detection information of multiple external sensors based on the sensor detection information data group 31 and the vehicle information data group 32 acquired from the information acquisition unit 11, and stores it in the memory unit 30.

[0067] The sensor detection information integration process corresponds to a sensor fusion process of detection information. The sensor detection information integration unit 12 first compares the detection information of the individual external sensors included in the sensor detection information data group 31 to identify detection information for the same environmental element. Then, the identified sensor detection information is integrated to generate an integrated detection information data group 34.

[0068] For example, an entry with a detection ID 302-1 of the external sensor 4-1 in FIG. 3 being "1" and an entry with a detection ID 302-2 of the external sensor 4-2 being "1" have detection positions close to each other and the detection type is the same as "vehicle". Therefore, the sensor detection information integration unit 12 determines that the two entries detect the same environmental element, and integrates the information of the two entries to generate integrated detection information. The generated integrated detection information corresponds to the entry with an integrated detection ID 402 of "1" in FIG. 4. When generating the integrated detection information, the sensor detection information integration unit 12 records a sensor source 406 indicating which sensor and which detection ID information is integrated. For example, the sensor source 406 "(4-1,1)(4-2,1)" in the entry with an integrated detection ID 402 of "1" in FIG. 4 indicates that the information of the entry is an integration of information of the external sensor 4-1 with a detection ID of "1" in FIG. 3 and information of the external sensor 4-2 with a detection ID of "1".

[0069] (Sensor detectable area determination process) Fig. 7 is a flowchart for explaining the processing of the sensor detectable area determination unit 13 of Fig. 6 in the first embodiment. In the first embodiment, the method is to extract the limit point of the detection capability (performance limit point) of each sensor group by comparing the time series data of the integrated detection information, and to determine the sensor detectable area of ​​each sensor group based on the information of the extracted limit point of the detection capability. The sensor detectable area determination unit 13 executes the processing of S701 to S713, generates sensor detectable area data of each sensor group, and stores it in the storage unit 30 as the sensor detectable area data group 35.

[0070] First, in S701 and S702, the integrated detection information ObList(t) generated at a predetermined time and the integrated detection information ObList(t-1) generated in the previous processing cycle are obtained from the integrated detection information data group 34 stored in the storage unit 30. The integrated detection information generated at a predetermined time is preferably the latest integrated detection information at the time this processing is executed. Note that the sensor detection information data group 31 and the integrated detection information data group 34 include not only the latest detection information of the external sensor group 4 acquired by the information acquisition unit 11 and the latest integrated detection information generated by the sensor detection information integration unit 12, but also data related to the detection information and integrated detection information handled in the previous processing.

[0071] Next, the processes of S703 to S711 are executed for each entry included in ObList(t). In the processes of S703 to S711, a position where the detection state of the sensor group for the same environmental element changes is searched for in the time series data of the integrated detection information, and the performance limit point of the sensor group is extracted. The detection state of the sensor group indicates, for example, whether the sensor group can detect the target environmental element or not. In this case, a change in the detection state in the time series data means either a change from a detection state to a non-detection state, or a change from a non-detection state to a detection state. In either case, it means that there is a high possibility that the performance limit point of the sensor group has been crossed before and after the change in the detection state.

[0072] In S703, it is confirmed whether there is an unprocessed entry in ObList(t). If there is no unprocessed entry (N in S703), the process proceeds to S712. If there is an unprocessed entry (Y in S703), the process proceeds to S704, and one corresponding entry Ob is extracted.

[0073] Then, in S705, it is confirmed whether an entry Ob' having the same integrated detection ID 402 as Ob' exists in ObList(t-1). If the corresponding entry Ob' does not exist (N in S705), the process returns to S703. If the corresponding entry Ob' exists (Y in S705), the process proceeds to S706.

[0074] In S706, the sensor sources 406 of Ob and Ob' are compared to check whether there is a sensor group S that exists in only one of the entries. If there is no corresponding sensor group S (N in S706), return to S703. If there is a corresponding sensor group S (Y in S706), proceed to S707. For a sensor group that only has one entry in the sensor sources 406 of Ob and Ob', this indicates that, over the time lapse from Ob' to Ob, an environmental element that was previously detectable can no longer be detected, or an environmental element that was previously undetectable can now be detected. In other words, there is a possibility that the boundary of the performance limit of that sensor group is appearing.

[0075] It should be noted here that Ob and Ob' are detected by another sensor group in addition to the sensor group in which the boundary of the performance limit appears. If an environmental element is detected only by the sensor group in which the boundary of the performance limit appears, when that sensor group is no longer able to detect it, the sensor detection information does not exist and so the element is not included in the integrated detection information. In other words, this means that changes in the detection state of a specific sensor group are checked based on the detection results of other sensor groups.

[0076] It is also possible to determine the change in the detection state of a given sensor group from the time series data of the sensor detection information of the sensor group included in the sensor detection information data group 31. In this case, the position where the presence or absence of an entry for the same environmental element changes in the time series data of the sensor detection information is extracted. However, when extraction is performed based on the change in the detection state of a single sensor group, there is a possibility that many cases of erroneous detection of an environmental element or cases where it cannot be detected because it is blocked by other obstacles will be included, and the estimation error of the performance limit will be large. On the other hand, when extraction is performed based on the change in the detection state of an environmental element detected by another sensor group, there is a low possibility that erroneous detection or detection blocked by other obstacles will be included, and there is an effect of reducing the estimation error of the performance limit.

[0077] In S707, the cause (non-detection cause) of the sensor group S not being able to detect the environmental element in either Ob or Ob' is estimated. Possible non-detection causes include, for example, exceeding the performance limit regarding the detection distance (distance limit), exceeding the performance limit regarding the detection angle (viewing angle limit), and occlusion by other obstacles. By targeting environmental elements detected by other sensor groups, the possibility of occlusion is reduced. However, for example, in the case of a millimeter wave radar, even if a vehicle is occluded by a vehicle ahead, it may be possible to detect the vehicle ahead through a gap under the vehicle ahead. On the other hand, in the case of a camera, if the vehicle ahead is occluded, it is not possible to detect the vehicle ahead. Therefore, even if the vehicle is detected by the millimeter wave radar, a situation may occur in which the vehicle ahead cannot be detected by the camera because it is occluded by the vehicle ahead. In order to eliminate such cases, the non-detection cause including occlusion is estimated.

[0078] Whether the cause of the non-detection is occlusion is determined, for example, from the positional relationship between the integrated detection position 403 in the integrated detection information entry (Ob or Ob') in which the sensor group S was not detected and the integrated detection position 403 in another integrated detection information entry included in the integrated detection information at the same timing (ObList(t) or ObList(t-1)). When each integrated detection position 403 is converted into a polar coordinate system seen from the sensor group S, the detection distance r and detection angle θ in the sensor group S are obtained. When the detection distance and detection angle of the undetected integrated detection information entry are r0 and θ0, respectively, if there is another integrated detection information entry such that θ0-Δθ≦θ<θ0+Δθ and r0>r, this means that another environmental element exists in front of the undetected environmental element as seen from the sensor group S. Then, if it can be determined that there is a high possibility that the undetected environmental element is obstructed based on the characteristics (size, height, etc.) of the environmental element existing in front, the cause of the non-detection is determined to be occlusion.

[0079] Whether the cause of non-detection is the field of view limit is determined, for example, when the integrated detection position 403 in the integrated detection information entry in which sensor group S was undetected is within a range near the boundary of the field of view for sensor group S and occlusion is not the cause of non-detection.

[0080] Whether or not the non-detection factor is the distance limit is determined, for example, when the non-detection factor is neither occlusion nor the viewing angle limit.

[0081] If the result of the determination of the cause of non-detection in S707 is the distance limit (Y in S708), the smaller of the detected distances Ob and Ob' is added to the distance limit observed value group DList(S) together with its detection time as the observed value of the distance limit for the sensor group S (S709). Here, as an example, the smaller detected distance is set as the observed value of the distance limit, but it may be the average of the detected distances Ob and Ob', or the larger detected distance.

[0082] If the result of the determination of the non-detection factor in S707 is not the distance limit (N in S708), proceed to S710 and check whether the result of the determination of the non-detection factor is the viewing angle limit. If the result of the determination of the non-detection factor is the viewing angle limit (Y in S710), the detection angle Ob or Ob' with the smaller absolute value is added to the viewing angle limit observation value AList(S) together with its detection time as the observation value of the viewing angle limit for sensor group S (S711). Here, as an example, the detection angle with the smaller absolute value is used as the observation value of the viewing angle limit, but it may be the average value of the detection angles Ob and Ob', or the detection angle with the larger absolute value.

[0083] The distance limit observation value group DList(S) and the viewing angle limit observation value group AList(S) also hold information that was added in the past. In other words, DList(S) and AList(S) store time-series data on the observation values ​​related to the distance limit and viewing angle limit of sensor group S. In practice, it is desirable to reduce the amount of memory used by deleting entries that have been there for a certain amount of time or by managing them in a ring buffer so that the number of stored entries does not exceed a certain value. If the result of the determination in S707 as the cause of non-detection is not the viewing angle limit (N in S710), the process returns to S703.

[0084] When the processes of S703 to S711 are completed for all entries in ObList(t), the process proceeds to S712. In S712, the current sensor detectable area is calculated for each sensor group based on the distance limit observation value group DList(S) and the viewing angle limit observation value group AList(S). Then, the calculated detectable area for each sensor group is stored as the sensor detectable area data group 35 in the storage unit 30 (S713), and the process ends.

[0085] FIG. 8 is a diagram showing an example of a method for calculating the sensor detectable distance based on DList(S) in S712. Graph 800 in FIG. 8 is an example of a group of distance limit observation values ​​included in DList(S) of a given sensor group S, plotted on the vertical axis with the detection time on the horizontal axis. In this example, it can be seen that the trend of the detection distance of the sensor group S changes with the passage of time, and the distribution of the detection distance around time t2 is lower than the distribution of the detection distance around time t1. This means that the performance of the sensor group S is degraded due to external environmental factors such as bad weather. For example, in bad weather such as heavy rain or thick fog, the visibility of a camera-based sensor becomes poorer the further away it goes, and noise is added to the parallax information for calculating the distance based on multiple images and to the contour of the object in the recognition process, so the detection distance tends to decrease compared to normal times. Also, in LiDAR, the attenuation rate of the reflected wave increases due to the influence of raindrops, water vapor, etc., and similar results are shown.

[0086] The detectable distance of the sensor group S is calculated, for example, from statistical values ​​such as the average, maximum, and minimum values ​​of the distance limit observation values ​​during the past T seconds from the calculation time. For example, at time t1 and time t2 in graph 800, observation value group 801 and observation value group 802 are used to calculate the detectable distance, respectively. In graph 800, the average value of these observation value groups is the detectable distance, which corresponds to D1 and D2, respectively. Graph 810 in FIG. 8 represents the calculated detectable distance on the vertical axis and the calculation time on the horizontal axis.

[0087] Although the method for calculating the detectable distance based on the distance limit observation value group DList(S) has been described above, the detectable angle based on the viewing angle limit observation value group AList(S) can also be calculated in a similar manner.

[0088] (Drive control mode determination process) The process of the driving control mode determination unit 14 will be described with reference to Figures 9 and 10. The driving control mode determination unit 14 determines the driving control mode of the vehicle system 1 based on a system parameter data group 38 including a driving environment data group 33, a sensor detectable area data group 35, and a system state (failure state, passenger instruction mode, etc.) of the vehicle system 1 and the driving control device 3. In addition to transitioning the vehicle system 1 to an appropriate system state according to the failure state of the vehicle system 1 and an automatic driving instruction from the passenger, the driving control mode is determined based on the detection performance requirements for the sensors in the driving environment and the actual sensor performance limit shown in the sensor detectable area.

[0089] 9 is an example of driving environment detection performance requirement information, which is information indicating detection performance requirements for a sensor of the driving environment. Note that the driving environment detection performance requirement information is a type of system parameter that determines the behavior of the vehicle system 1, and is assumed to be stored in the system parameter data group 38.

[0090] The driving environment type condition 901 indicates the condition of the road type that the entry targets, and expressway, exclusive road (excluding expressway), general road, etc. are specified. The detailed driving environment condition 902 indicates detailed conditions related to the driving environment targeted by the entry, and is expressed using, for example, a specific road name, road attributes (number of lanes, maximum curvature, presence or absence of road construction, etc.), etc. In Fig. 9, "Expressway A" is shown as an example of a specific road name as a detailed condition. Note that "*" is a wildcard, and means that any condition can be applied.

[0091] The performance requirement 903 indicates the detection performance required of the external sensor group 4 in the driving environment conditions expressed by a combination of the driving environment type condition 901 and the driving environment detailed condition 902. For example, in Fig. 9, it is expressed by a combination of the detection direction (forward, backward, side) and the detection distance with respect to the vehicle 2. Note that the specific shape of the area required for each of the forward, backward, and side detection directions is appropriately defined according to the detection distance.

[0092] 10 is a flowchart illustrating the driving control mode determination process. The driving control mode determination unit 14 executes the processes of S1001 to S1007 to determine the driving control mode of the vehicle system 1, and performs and notifies the driver of the driving control mode change as necessary.

[0093] In S1001, the driving control mode determination unit 14 acquires driving environment data on the driving route from the driving environment data group 13. Then, in S1002, the driving control mode determination unit 14 refers to road information included in the driving environment data, and identifies the corresponding performance requirement from the driving environment performance requirement information shown in Fig. 9. For example, when driving on an expressway other than Expressway A, "120 m or more ahead and 60 m or more behind" corresponds to the performance requirement.

[0094] Next, in S1003, the driving control mode determination unit 14 refers to the sensor detectable area data group 35 and identifies a detectable area according to the current driving control mode. The driving control mode is defined, for example, by the autonomous driving level. According to the SAE J3016 standard, the driver is responsible for autonomous driving level 2 or lower, and the system is responsible for autonomous driving level 3 or higher. Therefore, when operating in a driving control mode of autonomous driving level 3 or higher, a redundant system configuration is formed in principle to deal with failures and sensor / actuator malfunctions. Therefore, since it is necessary to satisfy the performance requirements with redundancy, the sensor detectable area data group 35 is referred to and an area detectable by multiple sensors is identified. On the other hand, if the autonomous driving level is 2 or lower, redundancy is not necessary, so the sensor detectable area data group 35 is referred to and an area detectable by a single sensor is identified.

[0095] Next, in S1004, the driving control mode determination unit 14 compares the performance requirements acquired in S1002 with the detectable area identified in S1003 to determine whether the performance requirements are satisfied. In the example of FIG. 9, the detectable area is expressed as a detectable distance for a detection direction relative to the vehicle 2, but it is assumed that the detection direction is appropriately defined, and it can be converted to "area" information. Therefore, it can be compared with the detectable area. Note that the detectable area may be expressed in the form of a detectable distance for each detection direction in accordance with the expression of the driving environment detection performance requirement information.

[0096] If the comparison result shows that the area indicated by the performance requirements is within the range of the surrounding detectable area, this means that the performance requirements are met, and the process ends without changing the driving control mode (No in S1004).On the other hand, if it is not within the range, the performance requirements are not met, and the process proceeds to S1005 (Yes in S1004).

[0097] In S10005, the driving control mode determination unit 14 identifies a driving control mode that satisfies the driving environment performance requirements. Here, it is assumed that there are three driving control modes, namely, a manual driving mode, an automatic driving level 2 mode, and an automatic driving level 3 mode, and that the automatic driving level 3 mode is currently selected. If it is found in S904 that the performance requirements of the automatic driving level 3 mode are not satisfied, it is next determined whether or not the performance requirements of the automatic driving level 2 mode are satisfied. If they are satisfied, the automatic driving level 2 mode is selected. If the performance requirements still cannot be satisfied, the manual driving mode is selected. Note that, for the sake of explanation, the automatic driving level is used as an example for the explanation, but the level of the automatic driving function may be defined to subdivide the modes. For example, even in the automatic driving level 2 mode, it is possible to divide it into a mode that automatically determines lane changes, a mode that does not allow lane changes unless manually instructed, and a mode that only allows lane following. For example, in the case of lane following only, the lateral performance requirements are unnecessary, so it is possible to specify detection performance requirements for each driving control mode separately from the driving environment, and to determine an appropriate driving control mode based on whether the detection performance requirements of both the driving environment and the driving control mode are satisfied. In that case, the detection performance requirements of the driving environment state the minimum conditions for enabling driving control in that road environment, and the detection performance requirements for the driving control mode specify stricter conditions.

[0098] When the driving control mode is selected in S1005, a process of changing the driving control mode is performed in S1006. The final driving control mode is determined through arbitration between devices to ensure consistency throughout the vehicle system 1, and through interaction with the driver's vehicle to transfer control to the driver as necessary. Then, in S1007, the determined driving control mode is notified to related functions and peripheral devices, and this process ends.

[0099] (Drive control information generation process) The driving control information generator 15 plans driving control for the vehicle 2 so that the vehicle 2 can travel safely and comfortably toward the destination indicated on the driving route in the driving environment data group 33. The basic processing flow is to generate a safe and comfortable driving trajectory for the vehicle 2 while avoiding obstacles detected by the external sensor group 4 in accordance with the traffic rules indicated by the driving environment data group 33 and the integrated detection information data group 34, and to generate control command values ​​for following the driving trajectory. In the present invention, the sensor detectable area data group 35 is further utilized to improve driving safety and comfort.

[0100] The performance limit of the external sensor group 4 changes depending on the external environment. In bad weather, the detectable distance of the external sensor becomes shorter, and the peripheral detectable area also becomes narrower. Even if there is no detection information at a position beyond the peripheral detectable area, it is possible that the external sensor group 4 is simply unable to detect an obstacle. If the driving trajectory is generated in the same way as under normal circumstances without being aware that the detection performance of the external sensor has deteriorated due to bad weather or the like, there is a risk of rear-ending an obstacle or leading to a deterioration in ride comfort due to sudden deceleration.

[0101] Therefore, the driving control information generating unit 15 generates a trajectory for the vehicle 2 to travel at a speed that allows the vehicle 2 to stop safely within the range of the periphery detection possible area. If the allowable deceleration of the vehicle 2 is α and the current speed of the vehicle 2 is v, the distance from when the vehicle 2 starts to decelerate until it stops is v. 2 If the distance from the current position of vehicle 2 to the intersection with the area with high potential risk on the travel route is L, then at least L>v 2 It is necessary to control the speed of vehicle 2 so that it satisfies Lv / 2α. However, this will result in sudden deceleration when the condition is no longer satisfied, so it is preferable to decelerate gradually before the condition is no longer satisfied. For example, a method can be used in which the time it takes for vehicle 2 to reach the point where the condition is no longer satisfied (TTB (Time To Braking)) is introduced as an index, and the speed of vehicle 2 is adjusted based on this. Note that TTB is (Lv 2In order to avoid sudden deceleration, for example, when the TTB becomes equal to or less than a predetermined value, the vehicle may be gradually decelerated (<α), or the speed may be controlled so that the TTB becomes equal to or greater than a predetermined value.

[0102] The driving control information generating unit 15 generates driving control information for the vehicle 2 based on the driving control mode of the vehicle system 1 determined by the driving control mode determining unit 14 and the control command value determined in the driving control plan. This makes it possible to generate driving control information based on the detection information of each sensor of the external sensor group 4 and the sensor detectable area determined by the sensor detectable area determining unit 13. This makes it possible to perform driving control that fully takes into account the detection performance of the sensors.

[0103] (HMI information generation processing) The HMI information generation unit 16 notifies and presents information relating to the driving control of the vehicle 2 via the HMI device group 8, and generates information for reducing anxiety or discomfort felt by the occupants of the vehicle 2 regarding the driving control.

[0104] The HMI information generating unit 16 generates information for notifying the occupant of the state of the driving control mode determined by the driving control mode determining unit 14 and the change therein by voice, screen, etc. In particular, when the driving control mode is changed, it is desirable to present the change to the occupant together with the reason. For example, when it is necessary to lower the autonomous driving level due to a decrease in the detection ability of the sensor caused by bad weather, etc., a voice notification saying "Please switch to manual driving because the detection ability of the sensor has decreased" or a similar message on the screen is presented. The HMI information generating unit 16 generates the information required for the HMI control (change information of the driving control mode and the reason therefor) according to a predetermined format.

[0105] Furthermore, the HMI information generating unit 16 generates information for presenting the detection situation around the vehicle system 1 to the occupant based on the sensor detectable area generated by the sensor detectable area determining unit 13 and the integrated detection information generated by the sensor detection information integrating unit 12. For example, by displaying the current sensor detectable area together with the integrated detection information on the screen as shown in Fig. 2, the occupant can understand the range that the sensor of the vehicle system 1 can detect and what the vehicle system 1 has actually detected. This allows the occupant to understand the reason when the detection ability of the sensor is reduced in bad weather as described above and the vehicle is driven at a reduced speed, thereby reducing the occupant's discomfort with the driving control.

[0106] According to the above embodiment, it is possible to quantify the performance limit of the sensor, which changes depending on the external environment, and therefore it is possible to flexibly set the driving control mode according to the performance limit. For example, by quantitatively comparing the performance requirements of the driving control mode in the driving environment with the performance limit at that time, it is possible to appropriately select the driving control mode that can ensure the function of the vehicle system 1. If the performance limit of the sensor is not quantified, it is not possible to appropriately determine whether the performance requirements are satisfied, and therefore the driving control mode must be determined on the safer side. As a result, even if the automatic driving can be continued under normal circumstances, the automatic driving is stopped, and the availability of the automatic driving function is reduced. In contrast, the present invention is capable of continuing the function to the maximum extent possible while ensuring safety, and has the effect of improving availability.

[0107] In addition, according to the above embodiment, it is possible to quantify the performance limit of the sensor that changes depending on the external environment, so that a safe driving control plan according to the performance limit is possible. By controlling the vehicle to travel at a speed that allows the vehicle to safely stop within a range where the external sensor group 4 can reliably detect obstacles, it is possible to travel at a safe speed even in poor visibility such as in bad weather. If the performance limit of the sensor is not quantified, it is not possible to properly determine a safe driving speed, so the vehicle must travel at a slower speed to the safer side. This results in excessive deceleration, which causes a problem of poor ride comfort for passengers. In contrast, the present invention has the effect of improving ride comfort by allowing the vehicle to continue traveling while ensuring safety and limiting deceleration to an appropriate level.

[0108] According to the embodiment of the present invention described above, the following advantageous effects are obtained. The driving control device 3 disclosed in Example 1 is an electronic control device mounted on a vehicle 2, and includes an information acquisition unit 11 as a sensor detection information acquisition unit that acquires detection information from a first external sensor and detection information from a second external sensor mounted on the vehicle, a sensor detection information integration unit 12 that identifies the correspondence between environmental elements indicated in the detection information of the first external sensor and environmental elements indicated in the detection information of the second external sensor, and a sensor detectable area determination unit 13 that determines the relationship between the relative position and detection capability of the first external sensor based on the detection state of the first external sensor with respect to the environmental elements detected by the second external sensor, and determines the detectable area of ​​the first external sensor based on the relationship. This makes it possible to detect degradation in the performance of the first external sensor due to changes in the external environment, track fluctuations in the actual detectable area, and contribute to continued flexible and safe driving control.

[0109] As one example, the second external sensor is mounted on the vehicle, the sensor detection information integration unit generates integrated detection information indicating environmental elements detected by both the first external sensor and the second external sensor and for which the correspondence has been identified, and the sensor detectable area determination unit determines the detectable area of ​​the first external sensor based on changes in the detection state of the first external sensor with respect to the environmental elements indicated in the integrated detection information. In such a configuration, the output of the sensor fusion can be used to evaluate the performance of the first external sensor.

[0110] In the first embodiment, a vehicle-mounted sensor different from the first external sensor is used as the second external sensor, but the second external sensor may be an infrastructure sensor installed on a road. In addition, another vehicle may be used as the second external sensor by acquiring information on environmental elements from the other vehicle.

[0111] In addition, in Example 1, the sensor detectable area determination unit determines the relationship between the relative position and detection capability of the first external sensor based on the detection position at which the detection state of the first external sensor changes relative to the environmental element detected by the second external sensor in the time series data of the integrated detection information. Therefore, the change in the detection capability of the first external sensor can be accurately reflected.

[0112] In addition, in Example 1, the sensor detectable area determination unit further estimates the factor that caused the change in the detection state of the first external sensor with respect to the environmental factors detected by the second external sensor, and determines the relationship between the relative position and detection capability of the first external sensor based on the estimated factor. Specifically, the relationship between the relative position and the detection capability is expressed as a combination of detectable distance and detectable angle range, and the sensor detectable area determination unit estimates whether the factor causing the change in the detection state is due to the detection distance or the detection angle, and determines the detectable distance of the first external sensor based on the estimated factor due to the detection distance, and determines the detectable angle range of the first external sensor based on the estimated factor due to the detection angle. In addition, the sensor detectable area determination unit estimates whether the cause of the change in the detection state is due to occlusion by another obstacle, and if the estimated cause is due to occlusion by another obstacle, it is not used as information for determining the relationship between the relative position and detection ability of the first external sensor. In this manner, by determining the detection distance and detection angle based on the cause of the change in the detection state of the first external sensor, the detection capability of the first external sensor can be accurately evaluated.

[0113] In addition, the sensor detectable area determination unit is capable of determining the detection reliability of the first external sensor by comparing detection position information of the first external sensor regarding the environmental element with detection position information of the second external sensor regarding the environmental element, and determining the detection state of the first external sensor based on the detection reliability. In addition, in the first embodiment, the vehicle control device further includes a driving control information generation unit 15 serving as a vehicle control information generation unit that generates control information for the vehicle based on the detectable area of ​​the first external sensor determined by the sensor detectable area determination unit and the integrated detection information. In this manner, the reliability of the first external sensor can be evaluated in addition to the detection range, which contributes to safe driving control. EXAMPLES

[0114] --Second embodiment-- A second embodiment of the electronic control device will be described with reference to Figures 11 and 12. In the following description, the same components as those in the first embodiment are given the same reference numerals, and differences will be mainly described. Points that are not specifically described are the same as those in the first embodiment.

[0115] In the first embodiment, the sensor detectable area data group 35 is expressed as a combination of detectable distance and detectable angle range as shown in Fig. 5. This is a suitable method when the sensor configuration is simple and the detection range can be approximated by a sector shape, or when the detectable area does not need to be determined in detail, such as on expressways and exclusive roads. On the other hand, when complex control is required, such as on general roads, it becomes necessary to understand how much of each relative position is visible on the road plane. Therefore, in the second embodiment, the sensor detectable area data group 35 is expressed as a grid map.

[0116] FIG. 11 shows an example of the sensor detectable area data group 35 in the second embodiment. The sensor detectable area 1100 indicates the sensor detectable area of ​​the external sensor 4-2. The detection range of the external sensor 4-2 is divided into a grid in a polar coordinate system, and the degree of detection capability (detection capability level) of the external sensor 4-2 is evaluated for each divided area (cell). The grid width in the distance direction and angle direction in the polar coordinate system is appropriately set according to the required expression granularity.

[0117] Table 1110 shows an example of the data structure of the sensor detectable area 1100. Since it is divided into a lattice shape using a polar coordinate system, it is managed as a two-dimensional array in the distance and angle directions. Each element of the array corresponds to a cell of the sensor detectable area 1100, and stores the detection ability level. Here, the detection ability level is expressed as 0 to 100, and the higher the value, the higher the detection ability of the sensor at that relative position.

[0118] Here, the data structure of FIG. 11 is shown as an example of the sensor detectable area data, but is not limited thereto. For example, a cell area in which the detection ability is higher than a predetermined threshold may be defined as the sensor detectable area. Also, for example, as in the first embodiment, the data may be converted into a form expressed by a combination of the detectable distance and the detectable angle range.

[0119] (Sensor detectable area determination process) Fig. 12 is a flowchart for explaining the processing of the sensor detectable area determination unit 13 of Fig. 6 in a second embodiment. In the second embodiment, a method is used for evaluating the detection capability at a detection position based on whether or not the sensor group can detect the integrated detection information in the detection range of the sensor group. The sensor detectable area determination unit 13 executes the processes of S1201 to S1211 for each sensor group to generate sensor detectable area data for each sensor group and stores it in the storage unit 30 as a sensor detectable area data group 35.

[0120] First, in S1201, the previously calculated sensor detectable area information SA of the sensor group S is obtained from the sensor detectable area data group 35 stored in the storage unit 30. Next, in S1202, the latest value ObList of the integrated detection information is obtained from the integrated detection information data group 34 stored in the storage unit 30.

[0121] Next, in S1203, the detection capability stored in each cell of the sensor detectable area information SA is decreased by Δa. The detection capability of a cell that has not been updated for a long period of time cannot be determined. Therefore, the detection capability is decreased over time to prevent erroneous overestimation of the detection capability.

[0122] Next, the processes of S1204 to S1211 are executed for each entry included in ObList. In S1204, it is confirmed whether there are any unprocessed entries in ObList. If there are no unprocessed entries (N in S1204), the process proceeds to S1212. If there are any unprocessed entries (Y in S1204), the process proceeds to S1205, and one corresponding entry Ob is extracted.

[0123] Then, in S1206, the integrated detection position of Ob is referred to, and it is determined that the integrated detection position of Ob corresponds to the sensor group S If the integrated detection position of Ob is outside the detection range of the sensor group S (N in S1206), the process returns to S1204. If it is within the detection range (Y in S1206), the process proceeds to S1207.

[0124] In S1207, it is confirmed whether the sensor source of Ob includes the sensor group S. If it does (Y in S1207), the process proceeds to S1208, where the detection capability level of the cell in the sensor detectable area information SA corresponding to the integrated detection position of Ob is increased (+a1), and the process returns to S1204. On the other hand, if it is not included (N in S1207), proceed to S1209.

[0125] Here, the detection capability of the cell is increased based on the fact that the sensor group S is included in the sensor source of Ob, but the update content of the detection capability may be changed according to the level of the detection state of the sensor group S. For example, the presence probability 305 included in the sensor detection information is information corresponding to the reliability of the sensor detection information. The lower the value of the presence probability 305, the worse the level of the detection state is, and the detection capability at that position cannot be said to be high. Also, when comparing the integrated detection position 403 of the integrated detection information with the detection position 303 of the sensor group S, if the error of the detection position of the sensor group S is large, the detection capability at that position cannot be said to be high. Therefore, more preferably, the increase (or decrease) in the detection capability may be determined according to the information (existence probability 305) indicating the reliability of the sensor detection information and the recognition accuracy.

[0126] In S1209, a reason is estimated as to why Ob could not be detected even though it was within the detection range of the sensor group S. This is a process equivalent to S707 of the sensor detectable area process in the first embodiment shown in FIG.

[0127] If the cause is due to occlusion (Y in S1210), the process returns to S1204 without updating the sensor detectable area information SA. On the other hand, if the cause is not occlusion (N in S1210), the process proceeds to S1211, where the detection capability of the cell in the sensor detectable area information SA corresponding to the integrated detection position of Ob is decreased (-a2).

[0128] When the processes of S1204 to S1211 are completed for all entries in ObList (N in S1204), the process proceeds to S1212, and SA is stored in the storage unit 30 as the sensor detectable area data group .

[0129] According to the embodiment of the present invention described above, the following advantageous effects are obtained. The electronic control device disclosed in the second embodiment can detect the performance degradation of the first external sensor due to the change in the external environment, follow the change in the actual detectable area, and contribute to the continuation of flexible and safe driving control, similarly to the first embodiment. It is also similar to the first embodiment in that an on-board sensor is used as the second external sensor, the output of the sensor fusion can be used, and an infrastructure sensor or another vehicle may be used as the second external sensor.

[0130] In Example 2, the detectable area of ​​the first external sensor is a grid-like map in which a specified area is divided into a grid and the detection capability of the first external sensor in each unit area is expressed, and the sensor detectable area determination unit determines the detection capability of each unit area of ​​the grid-like map based on the detection state of the first external sensor with respect to the environmental elements detected by the second external sensor in the integrated detection information. The grid map, for example, is divided into a grid shape in a polar coordinate system with the installation point of the first external sensor as the center. When the detection state of the first external sensor is undetected, the sensor detectable area determination unit reduces the detection capability of a unit area corresponding to the position of the integrated detection information in the detectable area of ​​the first external sensor, and updates the grid map. By using a grid map in this way, it is possible to evaluate how visible each relative position is on the road surface, and this can be applied to complex controls such as those on public roads.

[0131] The embodiment described above is merely an example, and the present invention is not limited to this. In other words, various applications are possible, and all embodiments are included in the scope of the present invention.

[0132] For example, in the above embodiment, each process is described on the assumption that it is executed by the same processing unit and storage unit in the driving control device 3, but it may be executed by multiple different processing units and storage units. In that case, for example, processing software having a similar configuration is loaded into each storage unit, and each processing unit shares the task of executing the process.

[0133] In addition, each process of the driving control device 3 is realized by executing a predetermined operation program using a processor and RAM, but it is also possible to realize it by original hardware as necessary. In addition, in the above embodiment, the group of external sensors, the group of vehicle sensors, and the group of actuators are described as separate devices, but it is also possible to realize it by combining any two or more of them as necessary.

[0134] In addition, the drawings show control lines and information lines that are considered necessary for explaining the embodiments, but do not necessarily show all of the control lines and information lines included in an actual product to which the present invention is applied. In reality, it may be considered that almost all components are connected to each other. [Explanation of symbols]

[0135] 1: vehicle system, 2: vehicle, 3: driving control device, 4: external sensor group, 5: vehicle sensor group, 6: map information management device, 7: actuator group, 8: HMI device group, 10: processing unit, 11: information acquisition unit, 12: sensor detection information integration unit, 13: sensor detectable area determination unit, 14: driving control mode determination unit, 15: driving control information generation unit, 16: HMI information generation unit, 17: information output unit, 30: memory unit, 31: sensor detection information data group, 32: vehicle information data group, 33: driving environment data group, 34: integrated detection information data group, 35: sensor detectable area data group, 36: driving control information data group, 37: HMI information data group, 38: system parameter data group, 40: communication unit

Claims

1. An electronic control device mounted on a vehicle, a sensor detection information acquisition unit that acquires detection information of a first external sensor and detection information of a second external sensor mounted on the vehicle; a sensor detection information integration unit that identifies a correspondence relationship between an environmental element indicated in the detection information of the first external sensor and an environmental element indicated in the detection information of the second external sensor; a sensor detectable area determination unit that determines a relationship between a relative position and detection capability of the first external sensor based on a detection state of the first external sensor with respect to the environmental element detected by the second external sensor, and determines a detectable area of ​​the first external sensor based on the relationship; Equipped with The second external sensor is mounted on the vehicle, the sensor detection information integration unit generates integrated detection information indicating environmental elements detected by both the first external sensor and the second external sensor and for which the correspondence relationship has been specified; The sensor detectable area determination unit determines a detectable area of ​​the first external sensor based on a change in a detection state of the first external sensor with respect to the environmental element indicated in the integrated detection information; the detectable area of ​​the first external sensor is a grid-like map in which a predetermined area is divided into a grid and a detection capability of the first external sensor in each unit area is expressed, The sensor detectable area determination unit determines a detection capability level of each unit area of ​​the grid map based on a detection state of the first external sensor with respect to the environmental element detected by the second external sensor in the integrated detection information.

1. An electronic control device comprising:

2. 2. The electronic control device according to claim 1, The sensor detectable area determination unit determines a relationship between a relative position and detection capability of the first external sensor based on a detection position at which a detection state of the first external sensor changes with respect to an environmental element detected by the second external sensor in time series data of the integrated detection information.

1. An electronic control device comprising:

3. 3. The electronic control device according to claim 2, The sensor detectable area determination unit further estimates a factor of a change in the detection state of the first external sensor with respect to the environmental element detected by the second external sensor, A relationship between a relative position and a detection capability of the first external sensor is determined based on the estimated factor.

1. An electronic control device comprising:

4. 4. The electronic control device according to claim 3, the sensor detectable area determination unit estimates whether a cause of the change in the detection state is due to occlusion by another obstacle; The estimated factor caused by occlusion due to another obstacle is not used as information for determining the relationship between the relative position and the detection ability in the first external sensor.

1. An electronic control device comprising:

5. 2. The electronic control device according to claim 1, The sensor detectable area determination unit By comparing the detection position information of the first external sensor related to the environmental element with the detection position information of the second external sensor related to the environmental element, a detection reliability of the first external sensor is determined, and a detection state of the first external sensor is determined based on the detection reliability.

1. An electronic control device comprising:

6. 2. The electronic control device according to claim 1, The vehicle control information generating unit generates control information for the vehicle based on the detectable area of ​​the first external sensor determined by the sensor detectable area determining unit and the integrated detection information.

1. An electronic control device comprising:

7. 2. The electronic control device according to claim 1, the sensor detectable area determination unit, when the detection state of the first external sensor is undetected, reduces a detection capability level of a unit area corresponding to a position of the integrated detection information in the detectable area of ​​the first external sensor; 1. An electronic control device comprising:

8. 2. The electronic control device according to claim 1, The grid map is divided into a grid in a polar coordinate system centered on the installation point of the first external sensor.

1. An electronic control device comprising:

9. A control method by an electronic control device mounted on a vehicle, comprising: a sensor detection information acquisition step of acquiring detection information of a first external sensor and detection information of a second external sensor mounted on the vehicle; a sensor detection information integration step of identifying a correspondence relationship between an environmental element indicated in the detection information of the first external sensor and an environmental element indicated in the detection information of the second external sensor; a sensor detectable area determination step of determining a relationship between a relative position and detection capability of the first external sensor based on a detection state of the first external sensor with respect to the environmental element detected by the second external sensor, and determining a detectable area of ​​the first external sensor based on the relationship; Including, The second external sensor is mounted on the vehicle, In the sensor detection information integration step, integrated detection information is generated that indicates environmental elements detected by both the first external sensor and the second external sensor and for which the correspondence relationship has been specified; In the sensor detectable area determination step, a detectable area of ​​the first external sensor is determined based on a change in a detection state of the first external sensor with respect to the environmental element indicated in the integrated detection information; the detectable area of ​​the first external sensor is a grid-like map in which a predetermined area is divided into a grid and a detection capability of the first external sensor in each unit area is expressed, In the sensor detectable area determination step, a detection capability level of each unit area of ​​the grid map is determined based on a detection state of the first external sensor with respect to the environmental element detected by the second external sensor in the integrated detection information. A control method comprising:

Images