Air traffic control system

Abstract

To provide a control system capable of safely and smoothly switching between automatic drive and remote control of an automatic drive vehicle by using information collection facilities provided along a road.SOLUTION: A control system 100 includes: a roadside device PV that communicates with an automatic drive vehicle VE to monitor its surroundings; a roadside device monitoring system 50 that monitors the roadside device PV; a remote operation system 60 that remotely operates the automatic drive vehicle VE; and an operation management system 70 that acquires monitoring results of the roadside device PV from the roadside device monitoring system 50, determines switching between the automatic drive and the remote operation from the monitoring results to instruct the remote operation system 60 to remotely operate the automatic drive vehicle VE when it is determined to switch to the remote operation.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a control system that uses facilities provided along a road to switch between the automatic driving and remote control of an autonomous vehicle.

Background Art

[0002] As a remote support system for autonomous vehicles, there is a system that switches between the remote control mode and the automatic driving mode of an autonomous vehicle based on a judgment from the surrounding situation of the autonomous vehicle, and when automatic driving is difficult, an operator at a control center performs remote control (Patent Document 1).

[0003] > In the system of Patent Document 1 above, it does not cope with the blind spots of autonomous vehicles, and in dangerous roads with poor visibility, etc., only the judgment from the surrounding situation of the autonomous vehicle is insufficient as a condition for switching to remote control.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

[0005] The present invention has been made in view of the above background, and an object thereof is to provide a control system that can safely and smoothly switch between the automatic driving and remote control of an autonomous vehicle by using information collection facilities provided along a road.

[0006] To achieve the above objective, the control system according to the present invention comprises: a roadside unit that communicates with an autonomous vehicle and monitors its surroundings; a roadside unit monitoring system that monitors the roadside unit; a remote control system that remotely controls the autonomous vehicle; and an operation management system that acquires monitoring results of the roadside unit from the roadside unit monitoring system, makes a decision on switching between autonomous driving and remote control based on the monitoring results, and if it decides to switch to remote control, instructs the remote control system to remotely control the autonomous vehicle. The monitoring results of the roadside unit acquired from the roadside unit monitoring system include not only surrounding information such as the presence or absence of obstacles around the roadside unit, but also status information such as malfunctions of the roadside unit.

[0007] The above control system utilizes roadside monitoring results when deciding whether to switch between autonomous driving and remote control. This allows for the identification of areas where autonomous driving would be dangerous, enabling a smooth transition from autonomous to remote control. Furthermore, it can address the degradation of autonomous driving functionality due to roadside equipment failure. In short, by considering the monitoring status of roadside equipment when deciding whether to switch between autonomous driving and remote control modes, the system can implement appropriate mode switching.

[0008] According to a specific aspect of the present invention, in the above-mentioned control system, the operation management system communicates with the autonomous vehicle and, upon receiving abnormal information from the autonomous vehicle, instructs the remote control system to remotely control the autonomous vehicle. In this case, the remote control can be switched over, taking into account the abnormal information from the autonomous vehicle.

[0009] According to another aspect of the present invention, the roadside unit has a roadside unit sensor that monitors a detection area including the route of the autonomous vehicle. When the roadside unit sensor detects an obstacle on the route of the autonomous vehicle, it notifies the roadside unit monitoring system of the obstacle information. The roadside unit monitoring system then notifies the operation management system of the obstacle information as a result of the roadside unit's monitoring. The operation management system then determines, based on the obstacle information, to switch from autonomous driving to remote control. In this case, even if an obstacle is present on the route of the autonomous vehicle, the switch to remote control can be performed smoothly. Furthermore, it is possible to detect obstacles ahead of the autonomous vehicle, allowing for a sufficient margin of error in switching to remote control and safely avoiding obstacles.

[0010] According to yet another aspect of the present invention, the roadside unit has a roadside unit sensor that monitors a detection area including the route of the autonomous vehicle, and if the roadside unit sensor fails, it notifies the roadside unit monitoring system of the failure information of the roadside unit sensor, the roadside unit monitoring system notifies the operation management system of the failure information as a result of monitoring the roadside unit, and the operation management system decides to switch from autonomous driving to remote control based on the failure information. In this case, even if the roadside unit sensor fails, the switch to remote control can be performed smoothly.

[0011] According to yet another aspect of the present invention, if communication with the roadside unit monitoring system is lost, the roadside unit monitoring system notifies the operation management system of the communication loss information as a result of the roadside unit monitoring, and the operation management system determines to switch from autonomous driving to remote control based on the communication loss information. In this case, even if communication with the roadside unit is lost, the switch to remote control can be performed smoothly.

[0012] According to yet another aspect of the present invention, if communication between an autonomous vehicle and a roadside unit that monitors a detection area including the autonomous vehicle's travel path is lost, the autonomous vehicle notifies the operation management system of the communication loss information as abnormal information, and the operation management system determines to switch from autonomous driving to remote control based on the communication loss information. In this case, even if communication between the autonomous vehicle and the roadside unit is lost, the switch to remote control can be performed smoothly.

[0013] According to yet another aspect of the present invention, if the remote control system determines that it is possible to return from remote control to autonomous driving, it notifies the fleet management system that remote control has ended, and the fleet management system instructs the autonomous vehicle to resume autonomous driving. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual plan view showing a road equipped with the control system according to the first embodiment. [Figure 2] This is a block diagram showing an example configuration of an air traffic control system. [Figure 3] This is a flowchart illustrating a series of operations in an air traffic control system. [Figure 4] This is a flowchart illustrating a series of operations in an air traffic control system. [Figure 5] This is a flowchart illustrating a series of operations in an air traffic control system. [Modes for carrying out the invention]

[0015] [First Embodiment] Hereinafter, an example of a control system according to the first embodiment of the present invention will be described with reference to Figure 1 and other figures. Figure 1 is a conceptual diagram for illustrating the overview of the case in which the control system 100 according to this embodiment is applied to a road RA.

[0016] Figure 1 shows an example of the operation of an autonomous vehicle VE, which is supported by the control system 100, when traveling on a straight road RA with one lane in each direction. Although a bus BU traveling along a predetermined route is shown as an example of an autonomous vehicle VE, the control system 100 can support various autonomous vehicles VE, not limited to buses BU, but also including passenger cars, trucks, trailers, and towing vehicles. The autonomous vehicle VE travels on road RA according to a travel route TR1 corresponding to future position information TR.

[0017] The control system 100 comprises an on-board system VS installed on the autonomous vehicle VE, roadside equipment PV installed along the road RA, and a control center CC that monitors and controls the on-board system VS and the roadside equipment PV. The control system 100 functions as a system through the cooperation of the on-board system VS, the roadside equipment PV, and the control center CC. The control system 100 uses the on-board system VS and the roadside equipment PV to monitor the status of the road RA and the autonomous vehicle VE, and supports the driving of the autonomous vehicle VE as it travels along the road RA. Specifically, the control system 100 switches between autonomous driving and remote control of the autonomous vehicle VE based on the monitoring status of the road RA, the roadside equipment PV, the autonomous vehicle VE, etc.

[0018] Figure 2 is a block diagram showing an example configuration of the control system. As shown in Figures 1 and 2, the on-board system VS is installed in the autonomous vehicle VE and can switch between autonomous driving and remote control via communication CT1 with the control center CC using the communication networks NT1a and NT1b. In addition to communication CT1 with the control center CC, the on-board system VS also communicates with the roadside unit PV using the communication network NT2 via communication CT2, mutually providing information about the vehicle and its surroundings.

[0019] In an autonomous vehicle (VE), the in-vehicle system (VS) comprises a driving control unit 11, an autonomous driving device 12, a remote control device 13, an in-vehicle sensor 14, a GNSS acquisition medium 15, a vehicle-to-infrastructure communication device 16, a control communication device 17, a route data unit 18, and a map data unit 19.

[0020] The driving operation unit 11 is composed of various parts necessary for various operations for normal driving such as steering, accelerator, and brake. The automatic driving device 12 performs automatic control such as engine operation corresponding to the operation of the driving operation unit 11 in order to perform the automatic driving of the autonomous vehicle VE. The remote control device 13 performs remote control such as engine operation corresponding to the operation of the driving operation unit 11. The in-vehicle sensor 14 is composed of a distance measuring unit such as an imaging unit (camera) and LiDAR, which are not shown, and detects the situation around the autonomous vehicle VE. The GNSS acquisition medium 15 is composed of a GPS receiver or the like. The road-vehicle communication device communicate wirelessly with the roadside unit PV. The control communication device 17 communicates wirelessly with the control center CC. The route data unit 18 stores information about the travel route TR1. The map data unit 19 is for grasping the position indicated by the travel route TR1 of the route data unit 18.

[0021] Regarding the map data unit 19, map data for at least the range that can be included as the travel route TR1 is stored. For example, it is assumed that national road map data is incorporated. The autonomous vehicle VE travels along the map data stored in the map data unit 19 for one travel route TR1 set from the route data unit 18.

[0022] In the case of the autonomous vehicle VE configured as described above, for example, the automatic driving device 12 controls the operations of the various parts constituting the in-vehicle sensor 14 in addition to various programs necessary for performing automatic driving, and obtains information on the situation around the autonomous vehicle VE (for example, information on the position of the white line defining the lane on the road RA), or obtains the information on its own position by GNSS (GPS, etc.) via the GNSS acquisition medium (GPS receiver, etc.) 15. As a result, it is possible to accurately estimate its own position and perform automatic driving based on the estimation result.

[0023] The automatic driving device 12 includes a future position information generation unit 12a for generating future position information TR. The future position information TR is composed of information such as the current position of the automatic driving vehicle VE itself on a certain driving route TR1 set from the route data unit 18 and the future route plan information based on the current position by using a GNSS acquisition medium 15 or the like. Note that the future position information TR may include a detour route TR2 when an obstacle OB or the like exists on the driving route of the automatic driving vehicle VE. The driving route TR1 and the detour route TR2 are the movement trajectories of the automatic driving vehicle VE based on the future position information TR, and the future position information TR is created in the automatic driving vehicle VE based on the route information, the speed, and the time of the automatic driving vehicle VE. Note that the detour route TR2 may be provided from the roadside unit PV or the control center CC.

[0024] Also, in an example here, in the automatic driving vehicle VE, it is described that a route for traveling a predetermined location is predetermined as the above-mentioned one driving route TR1. That is, the automatic driving vehicle VE performs automatic driving along the map data unit 19 for one driving route TR1 in the route data unit 18. At this time, the future position information TR corresponding to the driving route TR1 during automatic driving is transmitted to the roadside unit PV and the control center CC via the vehicle-to-roadside communication device 16 and the control communication device 17.

[0025] The automatic driving device 12 performs automatic driving of the automatic driving vehicle VE based on the captured image and sensor detection information acquired by the in-vehicle sensor 14. Note that the automatic driving device 12 transmits the captured image and sensor detection information corresponding to the video information to the control center CC via the control communication device 17. The captured image of the in-vehicle sensor 14 transmitted to the control center CC is used for remote control.

[0026] The remote control device 13 operates the automated vehicle VE according to the remote control information received from the remote control device 62 of the control center CC, which will be described later. Here, the remote control information is a driving control signal based on the remote control operation performed by the operator of the control center CC using the remote control terminal 61.

[0027] The vehicle-to-infrastructure communication device 16 has the function of performing wireless communication by connecting to the communication network NT2. The vehicle-to-infrastructure communication device 16 incorporates communication circuits that utilize communication methods such as mobile communication lines represented by 5G and 4G LTE, medium-range wireless communication methods represented by wireless LAN, narrow-range wireless communication methods such as DSRC, and spot communication methods such as beacons, and performs digital data communication with roadside PVs while identifying the other device. The vehicle-to-infrastructure communication device 16 can employ any one or a combination of the above communication methods.

[0028] The control communication device 17 performs digital data communication between the remote control system 60 and the operation management system 70 of the control center CC, which will be described later. In this embodiment, the wireless communication between the control communication device 17 and the remote control system 60 and the wireless communication between the control communication device 17 and the operation management system 70 utilize different communication networks NT1a and NT1b. The communication network NT1a between the control communication device 17 and the remote control system 60 is a high-speed line with enhanced security, a communication line that enables real-time remote control, and utilizes a mobile communication line such as IP-VPN. The communication network NT1b between the control communication device 17 and the operation management system 70 can be a general line, and utilizes a mobile communication line such as 5G or 4G LTE. Note that the wireless communication between the control communication device 17 and the remote control system 60 and the wireless communication between the control communication device 17 and the operation management system 70 are not limited to using different communication networks NT1a and NT1b, but may also use a common communication line.

[0029] Next, the roadside PV is a roadside device installed near the road RA. The roadside PV monitors the detection range SA, which includes the driving route TR1 of the autonomous vehicle VE, and communicates with the autonomous vehicle VE to obtain information about the autonomous vehicle VE from the autonomous vehicle VE itself. The roadside PV also notifies the autonomous vehicle VE of the status of the road RA based on the monitoring results and information about the autonomous vehicle VE. Furthermore, the roadside PV notifies the roadside monitoring system 50 of the monitoring status of the road RA and the monitoring status of the roadside PV via communication CT3 with the control center CC using the communication network NT3. The roadside PV is installed on traffic lights, utility poles, streetlights, etc., and is not limited to being installed on existing structures; it may also be installed as a separate, independent unit.

[0030] The roadside unit PV monitors a predetermined section of the autonomous vehicle VE's route, including the first lane RA1 corresponding to the lane in which the autonomous vehicle VE travels, and the second lane RA2 corresponding to the opposing lane of the first lane RA1. By monitoring the surroundings, i.e., the detection range SA, by the roadside unit PV, it is possible to obtain surrounding information over a wider range than the surrounding information obtained from the on-board sensors 14 installed on the autonomous vehicle VE, thereby compensating for the autonomous vehicle VE's blind spots. Although not shown in the diagram, blind spots are particularly likely to occur when there is a curve in the road RA and visibility around the curve is poor. The position and size of the detection range SA can be changed as appropriate.

[0031] The roadside PV monitors traffic conditions within the detection range SA and acquires object information such as moving objects MB and obstacles OB, and also acquires route information (future position information described later) from the autonomous vehicle VE indicating the driving route TR1 when traveling on road RA. The roadside PV notifies the autonomous vehicle VE and the roadside monitoring system 50 of hazard information and obstacle information in order to avoid collisions with moving objects MB and obstacles OB within the detection range SA. The roadside PV can also predict collision avoidance with moving objects MB and obstacles OB based on the hazard information and obstacle information and provide information for collision avoidance. Obstacle information includes, for example, the current time, type, location, and speed. Hazard information includes, for example, the possibility of collision with moving objects MB and obstacles OB, and specifically includes determining whether or not there will be a collision with other vehicles on the autonomous vehicle VE's driving path and stopping accordingly.

[0032] The roadside PV unit comprises a roadside control device 21, a roadside sensor 22, a vehicle-to-infrastructure communication device 23, a control communication device 24, and a map data unit 25.

[0033] The roadside control device 21 includes a roadside determination unit 21a composed of various circuit boards, a CPU, a storage device, etc., and a sensor interface 21b for connecting to a roadside sensor 22 that monitors the detection range SA.

[0034] The roadside determination unit 21a collects future position information TR of the autonomous vehicle VE received by the vehicle-to-infrastructure communication device 23, vehicle information, and object information as detection results from the roadside sensor 22, and uses this information to determine the road conditions. Typically, as shown in Figure 1, if the vehicle is about to travel straight through road RA, the road conditions in the detection range SA can be determined by extracting the status of obstacles OB as object information through image analysis processing, the driving status of the vehicle GM ahead (a moving object MB), and acquiring data related to the road shape in the detection range SA stored in the map data unit 25. Based on the determination results, obstacle information and hazard information are transmitted to the autonomous vehicle VE. Vehicle information includes, for example, the current time, type, location, and speed.

[0035] The sensor interface 21b takes in information acquired by the roadside sensor 22, i.e., target information, and outputs it to the roadside determination unit 21a. In other words, the sensor interface 21b is for acquiring target information within the detection range SA.

[0036] Furthermore, the roadside control device 21 performs a health check on the roadside unit sensor 22 at regular intervals to monitor whether the roadside unit sensor 22 is operating normally. The health information, which is the result of the health check, is periodically transmitted from the roadside unit sensor 22.

[0037] The roadside sensor 22 consists of an imaging unit (camera) and a distance measuring unit (not shown), and detects moving objects MB and obstacles OB that are present in the detection range SA, which is a predetermined area to be monitored. In other words, the roadside sensor 22 monitors the detection range SA, which is a detection area that includes the travel path of the autonomous vehicle VE. Moving objects MB can include vehicles, bicycles, pedestrians, etc. The imaging unit takes images and generates image data to monitor the detection range SA. The distance measuring unit can be a LiDAR, a millimeter-wave sensor, or radar, for example, and generates distance measurement data to obtain the position of moving objects MB, etc. The roadside sensor 22 may be configured to include either an imaging unit or a distance measuring unit, as long as it can acquire target information such as moving objects MB. In the figure, only one roadside sensor 22 is shown, but it is possible to install multiple cameras, etc., to monitor the entire detection range SA. Furthermore, while the detection range SA is shown here as an example, if the detection range SA changes depending on the direction of travel A1 of the autonomous vehicle VE to which the information is to be provided, it is possible to appropriately select the camera to be used accordingly. Here, the detection results acquired by the roadside sensor 22, including various information such as image data and distance measurement data concerning the moving object MB present in the detection range SA, are referred to as target information. In other words, the target information includes information such as the operating status of the moving object MB present in the detection range SA, as well as the presence of obstacles OB.

[0038] Furthermore, the roadside PV may transmit the captured images and sensor detection information corresponding to the video information acquired by the roadside sensor 22 to the control center CC via the control communication device 24, which will be described later. In this case, the captured images and other information from the roadside sensor 22 transmitted to the control center CC can be used for remote control.

[0039] The vehicle-to-infrastructure communication device 23 communicates wirelessly with the autonomous vehicle VE. The vehicle-to-infrastructure communication device 23 has the same communication functions as the vehicle-to-infrastructure communication device 16, and communicates digital data with the autonomous vehicle VE located in a predetermined communication zone while identifying the other device, via the communication network NT2 which enables communication using mobile communication lines such as 5G and 4G LTE, medium-range wireless communication methods such as Wi-Fi, narrow-range wireless communication methods such as DSRC, and spot communication methods such as beacons. The vehicle-to-infrastructure communication device 23 can employ one or a combination of any of the above communication methods. As previously described, the autonomous vehicle VE, which is the communication partner, transmits future location information TR, which indicates its future position, to the roadside device PV as data for making a determination. The future location information TR includes the current position of the autonomous vehicle VE (position at the current time), the future position created based on this (including the predicted arrival time), and information such as speed and direction (azimuth angle) at each of these times (scheduled times). Therefore, by receiving future location information TR from the autonomous vehicle VE, the roadside PV can determine, for example, the estimated time of arrival of the autonomous vehicle VE at its destination and the time required to pass through the detection range SA.

[0040] The control communication device 24 communicates wirelessly with the control center CC. The control communication device 24 communicates digital data with the roadside unit monitoring system 50 of the control center CC, which will be described later, via the communication network NT3, which enables communication using a communication method that utilizes a mobile communication line, such as 5G or 4G LTE. Note that the communication network NT3 may be a wired communication line.

[0041] The map data section 25 stores detailed data about the location where the roadside PV unit is installed and its surroundings, such as road information (coordinates, shape, width, lanes, road-to-road connections such as intersections, traffic regulations, etc.) and topographic information.

[0042] Next, the control center (CC) determines whether it is necessary to switch between autonomous driving and remote control of the autonomous vehicle (VE) based on the monitoring status of the road (RA), autonomous vehicle (VE), and roadside equipment (PV). If it is determined that it should switch to remote control, it performs remote control.

[0043] The control center CC is equipped with a roadside aircraft monitoring system 50, a remote control system 60, and an operation management system 70.

[0044] The roadside unit monitoring system 50 monitors the roadside unit PV. The monitoring results of the roadside unit PV obtained from the roadside unit monitoring system 50 include surrounding information (obstacle information) such as the presence or absence of moving objects MB and obstacles OB around the roadside unit PV, as well as hazard information, and also status information (health information) such as malfunctions of the roadside unit PV.

[0045] The roadside unit monitoring system 50 includes a monitoring and control device 51 and a roadside communication device 52. Although not shown in the figures, the roadside unit monitoring system 50 is also capable of communicating with the operation management system 70 by wire, wireless, or a combination thereof.

[0046] The monitoring and control device 51 communicates with the roadside PV unit at predetermined intervals via the roadside communication device 52 to check the status of the roadside PV unit. The monitoring and control device 51 monitors whether communication from the roadside PV unit is interrupted or malfunctioning. The monitoring and control device 51 performs a health check on the roadside PV unit at regular intervals to monitor whether the roadside PV unit is operating normally. Health information, which is the result of the health check, is periodically transmitted from the roadside PV unit via the roadside communication device 52.

[0047] Furthermore, the monitoring and control device 51 transmits from the roadside PV via the roadside communication device 52 obstacle information acquired by the roadside sensor 22 and hazard information determined by the roadside determination unit 21a of the roadside control device 21.

[0048] The monitoring and control device 51 transmits obstacle information, hazard information, health information, and sensor failure information acquired from the roadside PV to the operation management system 70, which will be described later.

[0049] The roadside communication device 52 performs wireless communication with the roadside PV. The roadside communication device 52 has the same communication functions as the control communication device 24 and performs digital data communication with the roadside PV via the communication network NT3, which enables communication using a mobile communication line such as 5G or 4G LTE.

[0050] The remote control system 60 is for remotely controlling the autonomous vehicle VE. The remote control system 60 includes a remote control terminal 61, a remote control device 62, and a vehicle communication device 63. Although not shown in the figures, the remote control system 60 can communicate with the operation management system 70 by wire, wireless, or a combination thereof.

[0051] The remote control terminal 61 is for the operator to remotely control the autonomous vehicle VE. The remote control terminal 61 is equipped with a monitor screen and control panel (not shown). The control panel has functions equivalent to a steering wheel, brakes, etc. The monitor screen displays captured images corresponding to video information acquired from the autonomous vehicle VE and the roadside unit PV. The operator remotely controls the autonomous vehicle VE by operating the control panel while viewing the monitor screen.

[0052] The remote control device 62 converts the operation information from the remote control terminal 61 into driving control signals corresponding to the remote control of the autonomous vehicle VE. The remote control device 62 transmits the driving control signals, which are remote control information, to the autonomous vehicle VE via the vehicle communication device 63. The remote control device 13 of the autonomous vehicle VE performs remote control based on the driving control signals. When the problem that was hindering autonomous driving is resolved and autonomous driving can be resumed, the remote control device 62 notifies the operation management system 70 that the remote control has ended.

[0053] The vehicle communication device 63 performs wireless communication with the autonomous vehicle VE. Similar to the control communication device 17, the vehicle communication device 63 has a high-speed communication function with enhanced security and performs digital data communication with the autonomous vehicle VE via the communication network NT1a, which enables communication using a mobile communication line such as IP-VPN.

[0054] The operation management system 70 acquires monitoring results from the roadside vehicle PV from the roadside vehicle monitoring system 50 and makes a decision on whether to switch between automated driving and remote control based on the monitoring results. In addition, the operation management system 70 acquires abnormal information from the automated driving vehicle VE and makes a decision on whether to switch between automated driving and remote control based on the monitoring results.

[0055] The operation management system 70 has the function of monitoring the status of the autonomous vehicle VE and the surrounding conditions of the autonomous vehicle VE. The operation management system 70 acquires hazard information, obstacle information, and status information of roadside units PV installed within the detection range SA in which the autonomous vehicle VE travels. Based on the above information, the operation management system 70 manages whether the roadside units PV are malfunctioning or functioning correctly. The information of the roadside units PV is aggregated by the roadside unit monitoring system 50 for each area and notified to the operation management system 70.

[0056] The operation management system 70 comprises an operation management control device 71 and a vehicle-side communication device 72. Although not shown in the figures, the operation management system 70 is also capable of communicating with the roadside monitoring system 50 and the remote control system 60 via wired, wireless, or a combination thereof.

[0057] The operation management control device 71 has a driving mode switching determination unit 71a. The driving mode switching determination unit 71a makes a decision on switching between automatic driving and remote control based on the monitoring results of the roadside unit PV obtained from the roadside unit monitoring system 50 and the status of the automated driving vehicle VE. If the operation management control device 71 decides to switch to remote control, it instructs the remote control system 60 to remotely control the automated driving vehicle VE. When the operation management control device 71 receives notification from the remote control system 60 that remote control has ended, it transmits information regarding the instruction to switch back to automatic driving (request to return to automatic driving) to the automated driving vehicle VE via the vehicle-side communication device 72. In addition, if the operation management control device 71 determines that there is an emergency risk of collision with an obstacle OB etc. based on hazard information from the roadside unit PV, it can notify the automated driving vehicle VE of an emergency stop request.

[0058] The vehicle-side communication device 72 performs wireless communication with the autonomous vehicle VE. Similar to the control communication device 17, the vehicle-side communication device 72 has general communication functions and performs digital data communication between the vehicle-side communication device 72 and the autonomous vehicle VE via the communication network NT1b, which enables communication using mobile communication lines such as 5G and 4G LTE.

[0059] In the above, the autonomous vehicle VE and the roadside unit PV communicate to each other to send and receive information such as future location information TR and vehicle information (vehicle status) when entering and passing through the detection range SA. At this time, the roadside unit PV notifies the roadside unit monitoring system 50 of each piece of information and simultaneously communicates directly with the autonomous vehicle VE within the roadside unit PV's communication area (communication range). The autonomous vehicle VE communicates with the operation management system 70 and the remote control system 60 at regular intervals or when switching driving modes. Table 1 summarizes the communication content exchanged between each device. In Table 1, health information of the autonomous vehicle VE and the roadside unit PV is transmitted at regular intervals. [Table 1] TIFF0007838738000001.tif153166

[0060] The control system 100 of this embodiment performs appropriate mode switching by adding the monitoring status of the roadside unit PV to the information from the automated driving vehicle VE regarding the decision information for switching between automated driving and remote control modes. In other words, the control system 100 can switch the driving mode of the automated driving vehicle VE using the status monitoring of the roadside unit PV, and can perform driving mode switching that encompasses information from the surrounding area of ​​the automated driving vehicle VE and information from the roadside unit PV. In particular, the monitoring status of the roadside unit PV includes the following items. (1) Communication anomaly between roadside PV unit and autonomous vehicle VE (vehicle-to-road communication anomaly) (2) Obstacle detection by roadside unit sensor 22 of roadside unit PV (3) Hazard assessment by roadside PV unit (4) Failure of the roadside unit sensor 22 of the roadside unit PV (5) Fault detection of roadside PV units by roadside unit monitoring system 50 (anomaly detection by health check)

[0061] The above (1) corresponds to communication content a1 in Table 1, the above (2) corresponds to communication content a2 in Table 1, the above (3) corresponds to communication content a3 in Table 1, the above (4) corresponds to communication content a4 and a5 in Table 1, and the above (5) corresponds to communication content a5 in Table 1. In addition, the health information of the autonomous vehicle VE shown in Table 1 corresponds to the abnormal information transmitted from the autonomous vehicle VE to the operation management system 70 shown in Figure 1. The abnormal information is based on the health information of the autonomous vehicle VE and includes, for example, when communication with the roadside unit PV is interrupted or when there is a problem with the equipment of the autonomous vehicle VE.

[0062] The following describes an example of the operation of the control system 100. The operation management system 70, for example, decides to switch from autonomous driving to remote control in the following situations and switches between autonomous driving and remote control for the autonomous driving vehicle VE under its management. When a problem occurs at the control center CC, i.e., when a remote control switch trigger occurs, the operation management system 70 is notified, a decision is made to switch the driving mode, and an alarm is issued. At the control center CC, an operator is stationed at the remote control system 60 to ensure that remote control can be started smoothly.

[0063] When a remote control switching trigger occurs, the operation management system 70 automatically switches from automatic driving to remote control after determining the driving mode switch. Also, when a return trigger occurs, the operation management system 70 automatically switches from remote control to automatic driving after determining the driving mode switch. In other words, after driving in remote control mode, if the remote control system 60 determines that it is possible to return from remote control to automatic driving, it notifies the operation management system 70 that remote control has ended. The operation management system 70 instructs the automatic driving vehicle VE to resume automatic driving in response to the automatic driving return request.

[0064] <Obstacle detection by roadside unit's sensor> The trigger source is the roadside unit PV. When the roadside unit PV detects an obstacle OB that cannot be avoided by autonomous driving on the path of the autonomous vehicle VE using the roadside unit sensor 22, it notifies the roadside unit monitoring system 50 of the obstacle information. The roadside unit monitoring system 50 notifies the operation management system 70 of the obstacle information as a result of monitoring by the roadside unit PV. The operation management system 70 determines that it will switch from autonomous driving to remote control based on the obstacle information and instructs the remote control system 60 to remotely control the autonomous vehicle VE. After the obstacle OB is bypassed by remote control, the operation management system 70 determines that it will switch back to autonomous driving for the autonomous vehicle VE, and the autonomous vehicle VE resumes autonomous driving. This allows for a smooth switch to remote control even if an obstacle OB is present on the path of the autonomous vehicle VE. Furthermore, it is possible to detect obstacle OB ahead of the autonomous vehicle VE, allowing for a switch to remote control with sufficient margin and enabling safe avoidance of obstacle OB.

[0065] <Roadside unit sensor failure> The trigger source is the roadside unit PV. If the roadside unit sensor 22 fails, the roadside unit PV notifies the roadside unit monitoring system 50 of the failure information of the roadside unit sensor 22. The roadside unit monitoring system 50 notifies the operation management system 70 of the failure information as a result of monitoring the roadside unit PV. The operation management system 70's driving mode switching determination unit 71a determines that it will switch from automatic driving to remote control based on the failure information and instructs the remote control system 60 to remotely control the automatic driving vehicle VE. After passing through the detection range SA via remote control, the operation management system 70 determines that it will switch back to automatic driving for the automatic driving vehicle VE, and the automatic driving vehicle VE resumes automatic driving. This ensures that the switch to remote control can be performed smoothly even if the roadside unit sensor 22 fails. Furthermore, for subsequent automatic driving vehicles VE, remote control is initiated before they enter the roadside unit PV that is malfunctioning.

[0066] <Malfunction of the roadside control unit's communication device> The trigger source is the control center CC. If communication with the roadside unit PV, which monitors the detection range SA including the route of the autonomous vehicle VE, is lost, the roadside unit monitoring system 50 notifies the operation management system 70 of the communication loss information of the roadside unit PV as a result of the roadside unit monitoring. The operation management system 70 determines that it will switch from autonomous driving to remote control based on the communication loss information and instructs the remote control system 60 to remotely control the autonomous vehicle VE. After the vehicle has passed through the detection range SA via remote control, the operation management system 70 determines that it will switch back to autonomous driving for the autonomous vehicle VE, and the autonomous vehicle VE resumes autonomous driving. This ensures that the switch to remote control can be performed smoothly even if communication with the roadside unit PV is lost. Furthermore, for subsequent autonomous vehicles VE, remote control is initiated before they enter the roadside unit PV that is malfunctioning.

[0067] <Failure of the vehicle-to-infrastructure communication device on the roadside unit> The trigger source is the autonomous vehicle VE. If communication between the autonomous vehicle VE and the roadside unit PV, which monitors the detection range SA including the autonomous vehicle VE's travel path, is lost, the autonomous vehicle VE notifies the operation management system 70 of the communication failure information of the roadside unit PV as abnormal information. The operation management system 70 determines that it should switch from autonomous driving to remote control based on the communication failure information and instructs the remote control system 60 to remotely control the autonomous vehicle VE. After passing through the communication area (communication range) of the roadside unit PV, which includes the detection range SA, via remote control, the operation management system 70 determines that it should switch back to autonomous driving for the autonomous vehicle VE, and the autonomous vehicle VE resumes autonomous driving. This allows for a smooth switch to remote control even if communication between the autonomous vehicle VE and the roadside unit PV is lost. Furthermore, for subsequent autonomous vehicles VE, remote control is initiated before they enter the roadside unit PV that is malfunctioning.

[0068] If the vehicle-to-infrastructure communication device 16 of the autonomous vehicle VE malfunctions, it is possible to switch to remote control without using information from the roadside unit PV. However, this is not as smooth as switching using information from the roadside unit PV, so it is preferable for the autonomous vehicle VE to travel slowly within the detection range SA.

[0069] <Equipment malfunction occurred in an autonomous vehicle> The trigger source is the autonomous vehicle VE. If the autonomous vehicle VE detects an equipment problem through self-diagnosis while driving, it determines that it is impossible to continue autonomous driving and notifies the operation management system 70 of the equipment problem information (vehicle information) as abnormal information. Examples of equipment problems include abnormal output of sensors necessary for autonomous driving (LiDAR, GNSS, etc.). The operation management system 70 determines to switch from autonomous driving to remote control based on the communication interruption information and instructs the remote control system 60 to remotely control the autonomous vehicle VE. After the equipment problem is resolved, the operation management system 70 determines to switch the autonomous vehicle VE back to autonomous driving, and the autonomous vehicle VE resumes autonomous driving.

[0070] <Obstacle detection using on-board sensors in autonomous vehicles> The trigger source is the autonomous vehicle VE. When the autonomous vehicle VE detects an obstacle OB that cannot be avoided by autonomous driving on its path using the onboard sensor 14, it notifies the operation management system 70 of the obstacle information. The operation management system 70 determines, based on the obstacle information, to switch from autonomous driving to remote control and instructs the remote control system 60 to remotely control the autonomous vehicle VE. After the obstacle OB is bypassed by remote control, the operation management system 70 determines to switch the autonomous vehicle VE back to autonomous driving, and the autonomous vehicle VE resumes autonomous driving.

[0071] In the above, the status management of roadside PVs and autonomous vehicle VEs is confirmed by periodic communication between each device. However, a failure in the communication device between the roadside PV and the autonomous vehicle VE can only be detected if the autonomous vehicle VE enters the range where it communicates with the roadside PV. Furthermore, if there is no information from either the roadside PV or the autonomous vehicle VE, the operation management system 70 at the control center CC makes the final decision.

[0072] The following describes a series of operational examples for some of the situations in the control system 100 described above, referring to the flowchart. Note that the autonomous vehicle VE continuously transmits its future position information TR to the roadside unit PV while receiving information from the roadside unit PV.

[0073] <Obstacle detection by roadside unit's sensor> Figure 3 is a flowchart illustrating a series of operations of the control system 100 when an obstacle occurs within the detection range SA of the roadside unit PV. In Figure 3, the autonomous vehicle VE is initially driving automatically on the road RA according to the travel route TR1 (step S10).

[0074] First, if the roadside control device 21 of the roadside unit PV detects an obstacle OB on the path of the autonomous vehicle VE using the roadside unit sensor 22 (Yes in step S11), it notifies the roadside unit monitoring system 50 of the obstacle information (step S12). Examples of obstacle information include large parked vehicles and road closures due to construction.

[0075] When the monitoring control device 51 of the roadside unit monitoring system 50 receives obstacle information from the roadside unit PV (Yes in step S13), it notifies the operation management system 70 of the obstacle information as a result of monitoring the roadside unit PV (step S14).

[0076] After receiving obstacle information from the roadside unit monitoring system 50, the operation management control device 71 of the operation management system 70 searches for an autonomous vehicle VE that is entering the detection range SA of the roadside unit PV (step S15).

[0077] The operation management control device 71 of the operation management system 70, acting as an operation mode switching determination unit 71a, determines whether the notified obstacle OB can be avoided by the detour route TR2 registered in the operation management system 70 (step S16). If the obstacle OB cannot be avoided (No. in step S16), it determines to switch from automatic driving to remote control based on the obstacle information, instructs the remote control system 60 to remotely control the automatic driving vehicle VE, and requests remote control from the automatic driving vehicle VE (step S17). In other words, the operation management system 70 notifies the remote control system 60 of the remote control request.

[0078] The remote control device 62 of the remote control system 60 initiates remote control of the autonomous vehicle VE traveling within the detection range SA of the roadside unit PV (step S18). Specifically, the remote control device 62 transmits a driving control signal corresponding to the operator's operation of the remote control terminal 61 to the remote control device 13 of the autonomous vehicle VE. In response to the remote control request from the remote control system 60 (Yes in step S19), the autonomous vehicle VE switches from autonomous driving to remote control and drives under remote control (step S20). Remote control continues until the avoidance of obstacles OB that would interfere with autonomous driving is completed.

[0079] The remote control device 62 of the remote control system 60 notifies the operation management system 70 of a request to return to automatic driving as the remote control has ended, after the vehicle has detoured around an obstacle OB by remote control, that is, after it has recovered from a situation that would have interfered with automatic driving (step S21). The request to return to automatic driving is notified to the operation management system 70 by, for example, an operator via the remote control system 60.

[0080] The operation management control device 71 of the operation management system 70 receives a remote control termination notification from the remote control system 60 and, as an operation mode switching determination unit 71a, switches from remote control to automatic driving and restores automatic driving of the automatic driving vehicle VE (step S22). In other words, the operation management system 70 notifies the automatic driving vehicle VE of a request to resume automatic driving. The automatic driving vehicle VE resumes automatic driving in response to the automatic driving resume request from the operation management system 70 (Yes in step S23) (step S24).

[0081] In step S16, if the operation management control device 71 of the operation management system 70 can avoid the obstacle OB on the detour route TR2 (Yes in step S16), it notifies the automated driving vehicle VE of the detour route TR2 (step S25). The automated driving vehicle VE receives the detour route TR2 from the operation management system 70 and, without switching from automated driving mode (No in step S19), drives automatically according to the detour route TR2 (step S26). After detouring the obstacle OB by automated driving, the automated driving vehicle VE returns to the original driving route TR1 and maintains automated driving (step S27).

[0082] <Failure of the vehicle-to-infrastructure communication device on the roadside unit> Figure 4 is a flowchart illustrating a series of operations of the control system 100 when a communication failure occurs between the roadside unit PV and the autonomous vehicle VE (failure of the roadside unit PV's vehicle-to-infrastructure communication device 23). In Figure 4, the autonomous vehicle VE is initially driving automatically on road RA according to the driving route TR1 (step S30). Also, the roadside unit PV has a malfunction in its vehicle-to-infrastructure communication device 23 (step S31).

[0083] First, when the autonomous driving vehicle VE, as an autonomous driving device 12, determines that it has entered the communication area with the roadside unit PV, which includes the detection range SA, based on its own position (Yes in step S32), and determines that it cannot communicate with the roadside unit PV (Yes in step S33), it notifies the operation management system 70 of the communication failure information (abnormal information) as a communication failure with the roadside unit PV (step S34). Note that the communication area with the roadside unit PV can be set by both the autonomous driving vehicle VE and the roadside unit PV.

[0084] When the operation management control device 71 of the operation management system 70 receives a communication interruption from the autonomous vehicle VE to the roadside unit PV (Yes in step S35), the operation mode switching determination unit 71a determines, based on the communication interruption information, that it will switch from autonomous driving to remote control, and instructs the remote control system 60 to remotely control the autonomous vehicle VE, requesting remote control from the autonomous vehicle VE (step S36).

[0085] The remote control unit 62 of the remote control system 60 initiates remote control of the corresponding autonomous vehicle VE (step S37). In response to the remote control request from the remote control system 60 (Yes in step S38), the autonomous vehicle VE switches from autonomous driving to remote control and drives under remote control (step S39). Remote control is maintained until the vehicle has passed through the communication area of ​​the roadside unit PV. For subsequent autonomous vehicles VE, remote control is initiated before they enter the roadside unit PV that is malfunctioning.

[0086] After the remote control device 62 of the remote control system 60 has passed through the communication area of ​​the roadside PV via remote control, that is, after recovering from a situation that would interfere with automatic driving, it notifies the operation management system 70 of a request to return to automatic driving as the remote control has ended (step S40).

[0087] The operation control device 71 of the operation management system 70 receives a remote control termination notification from the remote control system 60 and, as the driving mode switching determination unit 71a, switches from remote control to automatic driving and restores automatic driving of the automatic driving vehicle VE (step S41). In the automatic driving vehicle VE, in response to the automatic driving restoration request from the operation management system 70 (Yes in step S42), automatic driving is resumed (step S43).

[0088] In step S38, if the autonomous driving mode is maintained, the autonomous vehicle VE does not switch from autonomous driving to a driving mode (No. in step S38) and drives autonomously according to the driving route TR1 (step S44).

[0089] <Roadside unit sensor failure> Figure 5 is a flowchart illustrating a series of operations of the control system 100 when a failure occurs in the roadside PV. In Figure 5, the automated driving vehicle VE is initially driving automatically on road RA according to the driving route TR1 (step S50). Failures in the roadside PV include failures of the roadside sensor 22 and failures of the roadside control device 21, and the same operations occur in these cases as well. If the control communication device 24 of the roadside PV fails, the roadside PV failure is not notified to the roadside monitoring system 50. In this case, the roadside PV failure is determined by the interruption of communication of the roadside PV's health information, which is notified to the roadside monitoring system 50 at a certain time interval.

[0090] First, if the roadside PV determines that the roadside sensor 22 has failed (Yes in step S51) based on detection of communication interruptions or output abnormalities of the health information of the roadside sensor 22 that are notified at regular intervals, it notifies the roadside monitoring system 50 of the failure information of the roadside PV (step S52). Examples of output abnormalities of the roadside sensor 22 include the camera used as the roadside sensor 22 not transmitting information at a predetermined fps, or the output image having missing parts.

[0091] If the monitoring control device 51 of the roadside unit monitoring system 50 receives fault information for the roadside unit PV (Yes in step S53), it notifies the operation management system 70 of the fault information as a result of monitoring the roadside unit PV (step S54).

[0092] After receiving fault information from the roadside unit monitoring system 50, the operation management control device 71 of the operation management system 70 searches for an automated driving vehicle VE that is entering the detection range SA of the roadside unit PV in question (step S55).

[0093] The operation management control device 71 of the operation management system 70, acting as an operation mode switching determination unit 71a, determines, based on fault information, to switch from automatic operation to remote control, and instructs the remote control system 60 to remotely control the automatic operation vehicle VE, requesting remote control from the automatic operation vehicle VE (step S56).

[0094] The remote control unit 62 of the remote control system 60 initiates remote control of the corresponding autonomous vehicle VE (step S57). In response to the remote control request from the remote control system 60 (Yes in step S58), the autonomous vehicle VE switches from autonomous driving to remote control and drives under remote control (step S59). Remote control is maintained until the vehicle has passed through the communication area of ​​the roadside unit PV. For subsequent autonomous vehicles VE, remote control is initiated before they enter the roadside unit PV that is malfunctioning.

[0095] After the remote control device 62 of the remote control system 60 has passed through the communication area of ​​the roadside PV via remote control, that is, after recovering from a situation that would interfere with automatic driving, it notifies the operation management system 70 of a request to return to automatic driving as the remote control has ended (step S60).

[0096] The operation control device 71 of the operation management system 70 receives a remote control termination notification from the remote control system 60 and, as an operation mode switching determination unit 71a, switches from remote control to automatic driving and restores automatic driving of the automatic driving vehicle VE (step S61). In response to the automatic driving restoration request from the operation management system 70 (Yes in step S62), the automatic driving vehicle VE resumes automatic driving (step S63).

[0097] In step S58, if the autonomous driving mode is maintained, the autonomous vehicle VE does not switch from autonomous driving to a driving mode (No. in step S58) and drives autonomously according to the driving route TR1 (step S64).

[0098] In the control system 100 of the embodiment described above, when deciding whether to switch between automatic driving and remote control, the monitoring results of the roadside PV are used to identify in advance locations where it would be dangerous for the automatic driving vehicle VE to travel under automatic driving conditions, thereby enabling a smooth switch from automatic driving to remote control. Furthermore, it can also respond to a decrease in the functionality of automatic driving due to a failure of the roadside PV. In other words, when deciding whether to switch between automatic driving and remote control modes, the monitoring status of the roadside PV, such as its status (whether it is operational or not), is taken into consideration, enabling an appropriate mode switch.

[0099] 〔others〕 This invention is not limited to the embodiments described above, and can be implemented in various forms without departing from its spirit.

[0100] In the above embodiment, the shape of the road RA is merely an example and is not limited to this; the method can be applied to various shapes and structures.

[0101] In the above embodiment, the reference point of the driving route TR1 was set to the center of the front of the autonomous vehicle VE, but it can be changed as appropriate, for example, to the center of the body or the center of the rear end of the autonomous vehicle VE.

[0102] In the above embodiment, the control system 100 is said to consist of an on-board system VS, a roadside unit PV, a roadside unit monitoring system 50 in the control center CC, a remote control system 60, and an operation management system 70. However, it may also consist of a roadside unit PV, a roadside unit monitoring system 50, a remote control system 60, and an operation management system 70, regardless of whether or not information is provided from the autonomous vehicle VE.

[0103] Furthermore, while the above assumes that the roadside PVs and other components of the control system 100 are installed near the site, i.e., near the road RA, this is not limited to this. For example, sections responsible for various information processing and data management could be set up in a remote location as a management server for the control center CC, or various processing and data storage could be performed on the cloud. [Explanation of Symbols]

[0104] 11... Driving control unit, 12... Automatic driving device, 12a... Future position information generation unit, 13... Remote control device, 14... On-board sensor, 15... Acquisition medium, 16... Infrastructure-to-vehicle communication device, 17... Control communication device, 18... Route data unit, 19... Map data unit, 21... Roadside control device, 21a... Roadside determination unit, 21b... Sensor interface, 22... Roadside machine sensor, 23... Infrastructure-to-vehicle communication device, 24... Control communication device, 25... Map data unit, 50... Roadside machine monitoring system, 51... Monitoring and control device, 52... Roadside communication device, 60... Remote control Vertical system, 61... Remote control terminal, 62... Remote control device, 63... Vehicle communication device, 70... Operation management system, 71... Operation management control device, 71a... Driving mode switching determination unit, 72... Vehicle-side communication device, 100... Control system, BU... Bus, CC... Control center, GM... Vehicle ahead, MB... Moving object, OB... Obstacle, PV... Roadside device, RA... Road, RA1... Lane, RA2... Lane, SA... Detection range, TR... Future position information, TR1... Driving route, TR2... Detour route, VE... Autonomous driving vehicle, VS... On-board system

Claims

1. A roadside unit that communicates with the autonomous vehicle and monitors the surroundings, A roadside unit monitoring system that monitors the aforementioned roadside unit, A remote control system for remotely controlling the aforementioned autonomous vehicle, An operation management system that obtains monitoring results from the roadside unit monitoring system, makes a decision on switching between automated driving and remote control based on the monitoring results, and if it decides to switch to remote control, instructs the remote control system to remotely control the automated driving vehicle, Equipped with, The roadside unit monitoring system is a control system having a monitoring and control device that performs health checks on the roadside unit at regular intervals to monitor whether the roadside unit is operating normally.

2. The control system according to claim 1, wherein the operation management system communicates with the autonomous vehicle and, when it obtains abnormal information from the autonomous vehicle, instructs the remote control system to remotely control the autonomous vehicle.

3. The roadside unit has a roadside unit sensor that monitors a detection area including the travel path of the autonomous vehicle, and when the roadside unit sensor detects an obstacle on the travel path of the autonomous vehicle, it notifies the roadside unit monitoring system of the obstacle information. The roadside unit monitoring system notifies the operation management system of the obstacle information as a result of the monitoring of the roadside unit. The control system according to any one of claims 1 and 2, wherein the operation management system determines to switch from automatic driving to remote control based on the obstacle information.

4. The roadside unit has a roadside unit sensor that monitors a detection area including the travel path of the autonomous vehicle, and if the roadside unit sensor fails, it notifies the roadside unit monitoring system of the failure information of the roadside unit sensor. The roadside equipment monitoring system notifies the operation management system of the failure information as a result of monitoring the roadside equipment. The control system according to any one of claims 1 and 2, wherein the operation management system determines to switch from automatic driving to remote control based on the fault information.

5. If communication with the roadside unit monitoring system is lost when communication with the roadside unit monitoring the detection area including the route of the autonomous vehicle is lost, the roadside unit monitoring system notifies the operation management system of the communication loss information of the roadside unit as a result of the roadside unit monitoring. The control system according to any one of claims 1 and 2, wherein the operation management system determines to switch from automatic driving to remote control based on the communication interruption information.

6. If the autonomous vehicle loses communication with the roadside unit that monitors the detection area including the autonomous vehicle's travel path, it notifies the operation management system of the communication loss information of the roadside unit as abnormal information. The control system according to claim 2, wherein the operation management system determines to switch from automatic driving to remote control based on the communication interruption information.

7. When the remote control system determines that it is possible to return from remote control to automatic driving, it notifies the operation management system of the termination of the remote control. The operation management system is a control system according to any one of claims 1 to 6, which instructs the autonomous vehicle to perform autonomous driving.

Images