Vehicle management device, vehicle management method, vehicle management system, and vehicle management program
The vehicle management device addresses the challenge of connecting multiple platoons by using GNSS information to control vehicle positions and determine optimal connection forms, resulting in efficient and safe platoon connections.
Patent Information
- Application Number
- JP2021213338
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-12-27
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2041-12-27
AI Technical Summary
Conventional automated driving and following driving systems face challenges in efficiently connecting multiple platoons of vehicles while minimizing risks to road traffic and improving fuel efficiency.
A vehicle management device that calculates absolute and relative positions of vehicles using GNSS information, identifies position information, and controls driving based on this information. The device includes communication units to transmit and receive position information and images, allowing it to determine whether platoons can be connected and decide on the optimal connection form.
Enables smooth connection of platoons, reducing the risks associated with individual vehicle connections and improving fuel efficiency by optimizing the front-to-rear positional relationship between platoons.
Smart Images

Figure 0007682091000001 
Figure 0007682091000002 
Figure 0007682091000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a vehicle management device, a vehicle management method, a vehicle management system, and a vehicle management program, and more particularly to a vehicle management device, a vehicle management method, a vehicle management system, and a vehicle management program for managing a platoon of a plurality of vehicles. [Background technology]
[0002] In recent years, from the viewpoint of reducing energy consumption and as a countermeasure against driver shortages, platooning has become common in which multiple vehicles travel in a convoy on expressways and the like. Patent Document 1 discloses a platooning system for platooning multiple vehicles equipped with autonomous driving functions in a line along the direction of travel. In this platooning system, the order of the vehicles in the platoon is determined based on characteristic information that indicates the characteristics of each vehicle so as to minimize fuel consumption. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-215681 A Summary of the Invention [Problem to be solved by the invention]
[0004] Incidentally, in a platoon management system such as that described in Patent Document 1, the management device that manages each vehicle instructs the order of the vehicles forming the platoon, but does not disclose linking multiple platoons together. When another platoon with a similar destination or traveling speed is traveling nearby, linking the platoons together to travel is expected to reduce control labor and improve fuel efficiency. However, in conventional automated driving and following driving systems, each vehicle finds a vehicle to follow and forms a platoon, so when connecting platoons, each vehicle separates from the platoon it belongs to and joins another platoon individually. In the method where vehicles join individually, forming a new platoon involves risks to road traffic, and each vehicle controls the other, which is inefficient.
[0005] The present invention has been made in consideration of the above-mentioned problems, and an object of the present invention is to provide a vehicle management device, a vehicle management method, a vehicle management system, and a vehicle management program that can smoothly connect platoons together while reducing the risks involved when connecting platoons. [Means for solving the problem]
[0006] The above-mentioned problem is solved by the vehicle management device of the present invention, which is a vehicle management device for managing vehicles, comprising: an absolute position calculation unit for calculating an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle itself; a relative position calculation unit for calculating a relative position of the vehicle at the reference station in which the absolute position is corrected using GNSS correction information received from an external reference station; a position identification unit for identifying position information of the vehicle using the relative position; a driving control unit for controlling driving of the vehicle based on the position information identified by the position identification unit; and a first communication unit for transmitting and receiving the position information of the vehicle. a second communication unit that communicates with the first communication unit in the vehicle, the second communication unit having a receiving unit, and a state control unit that controls the driving state of the vehicle that is driven and controlled by the driving control unit, the state control unit including a judgment unit that judges whether or not platoons formed by the vehicles managed by driving based on position information for the vehicles received from the vehicles by the second communication unit can be connected, and a decision unit that decides a connection form including a front-to-rear positional relationship between the platoons, which is a relative connection configuration of the platoons after the platoons are connected based on a judgment result by the judgment unit, The second communication unit receives an image of the vehicle captured by an imaging device of the vehicle, The determination unit is Received Images of the leading and trailing vehicles of each convoy are The traveling status of the platoon is calculated based on the synthesized platoon image.This problem is solved by determining whether the formations can be linked together based on the above-mentioned conditions.
[0007] As described above, the vehicle management device uses the determination unit to determine whether or not the platoons formed by the vehicles managed by driving based on the vehicle position information can be connected, and based on the determination result of the determination unit, the determination unit determines the connection form including the front-to-rear positional relationship between the platoons, which is the relative connection configuration between the platoons after the platoons are connected. The traveling status of the platoon is calculated based on the synthesized platoon image. Therefore, it is possible to realize a vehicle management device that can smoothly connect platoons and reduce the risks involved when connecting platoons.
[0008] The above-mentioned problem is solved by a vehicle management method of the present invention, which uses a vehicle and a vehicle management device that manages the vehicle, and includes an absolute position calculation step of calculating an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle, a relative position calculation step of calculating a relative position of the vehicle at the reference station in which the absolute position is corrected using GNSS correction information received from an external reference station, a position identification step of identifying position information of the vehicle using the relative position, a driving control step of controlling the driving of the vehicle based on the position information identified in the position identification step, and a driving control step of transmitting the position information of the vehicle. the vehicle management device performs a first communication step of receiving from the vehicle position information of the vehicle, and a state control step of controlling the driving state of the vehicle whose driving is controlled by the driving control step, the state control step performing a judgment step of judging whether or not platoons formed by the vehicles managed by driving based on the position information for the vehicle received from the vehicle in the second communication step can be connected, and a determination step of determining a connection form including a relative connection configuration of the platoons after the platoons are connected based on the judgment result of the judgment step, the connection form including a front-to-rear positional relationship between the platoons; In the second communication step, an image of the vehicle captured by an imaging device of the vehicle is received, In the determination step, Received Images of the leading and trailing vehicles of each convoy are The traveling status of the platoon is calculated based on the synthesized platoon image.This problem is solved by determining whether the formations can be connected to each other based on the above-mentioned conditions.
[0009] The above-mentioned problem is solved by a vehicle management system according to the present invention, which is a vehicle management system including a vehicle and a vehicle management device for managing the vehicle, and the vehicle includes an absolute position calculation unit that calculates an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle, a relative position calculation unit that calculates a relative position of the vehicle at the reference station in which the absolute position is corrected using GNSS correction information received from an external reference station, a position identification unit that identifies position information of the vehicle using the relative position, a driving control unit that controls driving of the vehicle based on the position information identified by the position identification unit, and a vehicle management device that manages the vehicle. the vehicle management device comprises a second communication unit that communicates with the first communication unit in the vehicle, and a state control unit that controls the driving state of the vehicle that is driven and controlled by the driving control unit, the state control unit comprising a judgment unit that judges whether or not platoons formed by the vehicles managed by driving based on position information for the vehicle received from the vehicle by the second communication unit can be connected, and a determination unit that determines a connection form including a front-to-rear positional relationship between the platoons, which is a relative connection configuration between the platoons after the platoons are connected, based on a judgment result by the judgment unit; The second communication unit receives an image of the vehicle captured by an imaging device of the vehicle, The determination unit is Received Images of the leading and trailing vehicles of each convoy are Based on the synthesized platoon image, the traveling state image of the platoon is This problem can also be solved by determining whether the formations can be connected to each other based on the above.
[0010] The above-mentioned problem is solved by a vehicle management program of the present invention, which is executed by a first computer as a control device for controlling a vehicle and a second computer as a vehicle management device for managing the vehicle, and which causes the first computer to carry out an absolute position calculation process of calculating an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle, a relative position calculation process of calculating a relative position of the vehicle at the reference station in which the absolute position has been corrected using GNSS correction information received from an external reference station, a position identification process of identifying position information of the vehicle using the relative position, and a vehicle driving control based on the position information identified in the position identification process. and a first communication process that transmits position information of the vehicle, and the second computer executes a second communication process that receives position information of the vehicle from the vehicle, and a state control process that controls the driving state of the vehicle that is driven and controlled by the driving control process, and in the state control process, the second computer executes a judgment process that judges whether or not platoons formed by the vehicles managed by driving based on the position information for the vehicle received from the vehicle in the second communication process can be connected, and a determination process that determines a connection form including a relative connection configuration of the platoons after the platoons are connected based on a judgment result of the judgment process, the connection form including a front-to-rear positional relationship between the platoons, In the second communication process, an image of the vehicle captured by an imaging device of the vehicle is received, In the determination process, Received Images of the leading and trailing vehicles of each convoy are The traveling status of the platoon is calculated based on the synthesized platoon image. This problem can also be solved by determining whether the formations can be connected to each other based on the above-mentioned conditions. Effect of the Invention
[0011] According to the vehicle management device, vehicle management method, vehicle management system, and vehicle management program of the present invention, instructions are given to the lead vehicle in the platoon to link the platoons together as a vehicle group, which reduces the risk of linking compared to when the vehicles join individually. Therefore, it is possible to realize a vehicle management device, vehicle management system, and vehicle management program that can smoothly link platoons together and reduce the risk of linking. [Brief description of the drawings]
[0012] [Figure 1] 1 is a diagram illustrating the overall configuration of a vehicle management system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of a vehicle driving control device. [Figure 3A] FIG. 2 is a diagram illustrating a hardware configuration of a vehicle information processing device. [Figure 3B] FIG. 2 is a diagram showing the positions of identification marks attached to a target vehicle. [Figure 3C] FIG. 2 is a diagram showing the positions of identification marks attached to a target vehicle. [Figure 4] FIG. 2 is a diagram illustrating a hardware configuration of a remote control device. [Diagram 5] FIG. 2 is a diagram illustrating functions of a vehicle driving control device, a vehicle information processing device, and a remote control device. [Figure 6] FIG. 4 is a process flow diagram showing vehicle position information acquisition processing. [Figure 7A] FIG. 2 is a diagram illustrating a state in which autonomous driving control is being performed. [Figure 7B] FIG. 13 is a diagram illustrating a state in which autonomous driving control is changed to relative driving control. [Figure 7C] 11 is a diagram illustrating a state in which the vehicle passes a target vehicle after the relative driving control is changed to the autonomous driving control. FIG. [Figure 8] FIG. 4 is a diagram showing vehicle distance data. [Figure 9] FIG. 4 is a process flow diagram showing a vehicle driving control method. [Figure 10] FIG. 2 is a diagram illustrating a hardware configuration of a vehicle management device. [Figure 11] FIG. 2 is a diagram illustrating functions of a vehicle management device. [Figure 12] FIG. 2 is a diagram showing the front and rear formations before coupling, and the new formation after coupling. [Figure 13] FIG. 13 is a diagram showing an example of a composite image created from images acquired from the leading and trailing vehicles in a convoy. [Figure 14] FIG. 11 is a sequence diagram showing a connection determination process. [Figure 15] FIG. 11 is a sequence diagram showing a platoon connection control process. [Figure 16] FIG. 11 is a flow diagram showing an example of a process for determining whether or not convoys can be connected to each other. [Figure 17] FIG. 11 is a flow diagram showing an example of a process for canceling a connection between convoys. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] <<Vehicle management system overview>> Hereinafter, an embodiment of the present invention will be described with reference to FIGS. As shown in Figure 1, the vehicle management system S of this embodiment is composed of a vehicle C that can be automatically driven or remotely driven by acquiring location information such as GNSS information and identifying the location information of the vehicle itself (also referred to as "vehicle position" or "vehicle position information"), and a vehicle management device 80 that receives location information etc. from vehicle C and manages the driving of multiple convoys F formed by multiple vehicles C.
[0014] Each of the vehicles C that make up the platoon F is controlled by a vehicle driving control system S1. The vehicle driving control system S1 is a system that realizes "autonomous driving" that grasps the external environment of the vehicle C (host vehicle V), plans a planned driving route for the vehicle C on behalf of the driver, and drives the vehicle C by controlling it along the planned driving route, and "following driving" that drives the vehicle C to follow a predetermined target vehicle FV that is to be followed.
[0015] A plurality of vehicles C controlled by a vehicle driving control system S1 repeatedly switch between "automatic driving" and "follow-up driving" to form a convoy F made up of a plurality of vehicles. This convoy F indicates a group of vehicles, and is also called a "group of vehicles." By remotely driving the lead vehicle Ct of the convoy F based on the operation from the vehicle management device 80 or the remote operation device 70, the convoy F comes into a state where the entire group of vehicles is remotely driven. In particular, the vehicle management device 80 can remotely drive only the lead vehicle Ct and have the vehicle C traveling behind it follow it, thereby allowing the vehicle management device 80 to remotely drive a group of vehicles (platoon).
[0016] When multiple vehicles C are traveling under the vehicle travel control system S1, a group of platoons F may be formed on the same road. When multiple such groups of platoons F are traveling, if the distances between the platoons F are close and the destinations and travel speeds are also close, it is better for the platoons to merge, which can reduce the number of remotely driven lead vehicles Ct and the communication fees required to remotely or automatically drive the lead vehicle Ct. Therefore, in the vehicle management system S of this embodiment, the vehicle management device 80 manages the driving conditions, including the position information of the vehicles C that form the platoon F, as driving condition information, and when certain conditions are met, controls the leading vehicles Ct of each platoon F so that connections between the vehicles in the platoon F are made. That is, in the present invention, it is made clear that the vehicles travel in a convoy by controlling the driving of each vehicle, such as automatic driving or following driving, and that the convoy is not formed by controlling the convoy. Below, we first explain the vehicle driving control system S1 that realizes the "automatic driving" and "following driving" of vehicle C, and then explain the vehicle management system S that performs the process of connecting the convoys together using the vehicle management device 80.
[0017] <<Vehicle Driving Control System>> As described above, the vehicle driving control system S1 is a system that realizes "automatic driving" that grasps the external environment of the vehicle C, plans a planned driving route for the vehicle C on behalf of the driver, and drives the vehicle C along the planned driving route by controlling the vehicle C, and "following driving" that drives the vehicle C by following a predetermined target vehicle FV. The vehicle driving control system S1 is also capable of performing a "mode switching process" that switches between the automatic driving control mode and the following driving control mode.
[0018] The "follow-up operation (follow-up operation control)" may be called "relative operation (relative operation control)." In the following description, this will be referred to as "relative operation." In addition, in this embodiment, the "automatic driving control mode (first driving control mode)" will be simply referred to as the "automatic driving mode", and the "following driving control mode (second driving control mode)" will be simply referred to as the "relative driving mode". In addition, the vehicle C that is being driven relative to the host vehicle V will be referred to as the "host vehicle V," and the vehicle C that the host vehicle V is following will be referred to as the "target vehicle FV."
[0019] "Autonomous driving (autonomous driving mode)" includes "autonomous driving (autonomous driving mode)" in which the vehicle V is controlled to drive autonomously, and "remote driving (remote driving mode)" in which an operator outside the vehicle V remotely controls (externally controls) the vehicle V to drive it. In other words, in this embodiment, "autonomous driving" and "remote driving" are collectively referred to as "autonomous driving". Basically, when referring to autonomous driving, it will be explained as meaning autonomous driving. In addition, in remote operation, the operator does not have to be a human, and may be, for example, an AI (artificial intelligence).
[0020] In addition to the above-mentioned "automatic driving" and "relative driving," there is also "manual driving (manual driving mode)" in which a driver actually drives the vehicle V. In the above-mentioned mode switching process, in addition to switching between the manual driving mode and the automatic driving mode, it is also possible to switch between the manual driving mode and the relative driving mode.
[0021] The "own vehicle V" is a vehicle equipped with a vehicle driving control device 1 described below, and has an automatic driving function and a relative driving function. The "target vehicle FV" is a vehicle that is equipped with at least the vehicle information transmission device 50 described below and is capable of transmitting vehicle information (specifically, vehicle identification information, current location information, and information on the planned driving route) through communication via a network, and like the host vehicle V, may be equipped with the vehicle driving control device 1 described below and have both automatic driving functions and relative driving functions. The target vehicle FV is not limited to a leading vehicle that travels ahead of the host vehicle V, but may be a vehicle traveling alongside the host vehicle V. Alternatively, the target vehicle FV may be a trailing vehicle that travels behind the host vehicle V. The target vehicle FV may be, for example, a bus, a taxi, a truck, etc. that runs along a preset planned driving route, a circular bus that runs along a predetermined circular route, etc. Of course, it may also be other general vehicles.
[0022] <<Hardware configuration of vehicle driving control system>> As shown in Figures 1 and 2, the vehicle driving control system S1 includes a vehicle driving control device 1 that is mounted on each of the vehicles V and comprehensively controls the driving of the vehicle, an on-board sensor 10 that detects the external environment around the vehicle V, an on-board locator 20 that receives GNSS signals from an artificial satellite SA and a reference station ST and measures the current position of the vehicle V, an on-board ECU 30 that controls the steering, acceleration, deceleration, etc. of the vehicle V, and an on-board communication device 40 that communicates with external devices.
[0023] The vehicle driving control system S1 also includes a vehicle information transmission device 50 that is mounted on the target vehicle FV, connected to the vehicle driving control device 1 via a network, and transmits target vehicle information including location information of the target vehicle FV via communication via the network, and an identification mark 60 that is attached to the target vehicle FV and has vehicle identification information of the target vehicle FV embedded therein. The host vehicle V may further include the vehicle information transmission device 50 and the identification mark 60 provided in the target vehicle FV, and the target vehicle FV may further include the on-board sensor 10, on-board locator 20, on-board ECU 30, and on-board communication device 40 provided in the host vehicle V. In other words, the host vehicle V and the target vehicle FV may have the same configuration, which makes it possible for the host vehicle V and the target vehicle FV to be interchangeable and form a vehicle driving control system S1. Furthermore, the vehicle driving control system S1 includes a remote control device 70 that is installed outside the vehicle V and controls (remotely controls) the driving of the vehicle V by communicating with the vehicle driving control device 1 via a network. The vehicle driving control device 1, the vehicle information transmission device 50, and the remote control device 70 may communicate directly with each other.
[0024] <<Hardware configuration of vehicle driving control device>> As shown in FIG. 2, the vehicle driving control device 1 is a computer connected to an on-vehicle sensor 10, an on-vehicle locator 20, an on-vehicle ECU 30, and an on-vehicle communication device 40 via an on-vehicle network (CAN). Specifically, the vehicle driving control device 1 is a computer equipped with a CPU as a data calculation and control processing device, a ROM, RAM and HDD (SSD) as memory devices, and a communication interface for sending and receiving information data via an in-vehicle network. In addition to a main program that performs the necessary functions of a computer, the memory device of the vehicle driving control device 1 stores a vehicle driving control program and a vehicle management program, and the functions of the vehicle driving control device 1 are performed by executing these programs by the CPU. The in-vehicle ECU 30 (integrated ECU 31), the vehicle information transmission device 50, and the remote control device 70 are also computers having similar hardware configurations.
[0025] In order to perform "autonomous driving," the vehicle driving control device 1 controls the "autonomous driving" of the vehicle V by controlling the on-board ECU 30 (overall ECU 31) based on information on the external environment obtained from the on-board sensor 10, position information of the vehicle V obtained from the on-board locator 20, and vehicle information obtained from the on-board ECU 30. Furthermore, in order to perform "relative driving (following driving)", the vehicle driving control device 1 wirelessly communicates with the vehicle information transmission device 50 via the in-vehicle communication device 40 and receives target vehicle information including position information of a predetermined target vehicle FV. Then, the vehicle driving control device 1 controls the "relative driving (following driving)" of the host vehicle V relative to the target vehicle FV by controlling the in-vehicle ECU 30 (overall ECU 31) based on information about the external environment, the position information of the host vehicle V, and the target vehicle information including the position information of the target vehicle FV.
[0026] In addition, in order to execute "remote driving", the vehicle driving control device 1 wirelessly communicates with the remote operation device 70 via the in-vehicle communication device 40, and transmits information on the external environment, position information of the vehicle V, and vehicle information to the remote operation device 70. The remote operation device 70 receives this information, and displays content based on the information on the external environment and the position information of the vehicle V on the monitor 71 (navigation monitor 72), as well as providing a user notification to the operator.
[0027] More specifically, the vehicle driving control device 1 is newly installed on the host vehicle V, which already has an "autonomous driving function (on-vehicle sensor 10, on-vehicle locator 20, on-vehicle ECU 30)" installed, thereby improving the performance of the existing "autonomous driving function" and adding new "relative driving function" and "remote driving function."
[0028] <In-vehicle sensor configuration> The on-board sensor 10 detects the external environment around the vehicle V, such as moving objects (other vehicles, pedestrians, etc.), various structures, road shapes, etc. around the vehicle V, and specifically, is mainly composed of multiple imaging devices 11, multiple radars 12, and multiple lidars 13. The on-vehicle sensor 10 may further include detection sensors other than those described above.
[0029] The imaging device 11 is a small imaging camera (wide-angle camera) that captures external images around the vehicle V, and creates external image data and transmits the external image data to the vehicle driving control device 1 to perform a "sensing function" for driving control of the vehicle V and a "monitoring function" for the driver (operator).
[0030] The imaging device 11 is mounted on the host vehicle V in plurality, attached to the windshield of the host vehicle V, and includes a first imaging device 11a, a second imaging device 11b, and a third imaging device 11c that image the front, right side, and left side of the host vehicle V, a fourth imaging device 11d attached to the rear bumper of the host vehicle V that images the rear of the host vehicle V, and a fifth imaging device 11e and a sixth imaging device 11f attached to the left and right mirrors of the host vehicle V that image the right rear diagonal and left rear diagonal of the host vehicle V, and uses them as main cameras.
[0031] Further, the imaging device 11 includes, as sub cameras, a seventh imaging device 11g attached to the front bumper of the host vehicle V that images the front of the host vehicle V, and an eighth imaging device 11h and a ninth imaging device 11i attached to the periphery of the left and right backlights of the host vehicle V that image the right rear diagonal and left rear diagonal of the host vehicle V. In the present embodiment, nine imaging devices 11 are attached to predetermined positions of the host vehicle V, but the number and attachment positions of the imaging devices 11 can be changed according to the vehicle type and shape of the host vehicle V. The same applies to the radar 12 and the lidar 13. As another example of the sub camera, the seventh imaging device 11g may be attached to the upper part of the back glass (rear glass) of the host vehicle V, and image the rear of the host vehicle V from that position. In that case, it is preferable that the eighth imaging device 11h is attached to the right A pillar in the front of the host vehicle V, and the ninth imaging device 11i is attached to the left A pillar in the front.
[0032] The radar 12 is a millimeter-wave radar that transmits radio waves while continuously changing the irradiation direction, receives reflected waves from the target object to detect the target object (measures the position and speed of the target object), and performs three-dimensional spatial imaging. Compared with the imaging device 11 and the lidar 13, it can detect accurately even in environmental situations such as at night with poor visibility or in bad weather. The radar 12 acquires the detection result data (detection signal) of the above target object, and transmits the detection result data toward the vehicle travel control device 1.
[0033] Multiple radars 12 are mounted on the vehicle V, including a first radar 12a and a second radar 12b mounted around the left and right front lights of the vehicle V, and a third radar 12c and a fourth radar 12d mounted around the left and right back lights of the vehicle V. The radar 12 is not particularly limited to a millimeter wave radar, but may be a laser radar, an ultrasonic sensor, or the like.
[0034] The lidar 13 is a remote sensor that measures the distance to a target object by emitting laser light and receiving the light reflected from the target object, and performs three-dimensional spatial imaging. Compared to the imaging device 11 and the radar 12, the lidar 13 can measure the distance to surrounding target objects in units of a few centimeters. The LIDAR 13 acquires distance measurement data that measures the distance to the target object, and transmits the distance measurement data to the vehicle driving control device 1. Multiple riders 13 are mounted on the vehicle V, and include a first rider 13a and a second rider 13b attached around the left and right front lights of the vehicle V, a third rider 13c attached to the back bumper of the vehicle V, and a fourth rider 13d and a fifth rider 13e attached around the left and right back lights of the vehicle V.
[0035] <In-vehicle locator configuration> The vehicle-mounted locator 20 measures the current position of the vehicle V by utilizing a satellite positioning system using artificial satellites SA and reference stations ST, and also measures the acceleration and angular velocity of the vehicle V to improve the accuracy of measuring the current position. Specifically, the in-vehicle locator 20 includes a GNSS receiver 21 that receives GNSS radio waves (GPS radio waves) from a plurality of artificial satellites SA, and an inertial measurement unit 22 that measures the acceleration and angular velocity of the host vehicle V.
[0036] The GNSS receiver 21 is specifically an RTK-GNSS receiver that receives GNSS radio waves from multiple (specifically, four) artificial satellites SA and generates "GNSS information" necessary for independent positioning. It also receives "GNSS correction information" necessary for relative positioning from an external reference station ST. The GNSS receiver 21 is an example of a receiving device that receives information identifying position information (vehicle position, vehicle position information) that identifies the position of the vehicle, and may be a GPS receiver that receives GPS radio waves, an RNSS receiver that receives RNSS radio waves (Radio Navigation Satellite System), or the like. The reference station ST is a fixed reference station set at a known point, receives GNSS radio waves from a plurality of artificial satellites SA, generates “GNSS correction information”, and transmits it to the GNSS receiver 21. The “GNSS information” is distance information between the multiple artificial satellites SA and the GNSS receiver 21. "GNSS correction information" is correction data that corrects distance errors caused by delays or interference in receiving information from satellites when a reference station ST located at a known point receives GNSS radio waves and communicates between the reference station ST and the GNSS receiver 21.
[0037] The inertial measurement unit 22, also known as an IMU, is equipped with a three-axis gyro sensor (angular velocity sensor) and a three-axis acceleration sensor (accelerometer), measures the three-dimensional angular velocity and acceleration of the host vehicle V, and transmits information on the acceleration and angular velocity of the host vehicle V to the vehicle driving control device 1. The vehicle driving control device 1 can measure the current position of the vehicle V with a smaller error range by combining GNSS information (GNSS correction information) received from the GNSS receiver 21 with the angular velocity and acceleration information of the vehicle V received from the inertial measurement device 22.
[0038] <Automotive ECU Configuration> The in-vehicle ECU 30 is, for example, an ECU for ADAS, and is equipped with an upper-level overall ECU 31 that is connected to the vehicle driving control device 1 and transmits and receives various data, and a steering ECU 32, an accelerator ECU 33, and a brake ECU 34 that are connected to the upper-level overall ECU 31 and control the steering, acceleration, deceleration, etc. of the vehicle V in a subdivided manner, forming a hierarchical structure. The steering wheel ECU 32 is also called a driving support computer, and the accelerator ECU 33 and the brake ECU 34 are also called a power management control unit. The number and functions of the individual ECUs connected to the integrated ECU 31 are not particularly limited to the above-mentioned three ECUs 32 to 34, and other ECUs may be further provided at the same hierarchical level as these ECUs.
[0039] The steering wheel ECU 32 controls the electric power steering V1 of the host vehicle V in response to an instruction from the integrated ECU 31, and mainly controls the traveling direction of the host vehicle V. The electric power steering V1 includes a steering mechanism for steering the front wheels of the host vehicle V. For example, in a manual driving mode, the front wheels of the host vehicle V are steered by the driver's steering operation of the steering wheel V1a.
[0040] The accelerator ECU 33 controls the electric throttle V2 of the host vehicle V in response to an instruction from the integrated ECU 31, and mainly controls the acceleration and deceleration of the host vehicle V. The electric throttle V2 includes a drive mechanism that outputs a drive force to rotate the drive wheels of the host vehicle V. For example, in the manual driving mode, the engine output is adjusted in response to the accelerator operation of the accelerator pedal V2a by the driver.
[0041] The brake ECU 34 controls the electromagnetic brake device V3 of the host vehicle V in response to instructions from the integrated ECU 31, and mainly controls the deceleration and stopping of the host vehicle V. The electromagnetic brake device V3 is attached to each wheel of the host vehicle V and has a mechanism for applying resistance to the rotation of the wheels to slow down or stop the host vehicle V. For example, in the manual driving mode, the operation of the electromagnetic brake device V3 is adjusted in response to the braking operation of the brake pedal V3a by the driver.
[0042] <In-vehicle communication device> The in-vehicle communication device 40 is a device that communicates information with a vehicle information transmission device 50 mounted on the target vehicle FV, an externally installed remote control device 70, a vehicle management device 80, and an external server (not shown) via a network. Specifically, the in-vehicle communication device 40 receives target vehicle information including position information of the target vehicle FV acquired by the vehicle information transmission device 50 as information necessary for “relative driving”, and transmits the information to the vehicle driving control device 1. The in-vehicle communication device 40 also transmits information on the external image acquired by the vehicle driving control device 1 as information necessary for "remote driving" and information on the current position to the remote operation device 70. The in-vehicle communication device 40 also receives driving operation information for the host vehicle V from the remote operation device 70 that has accepted user input by the operator, and transmits the information to the vehicle driving control device 1. The in-vehicle communication device 40 also transmits to the vehicle management device 80 information such as external image information, current position information, and vehicle information acquired from the vehicle driving control device 1 as information necessary for the "processing for determining whether platoons are connected" described below. The in-vehicle communication device 40 also receives driving operation information of the vehicle V from the vehicle management device 80 and transmits it to the vehicle driving control device 1. In addition, the in-vehicle communication device 40 can communicate with an external server (not shown) to receive, for example, the latest traffic information, weather information, and the like from the external server.
[0043] <Hardware configuration of the vehicle information transmission device> As shown in Figures 1 and 3A, the vehicle information transmission device 50 is a computer mounted on a target vehicle FV for acquiring target vehicle information including the current location information of the target vehicle FV and transmitting the target vehicle information to the host vehicle V. As specific hardware configurations, the vehicle information transmission device 50 includes an in-vehicle locator 51 and an in-vehicle communication device 52. The “target vehicle information” includes location information (real-time location information) of the target vehicle FV, information on the planned driving route, and vehicle identification information, and is stored in the storage unit 500 of the vehicle information transmission device 50. "Vehicle identification information" refers to a vehicle ID that identifies a target vehicle FV, and information such as the vehicle model name, model type, and chassis number is associated with each vehicle ID and stored in the storage unit 500. In addition to being stored in the storage unit 500, the vehicle identification information is also embedded in an identification mark 60 attached to the target vehicle FV.
[0044] <In-vehicle locator configuration> Similar to the above-mentioned vehicle-mounted locator 20, the vehicle-mounted locator 51 has a GNSS receiver 51a that receives GNSS radio waves (GPS radio waves) from multiple artificial satellites SA, and an inertial measurement unit 51b that measures the acceleration and angular velocity of the target vehicle FV. The in-vehicle communication device 52 is a device that communicates information with the vehicle driving control device 1 mounted in the host vehicle V via a network. Specifically, the in-vehicle communication device 52 transmits the target vehicle information as information necessary for the "relative driving" of the host vehicle V to the vehicle driving control device 1 (in-vehicle communication device 40) at all times or as needed. Specifically, the in-vehicle communication device 52 can transmit the position information of the target vehicle FV, which is included in the target vehicle information, in real time. "Transmitting in real time" includes not only transmitting location information at the same time as changes in the location information of the target vehicle FV, but also transmitting location information with a slight time lag.
[0045] <Identification mark> 3A-C, the identification mark 60 is a two-dimensional barcode in which vehicle identification information for identifying the target vehicle FV is embedded (stored), and multiple identification marks 60 are attached to the outer surface of the target vehicle FV. Note that the identification mark 60 may also have embedded therein information that can specify the planned travel route of the target vehicle FV. The identification mark 60 is recognized by the imaging device 11 of the host vehicle V. In detail, when the imaging device 11 recognizes the identification mark 60 in the image captured by the imaging device 11, it acquires, as recognition results, the vehicle identification information of the target vehicle FV embedded in the identification mark 60, information that can identify the planned driving route, etc. Then, the vehicle driving control device 1 can acquire the vehicle identification information of the target vehicle FV from the imaging device 11 through network communication in a predetermined communication method or an in-vehicle network (CAN). In the above embodiment, the vehicle identification information can be acquired from the vehicle information transmission device 50 and the identification mark 60, but it is sufficient if the vehicle identification information can be acquired from at least one of them.
[0046] The identification mark 60 includes a first identification mark 60a, a second identification mark 60b, and a third identification mark 60c which are attached to the center, left end, and right end, respectively, in the vehicle width direction on the rear surface of the target vehicle FV, and a fourth identification mark 60d, a fifth identification mark 60e, and a sixth identification mark 60f which are attached to the center, left end, and right end, respectively, on the front surface of the target vehicle FV. The identification mark 60 also includes a seventh identification mark 60g, an eighth identification mark 60h, and a ninth identification mark 60i, which are attached respectively to the center, front end, and rear end of the left side of the target vehicle FV in the fore-and-aft direction of the vehicle, and a tenth identification mark 60j, an eleventh identification mark 60k, and a twelfth identification mark 60l, which are attached respectively to the center, front end, and rear end of the right side of the target vehicle FV.
[0047] The first identification mark 60a, the fourth identification mark 60d, the seventh identification mark 60g, and the tenth identification mark 60j arranged in the center of the rear, front, and both sides of the target vehicle FV are formed somewhat larger than the other identification marks. This makes it easier for the imaging device 11 to recognize the identification marks 60 when the host vehicle V is traveling around the target vehicle FV. In other words, it makes it easier for the vehicle driving control device 1 to detect the presence of the target vehicle FV.
[0048] The identification marks 60a to 60l each have vehicle identification information of the target vehicle FV embedded therein, as well as mark position information indicating the position (vehicle body position) at which each identification mark 60 is attached on the target vehicle FV embedded therein. Therefore, when any one of the identification marks 60a to 60l is recognized by the imaging device 11 of the host vehicle V, the vehicle driving control device 1 can obtain vehicle identification information of the target vehicle FV and detect the target vehicle FV. Furthermore, by recognizing, for example, the identification mark 60a and the identification mark 60c among the identification marks 60a to 60l, or by recognizing only the identification mark 60c, the vehicle driving control device 1 can detect that the host vehicle V is located behind the target vehicle FV, and further, to the right of the target vehicle FV, based on the above mark position information. In particular, the vehicle driving control device 1 can accurately grasp the position (relative position) of the target vehicle FV relative to the host vehicle V based on environmental information around the host vehicle V, position information of the host vehicle V, position information of the target vehicle FV, and mark position information obtained by the identification mark 60. The identification mark 60 may be made with ink that cannot be seen with the naked eye, such as transparent ink or invisible ink, and is preferably recognizable mainly by irradiating it with high-frequency ultraviolet light.
[0049] <Hardware configuration of remote control device> As shown in Figures 1 and 4, the remote control device 70 is a computer operated by an operator to perform "remote driving" of the vehicle V, and its specific hardware configuration includes multiple monitors 71, a navigation monitor 72, a steering wheel 73, an accelerator pedal 74, a brake pedal 75, and multiple operating switches 76. The remote control device 70 may further include components such as a speaker, a microphone, and a shift lever.
[0050] The monitor 71 and the navigation monitor 72 are display units that output visual information for performing "remote driving", and the monitor 71 displays a composite video (composite image) that is a composite of external images of the vehicle V captured by multiple imaging devices 11a to 11i based on predetermined layout information. The predetermined layout information is, for example, a display mode of a layout that does not create a blind spot for the operator and is easy for the operator to operate. At this time, it is preferable that a plurality of layout information including the predetermined layout information are associated with each other by a layout ID (layout identification information) and stored in the storage unit 100 of the vehicle driving control device 1. In this case, when an operation to change the predetermined layout information is performed using the operation switch 76 or the like, the layout ID after the change is transmitted from the remote control device 70 to the vehicle driving control device 1. Then, the vehicle driving control device 1 generates a composite image by combining the external image based on the layout information for the changed layout ID, and transmits the composite image to the remote control device 70. In this way, the composite image is changed and displayed on the monitor 71.
[0051] The handle 73 is an operating unit that is operated by an operator and is used to adjust the steering angle (steering amount) of the host vehicle V. The accelerator pedal 74 and the brake pedal 75 are operating parts that are operated by the operator and are used to adjust the drive of the electric throttle V2 of the vehicle V and the operation of the electromagnetic brake device V3, respectively. The multiple operation switches 76 are used to allow the user to input setting information for performing, for example, "remote driving." For example, by the operator appropriately operating the operation switches 76, it is possible to switch the external image (synthetic image) of the vehicle V to a predetermined layout display, or to switch the driving mode among an autonomous driving mode, a relative driving mode, and a remote driving mode.
[0052] <Vehicle driving control device functions> As shown in FIG. 5, from a functional perspective, the vehicle driving control device 1 has as its main components a memory unit 100 for storing various programs and various data, an environmental information acquisition unit 101, a position information acquisition unit 102 (position identification unit), a driving control unit 103 (driving control unit), a vehicle detection unit 104, a communication unit 105 (first communication unit), a mode change unit 106, a driving speed acquisition unit 107, and an image processing unit 108. These are composed of a CPU, ROM, RAM, HDD, communication interface, and various programs. The storage unit 100 stores vehicle identification information of the vehicle V, information on the planned driving route of the vehicle V, "inter-vehicle distance data" shown in FIG. 8, and the like.
[0053] Describing the vehicle information transmission device 50 from a functional perspective, its main components are a memory unit 500 that stores various programs and various data, a location information acquisition unit 501 that acquires the “current location information” of the target vehicle FV, and a communication unit 502 that transmits and receives various data between the vehicle driving control device 1. The storage unit 500 stores "target vehicle information" including the current position information of the target vehicle FV, information on the planned driving route, and vehicle identification information. The location information acquisition unit 501 acquires the "current location information" of the target vehicle FV in real time using the in-vehicle locator 51. Then, by storing the acquired "current location information" in the memory unit 500, it becomes possible to record the travel trajectory (past travel route) of the target vehicle FV equipped with the vehicle information transmission device 50, and the memory unit 500 becomes in a state where the travel trajectory of the target vehicle FV is stored. The communication unit 502 transmits the "target vehicle information" to the vehicle driving control device 1 (the in-vehicle communication device 40) using the in-vehicle communication device 52. In addition, the communication unit 502 transmits the "current position information" of the target vehicle FV in real time, which is included in the target vehicle information.
[0054] Describing the remote control device 70 from a functional perspective, its main components are a memory unit 700 that stores various programs and various data, a communication unit 701 that transmits and receives various data between the vehicle driving control device 1, a screen display unit 702 that displays external images and vehicle information of the vehicle V on the monitor 71 and also displays content based on information about the current position of the vehicle V (e.g., vehicle navigation) on the navigation monitor 72, an operation data creation unit 703 that accepts user operation input and creates operation data, and a user notification unit 704 that notifies the user to the operator.
[0055] The functions of the vehicle driving control device 1 provided in the host vehicle V will be described in detail below. <<External environment information and position information of the vehicle>> The environmental information acquisition unit 101 acquires “environmental information (strictly speaking, detected information of the external environment)” around the host vehicle V from the on-board sensor 10. In detail, as "environmental information", external image data of the surroundings of the vehicle V is obtained from the imaging device 11, detection result data of target objects around the vehicle V is obtained from the radar 12, and distance measurement data measuring the distance between the vehicle V and the target object is obtained from the lidar 13. In addition, "environmental information" specifically refers to detection information of moving objects (other vehicles, pedestrians, etc.) around the vehicle V, various structures, road shapes, etc., and is also referred to as driving environment information, and includes traffic environment information, road environment information, etc.
[0056] The environmental information acquisition unit 101 can acquire information on the traveling state of the target vehicle FV from the on-board sensor 10 in real time as "environmental information." ``Information regarding the driving condition'' refers to information regarding the target vehicle FV's constant speed driving operation, accelerating operation, decelerating operation, stopping operation, left turning operation, right turning operation, reversing operation, etc., in other words, behavior information (information based on behavior) of the target vehicle FV. As the environmental information acquisition unit 101 acquires information regarding the driving state of the target vehicle FV in real time, the vehicle driving control device 1 becomes able to detect, for example, that the target vehicle FV has stopped while driving, that the target vehicle FV has started driving while stopped, or that the target vehicle FV has started driving along a route different from the planned driving route of the host vehicle V, based on changes in information regarding the driving state of the target vehicle FV (changes in behavior information). At this time, "the target vehicle FV has started traveling on a route different from the planned traveling route of the host vehicle V (the planned traveling route of the target vehicle FV no longer matches the planned traveling route of the host vehicle V)" is determined based on the "traveling trajectory of the target vehicle FV" stored in the memory unit 500 of the target vehicle FV and the "traveling trajectory of the host vehicle V" described below, and by determining whether or not the traveling trajectory of the host vehicle V is on the planned traveling route of the host vehicle V.
[0057] The environmental information acquisition unit 101 may further acquire "vehicle control information" of the host vehicle V from the in-vehicle ECU 30. Examples of the "vehicle control information" include "steering angle information" obtained from the steering wheel ECU 32, "throttle opening information" obtained from the accelerator ECU 33, and "brake depression amount information" obtained from the brake ECU 34.
[0058] The position information acquisition unit 102 acquires “current position information” of the host vehicle V from the vehicle-mounted locator 20 . In detail, the position information acquisition unit 102 acquires GNSS information (GNSS correction information) from the GNSS receiver 21, acquires angular velocity and acceleration information of the host vehicle V from the inertial measurement unit 22, and determines the current position of the host vehicle V based on the GNSS information (GNSS correction information), angular velocity, and acceleration information. By storing the acquired "current position information" in the storage unit 100, it becomes possible to record the travel trajectory (past travel route) of the host vehicle V equipped with the vehicle travel control device 1, and the travel trajectory of the host vehicle V is stored in the storage unit 100. This travel trajectory of the host vehicle V is used to determine whether or not the host vehicle V is on a planned travel route, and to set a new planned travel route that leads the host vehicle V onto the planned travel route as necessary.
[0059] The “current position information” may be an “absolute position” calculated by single positioning, a “relative position” calculated by relative positioning, or a “corrected absolute position” or a “corrected relative position” corrected based on the above-mentioned “angular velocity and acceleration information” of the host vehicle V. The position accuracy of the "absolute position" is said to be about ±10m, while the position accuracy of the "relative position" is about ±40cm. The position accuracy of the "corrected absolute position" is higher than that of the absolute position, and the position accuracy of the "corrected relative position" is about ±5cm, which is the highest position accuracy.
[0060] <How to calculate current location information> Next, an example of the process of the vehicle position information acquisition process program (vehicle position information acquisition process) executed by the vehicle driving control system S1 will be described with reference to FIG. The absolute position calculation unit 102a acquires the above-mentioned "GNSS information" required for independent positioning through the GNSS receiver 21, and calculates the "absolute position" of the host vehicle V by independent positioning (step S01: absolute position calculation process, absolute position calculation step). The "absolute position" of the host vehicle V is the three-dimensional position of the host vehicle V that is obtained by receiving GNSS radio waves from multiple satellites SA, measuring the distance between the host vehicle V and each of the satellites SA located at known points, and solving a three-dimensional equation that determines the unknown points from each measured distance (equivalent to GNSS information).
[0061] In addition, in step S01, the relative position calculation unit 102b acquires the above-mentioned "GNSS correction information" necessary for relative positioning, corrects the "absolute position" by relative positioning, and calculates the "relative position" of the host vehicle V (relative position calculation process, relative position calculation step). The "relative position" of the host vehicle V is the three-dimensional position of the host vehicle V that is determined by receiving GNSS radio waves at a reference station ST located at a known point, obtaining the distance with the smaller measurement error from the reference station ST (the distance between each satellite SA and the host vehicle V), and calculating each measured distance (corresponding to GNSS correction information). The calculation method of the "relative position" includes a calculation method based on the RTK positioning method (interferometric positioning method) and a calculation method based on the DGPS positioning method (relative positioning method). Either calculation method may be used.
[0062] The corrected position calculation unit 102c acquires the above-mentioned "angular velocity and acceleration information" of the host vehicle V, and calculates a "corrected absolute position" by correcting the absolute position of the host vehicle V based on the "GNSS information" and the "acceleration and angular velocity information." The "corrected absolute position" of the host vehicle V is the three-dimensional position of the host vehicle V obtained by combining GNSS information with information on the angular velocity and acceleration of the host vehicle V (also called IMU information) to determine its position. In addition, the corrected position calculation unit 102c calculates a "corrected relative position" by correcting the relative position of the host vehicle V based on the "GNSS correction information" and the "acceleration and angular velocity information."
[0063] The reception determination unit 102d determines whether or not GNSS information can be received in real time (step S02), and if it determines that GNSS information can be received in real time (step S02: Yes), it subsequently determines whether or not GNSS correction information can be received in real time (step S03). Specifically, the reception determination unit 102d assumes a case in which there is an obstacle around the vehicle V and therefore radio waves cannot be received from the satellite SA, and in which data cannot be transmitted or received between the vehicle V and the reference station ST, and determines whether radio waves can be received from the satellite SA and whether data can be transmitted or received between the vehicle V and the reference station ST.
[0064] If the reception determination unit 102d determines that GNSS information and GNSS information can be received in real time (step S03: Yes), the location information acquisition unit 102 determines the current location of the vehicle V using the “corrected relative position” with the highest position accuracy (location determination process, location determination processing). In addition, if the position information acquisition unit 102 determines that it can receive GNSS information in real time but cannot receive GNSS correction information in real time (step S03: No), it identifies the current position of the vehicle V using a "corrected absolute position" with high position accuracy. Furthermore, when it is determined that GNSS information and GNSS correction information cannot be received in real time (step S02: No), the position information acquisition unit 102 can also determine the current position of the vehicle V using an “estimated position” calculated based on the most recently received “GNSS information” and the “acceleration and angular velocity information” (step S06).
[0065] The position information acquisition unit 102 acquires the most accurate "corrected relative position" as the "position information" of the vehicle V. On the other hand, when data cannot be transmitted or received from the reference station ST, the position information acquisition unit 102 acquires a "corrected absolute position." Alternatively, when there are obstacles around the vehicle V and radio waves cannot be received from the artificial satellite SA, the position information acquisition unit 102 acquires an "estimated position" (step S07). After identifying the current position of the vehicle V, the vehicle V transmits the current position of the vehicle V to the remote control device 70, the following vehicles, and the vehicle management device 80 (step S08). In addition, the actual driving route information of the vehicle V (also referred to as driving trajectory information or driving history information) is generated by compiling the position information from the driving start position to the driving end position of the vehicle V acquired by the position information acquisition unit 102. The generated driving route information (driving route data) of the host vehicle V is stored in memory unit 100 in association with information regarding the driving date and time, driving time, information regarding the driving mode of the host vehicle V (e.g., the number of times the driving mode is changed, the execution time of each driving mode), and vehicle information of the target vehicle FV that was followed in the relative driving mode.
[0066] <<Autonomous Driving Control>> The driving control unit 103 controls the integrated ECU 31 based on the "environmental information" obtained by the environmental information acquisition unit 101 and the "position information of the host vehicle V" obtained by the position information acquisition unit 102, and performs "autonomous driving control" of the host vehicle V. Note that when performing the "autonomous driving control" of the host vehicle V, the driving control unit 103 may acquire the "vehicle information" of the host vehicle V from the in-vehicle ECU 30, and further combine the "vehicle information" to control the integrated ECU 31.
[0067] When the host vehicle V starts to run along the planned travel route, the driving control unit 103 performs "autonomous driving control" to start the autonomous driving of the host vehicle V. Specifically, when the host vehicle V starts to run, the "autonomous driving mode" is set, and the driving control unit 103 performs autonomous driving control in the state where the "autonomous driving mode" is set. Thereafter, while the mode change unit 106 changes the driving mode between the "autonomous driving mode" and the "relative driving mode", the host vehicle V will travel toward the destination of the planned travel route. Note that if a target vehicle FV to be followed is detected at the timing when the host vehicle V starts to run and the position information of the target vehicle FV is obtained in real time, the mode change unit 106 may change from the "autonomous driving mode" to the "relative driving mode". In that case, the driving control unit 103 performs relative driving control in the state where the "relative driving mode" is set, and starts the relative driving of the host vehicle V with respect to the target vehicle FV. Alternatively, when the host vehicle V starts to run, the "remote driving mode" may be set instead of the "autonomous driving mode", and the driving control unit 103 may perform remote driving control in the state where the "remote driving mode" is set.
[0068] The vehicle detection unit 104 detects that a predetermined preceding vehicle traveling in front of the host vehicle V is a target vehicle FV to be followed in the planned travel route of the host vehicle V (see FIG. 7B). "Target vehicles to be followed" include not only vehicles traveling on a planned driving route that at least partially matches the planned driving route of the host vehicle V, but also vehicles that will travel the same route as the planned driving route of the host vehicle V for a certain driving distance (driving time). For example, this applies to vehicles traveling around the host vehicle V when the host vehicle V is traveling on a highway or general road where there are no branch points within a certain travel distance (travel time).
[0069] Specifically, the vehicle detection unit 104 detects that a predetermined preceding vehicle is a target vehicle FV based on the recognition result of the identification mark 60 of the preceding vehicle recognized by the imaging device 11. For example, when the first identification mark 60a of the target vehicle FV is recognized, the vehicle detection unit 104 detects that the target vehicle FV is located ahead of the host vehicle V. Alternatively, when the seventh identification mark 60g of the target vehicle FV is recognized, the vehicle detection unit 104 detects that the target vehicle FV is present to the right of the host vehicle V.
[0070] More specifically, the vehicle detection unit 104 obtains the recognition results of each identification mark 60a-60l of the target vehicle FV in real time from the imaging device 11, and can accurately detect the relative position of the target vehicle FV with respect to the host vehicle V in real time based on the vehicle identification information of the target vehicle FV (shape and size of the target vehicle FV) and the mark position information embedded in each identification mark 60a-60l. For example, the vehicle driving control device 1 can accurately detect that the target vehicle FV is traveling slightly to the left and forward of the host vehicle V, or that the target vehicle FV is traveling parallel to the host vehicle V and slightly ahead of the host vehicle V. In this case, the relative position of the target vehicle FV may be specified, for example, by a three-dimensional coordinate position with the host vehicle V as the center position. By doing so, the host vehicle V can be driven relatively while maintaining an appropriate inter-vehicle distance between the host vehicle V and the target vehicle FV, as shown in Fig. 7B. In addition, the host vehicle V can be driven autonomously so that the host vehicle V can appropriately overtake the target vehicle FV, as shown in Fig. 7C.
[0071] Although the vehicle detection unit 104 detects the target vehicle FV based on the recognition result of the identification mark 60, the target vehicle FV may be detected by other detection means. For example, the vehicle detection unit 104 may use the in-vehicle communication device 40 to wirelessly obtain vehicle identification information of the target vehicle FV from a vehicle information transmission device 50 mounted on the target vehicle FV, and detect the target vehicle FV based on the vehicle identification information. In other words, the target vehicle FV may be in a state where it can be detected by an identification mark 60 attached to the target vehicle FV, or the target vehicle FV may be in a state where it can be detected by wireless communication with a vehicle information transmission device 50 mounted on the target vehicle FV. In addition, the vehicle detection unit 104 may capture an image of the license plate of the target vehicle FV using the imaging device 11, read the license plate information from the license plate, obtain vehicle identification information of the target vehicle FV from a management server on the network (e.g., vehicle management device 80), and detect the target vehicle FV based on the vehicle identification information.
[0072] The communication unit 105 receives target vehicle information including at least the position information of the target vehicle FV detected by the vehicle detection unit 104. More specifically, when the vehicle detection unit 104 detects the target vehicle FV, the communication unit 105 starts communication with the vehicle information transmission device 50 via the network. The communication unit 105 then receives the position information of the target vehicle FV and information on the planned driving route from the vehicle information transmission device 50 mounted on the target vehicle FV. The location information acquisition unit 501 of the vehicle information transmission device 50 acquires the "current location information" of the target vehicle FV in real time in the same manner as the location information acquisition unit 102 described above.
[0073] <<Mode change (autonomous driving ⇒ relative driving)>> The mode change unit 106 changes the mode from the "autonomous driving mode (autonomous driving control)" to the "relative driving mode (relative driving control)" when a predetermined relative driving start condition is satisfied. Specifically, when autonomous driving control is being performed with the "autonomous driving mode" set as shown in Figure 7A, when a target vehicle FV is detected by the vehicle detection unit 104 and target vehicle information is received by the communication unit 105, the mode change unit 106 changes from the "autonomous driving mode" to the "relative driving mode" as shown in Figure 7B. More specifically, when the vehicle detection unit 104 detects a leading vehicle as a "predetermined relative driving start condition", it determines whether the leading vehicle is a target vehicle FV, and if it is determined that the leading vehicle is a target vehicle FV, it recognizes the leading vehicle as the target vehicle FV. Then, the mode change unit 106 changes from the "autonomous driving mode" to the "relative driving mode". In addition, if it is determined that the preceding vehicle is not the target vehicle FV, even if the preceding vehicle is detected, the mode change unit 106 will not change the mode because the ``specified relative driving start condition'' is not satisfied. Here, the "target vehicle FV" is a vehicle that has a vehicle ID pre-registered by the vehicle driving control device 1 (storage unit 100) mounted on the vehicle V and is identified by that vehicle ID. If that vehicle ID is set for the preceding vehicle, the "predetermined relative driving start condition" is satisfied, and if that vehicle ID is not set, the condition is not satisfied.
[0074] In detail, when the target vehicle FV is detected while autonomous driving control is being performed with the "autonomous driving mode" set, the mode change unit 106 sets the "relative driving mode" with the "autonomous driving mode" set. In other words, while keeping the "autonomous driving mode" in an enabled state, the "relative driving mode" is changed from an disabled state to an enabled state. At this time, the mode change unit 106 prioritizes and continues the "autonomous driving mode" with both modes set. In other words, the driving control unit 103 continues to perform autonomous driving control. When the autonomous driving control continues with both modes set, and the target vehicle information of the target vehicle FV is obtained, the mode change unit 106 causes the "relative driving mode" to be preferentially executed with both modes set. That is, the driving control unit 103 newly performs relative driving control. When the target vehicle information of the target vehicle FV cannot be obtained while the autonomous driving control continues with both modes set by the mode change unit 106, that is, when wireless communication with the vehicle information transmission device 50 mounted on the target vehicle FV cannot be established, the once-set "relative driving mode" is reset. In other words, the "relative driving mode" is changed from the effective state to the invalid state. At this time, since the "autonomous driving mode" remains set (effective state), the driving control unit 103 continues to perform autonomous driving control.
[0075] <<Relative Driving Control>> The driving control unit 103 controls the integrated ECU 31 based on the "environmental information", the "position information of the host vehicle V", and the "target vehicle information of the target vehicle FV", and performs "relative driving control" of the host vehicle V with respect to the target vehicle FV (see Fig. 7B). When executing the "relative driving control", the driving control unit 103 further combines the "vehicle identification information of the target vehicle FV" obtained from the recognition result of the identification mark 60 to control the integrated ECU 31, thereby performing a suitable relative driving according to the vehicle type (shape, size, driving performance, fuel consumption, displacement, etc.) of the target vehicle FV.
[0076] In addition, the "relative driving control" performed by the driving control unit 103 is a control process for specifying the position information of the host vehicle V traveling on the travel trajectory (past travel route) drawn based on the "position information of the target vehicle FV" included in the target vehicle information acquired from the target vehicle FV. In this relative driving control, on the travel trajectory, control is performed to travel at predetermined position information with a set inter-vehicle distance corresponding to the traveling speed of the host vehicle V in order to appropriately ensure the inter-vehicle distance between the host vehicle V and the target vehicle FV. Specifically, the traveling speed acquisition unit 107 acquires the "angular velocity and acceleration information" of the host vehicle V from the inertial measurement device 22, and integrates the acceleration and angular velocity to acquire the "traveling speed" of the host vehicle V in real time. Then, while referring to the "inter-vehicle distance data" shown in FIG. 8 stored in the storage unit 100, the driving control unit 103 specifies the position information where the host vehicle travels based on the position information of the target vehicle FV, and based on the position information of the host vehicle and the environmental information, performs relative driving control to drive the host vehicle V relative to the target vehicle FV. In this relative driving control, a process of correcting and trajectory-correcting the "position information of the host vehicle V" so that the host vehicle V actually travels along the position information specified based on the position information of the target vehicle FV is performed. That is, it is a process of correcting and trajectory-correcting the deviation (error) between the position information where the host vehicle travels, specified based on the position information of the target vehicle FV, and the position information where the host vehicle is actually traveling. Thereby, the traveling trajectory actually traveled by the host vehicle V (the traveling trajectory based on the position information of the host vehicle V) is stored in the storage unit 100.
[0077] The "inter-vehicle distance data" shown in FIG. 8 is a data table showing the correspondence between the traveling speed of the host vehicle V and the set inter-vehicle distance. For example, when the traveling speed (average traveling speed) of the host vehicle V is "80 km / h", the set inter-vehicle distance between the host vehicle V and the target vehicle FV is set to "40 to 70 m". Note that the "inter-vehicle distance data" may be graph data in which the traveling speed of the host vehicle V is on the X-axis, the set inter-vehicle distance is on the Y-axis, and the set inter-vehicle distance increases proportionally to the traveling speed (increases quadratically). In addition to setting the inter-vehicle distance from the target vehicle FV as described above, a time interval may be set so that the host vehicle V travels to the position where the target vehicle FV traveled a predetermined time ago (for example, several seconds ago). In this case, it is preferable to set it so as to ensure a minimum inter-vehicle distance so that the host vehicle V does not collide with the target vehicle FV.
[0078] The traveling speed acquisition unit 107 may calculate the "traveling speed" of the host vehicle V by processing the "GNSS information (GNSS correction information)" and the "acceleration and angular velocity information" using a Kalman filter to calculate the "speed" of the host vehicle V. In this way, the "traveling speed" can be calculated with higher accuracy. In addition, when acquiring "speed information" of the host vehicle V, a wheel speed sensor may be newly installed in the host vehicle V, and the "speed information" may be acquired through the wheel speed sensor.
[0079] The driving control unit 103 performs relative driving control by maintaining a set inter-vehicle distance according to the driving speed of the host vehicle V, but may also perform relative driving control of the host vehicle V with respect to the target vehicle FV based on the synchronization state of the host vehicle V and the target vehicle FV (for example, a state in which when the target vehicle FV travels "1 m", the host vehicle V also travels "1 m"). In the case of a synchronized state, the driving control unit 103 acquires environmental information around the host vehicle V, position information of the host vehicle V, and target vehicle information including position information of the target vehicle FV in real time, and combines this information to perform relative driving control.
[0080] <<Mode change (relative driving ⇒ autonomous driving)>> (When the target vehicle stops) When relative driving control is being performed with the "relative driving mode" set as shown in Fig. 7B, if the "predetermined condition according to the driving state" of the target vehicle FV is satisfied, the mode change unit 106 changes from the relative driving mode to the "autonomous driving mode." Then, the driving control unit 103 performs autonomous driving control in the "autonomous driving mode" as shown in Fig. 7C. "Specified conditions according to driving conditions" refers to a situation where the behavior of the target vehicle FV detects that the host vehicle V needs to overtake the target vehicle FV in order to drive efficiently, or that the host vehicle V needs to drive along a different route than the target vehicle FV. For example, this may be the case when the behavior of the target vehicle FV detects that the target vehicle FV has stopped on the side of the road (on the shoulder) or has started to stop. Another example is when the behavior of the target vehicle FV detects that the target vehicle FV has started traveling a route different from the planned route (specifically, a route toward a rest area). In other words, the "predetermined condition according to the driving state" can also be rephrased as a "relative driving release condition" for releasing the relative driving control of the host vehicle V. The following description will be given assuming that a target vehicle FV in motion stops at the side of the road as shown in FIG. 7C.
[0081] When relative driving control is being performed with the "relative driving mode" set as shown in Figure 7B, the environmental information acquisition unit 101 detects that the target vehicle FV has stopped (started stopping) on the side of the road as detection information regarding the driving state of the target vehicle FV. Then, when it is detected that the target vehicle FV has stopped at the side of the road based on the detection result by the environmental information acquisition unit 101, the mode change unit 106 determines that a predetermined condition corresponding to the traveling state of the target vehicle FV has been met, and then changes from the "relative driving mode" to the "autonomous driving mode." Then, the driving control unit 103 performs autonomous driving control in the "autonomous driving mode". Specifically, while grasping the driving environment information around the host vehicle V, the driving control unit 103 performs autonomous driving control of the host vehicle V so as to overtake the target vehicle FV as shown in FIG. 7C. Since the "autonomous driving mode" is always set (enabled), the driving control unit 103 can smoothly transition from the relative driving control to the autonomous driving control.
[0082] (When the target vehicles separate at a branch point) In addition to the above conditions, when relative driving control is being performed with the "relative driving mode" set, if a predetermined condition according to the planned driving route of the target vehicle FV is satisfied, the mode change unit 106 changes from the relative driving mode to the "autonomous driving mode." Then, the driving control unit 103 performs autonomous driving control in the "autonomous driving mode." The "predetermined condition according to the planned driving route" is when it is detected that the planned driving route of the target vehicle FV and the planned driving route of the host vehicle V no longer match. For example, it is possible that the planned driving route of the target vehicle FV has been acquired in advance and that the planned driving route no longer matches, or that the planned driving route of the target vehicle FV has been changed and the changed planned driving route no longer matches. The following description will be given assuming that the target vehicle FV and the host vehicle V separate at a branch point.
[0083] The communication unit 105 receives, from the vehicle information transmission device 50, "target vehicle information" including position information of the target vehicle FV and information on the planned driving route. When relative driving control is being performed with the "relative driving mode" set as shown in Fig. 7B, if it is detected that the planned driving routes of both vehicles no longer match based on the target vehicle information obtained by the communication unit 105, the mode change unit 106 considers that the "predetermined condition according to the driving state" is satisfied, and then changes from the relative driving mode to the "autonomous driving mode." Then, the driving control unit 103 performs autonomous driving control in the "autonomous driving mode". Specifically, the vehicle V separates from the target vehicle FV at a predetermined branch point and starts autonomous driving control of the vehicle V.
[0084] The above configuration makes it possible to realize a vehicle driving control device 1 that enables the host vehicle V to drive relative to the target vehicle FV and that can change the driving state of the host vehicle V as necessary. In addition, by using the vehicle driving control device 1, it is possible to receive position information of the target vehicle FV in real time and switch between "autonomous driving control" and "relative driving control" depending on the behavior (changes in driving conditions) of the target vehicle FV.
[0085] <<Remote operation control>> Next, the "remote operation control" will be described. The image processor 108 acquires external image data of the vehicle V from each of the imaging devices 11a-11i, and creates a composite image (composite image data) by combining the respective external images based on predetermined layout information. By generating the above-mentioned composite video and transmitting the generated composite video data to the remote control device 70, data communication costs can be reduced compared to the case of transmitting a plurality of external video data.
[0086] The communication unit 105 executes transmission and reception of data between the vehicle driving control device 1 and the remote control device 70 by using the in-vehicle communication device 40 . Specifically, the communication unit 105 transmits to the remote control device 70 the "environmental information" obtained by the environmental information acquisition unit 101 and the "current location information" obtained by the location information acquisition unit 102 as information necessary for "remote driving" of the vehicle V. In addition, the communication unit 105 receives "driving operation information" of the vehicle V from the remote control device 70 that has accepted a user input by an operator. The driving control unit 103 controls the integrated ECU 31 based on the "driving operation information" of the host vehicle V obtained from the remote operation device 70, and performs "remote driving control" of the host vehicle V.
[0087] With the above configuration, it is possible to realize a vehicle driving control device 1 that is also capable of performing "remote driving control" in which an operator remotely controls the host vehicle V to drive it. Therefore, it is possible to switch between "remote driving control" and "relative driving control" depending on the behavior of the target vehicle FV. When switching from "remote driving control" to "relative driving control", the operator is freed from the task of remotely driving the host vehicle V.
[0088] <<Vehicle driving control method>> Next, an example of the process of a vehicle driving control program (vehicle driving control operation method) executed by the vehicle driving control system S1 will be described with reference to FIG. The above-mentioned program in this embodiment is a program for realizing the above-mentioned environmental information acquisition unit 101, position information acquisition unit 102, driving control unit 103 (driving control unit), vehicle detection unit 104, communication unit 105, mode change unit 106, driving speed acquisition unit 107, and image processing unit 108 as functional components of a vehicle driving control device 1 equipped with a memory unit 100, and the CPU of the vehicle driving control device 1 executes this vehicle driving control program. The above program is executed upon receiving an operation instruction from a user (specifically, a driver of the vehicle V or an external operator).
[0089] The vehicle driving control flow shown in FIG. 9 starts with step S101 in which the vehicle driving control device 1 sets the "autonomous driving mode" when the host vehicle V starts driving. The vehicle driving control device 1 may set a "remote control driving mode" instead of the "autonomous driving mode". If the "remote control driving mode" is set, the driving control unit 103 performs remote control driving control of the host vehicle V in step S103 described below.
[0090] Next, in step S102, the environmental information acquisition unit 101 starts acquiring "environmental information" around the host vehicle V, and the position information acquisition unit 102 starts acquiring "position information of the host vehicle V." Note that acquisition of the "position information of the host vehicle V" by the position information acquisition unit 102 is performed by a "current position information acquisition process" shown in FIG. Then, in step S103, the driving control unit 103 controls the integrated ECU 31 based on the environmental information and the position information of the host vehicle V, and performs "autonomous driving control" of the host vehicle V (see FIG. 7A).
[0091] Next, in step S104, the vehicle detection unit 104 detects whether or not a predetermined preceding vehicle is a target vehicle FV to be followed on the planned driving route of the host vehicle V. Specifically, based on the recognition result of the identification mark 60 of a predetermined leading vehicle recognized by the imaging device 11, the vehicle detection unit 104 determines whether the leading vehicle is the target vehicle FV based on the above-mentioned predetermined relative driving start conditions. When the vehicle detection unit 104 determines that it is the target vehicle FV by satisfying the predetermined relative driving start conditions (step S104: Yes), it proceeds to step S105. On the other hand, when the vehicle detection unit 104 does not satisfy the predetermined relative driving start conditions and does not determine that it is the target vehicle FV (step S104: No), it returns to step S102. That is, the autonomous driving control in the "autonomous driving mode" is continued.
[0092] Next, in step S105, the mode change unit 106 sets the "relative driving mode" in the state where the "autonomous driving mode" is set. In other words, while keeping the "autonomous driving mode" in an active state, the "relative driving mode" is changed from an invalid state to an active state.
[0093] Next, in step S106, the communication unit 105 attempts to receive "target vehicle information" including the "position information of the target vehicle FV" detected by the vehicle detection unit 104. Specifically, the communication unit 105 starts communication with the vehicle information transmitting device 50 mounted on the target vehicle FV via the network and attempts to receive the position information of the target vehicle FV from the vehicle information transmitting device 50.
[0094] When the communication unit 105 receives the position information of the target vehicle FV from the target vehicle FV (step S106: Yes), it proceeds to step S107, and the driving control unit 103 controls the integrated ECU 31 based on the "environmental information", the "position information of the host vehicle V", and the "target vehicle information of the target vehicle FV", and performs "relative driving control" of the host vehicle V with respect to the target vehicle FV (see FIG. 7B). On the other hand, when the communication unit 105 does not receive the position information of the target vehicle FV (step S106: No), it proceeds to step S108. In the state where the "autonomous driving mode" is set, the mode change unit 106 changes the "relative driving mode" from an active state to an invalid state and releases it, and then returns to step S102.
[0095] Next, in step S109, when the mode change unit 106 is performing relative driving control with the "relative driving mode" set, it determines whether the target vehicle FV satisfies the "predetermined conditions". Specifically, the mode change unit 106 determines whether the target vehicle FV satisfies the "predetermined conditions according to the driving state" or whether the target vehicle FV satisfies the "predetermined conditions according to the planned driving route". Note that when the mode change unit 106 determines that either one of the "predetermined conditions according to the driving state" and the "predetermined conditions according to the planned driving route" of the target vehicle FV is satisfied, it determines that the above "predetermined conditions" are satisfied.
[0096] When it is determined that the target vehicle FV satisfies the "predetermined conditions" (step S109: Yes), the process proceeds to step S110, and the mode change unit 106 changes the "relative driving mode" from the active state to the inactive state and releases it. Then, in step S111, the driving control unit 103 performs autonomous driving control in the "autonomous driving mode" as shown in FIG. 7C. For example, when it is detected that the target vehicle FV in motion has stopped operating and thus the "predetermined conditions according to the driving state" are satisfied, the mode change unit 106 releases the "relative driving mode", and the driving control unit 103 switches the relative driving control and performs autonomous driving control. On the other hand, when it is determined that the target vehicle FV does not satisfy the "predetermined conditions" (step S109: No), the process returns to step S107.
[0097] Finally, in step S112, when the vehicle driving control device 1 determines that the host vehicle V has reached the destination or has terminated the autonomous driving control in the autonomous driving mode (step S112: Yes), the process of FIG. 9 ends. On the other hand, when the vehicle driving control device 1 continues to perform the driving control of the host vehicle V (step S112: No), the process returns to step S102.
[0098] The above-described vehicle driving control program configuration enables the host vehicle V to drive relative to the target vehicle FV, and makes it possible to change the driving state of the host vehicle V as necessary. In addition, it is possible to receive position information of the target vehicle FV in real time and switch between "autonomous driving control" and "relative driving control" depending on the behavior of the target vehicle FV.
[0099] <<Vehicle management system>> Using the vehicle driving control system S1 described above, multiple subject vehicles V find a target vehicle FV to follow, and by repeatedly switching between "autonomous driving control" and "relative driving control", a convoy (vehicle group) consisting of multiple vehicles is formed. The convoy at this time can be recognized as being formed externally by the "autonomous driving control" and "relative driving control" between each vehicle. Furthermore, when multiple platoons are traveling to similar destinations, on similar routes to their destinations, or at similar travel speeds, having the platoons merge can be expected to reduce control labor and improve fuel efficiency. The following describes a vehicle management device 80 and a vehicle management system S that control a plurality of convoys F formed by a vehicle travel control system S1 and connect the convoys together, with reference to Figs. 1 and 10 to 17.
[0100] In the vehicle driving control system S1, the functions of the host vehicle V and the target vehicle FV have been described separately, but each vehicle C forming the platoon F is also equipped with a function that allows the host vehicle V to become a target vehicle FV. That is, the vehicle C controlled by the vehicle management system S is equipped with a vehicle driving control device 1, an on-board sensor 10, an on-board locator 20, an on-board ECU 30, and an on-board communication device 40, as well as a vehicle information transmission device 50 and an identification mark 60, which allows the host vehicle V and the target vehicle FV to alternate and continue driving. In the following description, the host vehicle V having the function of a target vehicle FV will be referred to as vehicle C.
[0101] Furthermore, vehicle C automatically identifies and follows the target vehicle FV by the vehicle driving control system S1, but the driver may directly specify the vehicle to follow. For example, vehicle information is received from surrounding vehicles, and the driver specifies the vehicle to follow based on the vehicle information displayed on a display provided in vehicle C. In this case, it is also possible to prohibit following or warn the driver based on differences in vehicle class or information on the planned route of the vehicle.
[0102] Also, each vehicle C can be set in advance as to whether or not to perform follow-up driving. This enable / disable (ON / OFF) of follow-up driving can be set manually. Also, whether or not to perform follow-up driving can be set automatically by the vehicle driving control device 1 determining the type and weight of the luggage when the driver registers information on the luggage to be loaded in the vehicle C.
[0103] <<Hardware configuration of vehicle management device>> The vehicle management device 80 is a computer for managing the traveling of a group of vehicles C, as shown in Fig. 1, and includes a CPU as a data calculation and control device, a ROM, a RAM, and a HDD (SSD) as storage devices, and a communication interface for transmitting and receiving information data via a network, as shown in Fig. 10. It also includes a communication device 81 for communicating with external devices. In addition to a main program that performs the necessary functions of a computer, the memory device of the vehicle management device 80 also stores a vehicle management program, and the functions of the vehicle management device 80 are performed by executing these programs by the CPU.
[0104] <Functions of vehicle management device> Explaining the vehicle management device 80 from a functional perspective using Figure 10, its main components are a memory unit 800 that stores various programs and various data, a communication unit 801 (second communication unit) that transmits and receives various data between the vehicle driving control device 1 of vehicle C, a management unit 802 that manages the driving state of each vehicle C whose driving is controlled by the vehicle driving control device 1 based on position information for vehicle C obtained by communication with the vehicle driving control device 1 of vehicle C, and a state control unit 803 that controls the driving state of vehicle C managed by the management unit 802.
[0105] The state control unit 803 also includes a judgment unit 804, a decision unit 805, an instruction unit 806, and a connection control unit 807. The judgment unit 804 judges whether or not the platoons F can be connected based on the traveling state of the vehicles C. The decision unit 805 decides the connection form between the platoons F based on the judgment result of the judgment unit 804. The instruction unit 806 transmits information on the connection form decided by the decision unit 805 to the leading vehicles Ct of each of the platoons F. The connection control unit 807 controls the connection between the platoons F by communicating with the leading vehicles Ct instructed by the instruction unit 806. These are composed of a CPU, ROM, RAM, HDD, communication interface, various programs, etc., as shown in FIG. Each function of the vehicle management device 80 will be described in detail below. The vehicle management device 80 determines whether a group of platoons F can be connected, gives permission for connection, manages the connection status, and provides vehicles with information necessary for connection, which are realized by the functions described below. In the vehicle management system S of this embodiment, the platoons appear to be connected to each other from the outside, but in reality, the group of platoons is formed by each vehicle C performing driving control such as automatic driving or following driving, and it should be noted that the vehicle management device 80 does not directly issue instructions to each vehicle C to form the platoon F.
[0106] <Communications Department> The communication unit 801 communicates with the communication unit 105 (first communication unit) of the vehicle driving control device 1 provided in each of the vehicles C forming the platoon F, and receives "current location information" transmitted by the communication unit 105. The communication unit 801 receives the "current location information" of the vehicle C and stores it in the memory unit 800. The communication unit 801 may further acquire "vehicle information" from the vehicle C. The "vehicle information" includes information such as the identification information (vehicle ID) of the vehicle C, the vehicle model, the vehicle class, the overall width, overall height, overall length, displacement (motor output), passenger capacity, weight, etc. of the vehicle recorded in the vehicle inspection certificate. The "vehicle information" may include information such as the destination and the planned route to the destination, the contents and weight of the cargo, the number of passengers, etc., which do not change during operation but change with each operation.
[0107] In addition, the "vehicle information" may include information that changes while driving, such as the driving mode (whether autonomous driving mode or remote driving operation mode), an image of the vehicle captured by the imaging device 11 mounted on vehicle C, information on remaining fuel, and information on the target vehicle being followed. In addition, as "vehicle information", fault information (such as broken wiring in electronic circuits, abnormal signals from various sensors, etc.) detected by an on-board diagnostic device (OBD: On-Board Diagnostics) installed in vehicle C may be obtained. Hereinafter, the "current position information" and "vehicle information" received from each vehicle C will be collectively referred to as "travel information."
[0108] Additionally, the communication unit 801 is capable of communicating information with an external server (not shown), and can receive, for example, the latest traffic information, weather information, and the like (hereinafter, "external factor information") from the external server. Then, the “driving information” and “external factor information” received by the communication unit 801 are stored in the memory unit 800 .
[0109] <Management Department> The management unit 802 of the vehicle management device 80 manages the traveling state of the vehicle C based on the "current position information" received by the communication unit 801. Specifically, the management unit 802 manages information related to the constant speed traveling operation, acceleration operation, deceleration operation, stopping operation, left turn operation, right turn operation, reverse operation, etc. of the vehicle C, in other words, behavior information (information based on the behavior) of the vehicle C. The management unit 802 obtains the "current location information" of vehicle C in real time via the communication unit 801, and based on changes in information regarding the driving state of vehicle C (changes in behavior information), can detect, for example, that vehicle C while moving has stopped, that vehicle C while stopped has started moving, or that vehicle C has started moving along a route different from the planned driving route.
[0110] The management unit 802 manages "platoon information" regarding the platoon F. The "platoon information" is information indicating the state of the platoon F, and includes the vehicle types and identification information of the vehicles C that make up the platoon, the number of vehicles C that make up the platoon, and the like. The management unit 802 may calculate the length of the platoon F and the distance between the vehicles using the received "current position information" of the vehicles C, and manage this as the platoon information. The information may also include information regarding the leading vehicle Ct of the platoon F, identification information, driving mode, destination, planned driving route, and the like.
[0111] Whether vehicle C belongs to the convoy F is determined based on whether the distance CD (see FIG. 12) between the GNSS receivers 21 mounted on the vehicle C (leading vehicle Ct2) traveling ahead and the vehicle C traveling behind falls within a predetermined distance D according to the traveling speed. The predetermined distance D is set, for example, as the inter-vehicle distance according to the traveling speed × 1.5. Further, the distance FD (see FIG. 12) between the platoons F traveling in front and behind is calculated from the difference between the position of the GNSS receiver 21 of the last vehicle Ce (last vehicle) of the front platoon Ff (second platoon) traveling in front and the position of the GNSS receiver 21 of the leading vehicle Ct1 of the rear platoon Fr (first platoon) traveling behind the front platoon Ff. The position (current position information) of the GNSS receiver 21 may be identified using IMU information and an RTK positioning method.
[0112] Furthermore, the management unit 802 may manage "platoon information" regarding the platoon F and transmit the "platoon information" to the vehicles C that make up the platoon F. Each vehicle C can know from the received "platoon information" that the platoon F has been formed and the position (order within the platoon) in which its own vehicle is traveling within the entire platoon F. For example, it can know whether its own vehicle is the leading vehicle Ct of the platoon F, an intermediate vehicle traveling within the platoon, the number of vehicles traveling from the leading vehicle Ct, or the last vehicle Ce.
[0113] Furthermore, the management unit 802 may create a video to be referred to by an operator remotely driving the lead vehicle Ct, based on image information received from a vehicle C constituting the platoon F. The video to be referred to should be one that allows the driving condition of the entire platoon F to be grasped. For example, as shown in FIG. 13, image information is obtained from the imaging devices 11 mounted on the lead vehicle Ct and the rearmost vehicle Ce of the platoon F, and a composite image P (platoon image, composite video) is created. At this time, in order to reduce the amount of data transmitted and received, it is preferable not to use image information from intermediate vehicles in the platoon.
[0114] <Storage section> The memory unit 800 stores the "travel information" and "external factor information" received by the communication unit 801 as described above, and the "platoon information" managed by the management unit 802. The memory unit 800 also stores a "connecting method" for connecting platoons based on the "travel information." One "connecting method" is to reduce the travel speed of the front platoon Ff and increase the travel speed of the rear platoon Fr to close the gap between the platoons, and then, when the gap becomes equal to or smaller than a certain distance, vehicles C of the front platoon Ff and vehicles C of the rear platoon Fr travel at the same travel speed. The storage unit 800 also stores the driving mode of the leading vehicle Ct of the platoon F according to the "connection method."
[0115] The memory unit 800 stores conditions for not connecting platoons, which are used when the determination unit 804 determines whether or not the platoons can be connected, as "platoon connection prohibition conditions." Examples of "platoon joining prohibition conditions" include the following: <Prohibition conditions due to external factor information> (1) When the road you plan to travel on is congested. (2) When weather-related risk conditions exist, such as when it is snowing or raining. Whether the road is congested or not is determined based on traffic information received from an external server. Weather information is also determined based on information received from an external server. Judgment In addition, the vehicle speed may be determined based on environmental information acquired from vehicle C. <Prohibited conditions based on driving and platoon information> (3) When the distance FD between the formations is greater than a certain distance. (4) When the arrival time at the destination differs significantly. (5) When the speed difference between the platoons is greater than a threshold. (6) When the planned driving routes of each vehicle in the platoon are different. (7) When there is a common planned driving route between platoons, but the remaining common planned driving routes are shorter than the specified distance. (8) When the load capacity or vehicle weight contained in the vehicle information exceeds a certain value. (9) When vehicle C in convoy F does not correspond to the vehicle information set in the coupling control possible section.
[0116] The "interconnection controllable section" is a section in which whether or not interconnection is possible is set based on the platoon information and the vehicle information of the vehicles C that make up the platoon. For example, the following conditions are set for each section: interconnection is possible if the length of the platoon is within 25 m and the vehicles are standard-sized automobiles, and interconnection is possible if the length of the platoon is within 40 m, the vehicles are large automobiles, and the total weight of the platoon is 60 tons or less. The interconnection controllable sections set on the road and the vehicle information set for those sections may be stored in advance in the storage unit 800.
[0117] The state control unit 803 controls the traveling state of the vehicle C managed by the management unit 802. As described above, the state control unit 803 is composed of the judgment unit 804, the decision unit 805, the instruction unit 806, and the connection control unit 807.
[0118] The determination unit 804 determines whether or not the platoons F can be connected based on the traveling state of the vehicles C managed by the management unit 802. The decision as to whether or not coupling is possible is made by first checking with the leading vehicle Ct of the convoy F that has been requested to couple. If the convoy F that has been requested to couple does not permit coupling, the leading vehicle Ct transmits a signal to the vehicle management device 80 to refuse coupling. For example, the convoy F may refuse coupling if the cargo of some of the vehicles C contains valuables, dangerous goods, or the like. If the platoon F for which coupling is requested allows coupling, the judgment unit 804 judges whether coupling is possible based on the driving conditions. Specifically, the vehicle management device 80 acquires the driving conditions (driving information, platoon information, external factor information) of the platoon F and each vehicle C, and judges that the driving conditions do not fall under the "platoon coupling prohibition conditions" stored in the memory unit 800.
[0119] The determination unit 805 determines the connection form between the platoons F based on the determination result by the determination unit 804. If the determination unit 804 determines that the platoons F cannot be connected, it stops the connection between the platoons F. If the platoons F can be connected, it selects and determines the optimal connection method from the connection methods stored in the memory unit 800 based on the driving state of the vehicles C, i.e., the received "driving information", the "platoon information" and the "external factor information" stored in the memory unit 800. In addition, the determination unit 805 determines the driving mode of the leading vehicle Ct of each platoon F based on the determined connection method. of The state of the platoon after coupling, the coupling method, the set driving mode, etc. are collectively referred to as the "coupling configuration."
[0120] The instruction unit 806 transmits information on the connection form determined by the determination unit 805 to each of the leading vehicles Ct of the connected platoons F. By transmitting the information on the connection form, an instruction is given to connect the platoons F together. When the instruction unit 806 instructs the leading vehicle to couple, it may check for safety of external factors from the travel information and transmit the coupling start timing. The leading vehicle Ct of each platoon F starts coupling based on the received coupling method.
[0121] The connection control unit 807 controls the connection between queues by communicating with the leading vehicle Ct of each queue F. Also, during connection, if it is determined to cancel the connection, the leading vehicle Ct is controlled to release the connection. Even after the connection is started, the vehicle management device 80 receives driving information from the leading vehicle Ct of the queue F where the connection was started death and the determination unit 804 determines whether the connection is progressing normally based on the driving information. For example, at this time, if a vehicle not related to queue F interrupts between the queues, the queues cannot be connected to each other, so the determination unit 804 determines to cancel the connection. When the determination unit 804 determines to cancel the connection, the connection control unit 807 notifies the leading vehicle Ct of each queue of the cancellation of the connection. After the connection is released, each queue F continues to travel while maintaining the original queue. If it is not determined to cancel the connection, the connection between the queues is completed as it is.
[0122] <Vehicle management program> Next, an example of the processing of a vehicle management program (vehicle management method) executed by the vehicle management device 80 and the leading vehicle Ct of the queue F in the vehicle management system S will be described with reference to FIGS. 12 to 17. The above program according to the present embodiment is a program for realizing the communication unit 801, the management unit 802, the state control unit 803, the determination unit 804, the decision unit 805, the instruction unit 806, and the connection control unit 807 described above as functional components of the vehicle management device 80 having the storage unit 800, and the CPU of the vehicle management device 80 executes this vehicle management program (vehicle management method).
[0123] In explaining the processing of the vehicle management program, as a more specific situation, as shown in FIG. 12, an example is taken in which a rear queue Fr (first queue) traveling behind the front queue Ff (second queue) traveling forward on the same road is connected to the front queue Ff.
[0124] In addition, the vehicle management program is broadly composed of a "connection determination process" that determines whether or not platoons can be connected to each other, and a "platoon connection control process" that controls the platoons to be connected to each other if connection is possible.
[0125] In the following, first, the "connection determination process" that determines whether or not the formations can be connected to each other will be described using the sequence diagram shown in FIG. 14, and then the "formation connection control process" that connects the formations to each other will be described.
[0126] <When the leading vehicle in the rear convoy is in remote driving mode> To explain an example of the processing of the vehicle management program, it is assumed that the leading vehicle Ct2 of the front convoy Ff is being driven automatically (autonomous driving mode), and the leading vehicle Ct1 of the rear convoy Fr is being driven remotely (remote driving mode). Then, as the "first communication process (first communication step)", the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr send and receive driving information including current position information between vehicles C and transmit the driving information to the vehicle management device 80 even before the start of the "connection determination process". In addition, as a "second communication process (second communication step)", the communication unit 801 of the vehicle management device 80 receives driving information including current position information, etc. in real time from each of the vehicles C that constitute the front convoy Ff and the rear convoy Fr even before the start of the "connection judgment process". Furthermore, each vehicle C performs vehicle driving control based on the information on the current position identified in the position identification step (driving control step, driving control processing). The driving information of each vehicle C is stored in the memory unit 800, and the management unit 802 manages, as a "management process (management step)", the driving state in which multiple vehicles C are driving in a front convoy Ff or a rear convoy Fr.
[0127] 14, first, a connection request is transmitted from the leading vehicle Ct1 of the rear convoy Fr in remote driving mode to the vehicle management device 80 and the leading vehicle Ct2 of the front convoy Ff (step S201). This connection request may be transmitted manually by an operator remotely driving the leading vehicle Ct1 of the rear convoy Fr. The transmission of the connection request for connecting the platoons may be automatically performed when the leading vehicle Ct1 enters an expressway or starts traveling on a predetermined road, and a connection possible condition is met. The connection request may also be automatically transmitted on the condition that the leading vehicle Ct1 recognizes the identification mark 60 (QR code (registered trademark)) on the rear vehicle Cr of the platoon F that it wishes to connect with.
[0128] The communication unit 801 of the vehicle management device 80 and the leading vehicle Ct2 of the front convoy Ff receive this connection request. The vehicle management device 80 transmits a connection confirmation to the leading vehicle Ct2 of the front convoy Ff to confirm whether or not connection is possible (step S202).
[0129] The leading vehicle Ct2 of the front convoy Ff receives the connection confirmation from the vehicle control device 80, and transmits a connection possibility response indicating whether or not connection is possible (step S203). Although the front convoy Ff is traveling in a convoy, it may refuse to connect with other convoys. For example, if the cargo carried is valuable, the vehicle may not wish to connect with other convoys. If connecting with other convoys is prohibited, the leading vehicle Ct2 of the front convoy Ff transmits a signal to the vehicle management device 80 indicating that connecting is not possible. Also, if connecting with other convoys F is permitted, the leading vehicle Ct2 of the front convoy Ff transmits a signal to the vehicle management device 80 indicating that connecting is possible.
[0130] The communication unit 801 of the vehicle management device 80 receives a connection possibility response from the leading vehicle Ct2 of the front platoon Ff, and the judgment unit 804 judges whether the front platoon Ff and the rear platoon Fr can be connected based on the connection possibility response and the driving conditions of the vehicles C that form the platoon (connection permission judgment process (judgment process, judgment step): step S204). Note that the processes corresponding to the "state control process (state control step)" of the present invention are the "connection permission judgment process (judgment process, judgment step)", "decision process (decision process)", "instruction process (instruction process)", and "platoon connection control process (connection control process, connection control step)".
[0131] <Connection permission determination process> Here, the "connection permission determination process" executed in step S204 will be described in detail with reference to Fig. 16. The communication unit 801 of the vehicle management device 80 determines whether or not a connection is permitted from the leading vehicle Ct2 of the forward convoy Ff that has transmitted a connection confirmation. Possibility A response (acceptance response) is received (step S401). The determination unit 804 checks the received connection permission response (step S402). If the connection permission response indicates that connection is not permitted (step S402: No), the process ends without permitting the convoy to be connected. At this time, the fact that connection is not permitted may be transmitted to the leading vehicle Ct1 of the rear convoy Fr together with the reason why connection is not permitted.
[0132] If the connection possibility response from the forward platoon Ff indicates that connection is possible (step S402: Yes), a determination is made based on external factor information as to whether or not the "platoon connection prohibition condition" stored in memory unit 800 is met (step S403). For example, if the planned route is congested or it is snowing or raining, connecting the platoons may be dangerous, so the process does not allow the platoons to connect and ends (step S403: Yes).
[0133] In step 403, if the external factor information does not meet the "platoon joining prohibition condition" (step S403: No), the judgment unit 804 judges whether the platoon information of the front platoon Ff and the rear platoon Fr, and the vehicle information of vehicle C that constitutes the platoon, meet the "platoon joining prohibition condition". For example, if the planned driving routes are different, it is determined that the platoons cannot be joined because it corresponds to the above-mentioned platoon joining prohibition condition (6) “when the planned driving routes of each platoon are different.”
[0134] In step S404 of the "connection permission determination process," if the platoon information or vehicle information satisfies any one of the "platoon connection prohibition conditions" (step S404: Yes), the vehicles will maintain the current platoon state and travel without connecting. At this time, just as in the case where connecting is not permitted in step S402, the vehicle management device 80 may send a message to the leading vehicle Ct1 of the rear platoon Fr that sent the connection request that connecting is not permitted, along with the reason.
[0135] If the convoy information or vehicle information does not meet any of the "convoy connection prohibition conditions" (step S404: No), the communication unit 801 of the vehicle management device 80 transmits "connection permission" to the leading vehicle Ct2 of the forward convoy Ff and the leading vehicle Ct1 of the rear convoy Fr (step S405, step S205 in the connection determination process). After that, the vehicle management device 80, the leading vehicle Ct2 of the forward convoy Ff, and the leading vehicle Ct1 of the rear convoy Fr execute the "convoy connection control process" (step S206).
[0136] In the above-mentioned "joining permission judgment process," the judgment as to whether or not the external factor information satisfies the "platoon joining prohibition condition" (step S403) is performed prior to the judgment based on the platoon information and vehicle information (step S404), but the judgment based on the platoon information and vehicle information may be performed prior to the judgment based on the external factor information.
[0137] <Troop connection control processing> In step S204 of the connection determination process, if connection between the front convoy Ff and the rear convoy Fr is permitted, the vehicle management device 80, the front convoy Ff, and the rear convoy Fr proceed to a "platoon connection control process (connection control step)" which is a control for actually connecting the convoys. The "platoon connection control process" will be described below with reference to FIG. 15.
[0138] When connecting platoons, vehicles C that make up the front platoon Ff and the rear platoon Fr transmit their own vehicle's driving information, particularly their current position information, to the vehicle management device 80 in real time as a ``first communication process,'' and also transmit driving information immediately after the ``platoon connection control process'' is started (steps S301, S302). Furthermore, when starting to connect, each vehicle C constituting the front platoon Ff and the rear platoon Fr may travel in cooperative control mode. The cooperative control mode is a mode in which the vehicles C do not leave the platoon F individually but travel in cooperation as a group of vehicles. In other words, the cooperative control mode is a mode in which the vehicles C traveling behind the leading vehicle Ct are prohibited from leaving the platoon F on their own accord. The cooperative control mode is implemented until the connection of the platoons is completed or a decision is made to discontinue the connection.
[0139] The communication unit 801 of the vehicle management device 80 acquires traveling information from the front convoy Ff and the rear convoy Fr, and stores it together with the convoy information in the storage unit 800. In addition, the communication unit 801 acquires external factor information from an external server and stores it in the storage unit 800 (step S304).
[0140] Next, the determination unit 805 of the vehicle management device 80 To Based on the above, the connecting form for connecting the platoon is determined (determination process, determination step). Specifically, the optimal connecting method is selected and set from a plurality of connecting methods stored in the storage unit 800 based on the traveling information of the platoon (step S305). The linking method specifies information on the speed of each platoon when linking, the distance between the platoons, the vehicle distance, etc. One example of a linking method is to "slow down the speed of the front platoon Ff and increase the speed of the rear platoon Fr to close the distance FD between the platoons (see Figure 12). After that, when the distance FD between the front platoon Ff and the rear platoon Fr falls below a specified distance, both the front platoon Ff and the rear platoon Fr travel at the same speed." Another linking method is to "slow down the speed of the front platoon and increase the speed of the rear platoon to close the distance between the platoons, but if the distance FD between the platoons is wider than the distance FD between the vehicles C that make up the platoon, the rear platoon vehicle C increases its speed by one unit per hour from that state and moves closer until the size of the distance FD between the platoons matches the vehicle distance."
[0141] After the determination unit 805 selects and sets the connection method in step S304, the determination unit 805 further sets the driving modes of the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr based on the set connection method (step S306). At this time, if the connection method selected by the decision unit 805 is a method of automatically controlling both the front convoy Ff and the rear convoy Fr, both the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr are set to "automatic driving mode." Furthermore, if the selected connection method is a method of automatically controlling only the rear convoy Fr, for example, a method of only increasing the speed of the rear convoy Fr, at least the leading vehicle Ct1 of the rear convoy Fr is set to "automatic driving mode." If the selected connection method is a method of automatically controlling only the front convoy Ff, for example, if only the speed of the front convoy Ff is reduced, at least the leading vehicle Ct2 of the front convoy Ff is set to "automatic driving mode." By setting the leading vehicle Ct of the convoy F to be controlled to "automatic driving mode," the convoys can be connected together more safely than if the leading vehicle Ct was in "remote driving mode."
[0142] Next, the determination unit 805 performs a safety check of external factors before coupling based on the acquired platoon information and travel information (step S307). Specifically, it is checked whether the road is suitable for coupling and whether the weather is suitable. At this time, the operator remotely driving the leading vehicle Ct1 of the rear platoon Fr may check the safety by viewing the composite image of the platoon F shown in FIG. 13 displayed on the monitor. While checking for safety, the determination unit 805 determines whether or not coupling between the platoons can begin in step S308. If the coupling start condition is not met due to an external factor (step S308: No), the process returns to step S307, and safety checks for external factors are continued. If the coupling start condition is met in step S308, the coupling method and coupling start timing selected by the determination unit 805 are transmitted to the leading vehicle Ct2 of the front platoon Ff and the leading vehicle Ct1 of the rear platoon Fr (step S309: instruction processing, instruction step).
[0143] The leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr receive information on the connection method and connection start timing from the vehicle management device 80, and then start connecting the convoys according to the received connection method (steps S310, S311). At this time, if a driving mode is set for the connection method, the driving modes of the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr are changed accordingly. In addition, when the vehicle management device 80 allows connection with the forward convoy Ff and receives information on the connection method and the timing to start connecting, the lead vehicle Ct1 of the rear convoy Fr may confirm that it is the forward convoy Ff that is to be connected by recognizing an identification mark 60 (e.g., a QR code (registered trademark), see Figure 1) mounted on the rear vehicle Cr of the forward convoy Ff.
[0144] Even after coupling has begun, each vehicle C constituting the front convoy Ff and the rear convoy Fr transmits travel information to the vehicle management device 80 (steps S312, S313). The vehicle management device 80 analyzes the travel information even when the front convoy Ff and the rear convoy Fr are coupled, and determines whether or not to terminate (release) the coupling between the convoys (step S314). The "coupling termination determination process" during coupling will be described using the flow diagram in FIG. 17.
[0145] The communication unit 801 of the vehicle management device 80 receives driving information from each of the vehicles C that make up the front convoy Ff and the rear convoy Fr (step S501). The judgment unit 804 analyzes the convoy information and the driving information (step S502). Next, the judgment unit 804 judges whether or not the coupling cancellation condition is satisfied. If the coupling cancellation condition is satisfied (step S503: Yes), the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr are notified of coupling cancellation (coupling release) (step S504).
[0146] This "connection cancellation condition" (predetermined connection condition) is the same as the "concatenation prohibition" used when determining whether or not the platoons can be connected. For example, if there is a change in the weather and snow or rain falls while the platoons are connected, the platoon connection will be canceled. Also, for example, if, at the time when connection begins, the planned driving route common to the platoons is sufficiently long and exceeds a certain distance based on the planned driving route information of each platoon, but it is found that it takes time for the platoons to connect and the distance of the common planned driving route (platoon driving distance) after connection is not longer than the certain distance, the connection cancellation condition is met and the connection between the front platoon Ff and the rear platoon Fr is canceled.
[0147] If the coupling cancellation condition is not met (step S503: No), the vehicle management device 80 checks whether a coupling completion notification has been received from the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr. If a coupling completion notification has not been received, since coupling is in progress, the process returns to step S501 and continues to execute the "coupling cancellation determination process." The determination unit 804 repeatedly executes this "connection cancellation determination process" until it receives a connection completion notification from the leading cars Ct1 and Ct2.
[0148] Returning to Fig. 15, when the determination unit 804 of the vehicle management device 80 determines to discontinue the connection between the platoons in step S314 of the "platoon connection control process", the communication unit 801 transmits a connection cancellation notification to the leading vehicle Ct2 of the front platoon Ff and the leading vehicle Ct1 of the rear platoon Fr (step S315). While coupled, the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr constantly monitor whether they have received a coupling stop notification from the vehicle management device 80 (steps S316, S317), and if they have not received a coupling stop notification (steps S316, S317: No), they continue the coupling operation between the convoys to complete the coupling (steps S318, S320). If a connection cancellation notification is received (steps S316, S317: Yes), the connection operation between the formations is cancelled (steps S319, S321). The "platoon connection control process" ends when the connection between the front convoy Ff and the rear convoy Fr is completed or when it is decided to cancel the connection.
[0149] Returning to the "connection determination process" in Figure 14, after the "platoon connection control process" is completed, the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr check whether the connection is complete (steps S207, S208). If the connection between the front convoy Ff and the rear convoy Fr is complete (steps S207, S208: Yes), the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr send a connection completion notification to the vehicle management device 80 (steps S209, S210).
[0150] After the communication unit 801 of the vehicle management device 80 receives a coupling completion notification from the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr, the management unit 802 receives driving information from the vehicles C that make up the new convoy Fn after coupling. The management unit 802 generates convoy information from the driving information of each vehicle C that makes up the new convoy Fn and stores (preserves) it in the memory unit 800 (step S213). Thereafter, the management unit 802 manages the new convoy Fn after coupling. The connection completion notification may be transmitted from either the leading vehicle Ct2 of the front convoy Ff or the leading vehicle Ct1 of the rear convoy Fr.
[0151] In the "platoon connection control process," if the connection between the front convoy Ff and the rear convoy Fr is stopped (released) and the connection between the front convoy Ff and the rear convoy Fr is not completed (steps S207, S208: No), the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr transmit the connection cancellation and the reason therefor to the vehicle management device 80 (steps S211, S212). At this time, the leading vehicle Ct2 of the front convoy Ff and the leading vehicle Ct1 of the rear convoy Fr also notify that the front convoy Ff and the rear convoy Fr will continue to travel independently. The communication unit 801 of the vehicle management device 80 receives the connection interruption and the reason for it, and stores the information in the storage unit 800. The management unit 802 manages the front convoy Ff and the rear convoy Fr as convoys traveling independently.
[0152] <When the leading vehicle in the forward convoy is in remote driving mode> In the example of the connection determination process shown in Figure 14, the leading vehicle Ct2 of the front convoy Ff was in "automated driving mode", and the leading vehicle Ct1 of the rear convoy Fr was in "remote driving mode". This is just one example, and there are also cases where the leading vehicle Ct2 of the front convoy Ff is driven in "remote driving mode", and the leading vehicle Ct1 of the rear convoy Fr is driven in "automated driving mode". In this case, when starting the "connection determination process" shown in Figure 14, the vehicle management device 80 first calculates the distance FD between the platoons from the travel information of the front platoon Ff and the rear platoon Fr. If it is determined that the distance FD between the platoons is shorter than a predetermined distance, the vehicle management device 80 transmits a connection confirmation to the leading vehicle Ct2 of the front platoon Ff. Note that when a coupling possible condition is met, such as when the leading vehicle Ct1 of the rear convoy Fr enters an expressway or starts traveling on a predetermined road that has been specified in advance, the leading vehicle Ct1 may automatically transmit a coupling request to the vehicle management device 80, and the vehicle management device 80 may start the "coupling determination process." The coupling request may also be transmitted automatically on the condition that the leading vehicle Ct1 of the rear convoy Fr in the autonomous driving mode recognizes the identification mark 60 mounted on the rear vehicle Cr of the front convoy Ff. When the operator remotely driving the leading vehicle Ct2 of the forward convoy Ff receives the connection confirmation, the operator, for example, manually transmits a connection availability response to the vehicle management device 80. If the connection availability of the leading vehicle Ct2 has been registered in advance, the connection availability response may be automatically transmitted to the vehicle management device 80.
[0153] When the vehicle management device 80 receives a connection possibility response from the lead vehicle Ct2 of the forward convoy Ff, if connection is possible, it then executes the "connection permission determination process" of step S204 and determines whether connection is possible based on external factor information, driving information, etc. Thereafter, in the same manner as when the leading vehicle Ct1 of the rear convoy Fr is in remote driving mode, processing such as sending a connection permission (step S205) and "convoy connection control" is executed, and the connection between the front convoy Ff and the rear convoy Fr is carried out.
[0154] <When the leading vehicle in each convoy is autonomous> There may be cases where the leading vehicles Ct1, Ct2 of the front and rear convoys Ff and Fr are both operating in autonomous driving mode. In this case, when starting the "connection judgment process" shown in Figure 14, the vehicle management device 80 calculates the distance FD between the platoons from the driving information of the front platoon Ff and the rear platoon Fr, and if it determines that the distance FD between the platoons is shorter than a predetermined distance (the platoons are close to each other), it sends a connection confirmation transmission to the leading vehicles Ct2, Ct1 of both platoons Ff, Fr.
[0155] When a coupling possible condition is met, such as the leading vehicle Ct2 of the forward convoy Ff or the leading vehicle Ct1 of the rear convoy Fr entering an expressway or starting to travel on a predetermined road designated in advance, either one of the leading vehicles Ct2 and Ct1 may automatically transmit a coupling request to the vehicle management device 80, which may then initiate the "coupling determination process." Also, the coupling request may be transmitted automatically on the condition that the leading vehicle Ct1 of the rear convoy Fr in the autonomous driving mode recognizes the identification mark 60 mounted on the rear vehicle Cr of the forward convoy Ff. The leading vehicles Ct1 and Ct2 that receive the connection confirmation transmit a connection feasibility response to the vehicle management device 80, and the vehicle management device 80 then determines whether or not connection is possible based on the connection feasibility responses received from both leading vehicles Ct1 and Ct2 (step S204 of the connection determination process). Thereafter, in the same manner as when the leading vehicle Ct1 of the rear convoy Fr is in remote driving mode, processing such as sending a connection permission (step S205) and "convoy connection control" is executed, and the connection between the front convoy Ff and the rear convoy Fr is carried out.
[0156] In addition, as described above, when a connection request, etc. is sent when a condition is met, such as entering a highway or starting to travel on a pre-specified road, the vehicle detects at regular intervals whether the established condition is met, and if the established condition is no longer met, the following vehicle (or the following convoy) may cancel the connected driving and leave or separate. Similarly, when driving information is transmitted on the condition that the identification mark of vehicle C is recognized, the vehicle performs a process of recognizing the identification mark at regular intervals, and when the identification mark is no longer recognized, the following vehicle (or the following convoy) may terminate the coupled driving and leave or separate.
[0157] In the above embodiment, a vehicle management program is stored in a recording medium readable by the vehicle running control device 1 (first computer) and the vehicle management device 80 (second computer), and the vehicle running control device 1 and the vehicle management device 80 read and execute the program to execute processing. Here, the recording medium readable by the vehicle running control device 1 and the vehicle management device 80 refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. In addition, a dedicated software may be started using a terminal (mobile terminal) serving as the vehicle driving control device 1 and the vehicle management device 80, and the vehicle management program may be executed on a web browser.
[0158] In the above-mentioned embodiments, the vehicle management device, the vehicle management method, the vehicle management system, and the vehicle management program according to the present invention have been mainly described. With the above-mentioned vehicle management device, vehicle management method, vehicle management system, and vehicle management program, when connecting platoons, the connection form of each platoon can be sent to each lead vehicle to instruct the connection between the platoons, thereby allowing the platoons to be connected smoothly. That is, the vehicle management device 80 determines whether or not the platoon F can be connected, sends connection permission, manages the connection status, and provides information necessary for connection only to the lead vehicle in the platoon, but because the vehicles following the lead vehicle are driven by a vehicle driving control system, the vehicle management device 80 does not directly manage all of the vehicles in the platoon F. This reduces the amount of processing performed by the vehicle management device 80, making it possible for the platoons to be connected smoothly. In addition, by linking platoons, the number of leading vehicles is reduced, which reduces the number of vehicles driven by remote driving or automatic driving, and communication fees for remote driving or automatic driving can be reduced. In addition, by linking platoons, it is possible to inform surrounding vehicles in the platoon that they are automatic or remotely driven vehicles heading to the same destination, thereby reducing the risk of other vehicles cutting in between vehicles and tailgating, etc. The above embodiment is merely an example for facilitating understanding of the present invention, and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit of the present invention, and the present invention naturally includes equivalents thereof. [Explanation of symbols]
[0159] S Vehicle management system S1 Vehicle Driving Control System C Vehicle V Vehicle V1 Electric Power Steering V1a Handle V2 Electric Throttle V2a Accelerator Pedal V3 Electromagnetic Brake Device V3a Brake Pedal FV Target vehicle 1 Vehicle driving control device 10. Vehicle Sensors 11 Imaging device 11a to 11i: 1st imaging device to 9th imaging device 12 Radar (millimeter wave radar) 12a~12d Radar 1~4 13 Rider 13a~13e 1st Rider~5th Rider 20 Vehicle Locator 21 GNSS receiver (RTK-GNSS receiver) 22 Inertial measurement unit (IMU) 30 Automotive ECU 31 Integrated ECU 32 Steering ECU 33 Accelerator ECU 34 Brake ECU 40 In-vehicle communication device 50 Vehicle information transmission device 51 Vehicle Locator 51a GNSS receiver 51b Inertial measurement device 52 Vehicle-mounted communication device 60 Identification Mark 60a~60l 1st identification mark~12th identification mark 70 Remote Control Device 71 Monitor 72 Navigation Monitor 73 Handle 74 Accelerator pedal 75 Brake pedal 76 Operation switch 80 Vehicle management device 81 Communication equipment 100 Storage section 101 Environmental Information Acquisition Department 102 Location information acquisition unit 102a Absolute position calculation unit 102b Relative position calculation unit 102c Correction position calculation unit 102d Reception determination unit 103 Driving control unit (driving control unit) 104 Vehicle detection unit 105 Communications Department 106 Mode change section 107 Travel speed acquisition unit 108 Video Processing Unit 500 storage section 501 Location information acquisition unit 502 Communications Department 700 Storage section 701 Communications Department 702 Screen display section 703 Operation Data Creation Department 704 User Notification Unit 800 Storage section 801 Communication Department (Second Communication Department) 802 Management Department (Management Department) 803 State control section 804 Judgment Department 805 Decision Section 806 Instruction section 807 Connection control section SA satellite ST reference station F formation Ff Forward formation (2nd formation) Fr Rear formation (1st formation) Ct, Ct1, Ct2 Leading car Cr Rear vehicle Ce Last car P Composite Image
Claims
1. A vehicle management device that manages vehicles, an absolute position calculation unit that calculates an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle; a relative position calculation unit that calculates a relative position of the vehicle at an external reference station by correcting an absolute position using GNSS correction information received from the external reference station; a position identification unit that identifies position information of the vehicle using the relative position; a driving control unit that controls driving of the vehicle based on the position information identified by the position identification unit; A first communication unit that transmits and receives position information of the vehicle; A second communication unit that communicates with the first communication unit in the vehicle, A state control unit that controls a traveling state of the vehicle that is controlled by the traveling control unit; Equipped with The state control unit is a determination unit that determines whether or not a platoon formed by the vehicles managed by traveling based on position information for the vehicles received from the vehicles by the second communication unit can be connected to each other; a determination unit that determines a relative connection configuration of the formations after the formations are connected based on a determination result by the determination unit, the connection configuration including a front-rear positional relationship between the formations; Equipped with The second communication unit receives an image of the vehicle captured by an imaging device of the vehicle, the determination unit determines whether the platoons can be connected to each other based on a traveling state of the platoon based on a platoon image that is a composite of an image of a leading vehicle and an image of a trailing vehicle of each platoon received; Vehicle management device.
2. The state control unit is an instruction unit that instructs the platoons to be connected to each other by transmitting information about the connection form determined by the determination unit to a leading vehicle of each of the platoons; a connection control unit that controls the connection between the platoons through communication with a leading vehicle instructed by the instruction unit; The vehicle management device of claim 1 further comprising:
3. the vehicle management device calculates an inter-platoon distance between the first platoon and the second platoon based on travel information of the first platoon and a second platoon to be connected to the first platoon; The vehicle management device according to claim 1 , further comprising: a transmission of a connection confirmation with the first convoy to the leading vehicle of the second convoy when the inter-convoy distance is shorter than a predetermined distance.
4. The determination unit determines whether the platoons can be connected to each other using a predetermined connection condition based on a traveling state of the vehicles, The predetermined connection condition is 4. The vehicle management device according to claim 1, wherein a platoon travel distance after the platoons are connected to each other is set to a fixed distance based on planned travel route information of each platoon.
5. A vehicle management method using a vehicle and a vehicle management device that manages the vehicle, comprising: The vehicle, an absolute position calculation step of calculating an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle; a relative position calculation step of calculating a relative position of the vehicle at an external reference station by correcting the absolute position using GNSS correction information received from the external reference station; a position specifying step of specifying position information of the vehicle using the relative position; a driving control step of controlling driving of the vehicle based on the position information identified in the position identification step; A first communication step of transmitting position information of the vehicle; The vehicle management device, a second communication step of receiving vehicle position information from the vehicle; a state control step of controlling a running state of the vehicle that is run-controlled by the running control step; In the state control step, a determination step of determining whether or not a platoon formed by the vehicles managed by traveling based on position information for the vehicles received from the vehicles in the second communication step can be connected to each other; a determination step of determining a relative connection configuration of the formations after the formations are connected based on a result of the determination step, the connection configuration including a front-rear positional relationship between the formations; Do the following: In the second communication step, an image of the vehicle captured by an imaging device of the vehicle is received, In the determination step, a determination is made as to whether or not the platoons can be connected to each other based on a traveling state of the platoon based on a platoon image obtained by combining an image of a leading vehicle and an image of a trailing vehicle of each platoon. Vehicle management methods.
6. A vehicle management system including a vehicle and a vehicle management device that manages the vehicle, The vehicle is an absolute position calculation unit that calculates an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle; a relative position calculation unit that calculates a relative position of the vehicle at an external reference station by correcting an absolute position using GNSS correction information received from the external reference station; a position identification unit that identifies position information of the vehicle using the relative position; A vehicle driving control unit that controls driving of the vehicle based on the position information identified by the position identification unit, and a first communication unit that transmits and receives the position information of the vehicle, The vehicle management device includes: A second communication unit that communicates with the first communication unit in the vehicle; A state control unit that controls a driving state of the vehicle that is controlled by the driving control unit, The state control unit is a determination unit that determines whether or not a platoon formed by the vehicles managed by traveling based on position information for the vehicles received from the vehicles by the second communication unit can be connected to each other; a determination unit that determines a relative connection configuration of the formations after the formations are connected based on a result of the determination by the determination unit, the connection configuration including a front-rear positional relationship between the formations; Equipped with The second communication unit receives an image of the vehicle captured by an imaging device of the vehicle, the determination unit determines whether the platoons can be connected to each other based on a traveling state image of the platoon that is based on a platoon image that is a composite of an image of a leading vehicle and an image of a trailing vehicle of each platoon that has been received; Vehicle management system.
7. A vehicle management program to be executed by a first computer as a control device that controls a vehicle and a second computer as a vehicle management device that manages the vehicle, The first computer, An absolute position calculation process for calculating an absolute position of the vehicle using GNSS information acquired from a GNSS receiver mounted on the vehicle; A relative position calculation process for calculating a relative position of the vehicle at an external reference station by correcting the absolute position using GNSS correction information received from the external reference station; a position identification process for identifying position information of the vehicle using the relative position; a driving control process for controlling driving of the vehicle based on the position information identified by the position identification process; a first communication process for transmitting position information of the vehicle; The second computer, a second communication process for receiving vehicle position information from the vehicle; a state control process for controlling a running state of the vehicle that is run-controlled by the running control process; In the state control process, a determination process for determining whether or not a platoon formed by the vehicles managed by traveling based on position information for the vehicles received from the vehicles in the second communication process can be connected to each other; a determination process for determining a relative connection configuration of the formations after the formations are connected based on a determination result of the determination process, the connection configuration including a front-rear positional relationship between the formations; Run the command, In the second communication process, an image of the vehicle captured by an imaging device of the vehicle is received, In the determination process, a determination is made as to whether or not the platoons can be connected to each other based on a traveling state of the platoon based on a platoon image obtained by combining an image of a leading vehicle and an image of a trailing vehicle of each platoon that are received. Fleet management programs.
Citation Information
Patent Citations
Column traveling system
JP2017215681A
Vehicle control schemes for autonomous vehicle system
WO2021188872A1