Vehicle control device, system, method, and program
The vehicle control device addresses communication delays by predicting delays and synchronizing control signals with real-time conditions, improving remote vehicle control accuracy and efficiency.
Patent Information
- Application Number
- JP2021174555
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-10-26
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-10-26
AI Technical Summary
Communication delays occur between vehicles and cloud-based control devices, affecting the effectiveness of remote vehicle control.
A vehicle control device that predicts communication delays using data from vehicles and communication quality, generating control signals synchronized with real-time conditions to reduce the impact of delays.
Reduces the influence of communication delays by ensuring time synchronization between virtual and real-world vehicle control, enhancing the accuracy and efficiency of remote vehicle operations.
Smart Images

Figure 0007586049000001 
Figure 0007586049000002 
Figure 0007586049000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a control device that communicates with a vehicle and remotely controls the vehicle. [Background technology]
[0002] Patent Literature 1 discloses an autonomous vehicle service platform that is connected via a network to a plurality of autonomous vehicles that automatically drive on a road network so as to be able to communicate with each other. This autonomous vehicle service platform remotely controls the plurality of autonomous vehicles and provides users with various services using the autonomous vehicles.
[0003] Furthermore, Patent Document 2 discloses a system that evaluates risks associated with vehicle operation using a digital twin formed on the cloud based on data collected from multiple vehicles via a network. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2019-505059 A [Patent Document 2] JP 2020-013557 A Summary of the Invention [Problem to be solved by the invention]
[0005] In a system in which a vehicle and a control device provided on a cloud are connected via a network, a communication delay occurs between the vehicle and the cloud. For this reason, when the control device controls the vehicle, it is desirable to reduce the effect of the communication delay that occurs between the vehicle and the cloud.
[0006] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide a vehicle control device, etc. that can reduce the effects of communication delays that occur between a vehicle and the cloud when remotely controlling the vehicle using a control device provided on the cloud. [Means for solving the problem]
[0007] In order to solve the above problems, one aspect of the disclosed technology is a vehicle control device that communicates with multiple vehicles, and includes a communication unit that transmits and receives data between the multiple vehicles, an acquisition unit that acquires a communication delay time between a controlled vehicle that is to be remotely controlled among the multiple vehicles and the vehicle control device based on the data transmitted and received by the communication unit, and a generation unit that generates a control signal to be transmitted to the controlled vehicle for remote control based on the communication delay time acquired by the acquisition unit. Effect of the Invention
[0008] According to the vehicle control device disclosed above, when a vehicle is remotely controlled using a control device provided on the cloud, the effects of communication delays that occur between the vehicle and the cloud can be reduced. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a schematic configuration diagram of a network system including a vehicle control device according to an embodiment of the present disclosure; [Diagram 2] A block diagram showing the schematic configuration of the vehicle control device. [Diagram 3] Functional block diagram of the vehicle control device [Figure 4] A process flowchart of data correction control executed by the vehicle control device [Diagram 5] A flowchart of the communication delay time prediction process executed by the vehicle control device [Figure 6] A flowchart of the process for generating a control signal executed by the vehicle control device [Figure 7A] FIG. 1 is a diagram illustrating the transmission of control signals performed by a conventional device. [Figure 7B] FIG. 1 is a diagram for explaining an example of time-synchronized transmission of a control signal executed by the vehicle control device. [Figure 7C] FIG. 13 is a diagram for explaining an example of transmission of another control signal synchronized with time executed by the vehicle control device. [Figure 8] Functional block diagram of the vehicle control device using an external device DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] When remotely controlling a vehicle to be controlled, the vehicle control device of the present disclosure uses a database that stores past statistical communication quality data corresponding to a road map to predict a communication delay time at the future vehicle position where remote control will be performed, and generates and transmits a control signal suitable for the vehicle that ensures time synchronization between the virtual space formed on the cloud and the real space based on the predicted communication delay time and the digital twin, thereby reducing the effect of communication delays that occur between the vehicle and the cloud. Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.
[0011] <Embodiment> [composition] Fig. 1 is a block diagram showing an example of the overall configuration of a digital twin system 10 including a vehicle control device 100 according to an embodiment of the present disclosure. The digital twin system 10 illustrated in Fig. 1 is a vehicle system that includes the vehicle control device 100 and a communication device group 200 including a plurality of vehicles, and is capable of remotely controlling at least one vehicle included in the communication device group 200 by the vehicle control device 100. The vehicle control device 100 and the communication device group 200 are connected to each other so as to be able to communicate with each other via a communication line 500 such as the Internet.
[0012] (1)Communication equipment group The communication device group 200 constituting the digital twin system 10 includes a controlled vehicle 210, an information providing vehicle 220, and an information terminal 230. The controlled vehicle 210 is a controlled vehicle in which remote control utilizing a large amount of data collected by the vehicle control device 100 is executed by the vehicle control device 100. This controlled vehicle 210 provides at least data related to the vehicle state described below to the vehicle control device 100. The information providing vehicle 220 is a vehicle that is not subject to remote control and only provides data related to communication quality described below to the vehicle control device 100. The information terminal 230 is, for example, a smartphone or a tablet terminal, and is a communication device that provides data related to communication quality to the vehicle control device 100 in the same way as the information providing vehicle 220.
[0013] Examples of information included in the data related to communication quality (or radio wave quality) provided to the vehicle control device 100 by the information providing vehicle 220 or the information terminal 230 include "time / location information" including the time (timestamp) when the information is measured, detected, or acquired and the latitude / longitude of a global positioning system (GPS) that identifies the vehicle's location, "communication information" including the name of the service provider that provides the communication line 500 and a cell ID (Identification) that is information that can identify a wireless base station, and "communication quality information" including an execution speed (up and down average / peak throughput), a communication delay time, a packet loss, and radio wave strength RSSI. The time / location information can be acquired by using a clock function or a GPS receiving function implemented in the information providing vehicle 220 or the information terminal 230. The communication information can be acquired by using a communication function implemented in the information providing vehicle 220 or the information terminal 230. As an example, the communication quality information can be calculated from the results of executing an information measurement tool pre-implemented in the information providing vehicle 220 or the information terminal 230 or installed information measurement application software, and transmitting a predetermined test signal to the vehicle control device 100 (such as a measurement server) at a predetermined cycle. In addition to the above method, highly accurate communication quality information can be provided to the controlled vehicle 210 based on a ping value obtained by basic software that measures communication reachability and round trip time of a network, and a response speed obtained by transmitting and receiving data via the communication line 500 using an actual control signal, in order to reduce the processing load.
[0014] The data on the vehicle state provided by the controlled vehicle 210 to the vehicle control device 100 may include, in addition to the time / position information described above, "trajectory information" including at least the vehicle speed (time series history) and the vehicle direction (current state), which are information on the vehicle's travel trajectory. The trajectory information may further include road information including navigation (set route) information, turn signal operation information (current state), accelerator opening amount / brake braking amount information (time series history), acceleration / deceleration information (time series history), shift range (D / B / R) information (current state), steering angle information (time series history), travel lane information (current state), traffic light information of the oncoming lane (current state), and traffic congestion information (current state). This trajectory information can be acquired via an electronic control unit (ECU) that controls sensor devices mounted on the controlled vehicle 210.
[0015] If the vehicle control device 100 is able to predict a communication delay time (described later) using only data related to communication quality provided from the information providing vehicle 220 and the information terminal 230, the controlled vehicle 210 does not need to provide data related to communication quality to the vehicle control device 100. Furthermore, since the information providing vehicle 220 and the information terminal 230 are communication devices that participate in the system for the purpose of realizing a communication delay time prediction with high accuracy and high efficiency, they do not have to be essential components of the digital twin system 10. However, in order to predict the communication delay time with high accuracy and high efficiency, it is desirable that data related to communication quality is provided from a large number of controlled vehicles 210, information providing vehicles 220, and information terminals 230.
[0016] (2) Vehicle control device The vehicle control device 100 is configured to be able to communicate with communication devices (not shown) mounted on the controlled vehicle 210, the information providing vehicle 220, and the information terminal 230 via a communication line 500. The vehicle control device 100 can suitably execute remote control of the controlled vehicle 210 by receiving (collecting) data related to communication quality and data related to the vehicle state from the controlled vehicle 210, the information providing vehicle 220, and the information terminal 230, and by transmitting a predetermined control signal to the controlled vehicle 210. The vehicle control device 100 is configured, for example, on a cloud (for example, a cloud server).
[0017] FIG. 2 is a block diagram showing a schematic configuration of the vehicle control device 100 in FIG. 1. As shown in FIG. 2, the vehicle control device 100 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a storage device 103, and a communication device 104. The storage device 103 is a device equipped with a readable and writable storage medium such as a hard disk drive (HDD) or a solid state drive (SSD), and stores a program for measuring communication quality, collected data related to communication quality, data for generating a digital twin 160 (described later), a program for predicting communication delay, and the like. In the vehicle control device 100, the CPU 101 executes a program read from the storage device 103 by using the RAM 102 as a working area, thereby executing a predetermined process related to communication delay time prediction. The communication device 104 is a device for communicating with the controlled vehicle 210, the information providing vehicle 220, and the information terminal 230 via a communication line 500.
[0018] Fig. 3 is a functional block diagram of the vehicle control device 100 shown in Fig. 2. The vehicle control device 100 shown in Fig. 3 includes a communication unit 110, a collection unit 120, an estimation / prediction unit 130, a generation unit 140, a communication quality map database (DB) 150, and a digital twin 160. The communication quality map database 150 and the digital twin 160 are realized by the storage device 103 shown in Fig. 2. The communication unit 110, the collection unit 120, the estimation / prediction unit 130, and the generation unit 140 are realized by the CPU 101 shown in Fig. 2 executing a program stored in the storage device 103 using the RAM 102.
[0019] The communication unit 110 communicates with the controlled vehicle 210, the information providing vehicle 220, and the information terminal 230, and performs operations such as receiving specified data (data related to the vehicle status, data related to communication quality, etc.), sending and receiving specified test signals (such as signals for checking communication quality), and sending specified control signals (such as signals for remote control).
[0020] The collection unit 120 collects data on vehicle states and data on communication quality provided from the control target vehicle 210, the information providing vehicle 220, and the information terminal 230 at any time via the communication unit 110. The collection unit 120 then uses the data on the vehicle states to generate the digital twin 160, and uses the data on communication quality to form the communication quality map database 150.
[0021] The estimation / prediction unit 130 estimates the future position (future position) to which the control target vehicle 210 will next travel after a predetermined time, using data related to the vehicle state provided from the control target vehicle 210, the information providing vehicle 220, and the information terminal 230, and data stored in the digital twin 160. More specifically, the estimation / prediction unit 130 estimates the future position of the control target vehicle 210 based on the driving information (vehicle speed, traveling direction, set route of navigation, etc.) received from the control target vehicle 210 via the communication unit 110. This estimated future position of the control target vehicle 210 is used to generate the digital twin 160.
[0022] Furthermore, the estimation / prediction unit 130 predicts a communication delay time (or a communication delay amount) at a future position where the controlled vehicle 210 is estimated to move next, using data related to communication quality stored in the communication quality map database 150. More specifically, the estimation / prediction unit 130 predicts a communication delay time at a future position of the controlled vehicle 210 from communication quality (execution speed, communication delay time, packet loss / radio signal strength RSSI, etc.) obtained from the communication quality map database 150 based on course information (measurement time, GPS latitude / longitude, name of communication line service provider, etc.) provided from the controlled vehicle 210 via the communication unit 110. The execution speed includes upper and lower average / peak throughput, which is the amount of information that can be received per unit time required to calculate the time until the information reception is completed. Packet loss / radio signal strength RSSI, which indicates the possibility that information will not arrive, is used when considering the retransmission time of information.
[0023] In this way, the collection unit 120 and the estimation / prediction unit 130 can function as an acquisition unit that can estimate the future position of the controlled vehicle 210 and acquire the communication delay time that occurs between the controlled vehicle 210 and the vehicle control device 100 at this estimated future position.
[0024] The generation unit 140 generates a control signal for remote control of the vehicle to be transmitted to the control target vehicle 210, based on the communication delay time at the future position of the control target vehicle 210 predicted by the estimation / prediction unit 130. A method for generating the control signal based on this communication delay time will be described later.
[0025] The communication quality map database 150 is a storage unit that stores a plurality of pieces of data related to communication quality provided from the control target vehicle 210, the information providing vehicle 220, and the information terminal 230 via the communication unit 110. The communication quality map database 150 statistically stores past communication quality data required for predicting a communication delay time at a future position where the vehicle is estimated to travel by the estimation / prediction unit 130 in a map format corresponding to map information of roads. Examples of information included in the data related to communication quality stored in the communication quality map database 150 include data measurement time, GPS latitude / longitude, name of the communication line service provider, cell ID of the wireless base station, execution speed (up and down average / peak throughput), communication delay time, packet loss, and radio wave strength RSSI.
[0026] The digital twin 160 is a storage function unit for reproducing a virtual world synchronized with the real world in time on a cloud computer by updating and storing data on the current and past vehicle states (vehicle position, driving time, etc.) collected about the controlled vehicle 210 in real time. In addition, the digital twin 160 can generate future prediction data about the controlled vehicle 210 from current and past data and information based on a request. Examples of information included in the data stored by the digital twin 160 include vehicle information (VIN, etc.), information about other vehicle traffic (including bicycles, pedestrians, etc.), map information, time information, position information (GPS latitude / longitude), and trajectory information (vehicle speed, etc.) which is the driving trajectory.
[0027] 8, a system configuration may be adopted in which a device other than the vehicle control device 100, for example, an external device 300, holds a communication quality map database (DB) 350 having communication quality information equivalent to that of the communication quality map database 150. In this system configuration, the vehicle control device 100 may acquire (realize the function of) the communication quality map database 150 by referring to the communication quality map database 350 held by the external device 300, without directly receiving data related to communication quality from the information providing vehicle 220 or the information terminal 230. Examples of this external device 300 include a telecommunications carrier and an information providing service company.
[0028] [control] Next, the processes executed by the vehicle control device 100 according to the present embodiment will be described with further reference to Fig. 4 to Fig. 6. The processes executed by the vehicle control device 100 include data correction control, communication delay time prediction, and control signal generation.
[0029] (1) Data correction control Fig. 4 is a flowchart explaining the processing procedure of the data correction control executed by the vehicle control device 100. The data correction control illustrated in Fig. 4 is a process for correcting the data of the digital twin 160, and is executed every time data related to the vehicle state is received from the control target vehicle 210.
[0030] (Step S401) The vehicle control device 100 judges whether data on the vehicle state has been received from the controlled vehicle 210. The data on the vehicle state received from the controlled vehicle 210 includes information on the vehicle position, time information (time stamp), and information on the vehicle's travel path (trajectory information) at the time of data transmission (or data creation). The trajectory information includes at least the vehicle speed and vehicle direction. The trajectory information may further include navigation information, turn signal information, accelerator opening amount / brake braking amount information, acceleration / deceleration information, shift range (D / B / R) information, steering angle information, road information, driving lane information, oncoming lane traffic light information, congestion information, etc.
[0031] In this step S401, if data on the vehicle state is received from the control target vehicle 210 (S401, Yes), the process proceeds to step S402.
[0032] (Step S402) The vehicle control device 100 calculates a delay time (actual communication delay time) that actually occurs in communication between the controlled vehicle 210 and the vehicle control device 100. This actual communication delay time can be calculated from the difference between time information (time stamp) included in the data related to the vehicle state received from the controlled vehicle 210 and the time when the vehicle control device 100 received this data.
[0033] In step S402, when the actual communication delay time is calculated, the process proceeds to step S403.
[0034] (Step S403) The vehicle control device 100 derives the occurrence probability of the vehicle speed at the vehicle position of the controlled vehicle 210 at the time when the controlled vehicle 210 transmits data related to the vehicle state (or the time when the data is created). The occurrence probability of the vehicle speed at this vehicle position can be derived based on road information, congestion information, and past vehicle speed information included in the data related to the vehicle state received from the controlled vehicle 210 or held by the digital twin 160. The occurrence probability of the vehicle speed at this vehicle position is stored in a database in the form of a map, for example.
[0035] In this step S403, when the occurrence probability of the vehicle speed at the vehicle position of the controlled vehicle 210 at the data transmission time is derived, the process proceeds to step S404.
[0036] (Step S404) The vehicle control device 100 derives the occurrence probability of the position of the controlled vehicle 210 estimated at the time when the vehicle control device 100 receives data related to the vehicle state. More specifically, the vehicle control device 100 derives the occurrence probability of the vehicle position where the controlled vehicle 210 is estimated to be moving at the time when the vehicle control device 100 receives the data transmitted from the controlled vehicle 210 after the actual communication delay time has elapsed, based on the actual communication delay time occurring between the vehicle control device 100 and the controlled vehicle 210, the occurrence probability of the vehicle speed at the vehicle position of the controlled vehicle 210 at the data transmission time, and trajectory information included in the data related to the vehicle state received from the controlled vehicle 210. The occurrence probability of this vehicle position can be derived, for example, as follows.
[0037] a: When the vehicle is traveling at a high speed (and has no tendency to slow down) In this case, since it can be predicted that the vehicle is unlikely to make a right or left turn or move backward and will likely travel straight, the probability of occurrence of a position in front of the vehicle is derived to be high. b: When the vehicle's turn signal is activated for a left turn In this case, since it can be predicted that the vehicle will turn left, the probability of the vehicle being in a leftward position is derived to be high. c: The vehicle is traveling (decelerating) in the right-turn lane of a multi-lane road. In this case, since it can be predicted that the vehicle will turn right, the probability of the vehicle being in a rightward position is derived to be high. d: When the vehicle's shift range is in reverse (R) In this case, since it can be predicted that the vehicle will move backward, the probability of occurrence of a position behind the vehicle is derived to be high.
[0038] Note that the vehicle control device 100 may derive the occurrence probability of the vehicle position of the control target vehicle 210 at any time (for example, 1 second) from the time when the vehicle control device 100 receives the current data until the next time new data is received from the control target vehicle 210. This any time is determined to be an optimal value depending on the intended use of the control signal, the required accuracy for the vehicle position, and the like.
[0039] In this step S404, when the occurrence probability of the vehicle position of the control target vehicle 210 estimated at the data reception time is derived, the process proceeds to step S405.
[0040] (Step S405) The vehicle control device 100 generates (updates) the digital twin 160 based on the derived occurrence probability of the vehicle position of the control target vehicle 210. This makes it possible to obtain the digital twin 160 in which corrections have been made for data communication delays and transmission cycles.
[0041] In addition, as in the example described above, when the vehicle control device 100 derives the occurrence probability of the vehicle position of the controlled vehicle 210 at any time (for example, 1 second) from the time when it receives data regarding the vehicle state, the digital twin 160 is generated at each time corresponding to the derivation of the occurrence probability in synchronization with the current time.
[0042] In this step S405, when the digital twin 160 is generated, the process proceeds to step S401, and this data correction control is repeated.
[0043] (2) Communication Delay Time Prediction Fig. 5 is a flowchart for explaining the procedure of the communication delay time prediction process executed by the vehicle control device 100. The communication delay time prediction illustrated in Fig. 5 is a process for predicting the communication delay time at the future position of the control target vehicle 210, and is executed at a predetermined timing when the prediction of the communication delay time is required.
[0044] (Step S501) The vehicle control device 100 judges whether or not it is necessary to predict the communication delay time. For example, this judgment is made when there is an explicit request for remote control from the controlled vehicle 210, when a response to a test signal for checking communication quality is received from the controlled vehicle 210, etc.
[0045] In this step S501, if it becomes necessary to predict a communication delay time (S501, Yes), the process proceeds to step S502.
[0046] (Step S502) The vehicle control device 100 acquires communication quality at a future position of the controlled vehicle 210. More specifically, the vehicle control device 100 acquires (extracts) information on the most promising communication quality for the future position of the controlled vehicle 210 from the communication quality map database 150 based on the course information (measurement time, GPS latitude / longitude, name of the communication line service provider, etc.) provided by the controlled vehicle 210. Whether or not the information is the most promising communication quality information can be determined based on conditions such as, for example, whether it is severe information, whether it is highly probable information, whether it is information on the most recent results, etc.
[0047] In this step S502, when the communication quality at the future position of the control-target vehicle 210 is acquired, the process proceeds to step S503.
[0048] (Step S503) Based on the information on the communication quality acquired in step S502, the vehicle control device 100 calculates a delay time (estimated communication delay time) that is predicted to occur in communication at a future position of the controlled vehicle 210. As an example, when the communication quality is good, a relatively short time is calculated as the estimated communication delay time, and when the communication quality is poor, a relatively long time is calculated as the estimated communication delay time.
[0049] In this step S503, when the predicted communication delay time at the future position of the control target vehicle 210 is calculated, the process proceeds to step S501, and this communication delay time prediction is repeated.
[0050] (3) Control signal generation Fig. 6 is a flowchart for explaining the procedure of a control signal generation process executed by the vehicle control device 100. The control signal generation illustrated in Fig. 6 is a process for generating a control signal related to remote control at a future position of the controlled vehicle 210, and is executed at a predetermined timing when the generation of a control signal is required.
[0051] (Step S601) The vehicle control device 100 judges whether it is necessary to generate a control signal for the control target vehicle 210. This judgment is made, for example, when there is an explicit request for remote control from the control target vehicle 210, or when the vehicle control device 100 detects a situation in which remote control of the control target vehicle 210 is necessary.
[0052] In this step S601, if it becomes necessary to generate a control signal (S601, Yes), the process proceeds to step S602.
[0053] (Step S602) The vehicle control device 100 acquires a predicted communication delay time that will occur in communication at a future position of the control target vehicle 210. This predicted communication delay time is a value calculated in the process of step S503 in the above-mentioned communication delay time prediction.
[0054] In this step S602, when the predicted communication delay time that will occur in communication at the future position of the control target vehicle 210 is acquired, the process proceeds to step S603.
[0055] (Step S603) The vehicle control device 100 generates and transmits a control signal for the controlled vehicle 210 at a future position, in other words, a control signal with control content synchronized with the time that the controlled vehicle 210 is expected to receive at the future position. More specifically, the vehicle control device 100 generates a control signal required for remotely controlling the controlled vehicle 210 that has advanced to a future position at real time in the real space at the synchronized time in the virtual space. Then, the vehicle control device 100 transmits the generated control signal to the controlled vehicle 210 at a timing when the control of the time in the virtual space and the control of the time in the real space are synchronized based on the predicted communication delay time acquired in the above step S602.
[0056] For example, consider a situation where vehicle X traveling straight south is in danger of colliding with vehicle Y traveling straight east at an intersection in 40 seconds (time T). In such a situation, one method of remotely controlling vehicle X is to slow down vehicle X's speed and let vehicle Y pass the intersection first. Here, assume that the predicted communication delay time in the area near the intersection for vehicle X is 10 seconds. In this case, even if a control signal instructing vehicle X to "pass the intersection in 10 seconds" is transmitted to vehicle X 20 seconds before time T, vehicle X will receive the control signal 10 seconds after the actual time in the real space, and the actual action will be "pass the intersection in 20 seconds (= command 10 seconds + delay 10 seconds)," and the collision between vehicle X and vehicle Y cannot be avoided.
[0057] Therefore, in the method of this embodiment, a control signal is sent to vehicle X by going back (advancing) the time by the predicted communication delay time so that the time when the control content is considered in the virtual space is synchronized with the time when the vehicle receives the control signal in the real space. Specifically, in the above-mentioned scene, taking into consideration that the predicted communication delay time is 10 seconds, a control signal is generated to send to vehicle X an instruction to "pass through the intersection in 20 seconds" 30 seconds before the time T, which is 10 seconds back (advance), rather than a control signal to send to vehicle X an instruction to "pass through the intersection in 20 seconds" 20 seconds before the time T.
[0058] In this step S603, when a control signal for the controlled vehicle 210 at a future position is generated and transmitted, the process proceeds to step S601, and this control signal generation is repeated.
[0059] 7A, 7B, and 7C are further used to explain the transmission of time-synchronized control signals executed by the vehicle control device 100. Fig. 7A is a diagram showing a state of transmission of a control signal by a conventional device. Figs. 7B and 7C are diagrams showing an example of a state of transmission of a control signal by the vehicle control device 100 of this embodiment, respectively.
[0060] 7A, in processing by a conventional device that does not consider communication delay time, the control content determined at time T in the virtual space reaches the vehicle in the real space at a time delayed by the communication delay time from time T. For this reason, for example, even if it is assumed in the virtual space that control signal A and control signal B are to be executed simultaneously (control plan determination), there will be a discrepancy between the two controls in the real space.
[0061] In contrast, in the process by the vehicle control device 100 according to the present embodiment illustrated in Fig. 7B, the transmission timing (transmission time) of the control signal A and the control signal B is advanced by the amount of each predicted communication delay time. This process makes it possible to execute the control signal A and the control signal B simultaneously in the real space as assumed in the virtual space.
[0062] Also, as in the processing by the vehicle control device 100 according to this embodiment illustrated in FIG. 7C, the control signal A and the control signal B may be transmitted at the same transmission timing (transmission time), and for the control signal A with a short predicted communication delay time, the start of control execution may be delayed by the time difference between the predicted communication delay time of the control signal A and the predicted communication delay time of the control signal B (queue processing).
[0063] <Actions, Effects, etc.> As described above, according to the vehicle control device 100 according to an embodiment of the present disclosure, past statistical communication quality data corresponding to a road map is stored in a storage unit (communication quality map database 150) based on data regarding communication quality transmitted and received between the communication device group 200 (the controlled vehicle 210, the information providing vehicle 220, and the information terminal 230). Using this communication quality data, the vehicle control device 100 can predict the communication delay time at the future vehicle position where remote control will be performed when instructing the controlled vehicle 210 to perform remote control, and can generate and transmit a control signal suitable for performing remote control using the digital twin 160 based on this predicted communication delay time.
[0064] This process makes it possible to instruct the controlled vehicle 210 to perform remote control using a control signal that is corrected based on the predicted communication delay time and synchronizes the time in the virtual space formed on the cloud using the digital twin 160 with the actual time in the real space (ensuring time synchronism). Therefore, it is possible to reduce the effect of communication delays that occur between the vehicle and the cloud.
[0065] The above describes one embodiment of the present disclosure, but the present disclosure can be viewed as a system including a vehicle control device, a method executed by a vehicle control device having a processor and a memory, a control program for executing the method, a computer-readable non-transitory storage medium storing the control program, and a vehicle control device and a vehicle. [Industrial Applicability]
[0066] The present disclosure is useful in cases where it is desired to reduce the effects of communication delays that occur between a vehicle and the cloud when remotely controlling a vehicle using a vehicle control device provided on the cloud. [Explanation of symbols]
[0067] 10 Digital Twin System 100 Vehicle control device 101 CPU 102 RAM 103 Storage device 104 Communication equipment 110 Communications Department 120 Collection Department 130 Estimation / Prediction Section 140 Generation part 150, 350 Communication quality map database 160 Digital Twin 200 Communication equipment group 210 Controlled Vehicles 220 Information vehicle 230 Information terminal 300 External device 500 communication lines
Claims
1. A vehicle control device that communicates with a plurality of vehicles, A communication unit that transmits and receives data between the plurality of vehicles; an acquisition unit that acquires a communication delay time between a controlled vehicle that is a target of remote control among the plurality of vehicles and the vehicle control device based on the data transmitted and received by the communication unit; A generating unit that generates a control signal to be transmitted to the controlled vehicle for remote control based on the communication delay time acquired by the acquiring unit, with a control content synchronized with a time when the controlled vehicle is expected to receive the control signal, The communication unit is When remote control of the controlled vehicle is to be executed, the control signal is transmitted to the controlled vehicle at a time earlier than a time when the controlled vehicle is expected to receive the control signal by the communication delay time; A vehicle control device, when remote control of two controlled vehicles is executed simultaneously, sends two control signals to the two controlled vehicles at the same time, with an instruction to wait for the start of control execution for the controlled vehicle having a shorter communication delay time for the time difference between the two communication delay times.
2. The vehicle control device described in claim 1, wherein the acquisition unit collects information regarding the positions of the multiple vehicles and information regarding communication quality at each of the positions of the multiple vehicles from the data received by the communication unit, and predicts a communication delay time between the controlled vehicle and the vehicle control device at a future position where the vehicle's progress is estimated based on the information.
3. The communication unit further transmits and receives data to and from one or more information terminals other than the plurality of vehicles. The vehicle control device according to claim 2 , wherein the acquisition unit collects information on positions of the one or more information terminals and information on communication quality at each of the positions of the one or more information terminals from the data received by the communication unit.
4. 4. The vehicle control device according to claim 2 or 3, wherein the acquisition unit collects information regarding the positions of the plurality of vehicles and trajectory information regarding the speed and direction of each of the plurality of vehicles from the data received by the communication unit, and estimates the future position in which the controlled vehicle will travel based on the trajectory information.
5. The vehicle control device according to claim 1 , wherein the communication delay time is used to form a digital twin in a virtual space that is time-synchronized with a real space.
6. A system including a plurality of vehicles and a vehicle control device that communicates with the plurality of vehicles, The vehicle control device includes: A communication unit that transmits and receives data between the plurality of vehicles; an acquisition unit that acquires a communication delay time between a controlled vehicle that is a target of remote control among the plurality of vehicles and the vehicle control device based on the data transmitted and received by the communication unit; A generating unit that generates a control signal to be transmitted to the controlled vehicle for remote control based on the communication delay time acquired by the acquiring unit, with a control content synchronized with a time when the controlled vehicle is expected to receive the control signal, The communication unit of the vehicle control device When remote control of the controlled vehicle is to be executed, the control signal is transmitted to the controlled vehicle at a time earlier than a time when the controlled vehicle is expected to receive the control signal by the communication delay time; When remote control of two controlled vehicles is performed simultaneously, the system sends two control signals to the two controlled vehicles at the same time, with an instruction to the controlled vehicle having a shorter communication delay time to wait for the time difference between the two communication delay times before starting to execute control.
7. A method executed by a computer of a vehicle control device that has a processor and a memory and communicates with a plurality of vehicles, comprising: transmitting and receiving data to and from the plurality of vehicles; acquiring a communication delay time between a controlled vehicle that is a target for remote control among the plurality of vehicles and the vehicle control device based on the transmitted and received data; generating a control signal to be transmitted to the controlled vehicle for remote control based on the communication delay time, with control content synchronized with a time when the controlled vehicle is expected to receive the control signal; When remote control of the controlled vehicle is to be performed, transmitting the control signal to the controlled vehicle at a time that is earlier than a time at which the controlled vehicle is expected to receive the control signal by the communication delay time; When remote control of two controlled vehicles is to be performed simultaneously, a step of sending two control signals to the two controlled vehicles at the same time, with an instruction to the controlled vehicle having a shorter communication delay time to wait for the time difference between the two communication delay times before starting to execute control.
8. A program to be executed by a computer of a vehicle control device that has a processor and a memory and communicates with a plurality of vehicles, transmitting and receiving data to and from the plurality of vehicles; acquiring a communication delay time between a controlled vehicle that is a target for remote control among the plurality of vehicles and the vehicle control device based on the transmitted and received data; generating a control signal to be transmitted to the controlled vehicle for remote control based on the communication delay time, with control content synchronized with a time when the controlled vehicle is expected to receive the control signal; When remote control of the controlled vehicle is to be performed, transmitting the control signal to the controlled vehicle at a time that is earlier than a time at which the controlled vehicle is expected to receive the control signal by the communication delay time; When remote control of two controlled vehicles is to be executed simultaneously, a step of sending two control signals to the two controlled vehicles at the same time by adding an instruction to the controlled vehicle having a shorter communication delay time to wait for the time difference between the two communication delay times before starting to execute control.
Citation Information
Patent Citations
Digital twinning-based vehicle depot rapid departure control method and system
CN112758134A
Radio communication system and radio communication method
JP2015109509A
Remote controller and remote control system using remote controller
JP2016024613A
Terminal device, base station device, radio communication system and information notifying method
JP2017034635A
Information processing device, operated vehicle, information processing method, and program
JP2018106676A
