Vehicle control device, vehicle control method, and vehicle control program

Abstract

To provide a vehicle control device capable of correctly measuring a present position of a vehicle.SOLUTION: A vehicle control device 1 controls traveling of a vehicle including a radar to detect an object. The vehicle control device 1 executes: processing to calculate an absolute position of the vehicle with positions of artificial satellites as reference; processing to calculate a relative position of the vehicle indicating a relative position with a reference station positioned at a known point; processing to calculate a correction relative position of the vehicle based on a three-dimensional angular speed and an acceleration speed; processing to control traveling of the vehicle with the use of position information of the vehicle based on the absolute position or the relative position; and processing to acquire information of an outer environment of the vehicle from the radar. The processing to control traveling of the vehicle is the processing to control the traveling of the vehicle with the use of the position information based on the relative position when the presence of an object is not recognized from detection information by the radar. When presence of the object is recognized from the detection information by the radar, the traveling of the vehicle is controlled with the use of the position information based on the correction relative position.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a vehicle control device, a vehicle control method, and a vehicle control program, and more particularly to a vehicle control device, a vehicle control method, and a vehicle control program that control the running of a vehicle based on information on the current position of the running vehicle.

Background Art

[0002] In recent years, in order to realize the safety and comfort of drivers, vehicles equipped with an ADAS (Advanced Driver Assistance System) that enables the vehicle itself to grasp information on the surrounding external environment, control the running of the vehicle on behalf of the driver, and perform autonomous driving are known. In addition, when a driving obstacle occurs due to a malfunction of the vehicle or the like, a remote driving technology for operating the running of the vehicle by communication via a network is known in order to safely stop the vehicle or continue running safely (see, for example, Patent Document 1).

[0003] In the vehicle control device described in Patent Document 1, it is possible to select any one of a remote driving mode, an autonomous driving mode, and a driving support mode, and the vehicle can be controlled in the selected operation mode. When the remote driving mode is selected, the operator remotely operates the vehicle using a remote driving device connected to the control device through a network.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] Incidentally, in a vehicle remote operation system such as Patent Document 1, a technology for accurately measuring the current position of a traveling vehicle is required, and this technology is used for automatic driving control or for a navigation service that guides a driver or operator along a route to a destination. For example, in the automatic operation method described in Patent Document 2, a GPS signal is received during the travel of a vehicle to obtain the position (absolute position) of the vehicle in real time. When the reliability of the position accuracy of the vehicle decreases, the coordinates and azimuth based on GPS (Global Positioning System) and the coordinates and azimuth based on an inertial measurement unit (IMU) are matched to correct the absolute position. Under such circumstances, a technology for more accurately measuring the current position of a traveling vehicle has been required.

[0006] An object of the present invention is to provide a vehicle control device, a vehicle control method, and a vehicle control program that can more accurately measure the current position of a traveling vehicle and can measure the position information of the vehicle in response to the external environment of the vehicle.

Means for Solving the Problems

[0007] According to the vehicle control device of the present invention, the above problem is solved by a vehicle control device that controls the travel of a vehicle equipped with a radar for detecting an object, obtains GNSS information using a GNSS receiver mounted on the vehicle from an artificial satellite, calculates the absolute position of the vehicle based on the position of the artificial satellite, and GNSS correction information for correcting the error of the GNSS information from a reference station located at a known point or before records the GNSS correction information for correcting the error of the GNSS information obtainedA process of correcting the absolute position and calculating the relative position of the vehicle indicating the relative position with respect to the reference station located at the known point; a process of calculating the corrected relative position of the vehicle based on the GNSS correction information, the three-dimensional angular velocity and acceleration obtained from an inertial measurement device mounted on the vehicle; a process of controlling the travel of the vehicle using the position information of the vehicle based on the absolute position or the relative position; and a process of acquiring information on the external environment of the vehicle from the radar. The process of controlling the travel of the vehicle controls the travel of the vehicle using the position information based on the relative position when the object does not exist according to the detection information from the radar as the information on the external environment, and controls the travel of the vehicle using the position information based on the corrected relative position when the object exists according to the detection information from the radar as the information on the external environment, thereby solving the problem.

[0008] Also, for the problem, a computer that controls the travel of a vehicle equipped with a radar for detecting an object acquires GNSS information using a GNSS receiver mounted on the vehicle from an artificial satellite, and calculates the absolute position of the vehicle with reference to the position of the artificial satellite, and a reference station located at a known point before GNSS correction information for correcting the error of the GNSS information obtained Execute a process of correcting the absolute position and calculating the relative position of the vehicle indicating the relative position with respect to the reference station located at the known point; a process of calculating the corrected relative position of the vehicle based on the GNSS correction information, the three-dimensional angular velocity and acceleration obtained from an inertial measurement device mounted on the vehicle; a process of controlling the travel of the vehicle using the position information of the vehicle based on the absolute position or the relative position; and a process of acquiring information on the external environment of the vehicle from the radar. In the process of controlling the travel of the vehicle, when the object does not exist according to the detection information from the radar as the information on the external environment, the travel of the vehicle is controlled using the position information based on the relative position, and when the object exists according to the detection information from the radar as the information on the external environment, the travel of the vehicle is controlled using the position information based on the corrected relative position. The problem is also solved by a vehicle control method including this. Further, the above problem is solved by a vehicle control program that causes a computer that controls the running of a vehicle equipped with a radar for detecting an object to acquire GNSS information from an artificial satellite using a GNSS receiver mounted on the vehicle, calculate the absolute position of the vehicle based on the position of the artificial satellite, and whether it is a reference station located at a known point before acquire GNSS correction information for correcting the error of the recorded GNSS information obtained correct the absolute position, calculate the relative position of the vehicle indicating the relative position with respect to the reference station located at the known point, calculate the corrected relative position of the vehicle based on the GNSS correction information and the three-dimensional angular velocity and acceleration acquired from an inertial measurement unit mounted on the vehicle, and use the position information of the vehicle based on the absolute position or the relative position to control the running of the vehicle, and acquire information on the external environment of the vehicle from the radar. In the process of controlling the running of the vehicle, when the object does not exist in the detection information by the radar as the information on the external environment, the running of the vehicle is controlled using the position information based on the relative position, and when the object exists in the detection information by the radar as the information on the external environment, the running of the vehicle is controlled using the position information based on the corrected relative position.

Effects of the Invention

[0009] According to the vehicle control device, vehicle control method, and vehicle control program of the present invention, it is possible to more accurately measure the current position of a running vehicle.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described with reference to FIGS. 1-6. As shown in FIG. 1, the vehicle remote operation system S of the present embodiment grasps the external environment of the traveling vehicle V, plans the traveling route of the vehicle V on behalf of the driver, and controls the vehicle V based on the traveling route to realize "automatic driving" for traveling, and "remote driving" in which an operator outside the vehicle V remotely operates (externally operates) the vehicle V to travel. It is a system that can perform "mode switching processing" for switching between the automatic driving mode and the remote driving mode. In addition, there is a manual driving mode in which the driver rides in the vehicle V and performs driving operations (details will be described later). In the above mode switching processing, in addition to switching between this manual driving mode and the automatic driving mode, it is also possible to switch between the manual driving mode and the remote driving mode. Note that the operator does not have to be a human, and may be, for example, AI (artificial intelligence).

[0012] <Hardware Configuration of Vehicle Remote Operation System> As shown in FIGS. 1-3, the vehicle remote operation system S includes a vehicle control device 1 mounted on the vehicle V for comprehensively controlling the traveling of the vehicle V, an in-vehicle sensor 10 for detecting the external environment around the vehicle V, an in-vehicle locator 20 for receiving GNSS signals from the artificial satellite SA and the reference station ST and measuring the current position of the vehicle V, an in-vehicle ECU 30 for controlling the steering, acceleration, and deceleration of the vehicle V, and an in-vehicle communication device 40 for communicating with an operation device 50 and external devices installed outside the vehicle V. In addition, the vehicle remote operation system S is connected to the vehicle control device 1 via a network (digital communication path), and includes an operation device 50 for operating the running of the vehicle V by communication via the network. Of course, the vehicle control device 1 and the operation device 50 may directly communicate with each other.

[0013] As shown in FIG. 2, the vehicle control device 1 is a computer connected to an in-vehicle sensor 10, an in-vehicle locator 20, an in-vehicle ECU 30, and an in-vehicle communication device 40 through an in-vehicle network (CAN). Specifically, it is a computer including a CPU as a data calculation and control processing device, a ROM, a RAM, and an HDD (SSD) as storage devices, and a communication interface for transmitting and receiving information data through the in-vehicle network. In the storage device of the vehicle control device 1, in addition to a main program that performs necessary functions as a computer, a vehicle control program and a vehicle remote operation program are stored. When these programs are executed by the CPU, the functions of the vehicle control device 1 are exerted. Note that the in-vehicle ECU 30 (integrated ECU 31) and the operation device 50 are also computers having a similar hardware configuration.

[0014] The vehicle control device 1 controls the in-vehicle ECU 30 (integrated ECU 31) based on the information on the external environment obtained from the in-vehicle sensor 10, the information on the current position obtained from the in-vehicle locator 20, and the vehicle information obtained from the in-vehicle ECU 30 in order to execute "automatic driving", thereby controlling the running of the vehicle V. In addition, the vehicle control device 1 wirelessly communicates with the operation device 50 through the in-vehicle communication device 40 in order to execute "remote driving", and transmits the information on the external environment, the information on the current position, and the vehicle information to the operation device 50. The operation device 50 receives these information, and in addition to displaying the content based on the information on the external environment and the information on the current position on the monitor 51 (navigation monitor 52), can notify the operator. More specifically, the vehicle control device 1 is newly installed in a vehicle V that is pre-equipped with an "automatic driving function (in-vehicle sensor 10, in-vehicle locator 20, in-vehicle ECU 30)", so as to enhance the performance of the existing "automatic driving function" and newly endow a "remote driving function".

[0015] The in-vehicle sensor 10 detects moving objects (such as other vehicles and pedestrians), various structures, road shapes, etc. around the vehicle V as the external environment around the vehicle V. Specifically, it is mainly composed of a plurality of imaging devices 11, a plurality of radars 12, and a plurality of lidars 13. Note that the in-vehicle sensor 10 may further have detection sensors other than those described above.

[0016] The imaging device 11, also referred to as an imaging apparatus, is a small imaging camera (wide-angle camera) that captures (images) the external video around the vehicle V. It creates external video data and transmits the external video data to the vehicle control device 1 in order to execute a "sensing function" for the driving control of the vehicle V and a "monitoring function" for the driver (operator). A plurality of imaging devices 11 are installed in the vehicle V. The first imaging device 11a, the second imaging device 11b, and the third imaging device 11c are attached to the front glass of the vehicle V and capture the front, right side, and left side of the vehicle V respectively. The fourth imaging device 11d is attached to the rear bumper of the vehicle V and captures the rear of the vehicle V. The fifth imaging device 11e and the sixth imaging device 11f are attached to the left and right mirrors of the vehicle V and capture the right rear diagonal and left rear diagonal of the vehicle V respectively. These are provided as main cameras. In addition, as sub-cameras, the imaging device 11 includes a seventh imaging device 11g attached to the front bumper of the vehicle V to capture the front of the vehicle V, and an eighth imaging device 11h and a ninth imaging device 11i attached to the periphery of the left and right rear lights of the vehicle V to capture the right rear diagonal and left rear diagonal of the vehicle V respectively. In this embodiment, a total of nine imaging devices 11 are attached to predetermined positions on the vehicle V. However, the number and attachment positions of the imaging devices 11 can be changed according to the vehicle type and shape of the vehicle V. The same applies to the radar 12 and the lidar 13. As another example of the sub-camera, the seventh imaging device 11g may be attached to the upper part of the rear glass (rear windshield) of the vehicle V, and may image the rear of the vehicle V from that position. In that case, it is preferable that the eighth imaging device 11h is attached to the right A-pillar at the front of the vehicle V, and the ninth imaging device 11i is attached to the left A-pillar at the front.

[0017] The radar 12 is a millimeter-wave radar that transmits radio waves while continuously changing the irradiation direction, receives reflected waves from the target object to detect the target object (measures the position and velocity of the target object), and performs three-dimensional spatial imaging. Compared with the imaging device 11 and the lidar 13, it can detect accurately even in environmental situations such as at night with poor visibility or in bad weather. The radar 12 acquires the detection result data (detection signal) of the above-mentioned target object and transmits the detection result data toward the vehicle control device 1. A plurality of radars 12 are mounted on the vehicle V, and include a first radar 12a and a second radar 12b attached to the peripheries of the left and right front lights of the vehicle V, and a third radar 12c and a fourth radar 12d attached to the peripheries of the left and right back lights of the vehicle V. Note that the radar 12 is not particularly limited to a millimeter-wave radar, and may be a radar such as a lidar or an ultrasonic sensor.

[0018] The lidar 13 is a remote sensor that irradiates laser light, receives the reflected light from the target object to measure the distance to the target object, and performs three-dimensional spatial imaging. Compared with the imaging device 11 and the radar 12, it can measure the distance to the surrounding target objects in units of several centimeters. The lidar 13 acquires the distance measurement data obtained by measuring the distance to the above-mentioned target object and transmits the distance measurement data toward the vehicle control device 1. A plurality of lidars 13 are mounted on the vehicle V, including a first lidar 13a and a second lidar 13b attached to the peripheries of the left and right front lights of the vehicle V, a third lidar 13c attached to the back bumper of the vehicle V, and a fourth lidar 13d and a fifth lidar 13e attached to the peripheries of the left and right back lights of the vehicle V.

[0019] The in-vehicle locator 20 measures the current position of the vehicle V using a satellite positioning system that uses artificial satellites SA and a reference station ST, and also measures the acceleration and angular velocity of the vehicle V in order to improve the measurement accuracy of the current position. Specifically, the in-vehicle locator 20 includes a GNSS receiver 21 that receives GNSS radio waves (GPS radio waves) from a plurality of artificial satellites SA, and an inertial measurement unit 22 that measures the acceleration and angular velocity of the vehicle V.

[0020] Specifically, the GNSS receiver 21 is an RTK-GNSS receiver that receives GNSS radio waves from a plurality (specifically, four) of artificial satellites SA and generates "GNSS information" necessary for single-point positioning. It also receives "GNSS correction information" necessary for relative positioning from an external reference station ST. Note that the reference station ST is a fixed reference station set at a known point, which receives GNSS radio waves from a plurality of artificial satellites SA, generates "GNSS correction information", and transmits it to the GNSS receiver 21. "GNSS information" is distance information between a plurality of artificial satellites SA and the GNSS receiver 21. "GNSS correction information" is distance information obtained by a reference station ST located at a known point receiving GNSS radio waves and the reference station ST and the GNSS receiver 21 communicating with each other to correct the measurement error of the "GNSS information".

[0021] The inertial measurement unit 22, also called an IMU, includes a three-axis gyro sensor (angular velocity meter) and a three-axis acceleration sensor (accelerometer), measures the three-dimensional angular velocity and acceleration of the vehicle V, and transmits information on the acceleration and angular velocity of the vehicle V to the vehicle control device 1. The vehicle control device 1 can measure the current position of the vehicle V within a smaller error range by combining the GNSS information (GNSS correction information) received from the GNSS receiver 21 and the information on the angular velocity and acceleration of the vehicle V received from the inertial measurement device 22 for positioning.

[0022] The in-vehicle ECU 30 is, for example, an ECU for ADAS, which is connected to the vehicle control device 1, and includes a comprehensive ECU 31 at a higher level that performs transmission and reception of various data, and a steering wheel ECU 32, an accelerator ECU 33, and a brake ECU 34, each of which is connected to the comprehensive ECU 31 as the higher level and controls the steering, acceleration, and deceleration of the vehicle V in a subdivided manner, forming a hierarchical structure. Note that the steering wheel ECU 32 is also called a driving support computer, and the accelerator ECU 33 and the brake ECU 34 are also called power management control units. Note that the number and functions of the individual ECUs connected to the comprehensive ECU 31 are not particularly limited to the above three ECUs 32 - 34, and other ECUs may be further provided at the same level as these ECUs.

[0023] The steering wheel ECU 32 controls the electric power steering V1 of the vehicle V in response to an instruction from the comprehensive ECU 31, and mainly controls the traveling direction of the vehicle V. The electric power steering V1 includes a steering mechanism that steers the front wheels of the vehicle V. For example, in the manual driving mode, the front wheels of the vehicle V are steered by the steering operation of the steering wheel V1a by the driver. Note that the steering wheel V1a is equipped with a torque sensor and an angle sensor, and the "mode switching process" of the driving mode can be performed based on the detection results of these sensors.

[0024] The accelerator ECU 33 controls the electric throttle V2 of the vehicle V in response to an instruction from the comprehensive ECU 31, and mainly controls the acceleration and deceleration of the vehicle V. The electric throttle V2 is equipped with a drive mechanism that outputs a driving force for rotating the drive wheels of the vehicle V. For example, in the manual driving mode, the output of the engine is adjusted in response to the accelerator operation of the accelerator pedal V2a by the driver.

[0025] The brake ECU 34 controls the electromagnetic brake device V3 of the vehicle V in response to an instruction from the integrated ECU 31, and mainly controls the deceleration and stop of the vehicle V. The electromagnetic brake device V3 is attached to each wheel of the vehicle V and has a mechanism for decelerating or stopping the vehicle V by applying resistance to the rotation of the wheel. For example, in the manual driving mode, the operation of the electromagnetic brake device V3 is adjusted in response to the brake operation of the brake pedal V3a by the driver.

[0026] The in-vehicle communication device 40 is a device that communicates information via a network with an operation device 50 installed outside the vehicle V and an external server (not shown). For example, it transmits information on the external video acquired by the vehicle control device 1 and information on the current position as information necessary for "remote driving" to the operation device 50. Also, it receives the driving operation information of the vehicle V from the operation device 50 that has received user input by the operator and transmits it to the vehicle control device 1. The in-vehicle communication device 40 communicates information with an external server (not shown), and for example, can also receive the latest traffic information, weather information, etc. from the external server.

[0027] As shown in FIG. 3, the operation device 50 is a computer operated by an operator for performing "remote driving" of the vehicle V. As a specific hardware configuration of the operation device 50, it includes a plurality of monitors 51, a navigation monitor 52, a steering wheel 53, an accelerator pedal 54, a brake pedal 55, and a plurality of operation switches 56. Note that the operation device 50 may further include components such as a speaker, a microphone, and a shift lever.

[0028] The monitor 51 and the navigation monitor 52 are display units that output visual information for performing "remote driving". On the monitor 51, a composite video (composite image) obtained by synthesizing external images of the vehicle V captured by a plurality of imaging devices 11a - 11i based on predetermined layout information is displayed. The predetermined layout information is, for example, a display mode with a layout that does not create blind spots for the operator and is easy for the operator to operate. At this time, it is also possible to store a plurality of layout information in a predetermined storage unit of the vehicle V in association with a layout ID (layout identification information). In this case, after switching the layout display using an operation switch or the like described later and further performing an operation to change the layout information, the changed layout ID is transmitted from the operation device 50 (operation switch 56) to the vehicle V. Although details will be described later, at this time, in the vehicle V, a composite video obtained by synthesizing external images based on the layout information corresponding to the changed layout ID is generated, and the composite video is displayed on the monitor 51.

[0029] The steering wheel 53 is an operation unit that is operated by the operator and is used to adjust the steering angle (steering amount) of the vehicle V. The accelerator pedal 54 and the brake pedal 55 are operation units that are respectively operated by the operator and are used to adjust the drive of the electric throttle V2 and the operation of the electromagnetic brake device V3 of the vehicle V. The plurality of operation switches 56 are used, for example, for the user to input setting information for performing "remote driving". For example, by appropriately operating the operation switch 56 by the operator, it is possible to switch the external image (composite image) of the vehicle V to a predetermined layout display and to switch the driving mode between the automatic driving mode and the remote driving mode.

[0030] <Functions of the Vehicle Remote Operation System> As shown in Fig. 4, the vehicle control device 1, in terms of its functional aspects, mainly comprises a storage unit 100 that stores various programs and various data, an external information acquisition unit 101, an absolute position calculation unit 102, a relative position calculation unit 103, a corrected position calculation unit 104, a reception determination unit 105, a position identification unit 106, a video processing unit 107, a communication unit 108, a vehicle control unit 109, a speed calculation unit 110, and a position information selection unit 111. These are constituted by a CPU, a ROM, a RAM, an HDD, a communication interface, and various programs and the like.

[0031] Regarding the operation device 50 as well, in terms of its functional aspects, it mainly comprises a storage unit 500 that stores various programs and various data, a communication unit 501 that transmits and receives various data to and from the vehicle control device 1, a screen display unit 502 that displays the external video of the vehicle V and vehicle information on the monitor 51, and also displays the content based on the information of the current position of the vehicle V (for example, vehicle navigation) on the navigation monitor 52, an operation data creation unit 503 that receives the input of user operations and creates operation data, and a user notification unit 504 that notifies the user to the operator.

[0032] Hereinafter, the functions of the vehicle control device 1 will be described in detail. <<Main Functions>> The external information acquisition unit 101 acquires the "detection information of the external environment" around the vehicle V from the in-vehicle sensors 10, and also acquires the "measurement information of the current position" of the vehicle V from the in-vehicle locator 20. Specifically, as the "detection information of the external environment", it acquires the external video data around the vehicle V from the imaging device 11, acquires the detection result data of the target objects around the vehicle V from the radar 12, and acquires the distance measurement data that measures the distance to the target objects of the vehicle V from the lidar 13. Also, as the "measurement information of the current position", it acquires GNSS information (GNSS correction information) from the GNSS receiver 21, and acquires the information of the angular velocity and acceleration of the vehicle V from the inertial measurement unit 22. Note that the external information acquisition unit 101 may further acquire "vehicle information" of the vehicle V from the in-vehicle ECU 30. Examples of the "vehicle information" include "steering angle information" obtained from the steering wheel ECU 32, "throttle opening information" obtained from the accelerator ECU 33, "brake depression amount information" obtained from the brake ECU 34, and the like.

[0033] The absolute position calculation unit 102 acquires the above-mentioned "GNSS information" necessary for single-point positioning and calculates the "absolute position" of the vehicle V by single-point positioning. The "absolute position" of the vehicle V is a three-dimensional position of the vehicle V obtained by receiving GNSS radio waves from a plurality of artificial satellites SA, measuring the distances between the artificial satellites SA located at known points and the vehicle V, and solving a three-dimensional equation for obtaining an unknown point from the respective measured distances (corresponding to GNSS information). As shown in FIG. 5, the positional accuracy of the "absolute position" is about ±10 m.

[0034] The relative position calculation unit 103 acquires the above-mentioned "GNSS correction information" necessary for relative positioning, corrects the "absolute position" by relative positioning, and calculates the "relative position" of the vehicle V. The "relative position" of the vehicle V is a three-dimensional position of the vehicle V obtained by receiving GNSS radio waves also at a reference station ST located at a known point, acquiring distances with smaller measurement errors from the reference station ST (the distances between the respective artificial satellites SA and the vehicle V), and obtaining from the respective measured distances (corresponding to GNSS correction information). As shown in FIG. 5, the positional accuracy of the "relative position" is about ±40 cm, and the positional accuracy is higher than that of the absolute position. In FIG. 5, the "GNSS correction information" is expressed as "GNSS information + RTK information". As the calculation method of the "relative position", there are a calculation method of the RTK positioning method (interferometric positioning method) and a calculation method of the DGPS positioning method (relative positioning method). Any calculation method may be used. Note that the reference station ST is, in principle, the reference station installed at the position closest to the vehicle V among a plurality of reference stations ST located at known points.

[0035] The correction position calculation unit 104 acquires the above "angular velocity and acceleration information" of the vehicle V, and calculates a "corrected absolute position" obtained by correcting the absolute position of the vehicle V based on the "GNSS information" and the "acceleration and angular velocity information". The "corrected absolute position" of the vehicle V is a three-dimensional position of the vehicle V obtained by combining the GNSS information and the information on the angular velocity and acceleration of the vehicle V (also called IMU information) for positioning. The position accuracy of the "corrected absolute position" is higher than that of the absolute position.

[0036] In addition, the correction position calculation unit 104 calculates a "corrected relative position" obtained by correcting the relative position of the vehicle V based on the "GNSS correction information" and the "acceleration and angular velocity information". As shown in FIG. 5, the position accuracy of the "corrected relative position" is about ±5 cm, which is higher than the absolute position and the relative position. In FIG. 5, the "acceleration and angular velocity information" is expressed as "IMU information", and it is described as "GNSS information + RTK information + IMU information".

[0037] The reception determination unit 105 determines whether the GNSS information can be received in real time. If it is determined that the GNSS information can be received in real time, it then determines whether the GNSS correction information can be received in real time. Specifically, the reception determination unit 105 assumes a case where there are obstacles around the vehicle V and radio waves cannot be received from the artificial satellite SA, or a case where data cannot be transmitted and received with the reference station ST, and determines whether radio waves can be received from the artificial satellite SA and whether data can be transmitted and received with the reference station ST.

[0038] The position identification unit 106 identifies the current position of the vehicle based on the determination result by the reception determination unit 105. Specifically, as shown in FIG. 6, when the position specifying unit 106 determines that GNSS information and GNSS information can be received in real time (S3 in FIG. 6), it specifies the current position of the vehicle V using the "corrected relative position" with the highest position accuracy (S4 in FIG. 6). Also, when the position specifying unit 106 determines that GNSS information can be received in real time but GNSS correction information cannot be received in real time (S3 in FIG. 6), it specifies the current position of the vehicle V using the "corrected absolute position" with high position accuracy (S5 in FIG. 6). Furthermore, when the position specifying unit 106 determines that GNSS information and GNSS correction information cannot be received in real time (S2 in FIG. 6), it specifies the current position of the vehicle V using the "estimated position" calculated based on the "GNSS information" received immediately before and the "information on acceleration and angular velocity" (S6 in FIG. 6). Note that the "estimated position" is the three-dimensional position of the vehicle V calculated based on the "GNSS information" received immediately before and the "information on acceleration and angular velocity" from the past time point when the "GNSS information" was received to the current time point. The position accuracy of the "estimated position" is equivalent to the position accuracy of the "absolute position".

[0039] The video processing unit 107 acquires external video data of the vehicle V from a plurality of imaging devices 11a - 11i respectively, and creates a composite video (composite video data) by synthesizing each external video based on predetermined layout information. By generating the above composite video and transmitting the generated composite video data to the operating device 50, the amount of data to be transmitted can be reduced (the number of communication lines can be reduced) compared with the case of transmitting a plurality of external video data, and the cost associated with data communication can be reduced.

[0040] The communication unit 108 executes data transmission and reception between the vehicle control device 1 and the operating device 50 using the in-vehicle communication device 40. Specifically, the communication unit 108 transmits, to the operation device 50, the "detection information of the external environment" obtained by the external information acquisition unit 101 and the "information of the current position" specified by the position identification unit 106 as information necessary for the "remote driving" of the vehicle V. In addition, the communication unit 108 may also transmit the "vehicle information" obtained by the external information acquisition unit 101 to the operation device 50 together. Further, the communication unit 108 receives the driving operation information of the vehicle V from the operation device 50 that has received the user input by the operator.

[0041] The vehicle control unit 109 controls the integrated ECU 31 based on the "detection information of the external environment" obtained by the external information acquisition unit 101 and the "information of the current position" specified by the position identification unit 106, and executes the "automatic driving" of the vehicle V. Also, the vehicle control unit 109 controls the integrated ECU 31 based on the "driving operation information" of the vehicle V acquired from the operation device 50, and executes the "remote driving" of the vehicle V. In addition, when executing the "automatic driving" of the vehicle V, the vehicle control unit 109 may acquire the "vehicle information" of the vehicle V from the in-vehicle ECU 30, and further combine the "vehicle information" to control the integrated ECU 31.

[0042] <<Sub-function>> When specifying the current position of the vehicle V, in order to further improve the position accuracy, it is also possible to further acquire the "speed information" of the vehicle V. Specifically, the speed calculation unit 110 acquires the "angular velocity and acceleration information" of the vehicle V, and calculates the "speed" of the vehicle V by integrating the acceleration and the angular velocity. Then, the corrected position calculation unit 104 can calculate a "corrected absolute position" with higher position accuracy by combining the "GNSS information", the "angular velocity and acceleration information", and the newly acquired "speed information" for positioning. Alternatively, a "corrected relative position" can be calculated. In addition, when calculating the "speed" of the vehicle V, the speed calculation unit 110 may calculate the "speed" of the vehicle V by processing "GNSS information (GNSS correction information)" and "acceleration and angular velocity information" with a Kalman filter. In this way, the "speed" can be calculated with higher accuracy. In addition, when specifying the current position of the vehicle V, the "steering angle information" of the vehicle V may be acquired and further combined and calculated. For example, by newly installing a steering angle sensor on the vehicle V, the "steering angle information" can be acquired through the steering angle sensor. In addition, when acquiring the "speed information" of the vehicle V, a wheel speed sensor may be newly installed on the vehicle V, and the "speed information" may be acquired through the wheel speed sensor.

[0043] Also, when executing "automatic driving" or "remote driving" of the vehicle V in an environment where there are no obstacles around the vehicle V, it may be preferable to prioritize reducing the data communication volume and the cost associated with data communication over the position accuracy of the current position of the vehicle V. Specifically, the position information selection unit 111 selects whether to use the "relative position" or the "corrected relative position" based on the detection information of the external environment obtained by the external information acquisition unit 101 before S7 in FIG. 6. More specifically, when there are no moving objects or buildings (structures) around the vehicle V in the detection information of the external environment (for example, when driving in the wilderness or grassland), it is advisable to select the "relative position" in order to suppress the data communication volume of the vehicle control device 1. That is, it is acceptable not to acquire the angular velocity and acceleration information of the vehicle V (the measurement of the angular velocity and acceleration may be temporarily interrupted). Alternatively, when there are moving objects or buildings around the vehicle V in the detection information of the external environment (for example, when driving in an urban area), it is advisable to prioritize the position accuracy of the current position of the vehicle V and select the "corrected relative position". In this way, the method for specifying the current position of the vehicle V can be appropriately selected according to the external environment around the vehicle V. The selection by the position information selection unit 111 may be made according to preset selection conditions or user-set selection conditions.

[0044] With the above configuration, it is possible to realize a vehicle remote operation system that can flexibly measure the position information of the vehicle V according to the external environment (radio wave situation and data communication situation) around the vehicle V and specify the current position with higher position accuracy.

[0045] <Vehicle Remote Operation Method> Next, the processing of the vehicle remote operation program (vehicle remote operation method) executed by the vehicle remote operation system S will be described with reference to FIG. 6. The above program according to the present embodiment is a program for realizing the above-described external information acquisition unit 101, absolute position calculation unit 102, relative position calculation unit 103, correction position calculation unit 104, reception determination unit 105, position specification unit 106, video processing unit 107, communication unit 108, and vehicle control unit 109 as functional components of the vehicle control device 1 including the storage unit 100, and the CPU of the vehicle control device 1 executes this vehicle maintenance support program. The above program is executed by receiving an operation instruction from a user (specifically, a driver or an operator).

[0046] In the vehicle remote operation flow shown in FIG. 6, first, the external information acquisition unit 101 starts acquiring "GNSS information" through the GNSS receiver 21 from step S1. Actually, the external information acquisition unit 101 starts acquiring "GNSS information" and "GNSS correction information" through the GNSS receiver 21, and also starts acquiring "angular velocity and acceleration information" of the vehicle V through the inertial measurement device 22. In addition, the external information acquisition unit 101 also starts acquiring "detection information of the external environment" around the vehicle V from the in-vehicle sensor 10.

[0047] Next, in step S2, the reception determination unit 105 determines whether GNSS information can be received in real time. When it is determined that "GNSS information" can be received (step S2: Yes), the process proceeds to step S3, and then the reception determination unit 105 determines whether "GNSS correction information" can be received in real time. When the reception determination unit 105 determines that "GNSS correction information" can also be received (step S3: Yes), the process proceeds to step S4.

[0048] In step S4, the absolute position calculation unit 102, the relative position calculation unit 103, and the correction position calculation unit 104 calculate the "corrected relative position (relative position)" of the vehicle V. Specifically, first, the absolute position calculation unit 102 acquires "GNSS information" and calculates the "absolute position" of the vehicle V by single positioning. Then, the relative position calculation unit 103 acquires "GNSS correction information" and calculates the "relative position" of the vehicle V by relative positioning. Then, the correction position calculation unit 104 acquires "information on angular velocity and acceleration" and calculates the "corrected relative position" obtained by correcting the relative position of the vehicle V. Then, the process proceeds to step S7. The "corrected relative position" is the position information with the highest position accuracy.

[0049] In step S3 above, when the reception determination unit 105 determines that "GNSS correction information" cannot be received (step S3: No), the process proceeds to step S5. In step S5, the absolute position calculation unit 102 and the correction position calculation unit 104 calculate the "absolute corrected position (absolute position)" of the vehicle V. Specifically, first, the absolute position calculation unit 102 acquires "GNSS information" and calculates the "absolute position" of the vehicle V by single positioning. Then, the correction position calculation unit 104 acquires "information on angular velocity and acceleration" and calculates the "corrected absolute position" obtained by correcting the absolute position of the vehicle V. Then, the process proceeds to step S7.

[0050] In step S2 above, when the reception determination unit 105 determines that "GNSS information" cannot be received (step S2: No), the process proceeds to step S6. In step S6, the position identification unit 106 calculates the "estimated position" of the vehicle V. Specifically, the position identification unit 106 calculates an "estimated position" based on the "GNSS information" received immediately before and the "acceleration and angular velocity information" (corresponding to an estimated position calculation unit). Then, it proceeds to step S7.

[0051] Next, in step S7, the position identification unit 106 identifies the current position of the vehicle V using the calculated position information. When proceeding from step S4 above, the position identification unit 106 identifies the current position of the vehicle V using the "corrected relative position" with the highest position accuracy. When proceeding from step S5 above, the position identification unit 106 identifies the current position of the vehicle V using the "corrected absolute position". When proceeding from step S6 above, the position identification unit 106 identifies the current position of the vehicle V using the "estimated position".

[0052] Next, in step S8, the communication unit 108 transmits, as information necessary for the "remote operation" of the vehicle V, the "current position information" identified by the position identification unit 106 and the "external environment detection information" obtained by the external information acquisition unit 101 to the operation device 50. Note that the operation device 50 receives these pieces of information, displays the content based on the current position information and the external environment detection information on the monitor 51 and the navigation monitor 52, and gives user notification to the operator as necessary.

[0053] If, while going through steps S1 to S8 above, the user's stop of the remote operation is finally received (step S9: Yes), the process in FIG. 6 is terminated. On the other hand, if the stop of the remote operation has not been received (step S9: No), it returns to step S2. With the configuration of the vehicle remote operation program described above, it becomes possible to more accurately measure the current position of the vehicle V in accordance with the external environment around the vehicle V.

[0054] <Other Embodiments> In the above-described embodiment, as shown in FIG. 2, the vehicle remote operation system S includes the vehicle control device 1 and the in-vehicle ECU 30, and the "remote operation function (vehicle control device 1)" is newly added to the vehicle V equipped with the "automatic driving function (in-vehicle ECU 30)", but it can be changed without being particularly limited. For example, the vehicle control device 1 may also have the functions of the in-vehicle ECU 30. That is, the vehicle remote operation system S may mainly be composed of the vehicle control device 1 (including the functions of the in-vehicle ECU 30), the in-vehicle sensor 10, the in-vehicle locator 20, the in-vehicle communication device 40, and the operation device 50 (the in-vehicle ECU 30 may be removed from the configuration).

[0055] In the above-described embodiment, as shown in FIG. 2, the vehicle remote operation system S includes the vehicle control device 1 and the in-vehicle locator 20, but without being particularly limited, the vehicle control device 1 may have the in-vehicle locator 20. In that case, it is preferable that the in-vehicle locator 20 has an absolute position calculation unit 102 that calculates the absolute position of the vehicle V, a relative position calculation unit 103 that calculates the relative position of the vehicle V, and a corrected position calculation unit 104 that calculates the corrected relative position of the vehicle V. And it is preferable that the vehicle control device 1 acquires the information of the absolute position, relative position, and corrected relative position of the vehicle V respectively.

[0056] In the above-described embodiment, as shown in FIGS. 2 and 4, the corrected position calculation unit 104 acquires the information of the acceleration and angular velocity of the vehicle V from the inertial measurement device 22 and calculates the corrected relative position of the vehicle V, but it can be changed without being particularly limited. For example, when the vehicle control device 1 specifies the current position of the vehicle V, it may not acquire (use) the information of the acceleration and angular velocity of the vehicle V. In that case, the current position of the vehicle V will be specified using the "absolute position" and "relative position" of the vehicle V. Also, for example, when the vehicle control device 1 specifies the current position of the vehicle V, it may not acquire (use) the information of the acceleration and angular velocity of the vehicle V and may acquire (use) the information of the speed of the vehicle V.

[0057] In the above embodiment, as shown in FIG. 2, the imaging device 11 detects information on the external environment around the vehicle V as part of the in-vehicle sensor 10. However, without being particularly limited, the imaging device 11 may only acquire an external image around the vehicle V. That is, the radar 12 and the lidar 13 may function as the in-vehicle sensor 10 to detect information on the external environment around the vehicle V.

[0058] In the above embodiment, a vehicle remote operation program is stored in a recording medium readable by the vehicle control device 1, and the process is executed by the vehicle control device 1 reading and executing the program. Here, the recording medium readable by the vehicle control device 1 refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. In addition, it may be possible to start a dedicated web app using a terminal (portable terminal) that serves as the vehicle control device 1 and execute the vehicle remote operation program on a web browser.

[0059] In the above embodiment, the vehicle remote operation system and the vehicle remote operation method according to the present invention have been mainly described. However, the above embodiment is merely an example for facilitating the understanding of the present invention and does not limit the present invention. The present invention can be changed and improved without departing from its gist, and it goes without saying that equivalents of the present invention are included therein.

Explanation of Reference Numerals

[0060] S Vehicle remote operation system V Vehicle V1 Electric power steering V1a Steering wheel V2 Electric throttle V2a Accelerator pedal V3 Electromagnetic brake device V3a Brake pedal 1 Vehicle control device 10 In-vehicle sensor 11 Imaging device 11a - 11i, First to Ninth Imaging Devices 12, Radar (Millimeter - Wave Radar) 12a - 12d, First to Fourth Radars 13, LiDAR 13a - 13e, First to Fifth LiDARs 20, Vehicle - Mounted Locator 21, GNSS Receiver (RTK - GNSS Receiver) 22, Inertial Measurement Unit (IMU) 30, Vehicle - Mounted ECU 31, Integrated ECU 32, Steering Wheel ECU 33, Accelerator ECU 34, Brake ECU 40, Vehicle - Mounted Communication Device 50, Operating Device 51, Display Monitor 52, Display Navigation Monitor 53, Steering Wheel 54, Accelerator Pedal 55, Brake Pedal 56, Operation Switch 100, Storage Unit 101, External Information Acquisition Unit 102, Absolute Position Calculation Unit 103, Relative Position Calculation Unit 104, Corrected Position Calculation Unit 105, Reception Judgment Unit 106, Position Identification Unit 107, Image Processing Unit 108, Communication Unit (First Communication Unit) 109, Vehicle Control Unit 110, Speed Calculation Unit 111, Position Information Selection Unit 500, Storage Unit 501, Communication Unit (Second Communication Unit) 502, Screen Display Unit 503, Operation Data Creation Unit 504, User Notification Unit SA, Artificial Satellite ST, Reference Station

Claims

1. A vehicle control device for controlling the running of a vehicle equipped with a radar for detecting an object, comprising: a process of acquiring GNSS information using a GNSS receiver mounted on the vehicle from a satellite and calculating an absolute position of the vehicle based on the position of the satellite; a process of acquiring GNSS correction information for correcting an error of the GNSS information from a reference station located at a known point, correcting the absolute position, and calculating a relative position of the vehicle indicating a relative position with respect to the reference station located at the known point; a process of calculating a corrected relative position of the vehicle based on the GNSS correction information and three-dimensional angular velocity and acceleration acquired from an inertial measurement device mounted on the vehicle; a process of controlling the running of the vehicle using the position information of the vehicle based on the absolute position or the relative position; a process of acquiring information on the external environment of the vehicle from the radar, and the process of controlling the running of the vehicle uses, as the information on the external environment, position information based on the relative position to control the running of the vehicle when the object does not exist according to the detection information by the radar, and uses, as the information on the external environment, position information based on the corrected relative position to control the running of the vehicle when the object exists according to the detection information by the radar.

2. A computer for controlling the running of a vehicle equipped with a radar for detecting an object, which executes a process of acquiring GNSS information using a GNSS receiver mounted on the vehicle from a satellite and calculating an absolute position of the vehicle based on the position of the satellite; a process of acquiring GNSS correction information for correcting an error of the GNSS information from a reference station located at a known point, correcting the absolute position, and calculating a relative position of the vehicle indicating a relative position with respect to the reference station located at the known point; a process of calculating a corrected relative position of the vehicle based on the GNSS correction information and three-dimensional angular velocity and acceleration acquired from an inertial measurement device mounted on the vehicle; a process of controlling the running of the vehicle using the position information of the vehicle based on the absolute position or the relative position; a process of acquiring information on the external environment of the vehicle from the radar, In the process of controlling the running of the vehicle, as information on the external environment, when the object does not exist based on the detection information by the radar, the running of the vehicle is controlled using the position information based on the relative position, and as information on the external environment, when the object exists based on the detection information by the radar, the running of the vehicle is controlled using the position information based on the corrected relative position. A vehicle control method including this.

3. In a computer that controls the running of a vehicle equipped with a radar for detecting an object, a process of acquiring GNSS information using a GNSS receiver mounted on the vehicle from an artificial satellite and calculating an absolute position of the vehicle with reference to the position of the artificial satellite; a process of acquiring GNSS correction information for correcting an error in the GNSS information from a reference station located at a known point, correcting the absolute position, and calculating a relative position of the vehicle indicating a relative position with respect to the reference station located at the known point; a process of calculating a corrected relative position of the vehicle based on the GNSS correction information and a three-dimensional angular velocity and acceleration acquired from an inertial measurement device mounted on the vehicle; a process of controlling the running of the vehicle using the position information of the vehicle based on the absolute position or the relative position; a process of acquiring information on the external environment of the vehicle from the radar, and causing the computer to execute the processes. In the process of controlling the running of the vehicle, as information on the external environment, when the object does not exist based on the detection information by the radar, the running of the vehicle is controlled using the position information based on the relative position, and as information on the external environment, when the object exists based on the detection information by the radar, the running of the vehicle is controlled using the position information based on the corrected relative position. A vehicle control program including this.

Images