MOBILITY CONTROL DEVICE, MOBILITY CONTROL METHOD, AND MOBILITY CONTROL PROGRAM

Abstract

To provide a movement control device capable of more accurately estimating the current position of a moving body.SOLUTION: A movement control device 1 controls the movement of a vehicle V on the basis of information on the current position of the vehicle V. Specifically, the movement control device 1 comprises: an own-position estimating section that estimates the current position of the vehicle V on the basis of GNSS information; an environment information acquiring section that acquires environment information around the vehicle V; and a movement information acquiring section that acquires movement information of the vehicle V. The own-position estimating section estimates the current position of the vehicle V on the basis of the environment information when the GNSS information cannot be acquired. The own-position estimating section also estimates the current position of the vehicle V on the basis of the movement information when the GNSS information and the environment information cannot be acquired.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a mobile control device, a mobile control method, and a mobile control program. [Background technology]

[0002] In recent years, vehicles equipped with ADAS (Advanced Driver Assistance System) that enables the vehicle itself to grasp information about the external environment around it, control the vehicle's driving on behalf of the driver, and drive autonomously to ensure driver safety and comfort have become known (see, for example, Patent Document 1).

[0003] In the automatic operation method described in Patent Document 1, a GPS signal is received while the vehicle is traveling to acquire the current position (absolute position) of the vehicle in real time, and when the reliability of the vehicle's position accuracy decreases, the absolute position is corrected by aligning the coordinates and azimuth angle based on the GPS (Satellite Positioning System) with the coordinates and azimuth angle based on an inertial measurement unit (IMU). Then, the traveling of the vehicle is controlled based on the information on the current position of the vehicle. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-32873 A Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, in the case of the travel control of a moving object as described in Patent Document 1, there has been a demand for a technology that can estimate the current position of a moving object with higher accuracy even in an external environment where a GPS signal (GNSS information) cannot be acquired. There has also been a demand for using this technology in the travel control of a moving object and in a navigation service that provides a driver or operator with guidance on a route to a destination.

[0006] The present invention has been made in consideration of the above-mentioned problems, and an object of the present invention is to provide a mobile control device, a mobile control method, and a mobile control program that are capable of more accurately estimating the current position of a moving body. [Means for solving the problem]

[0007] The above-mentioned problem is solved by a mobile control device of the present invention, which is a mobile control device that controls the movement of a moving body, comprising: a self-position estimation unit that acquires GNSS information through a GNSS receiver mounted on the moving body and estimates a current position of the moving body based on the GNSS information; and an environmental information acquisition unit that acquires environmental information around the moving body through a sensor mounted on the moving body; a direction of travel recognition unit that recognizes a direction of travel of the moving object; and when the GNSS information cannot be acquired, the self-position estimation unit estimates a current position of the moving object based on the environmental information acquired by the environmental information acquisition unit, and the mobile control device A first traveling direction is recognized by the traveling direction recognition unit, and identifying, as a first reference point, a position changed from a first estimated state in which the self-location estimation unit estimates the current position of the moving object based on the GNSS information to a second estimated state in which the self-location estimation unit estimates the current position of the moving object based on the environmental information; The travel direction recognition unit recognizes a second travel direction different from the first travel direction, and a reference point specifying unit that specifies a position changed from the second estimated state to the first estimated state as a second reference point different from the first reference point; , the moving direction of the moving body is recognized, and the estimated state is changed. standard Points a reference point recording unit for recording the reference point recorded by the reference point recording unit; To the point and a switching unit that switches an estimation state by the self-location estimation unit based on the environmental information, wherein the switching unit switches from the first estimation state to the second estimation state when the moving object reaches the first reference point or when the moving object reaches within a certain distance from the first reference point, and the self-location estimation unit estimates a current position of the moving object based on the environmental information using the second estimation state to which the switching has been performed. The mobile control device controls the movement of the mobile object based on the current position of the mobile object estimated by the self-position estimation unit and the traveling direction of the mobile object recognized by the traveling direction recognition unit. This problem is solved by: According to a mobile control device of the present invention, there is provided a mobile control device for controlling the movement of a moving body, the mobile control device including: a self-position estimation unit that acquires GNSS information through a GNSS receiver mounted on the moving body and estimates a current position of the moving body based on the GNSS information; and an environmental information acquisition unit that acquires environmental information around the moving body through a sensor mounted on the moving body. a direction of travel recognition unit that recognizes a direction of travel of the moving object; and when the GNSS information cannot be acquired, the self-position estimation unit estimates a current position of the moving object based on the environmental information acquired by the environmental information acquisition unit, and the mobile control device A first traveling direction is recognized by the traveling direction recognition unit, and identifying, as a first reference point, a position changed from a first estimated state in which the self-location estimation unit estimates the current position of the moving object based on the GNSS information to a second estimated state in which the self-location estimation unit estimates the current position of the moving object based on the environmental information; The travel direction recognition unit recognizes a second travel direction different from the first travel direction, and a reference point specifying unit that specifies a position changed from the second estimated state to the first estimated state as a second reference point different from the first reference point; , the moving direction of the moving body is recognized, and the estimated state is changed. standard Points a reference point recording unit for recording the reference point recorded by the reference point recording unit; To the point and a switching unit that switches an estimation state by the self-location estimation unit based on the GNSS information, wherein the switching unit switches from the second estimation state to the first estimation state when the moving object reaches the second reference point or when the moving object reaches within a certain distance from the second reference point, and the self-location estimation unit estimates a current position of the moving object based on the GNSS information in accordance with the switched first estimation state. The mobile control device controls the movement of the mobile object based on the current position of the mobile object estimated by the self-position estimation unit and the traveling direction of the mobile object recognized by the traveling direction recognition unit. This problem is solved by: As described above, the self-location estimation unit estimates the current location of the moving object based on GNSS information, and when the GNSS information cannot be acquired, estimates the current location of the moving object based on environmental information. In this way, a mobile control device that can estimate the current location of the moving object more accurately according to the surrounding environment of the moving object can be realized.

[0008] The above-mentioned problem is solved by a mobility control method of the present invention, which is executed by a computer that controls the movement of a moving body, and the computer acquires GNSS information through a GNSS receiver mounted on the moving body, estimates a current position of the moving body based on the GNSS information, acquires environmental information around the moving body through a sensor mounted on the moving body, and Recognizing a direction of travel of the moving object; and estimating the current position of the moving object based on the environmental information when the GNSS information cannot be acquired, and the computer A first direction of travel is recognized, and Identifying, as a first reference point, a position changed from a first estimation state in which the current position of the moving object is estimated based on the GNSS information to a second estimation state in which the current position of the moving object is estimated based on the environmental information; A second direction of travel different from the first direction of travel is recognized; and identifying a position changed from the second estimated state to the first estimated state as a second reference point different from the first reference point; , the moving direction of the moving body is recognized, and the estimated state is changed. standard Points Recording and said recorded criteria To the point and switching an estimation state based on the environmental information, in which when switching the estimation state, when the moving body reaches the first reference point or when the moving body reaches within a certain distance from the first reference point, the first estimation state is switched to the second estimation state, and when estimating a current position of the moving body, the current position of the moving body is estimated based on the environmental information using the second estimation state to which the state has been switched. The computer executes controlling the movement of the moving object based on the estimated current position of the moving object and the recognized traveling direction of the moving object. This can also be solved by:

[0009] In addition, according to the mobility control program of the present invention, the above problem is solved by providing a computer as a mobility control device that controls the movement of a mobile object with a process of acquiring GNSS information through a GNSS receiver mounted on the mobile object and estimating a current position of the mobile object based on the GNSS information, and a process of acquiring environmental information around the mobile object through a sensor mounted on the mobile object. A process of recognizing a traveling direction of the moving object;In the process of estimating the current position of the moving object, when the GNSS information cannot be acquired, the current position of the moving object is estimated based on the environmental information, and the computer is caused to A first direction of travel is recognized, and Identifying, as a first reference point, a position changed from a first estimation state in which the current position of the moving object is estimated based on the GNSS information to a second estimation state in which the current position of the moving object is estimated based on the environmental information; A second direction of travel different from the first direction of travel is recognized; and a process of identifying a position changed from the second estimated state to the first estimated state as a second reference point different from the first reference point; , the moving direction of the moving body is recognized, and the estimated state is changed. standard Points The process to be recorded and the criteria recorded To the point and a process of switching an estimated state based on the environmental information, in which the process of switching the estimated state switches from the first estimated state to the second estimated state when the moving object reaches the first reference point or when the moving object reaches within a certain distance from the first reference point, and in which the process of estimating the current position of the moving object estimates the current position of the moving object based on the environmental information using the second estimated state to which the process has been switched. and causing the computer to execute a process of controlling the movement of the moving object based on the estimated current position of the moving object and the recognized traveling direction of the moving object. This can also be solved by: Effect of the Invention

[0010] According to the mobile control device, the mobile control method, and the mobile control program of the present invention, it becomes possible to estimate the current position of a mobile object more accurately. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram showing the overall configuration of a cruise control system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of a driving control device. [Figure 3A] FIG. 2 is a diagram illustrating a hardware configuration of an information transmission device. [Figure 3B] FIG. 2 is a diagram showing the positions of identification marks attached to a target vehicle. [Figure 3C] FIG. 2 is a diagram showing the positions of identification marks attached to a target vehicle. [Figure 4] FIG. 2 is a diagram illustrating a hardware configuration of a remote control device. [Diagram 5] FIG. 2 is a diagram illustrating the functions of a driving control device, an information transmission device, and a remote control device. [Figure 6] FIG. 2 is a diagram showing map information, illustrating a vehicle travel route and reference points. [Figure 7] 13 is a diagram illustrating a state when the vehicle travels from the third space to the first space. FIG. [Figure 8] 10A and 10B are diagrams illustrating the relationship between the change in the self-location estimation of the vehicle and the traveling direction of the vehicle. [Figure 9] FIG. 13 is a diagram showing map information, illustrating recognition of a reference point and a traveling direction. [Figure 10A] FIG. 2 is a diagram illustrating a state in which autonomous driving control is being performed. [Figure 10B] FIG. 13 is a diagram illustrating a state in which autonomous driving control is changed to relative driving control. [Figure 10C] 11 is a diagram illustrating a state in which the relative driving control is changed to the autonomous driving control and the moving body overtakes the target vehicle. FIG. [Figure 11] FIG. 4 is a diagram showing vehicle distance data. [Figure 12] FIG. 2 is a process flow diagram showing a driving control method (1). [Figure 13] FIG. 11 is a process flow diagram showing a driving control method (2). [Figure 14] FIG. 11 is a process flow diagram showing a driving control method (3). [Figure 15] FIG. 11 is a process flow diagram showing a driving control method (4). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <Overall configuration of the driving control system (mobility control system)> Hereinafter, one embodiment of the present invention will be described with reference to FIGS. In this embodiment, a vehicle will be used as an example of a "mobile body" for explanation. In addition to automobiles, a "mobile body" may be a vehicle such as a bus or truck, a railway vehicle such as a train or steam train, or a vehicle such as an airplane or ship. Alternatively, it may be an unmanned mobile body such as a drone. Since a vehicle is used as an example of a "mobile body" for explanation, the movement of a position (point) is expressed as "traveling" in the following description. Not limited to this, depending on the type of the "mobile body", it may be appropriate to express it as "navigating" or "flying", and the expression will be substituted as appropriate. In addition, these can be collectively expressed as "movement".

[0013] As shown in FIG. 1, the driving control system S (mobile control system) of this embodiment is a system that realizes "automatic driving" in which the external environment of the vehicle V is grasped, the planned driving route (also referred to as the "planned travel route") of the vehicle V is planned on behalf of the driver, and the vehicle V is controlled to drive (also referred to as "move") along the planned driving route, and "following driving" in which the vehicle V is made to follow a specified target vehicle FV, and is capable of performing a "mode switching process" to switch between the automatic driving control mode and the following driving control mode. The "follow-up operation (follow-up operation control)" may be called "relative operation (relative operation control)." In the present embodiment, the "relative operation" will be referred to hereinafter in the description. In addition, in this embodiment, the "automatic driving control mode (first driving control mode)" will be simply referred to as the "automatic driving mode", and the "following driving control mode (second driving control mode)" will be simply referred to as the "relative driving mode".

[0014] "Autonomous driving (autonomous driving mode)" includes "autonomous driving (autonomous driving mode)" in which the vehicle V is controlled to drive (move) autonomously, and "remote driving (remote driving mode)" in which an operator outside the vehicle V remotely controls (externally controls) the vehicle V to drive it. In other words, "autonomous driving" and "remote driving" are collectively referred to as "autonomous driving." Basically, when referring to autonomous driving, it is explained as meaning autonomous driving. In addition, in remote operation, the operator does not have to be human, but may be AI (artificial intelligence).

[0015] In addition to the above-mentioned "automatic driving" and "relative driving," there is also "manual driving (manual driving mode)," in which the driver actually drives the vehicle V. In the above-mentioned mode switching process, in addition to switching between the "manual driving mode" and the "automatic driving mode," it is also possible to switch between the "manual driving mode" and the "relative driving mode."

[0016] It should be noted that "vehicle V" is a vehicle equipped with a cruise control device 1 described below and equipped with an automatic driving function and a relative driving function. The "target vehicle FV" is a vehicle that is equipped with a vehicle information transmission device 50 described below and is traveling (moving) in a state where it is capable of transmitting vehicle information (specifically, vehicle identification information, current location information, and information on the planned driving route) via communication. The target vehicle FV is not limited to a leading vehicle that runs (moves) ahead of the vehicle V, but may be a vehicle running alongside the vehicle V. Alternatively, the target vehicle FV may be a trailing vehicle that runs behind the vehicle V. The target vehicle FV may be, for example, a bus, a taxi, a truck, etc. that runs along a preset planned driving route, a circular bus that runs along a predetermined circular route, etc. Of course, it may also be other general vehicles.

[0017] <Hardware configuration of the driving control system (mobility control system)> As shown in Figures 1 to 4, the driving control system S is equipped with a driving control device 1 (mobile control device) that is mounted on a vehicle V and comprehensively controls the driving of the vehicle V, an on-board sensor 10 that detects the external environment around the vehicle V, an on-board locator 20 that receives GNSS signals from an artificial satellite SA and a reference station ST and measures the current position of the vehicle V, an on-board ECU 30 that controls the steering, acceleration, deceleration, etc. of the vehicle V, and an on-board communication device 40 that communicates with external devices. The driving control system S also includes a vehicle information transmission device 50 that is mounted on the target vehicle FV, connected to the driving control device 1, and transmits target vehicle information including location information of the target vehicle FV via communication, and an identification mark 60 that is attached to the target vehicle FV and has vehicle identification information of the target vehicle FV embedded therein. In addition, the vehicle V may further include the vehicle information transmission device 50 and the identification mark 60 provided in the target vehicle FV, and the target vehicle FV may further include the on-board sensor 10, on-board locator 20, on-board ECU 30, and on-board communication device 40 provided in the vehicle V. In other words, the vehicle V and the target vehicle FV may have the same configuration, which makes it possible for the vehicle V and the target vehicle FV to be interchangeable and to configure the driving control system S. Furthermore, the driving control system S includes a remote control device 70 that is installed outside the vehicle V and that controls (remotely controls) the driving (movement) of the vehicle V by communicating with the driving control device 1. The driving control device 1, the vehicle information transmission device 50, and the remote control device 70 may communicate directly with each other.

[0018] <Drive control device (movement control device)> As shown in FIG. 2, the driving control device 1 is a computer connected to an on-vehicle sensor 10, an on-vehicle locator 20, an on-vehicle ECU 30, and an on-vehicle communication device 40 via an on-vehicle network (CAN). Specifically, the driving control device 1 is a computer equipped with a CPU (processor) as a data calculation and control processing device, ROM, RAM and HDD (SSD) as storage devices, and a communication interface for sending and receiving information data via an in-vehicle network. In addition to a main program that performs the functions required of a computer, a driving control program is stored in the storage device (memory) of the driving control device 1, and these programs are executed by a CPU (processor) to perform the functions of the driving control device 1. Alternatively, they may be executed by a semiconductor integrated circuit or a field-programmable gate array (FPGA) that implements a CPU. The in-vehicle ECU 30 (integrated ECU 31), the vehicle information transmission device 50, and the remote control device 70 are also computers having similar hardware configurations.

[0019] <<Autonomous driving, relative driving, remote driving>> In order to perform "autonomous driving," the driving control device 1 controls the "autonomous driving" of the vehicle V by controlling the on-board ECU 30 (overall ECU 31) based on external environmental information obtained from the on-board sensor 10, position information and driving information of the vehicle V obtained from the on-board locator 20, and vehicle information obtained from the on-board ECU 30. Furthermore, in order to perform "relative driving (following driving)", the driving control device 1 wirelessly communicates with the vehicle information transmission device 50 via the in-vehicle communication device 40 and receives target vehicle information including position information of a predetermined target vehicle FV. Then, the driving control device 1 controls the "relative driving (following driving)" of the vehicle V relative to the target vehicle FV by controlling the in-vehicle ECU 30 (overall ECU 31) based on external environmental information, the position information of the vehicle V, and the target vehicle information including the position information of the target vehicle FV. In addition, in order to execute "remote driving", the driving control device 1 wirelessly communicates with the remote operation device 70 via the in-vehicle communication device 40, and transmits external environmental information, position information and driving information of the vehicle V, and vehicle information to the remote operation device 70. The remote operation device 70 receives this information, and displays content based on the external environmental information and the position information of the vehicle V on the monitor 71 (navigation monitor 72), as well as providing a user notification to the operator.

[0020] More specifically, the driving control device 1 is newly installed on a vehicle V that is already equipped with an "autonomous driving function (on-vehicle sensor 10, on-vehicle locator 20, on-vehicle ECU 30)," thereby improving the performance of the existing "autonomous driving function" and adding new "relative driving function" and "remote driving function."

[0021] <<Drive control using map information>> In order to perform "autonomous driving," "relative driving," and "remote driving," the driving control device 1 estimates its own position using the "map information" shown in Figure 6, and performs driving control (also referred to as "mobility control") of the vehicle V while accurately estimating the position information of the vehicle V (hereinafter also referred to as the "current position" or "local point"). In detail, the driving control device 1 uses "map information" including information on "reference points (first reference point, second reference point)" to recognize the "space (first space, second space, third space)" reached upon reaching the reference point, performs a suitable self-location estimation according to the space, and performs an estimation process for position information of the vehicle V and driving control of the vehicle V. Of course, driving control of the vehicle V may be performed while estimating the position information of the vehicle V.

[0022] The "space (first space, second space, third space)" is a division based on the difference in the method of self-location estimation in the above-ground space (or underground space), and the method of self-location estimation by the vehicle V (cruise control device 1) differs depending on the space. Note that the "space" may be expressed as a "region" or a "specific range", etc. The "first space" refers to a space in which, when the vehicle V exists, the vehicle V (cruising control device 1) can acquire GNSS information through external communication and can estimate its own position based on the GNSS information. The state in which the self-position can be estimated based on the GNSS information is, for example, a state in which, when the reception sensitivity level of the GNSS information (GNSS signal) is measured, the sensitivity level is at a certain level (above a certain level). The "first space" may be referred to as, for example, the "outdoors (outdoor space)" and it may be expressed that the vehicle V exists (is located) outdoors (outdoor space).

[0023] The "second space" refers to a space in which, when the vehicle V exists in the space, the vehicle V (cruising control device 1) does not communicate with the outside, the vehicle can acquire external environmental information by itself, and can estimate its own position based on the environmental information. In other words, the "second space" refers to a space in which the vehicle V cannot estimate its own position based on GNSS information (a state in which the reception sensitivity level of the GNSS signal is below a certain level). The state in which the vehicle's own position can be estimated based on environmental information is, for example, a state in which the vehicle V (the on-board sensor 10) can detect the external environment around the vehicle V and perform three-dimensional spatial mapping. It should be noted that the "second space" and the "third space" may be referred to as, for example, "indoors (indoor space)" and it may be expressed that the vehicle V is present indoors (indoor space).

[0024] The "third space" refers to a space in which, when the vehicle V exists within the space, the vehicle V (cruising control device 1) does not communicate with the outside, does not acquire external environmental information by itself, acquires driving information of the vehicle V, and estimates its own position based on the driving information. In other words, the "third space" refers to a space in which the vehicle V is in a state in which it cannot estimate its own position based on GNSS information (a state in which it cannot communicate with the outside), and in which the vehicle V is in a state in which it cannot acquire external environmental information at a certain level or above. The state in which external communication is not possible and external environmental information cannot be obtained is, for example, a state in which the vehicle V is located in a tunnel or under an overpass, a state immediately after the vehicle V moves from the "first space" to the "second space", or a state immediately after the vehicle V moves from the "second space" to the "first space". In this state, the vehicle V obtains driving information of the vehicle V by the inertial measurement device 22. If the inertial measurement device 22 is unable to acquire driving information for the vehicle V while the above condition continues for a certain period of time or longer, the vehicle V (driving control device 1) recognizes that a malfunction or a fatal error has occurred in the vehicle V, and terminates the driving control process.

[0025] In the above, "when vehicle V is present within a space" refers to when the vehicle's position information (current position) belongs to that space (area), and when the vehicle's position information is expressed as "vehicle position range information", it refers to when at least a part of the vehicle position range information belongs to that space. In addition, "when vehicle V is not present in the space" refers to a time when the vehicle's position information (current position) does not belong to that space (area), and when the vehicle's position information is expressed as "vehicle position range information," it refers to a time when all of the vehicle position range information does not belong to that space.

[0026] The vehicle V (cruising control device 1) recognizes that the map information (the first space, the second space, and the third space) are continuous. Therefore, when the vehicle V travels to a different space, the vehicle V does not search for the space from all of the map information stored in the vehicle V. In the "map information", the second space and the third space exist within the first space, as shown in Fig. 6. Therefore, even when the vehicle V is traveling "indoors (second space, third space)", the coordinates based on the GNSS information (GNSS coordinates) can be grasped based on the "reference point".

[0027] Incidentally, when the vehicle V has just moved from the "first space" to the "second space", the vehicle V switches from self-location estimation based on GNSS information to self-location estimation based on environmental information, and there is a slight time lag in the timing of the switch (the vehicle V becomes lost). The same is true for the state immediately after moving from the "second space" to the "first space". Therefore, at the timing of the switch, the vehicle V (cruising control device 1) temporarily estimates its own location based on the driving information of the vehicle V and controls the driving of the vehicle V, and it is desirable to estimate its own location more accurately. Therefore, as shown in FIG. 6, the driving control device 1 uses "map information" including information on the above-mentioned "reference points (first reference point, second reference point)" and recognizes the "space (first space, second space, third space)" upon reaching the reference point, and performs self-position estimation according to the space. In addition, when estimating its own position after switching the "reference point," the driving control device 1 can improve the accuracy of its own position estimation and the exploration speed by limiting the exploration range of "indoors (second space, third space)" based on the position and direction of travel before switching the "reference point" (it does not explore the entire "indoors" area).

[0028] The "reference point" indicates a position (entrance / exit position, reference position) when the vehicle V enters or exits a different space among the above-mentioned "first space", "second space", and "third space", and when the vehicle V reaches the reference point, the method of self-position estimation by the vehicle V (cruise control device 1) is switched. The "reference point" is recorded in the map information of FIG. 6. The "first reference point", also referred to as the entrance reference point, is a position (reference position) that indicates the "entrance to the second space" when a vehicle V traveling in the first space moves from the first space to the second space. In other words, the "first reference point" is a position (switching position) where the traveling vehicle V (cruising control device 1) changes from a state (first estimation state) in which the current position is estimated based on GNSS information to a state (second estimation state) in which the current position is estimated based on environmental information. In addition, the position (reference position) indicating the "entrance to the third space" when the vehicle V moves from the first space to the third space, and the position (reference position) indicating the "entrance to the third space" when the vehicle V moves from the second space to the third space are also referred to as the "first reference point (entrance reference point)."

[0029] The "second reference point", also referred to as the exit reference point, is a position (reference position) that indicates the "exit of the second space" when a vehicle V traveling in the second space moves from the second space to the first space. In other words, the "second reference point" is a position (switching position) where the traveling vehicle V (cruising control device 1) has changed from a state (second estimation state) in which the current position is estimated based on environmental information to a state (first estimation state) in which the current position is estimated based on GNSS information. In addition, the position (reference position) indicating the "exit of the third space" when the vehicle V moves from the third space to the first space, and the position (reference position) indicating the "exit of the third space" when the vehicle V moves from the third space to the second space are also referred to as the "second reference point (exit reference point)."

[0030] By using the map information in which the above-mentioned reference points are recorded, the driving control device 1 can switch the estimation method (measurement method) of the vehicle V's own position upon reaching the reference point, or can switch the estimation method of the vehicle V's own position in advance upon reaching the reference point. By doing so, at the timing to switch the self-location estimation, the driving control device 1 can smoothly control the driving of the vehicle V. In other words, the self-location estimation method can be switched at a better timing, and the current location of the vehicle V can be estimated with higher accuracy.

[0031] The "map information" includes map information, spatial information including information on the first space, the second space, and the third space, and reference point information including information on the first reference point and the second reference point, and is created and updated by the driving control system S (driving control device 1). In detail, when the vehicle V is traveling along a predetermined planned travel route, the travel control device 1 specifies a position changed from a state in which the current position of the vehicle V is estimated based on GNSS information (first estimated state) to a state in which the current position of the vehicle V is estimated based on environmental information (second estimated state) as a first reference point (similarly for the second reference point). Then, the information of the specified reference point is recorded and reflected in the map information. In this way, the information of the reference point is updated in the map information, and the spatial information is also updated. In addition, the driving control device 1 may store environmental information near the "reference point" (within a certain distance from the "reference point") and vehicle information (vehicle speed, acceleration / deceleration (roll, pitch, yaw), and tilt information) immediately before reaching the "reference point," and use this information to improve the accuracy of estimating the "reference point." The map information is preferably created and updated by collecting and aggregating reference point information and spatial information recorded by multiple vehicles V (driving control devices 1) managed by the driving control system S. By using the updated map information, each vehicle V (cruising control device 1) can estimate the current position of the traveling vehicle V more accurately.

[0032] In this way, the “map information” is used to estimate the current position of the vehicle V, as well as to identify the actual driving route that the vehicle V has actually traveled. As shown in FIG. 6, in the "map information", the start position of the vehicle V, the destination position (goal position), and the planned travel route of the vehicle V are set. 6, information on the "first space," "second space," and "third space" is also set, and the information on the spaces is used as reference information. In other words, the driving control device 1 may recognize movement to a different space based on the position of the reference point or the position where the self-position estimation method is switched.

[0033] <Configuration other than the driving control device> The on-board sensor 10 detects the external environment around the vehicle V, such as moving objects (other vehicles, pedestrians, etc.), various structures, road shapes, etc. around the vehicle V, and specifically has multiple imaging devices 11, multiple radars 12, and multiple lidars 13. The on-vehicle sensor 10 is also called an external sensor, and corresponds to a "first sensor" that detects environmental information around the vehicle V. The on-vehicle sensor 10 may further include a detection sensor other than those described above. Alternatively, among the above detection sensors, the on-vehicle sensor 10 may include only the imaging device 11, the radar 12, or the lidar 13.

[0034] The imaging device 11 is a small imaging camera (wide-angle camera) that captures external images around the vehicle V, and creates external image data and transmits the external image data to the driving control device 1 to perform a "sensing function" for driving control of the vehicle V and a "monitoring function" for the driver (operator). Multiple imaging devices 11 are mounted on the vehicle V, and include a first imaging device 11a, a second imaging device 11b, and a third imaging device 11c that are attached to the windshield of the vehicle V and capture images of the front, right side, and left side of the vehicle V, a fourth imaging device 11d that is attached to the back bumper of the vehicle V and captures images of the rear of the vehicle V, and a fifth imaging device 11e and a sixth imaging device 11f that are attached to the left and right mirrors of the vehicle V and capture images of the diagonally rear right and left sides of the vehicle V, as main cameras. In addition, the imaging device 11 is equipped with a seventh imaging device 11g, which is attached to the front bumper of the vehicle V and captures images in front of the vehicle V, as sub-cameras, and an eighth imaging device 11h and a ninth imaging device 11i, which are attached around the left and right backlights of the vehicle V and capture images of the right rear and left rear of the vehicle V. In this embodiment, a total of nine imaging devices 11 are attached to predetermined positions of the vehicle V, but the number and attachment positions of the imaging devices 11 can be changed depending on the type and shape of the vehicle V. The same applies to the radar 12 and the lidar 13.

[0035] The radar 12 is a millimeter wave radar that transmits radio waves while continuously changing the irradiation direction, detects the target object by receiving the reflected waves from the target object (measures the position and speed of the target object), and performs three-dimensional spatial imaging. Compared to the imaging device 11 and the lidar 13, it can perform detection with high accuracy even in environmental conditions such as poor visibility at night or in bad weather. The radar 12 acquires detection result data (detection signal) of the target object, and transmits the detection result data to the driving control device 1. Multiple radars 12 are mounted on the vehicle V, including a first radar 12a and a second radar 12b mounted around the left and right front lights of the vehicle V, and a third radar 12c and a fourth radar 12d mounted around the left and right back lights of the vehicle V. The radar 12 is not particularly limited to a millimeter wave radar, but may be a laser radar, an ultrasonic sensor, or the like.

[0036] The lidar 13, also called "Lidar", is a remote sensor that measures the distance to a target object (e.g., a structure, a pedestrian, etc.) by emitting laser light and receiving the light reflected from the target object, and performs three-dimensional spatial imaging (mapping). Compared to the imaging device 11 and the radar 12, the lidar 13 can measure the distance to surrounding target objects in units of a few centimeters. The LIDAR 13 acquires distance measurement data that measures the distance to the target object, and transmits the distance measurement data to the driving control device 1. Multiple riders 13 are mounted on the vehicle V, and include a first rider 13a and a second rider 13b attached around the left and right front lights of the vehicle V, a third rider 13c attached to the back bumper of the vehicle V, and a fourth rider 13d and a fifth rider 13e attached around the left and right back lights of the vehicle V.

[0037] The on-vehicle locator 20 measures the current position of the vehicle V by utilizing a satellite positioning system using the artificial satellite SA and the reference station ST, and also measures the running information (acceleration, angular velocity, etc.) of the vehicle V in order to improve the measurement accuracy of the current position of the vehicle V. Note that when the satellite positioning system cannot be used (when external communication is not possible), the current position of the vehicle V is measured using the running information of the vehicle V. Specifically, the in-vehicle locator 20 includes a GNSS receiver 21 that receives GNSS radio waves (GPS radio waves) from multiple artificial satellites SA, and an inertial measurement unit 22 that measures driving information (acceleration, angular velocity, etc.) of the vehicle V. In addition, the in-vehicle locator 20 may further include an encoder (wheel encoder) that measures driving information such as the rotation speed and rotation angle of the wheels of the vehicle V.

[0038] The GNSS receiver 21 is specifically an RTK-GNSS receiver that receives GNSS radio waves from multiple (specifically, four) satellites SA, generates "GNSS information" necessary for independent positioning, and receives "GNSS correction information" necessary for relative positioning from an external reference station ST. The reference station ST is a fixed reference station set at a known point, receives GNSS radio waves from a plurality of artificial satellites SA, generates “GNSS correction information”, and transmits it to the GNSS receiver 21. The “GNSS information” is distance information between the multiple artificial satellites SA and the GNSS receiver 21. "GNSS correction information" is distance information in which the measurement error of the "GNSS information" is corrected by the reference station ST located at a known point receiving GNSS radio waves and the reference station ST communicating with the GNSS receiver 21.

[0039] The inertial measurement unit 22, also referred to as an IMU, is equipped with a three-axis gyro sensor (angular velocity sensor) and a three-axis acceleration sensor (accelerometer), measures the three-dimensional angular velocity and acceleration of the vehicle V, and transmits driving information of the vehicle V (acceleration and angular velocity information) to the driving control device 1. The inertial measurement unit 22 (IMU) is also called an internal sensor, and corresponds to a “second sensor” that measures driving information of the vehicle V. The driving control device 1 can measure the current position of the vehicle V with a smaller error range by combining GNSS information (GNSS correction information) received from the GNSS receiver 21 and driving information of the vehicle V received from the inertial measurement unit 22 to perform positioning. Furthermore, when GNSS information cannot be used (when external communication is not possible), the cruise control device 1 measures the current position of the vehicle V using travel information of the vehicle V. In this case, when the in-vehicle locator 20 further includes an encoder, the cruise control device 1 may measure the current position of the vehicle V by combining the travel information of the vehicle V received from the inertial measurement device 22 and the travel information of the vehicle V received from the encoder.

[0040] The in-vehicle ECU 30 is, for example, an ECU for ADAS, and is equipped with an upper-level overall ECU 31 that is connected to the driving control device 1 and transmits and receives various data, and a handle ECU 32, an accelerator ECU 33, and a brake ECU 34 that are connected to the upper-level overall ECU 31 and that perform detailed control of the steering, acceleration, deceleration, etc. of the vehicle V, forming a hierarchical structure. The steering wheel ECU 32 is also called a driving support computer, and the accelerator ECU 33 and the brake ECU 34 are also called a power management control unit. The number and functions of the individual ECUs connected to the integrated ECU 31 are not particularly limited to the above-mentioned three ECUs 32 to 34, and other ECUs may be further provided at the same hierarchical level as these ECUs.

[0041] The steering ECU 32 controls the electric power steering V1 of the vehicle V in response to an instruction from the integrated ECU 31, and mainly controls the direction in which the vehicle V travels. The electric power steering V1 includes a steering mechanism for steering the front wheels of the vehicle V. For example, in a manual driving mode, the front wheels of the vehicle V are steered by the driver's steering operation of the steering wheel V1a.

[0042] The accelerator ECU 33 controls the electric throttle V2 of the vehicle V in response to an instruction from the integrated ECU 31, and mainly controls the acceleration and deceleration of the vehicle V. The electric throttle V2 includes a drive mechanism that outputs a drive force to rotate the drive wheels of the vehicle V. For example, in a manual driving mode, the electric throttle V2 adjusts the engine output in response to the accelerator operation of the accelerator pedal V2a by the driver.

[0043] The brake ECU 34 controls the electromagnetic brake device V3 of the vehicle V in response to instructions from the integrated ECU 31, and mainly controls the deceleration and stopping of the vehicle V. The electromagnetic brake device V3 is attached to each wheel of the vehicle V and has a mechanism for applying resistance to the rotation of the wheels to slow down or stop the vehicle V. For example, in the manual driving mode, the operation of the electromagnetic brake device V3 is adjusted in response to the braking operation of the brake pedal V3a by the driver.

[0044] The in-vehicle communication device 40 is a device that communicates information with a vehicle information transmission device 50 mounted on the target vehicle FV, an externally installed remote control device 70, and an external server (not shown) via a network. Specifically, the in-vehicle communication device 40 receives target vehicle information including position information of the target vehicle FV acquired by the vehicle information transmission device 50 as information necessary for “relative driving”, and transmits the information to the driving control device 1. The in-vehicle communication device 40 also transmits information on the external video acquired by the driving control device 1 as information necessary for "remote driving" and information on the current position to the remote operation device 70. The in-vehicle communication device 40 also receives driving operation information for the vehicle V from the remote operation device 70 that has accepted a user input by an operator, and transmits the information to the driving control device 1. In addition, the in-vehicle communication device 40 can communicate with an external server (not shown) to receive, for example, the latest traffic information, weather information, and the like from the external server.

[0045] As shown in Figures 1 and 3A, the vehicle information transmission device 50 is a computer mounted on a target vehicle FV for acquiring target vehicle information including the current location information of the target vehicle FV and transmitting the target vehicle information to the vehicle V. As specific hardware configurations, the vehicle information transmission device 50 includes an in-vehicle locator 51 and an in-vehicle communication device 52. The “target vehicle information” includes location information (real-time location information) of the target vehicle FV, information on the planned driving route, and vehicle identification information, and is stored in the storage unit 500 of the vehicle information transmission device 50. "Vehicle identification information" refers to a vehicle ID that identifies a target vehicle FV, and information such as the vehicle model name, model type, and chassis number is associated with each vehicle ID and stored in the storage unit 500. In addition to being stored in the storage unit 500, the vehicle identification information is also embedded in an identification mark 60 attached to the target vehicle FV.

[0046] The on-vehicle locator 51 includes a GNSS receiver 51a that receives GNSS radio waves (GPS radio waves) from multiple artificial satellites SA, and an inertial measurement unit 51b that measures the acceleration and angular velocity of the target vehicle FV, similar to the above-described on-vehicle locator 20. The on-vehicle locator 51 may further include an encoder. The in-vehicle communication device 52 is a device that communicates information with the driving control device 1 mounted on the vehicle V through a network. Specifically, the in-vehicle communication device 52 transmits the target vehicle information as information necessary for the "relative driving" of the vehicle V to the driving control device 1 (the in-vehicle communication device 40) at all times or as needed. Specifically, the in-vehicle communication device 52 can transmit the position information of the target vehicle FV, which is included in the target vehicle information, in real time. "Transmitting in real time" includes not only transmitting location information at the same time as changes in the location information of the target vehicle FV, but also transmitting location information with a slight time lag.

[0047] 3A to 3C, the identification mark 60 is a two-dimensional barcode in which vehicle identification information for identifying the target vehicle FV is embedded (stored), and multiple identification marks 60 are attached to the outer surface of the target vehicle FV. Note that the identification mark 60 may also include embedded information that can specify the planned travel route of the target vehicle FV. The identification mark 60 is recognized by the imaging device 11 of the vehicle V. In detail, when the imaging device 11 recognizes the identification mark 60 in the image captured by the imaging device 11, it acquires, as recognition results, the vehicle identification information of the target vehicle FV embedded in the identification mark 60, information that can identify the planned driving route, etc. Then, the driving control device 1 can acquire the vehicle identification information of the target vehicle FV from the imaging device 11 through network communication in a predetermined communication method or an in-vehicle network (CAN). In the above embodiment, the driving control device 1 is capable of acquiring the vehicle identification information from the vehicle information transmission device 50 and the identification mark 60, but it is sufficient if it can acquire the vehicle identification information from at least one of them.

[0048] The identification mark 60 includes a first identification mark 60a, a second identification mark 60b, and a third identification mark 60c which are attached to the center, left end, and right end, respectively, in the vehicle width direction on the rear surface of the target vehicle FV, and a fourth identification mark 60d, a fifth identification mark 60e, and a sixth identification mark 60f which are attached to the center, left end, and right end, respectively, on the front surface of the target vehicle FV. The identification mark 60 also includes a seventh identification mark 60g, an eighth identification mark 60h, and a ninth identification mark 60i, which are attached respectively to the center, front end, and rear end of the left side of the target vehicle FV in the fore-and-aft direction of the vehicle, and a tenth identification mark 60j, an eleventh identification mark 60k, and a twelfth identification mark 60l, which are attached respectively to the center, front end, and rear end of the right side of the target vehicle FV.

[0049] The identification marks 60a to 60l each have vehicle identification information of the target vehicle FV embedded therein, as well as mark position information indicating the position (vehicle body position) at which each identification mark 60 is attached on the target vehicle FV embedded therein. Therefore, when any one of the identification marks 60a to 60l is recognized by the imaging device 11 of the vehicle V, the driving control device 1 can obtain the vehicle identification information of the target vehicle FV and detect the target vehicle FV. Furthermore, by recognizing, for example, the identification mark 60a and the identification mark 60c among the identification marks 60a to 60l, or by recognizing only the identification mark 60c, the driving control device 1 can detect that the vehicle V is located behind the target vehicle FV, and further, to the right of the target vehicle FV, based on the above mark position information. In particular, the driving control device 1 can accurately grasp the position (relative position) of the target vehicle FV with respect to the vehicle V based on environmental information around the vehicle V, position information of the vehicle V, driving information of the vehicle V, position information of the target vehicle FV, and mark position information obtained by the identification mark 60.

[0050] As shown in Figures 1 and 4, the remote control device 70 is a computer operated by an operator to perform "remote driving" of the vehicle V, and its specific hardware configuration includes multiple monitors 71, a navigation monitor 72, a steering wheel 73, an accelerator pedal 74, a brake pedal 75, and multiple operating switches 76. The remote control device 70 may further include components such as a speaker, a microphone, and a shift lever.

[0051] The monitor 71 and the navigation monitor 72 are display units that output visual information for performing "remote driving", and the monitor 71 displays a composite video (composite image) that is a composite of external images of the vehicle V captured by multiple imaging devices 11a to 11i based on predetermined layout information. The predetermined layout information is, for example, a display mode of a layout that does not create blind spots for the operator and is easy for the operator to operate. At this time, it is preferable that a plurality of layout information including the predetermined layout information are associated with each other by a layout ID (layout identification information) and stored in the storage unit 100 of the cruise control device 1. In this case, when an operation to change the predetermined layout information is performed using the operation switch 76 or the like, the changed layout ID is transmitted from the remote control device 70 to the cruise control device 1. Then, the driving control device 1 generates a composite image by combining the external image based on the layout information for the changed layout ID, and transmits the composite image to the remote control device 70. In this way, the composite image is changed and displayed on the monitor 71.

[0052] The handle 73 is an operating unit that is operated by an operator and is used to adjust the steering angle (steering amount) of the vehicle V. The accelerator pedal 74 and the brake pedal 75 are operating parts that are operated by an operator and are used to adjust the drive of the electric throttle V2 of the vehicle V and the operation of the electromagnetic brake device V3, respectively. The multiple operation switches 76 are used to allow the user to input setting information for performing, for example, "remote driving." For example, by the operator appropriately operating the operation switches 76, it is possible to switch the external image (composite image) of the vehicle V to a predetermined layout display, or to switch the driving mode among an autonomous driving mode, a relative driving mode, and a remote driving mode.

[0053] <Functions of the driving control system> As shown in FIG. 5, from a functional standpoint, the driving control device 1 includes a memory unit 100 for storing various programs and various data, as well as an environmental information acquisition unit 101, a driving information acquisition unit 102 (movement information acquisition unit), a self-position estimation unit 103, a driving control unit 104, a reference point identification unit 105, a reference point recording unit 106, a map creation unit 107, a recognition unit 108, an estimation mode switching unit 109, a detection unit 110, a position error measurement unit 111, a correction route setting unit 112, and a traveling direction recognition unit 113 as main components for mainly executing the "process of estimating the current position of the vehicle." In addition, the driving control device 1 is equipped with a driving control unit 104, a vehicle detection unit 114, a communication unit 115, a driving mode change unit 116, a driving speed acquisition unit 117, and an image processing unit 118, in order to mainly execute "driving control processing for autonomous driving, relative driving, and remote driving." These are composed of a CPU (processor), ROM, RAM, HDD, communication interface, and various programs. In addition, the memory unit 100 stores vehicle identification information of the vehicle V, information on the planned route of the vehicle V, “map information” shown in FIG. 6, “data regarding the direction of travel at the time of self-location estimation” shown in FIG. 8, “inter-vehicle distance data” shown in FIG. 11, etc.

[0054] Describing the vehicle information transmission device 50 from a functional perspective, it mainly comprises a memory unit 500 that stores various programs and various data, a location information acquisition unit 501 that acquires the “current location information” of the target vehicle FV, and a communication unit 502 that transmits and receives various data between the driving control device 1. The storage unit 500 stores "target vehicle information" including the current position information of the target vehicle FV, information on the planned driving route, and vehicle identification information. The location information acquisition unit 501 acquires the "current location information" of the target vehicle FV in real time using the in-vehicle locator 51. Then, by storing the acquired "current location information" in the memory unit 500, it becomes possible to record the travel trajectory (past travel route) of the target vehicle FV equipped with the vehicle information transmission device 50. The memory unit 500 is in a state where the travel trajectory of the target vehicle FV is stored. The communication unit 502 transmits the "target vehicle information" to the driving control device 1 (the in-vehicle communication device 40) using the in-vehicle communication device 52. In addition, the communication unit 502 transmits the "current position information" of the target vehicle FV, which is included in the target vehicle information, in real time.

[0055] Describing the remote control device 70 from a functional perspective, it mainly comprises a memory unit 700 that stores various programs and various data, a communication unit 701 that transmits and receives various data between the driving control device 1, a screen display unit 702 that displays external images and vehicle information of the vehicle V on the monitor 71 and also displays content based on information on the current location of the vehicle V (e.g., vehicle navigation) on the navigation monitor 72, an operation data creation unit 703 that accepts user operation input and creates operation data, and a user notification unit 704 that notifies the user to the operator.

[0056] The functions of the driving control device 1 will be described in detail below. <<1. Estimation of self-location>> The driving control device 1 performs driving control of the vehicle V while estimating the current position of the vehicle V. The process of estimating the vehicle's own position is specifically as follows. The environmental information acquisition unit 101 acquires “environmental information (strictly speaking, detected information of the external environment)” around the vehicle V through an on-board sensor 10 (first sensor) mounted on the vehicle V. In detail, as "environmental information", external image data of the surroundings of the vehicle V is obtained from the imaging device 11, detection result data of target objects around the vehicle V is obtained from the radar 12, and distance measurement data measuring the distance between the vehicle V and the target object is obtained from the lidar 13. In addition, "environmental information" specifically refers to detection information of moving objects (other vehicles, pedestrians, etc.) around vehicle V, various structures, road shapes, etc., and is also referred to as driving environment information, and includes traffic environment information, road environment information, etc.

[0057] The driving information acquisition unit 102 (mobility information acquisition unit) acquires “driving information” of the vehicle V through an inertial measurement unit 22 (second sensor) mounted on the vehicle V. Specifically, the "driving information" is behavior information (information based on behavior) of the vehicle V including information on the acceleration and angular velocity of the vehicle V. The "driving information" may include information such as the rotational speed and rotational angle of the wheels of the vehicle V, as well as information regarding the vehicle V's constant speed driving operation, accelerating operation, decelerating operation, stopping operation, left turning operation, right turning operation, reverse operation, and the like. The "driving information" may also be referred to as odometry information.

[0058] The self-position estimation unit 103 estimates the current position of the vehicle V based on information obtained through the on-board sensor 10 and on-board locator 20 (GNSS receiver 21, inertial measurement unit 22) mounted on the vehicle V. Specifically, the self-position estimation unit 103 has a first position estimation unit 103a, a second position estimation unit 103b, a third position estimation unit 103c, and a reception determination unit 103d.

[0059] The first position estimation unit 103a acquires "GNSS information" necessary for independent positioning through the GNSS receiver 21, and calculates the "absolute position" of the vehicle V by independent positioning. The "absolute position" of vehicle V is the three-dimensional position of vehicle V obtained by receiving GNSS radio waves from multiple satellites SA, measuring the distance between vehicle V and satellites SA located at known points, and solving a three-dimensional equation that determines unknown points from each measured distance (equivalent to GNSS information). The first position estimation unit 103a estimates the current position of the vehicle V based on the "absolute position" of the vehicle V.

[0060] The second position estimation unit 103b estimates the current position of the vehicle V using “environmental information” about the surroundings of the vehicle V obtained by the environmental information acquisition unit 101. The third position estimation unit 103c estimates the current position of the vehicle V using the “travel information” of the vehicle V obtained by the travel information acquisition unit 102. The position accuracy of the vehicle V estimated by the first position estimation unit 103a is higher than the position accuracy of the vehicle V estimated by the second position estimation unit 103b and the third position estimation unit 103c. In addition, the position accuracy of the vehicle V estimated by the second position estimation unit 103b is higher than the position accuracy of the vehicle V estimated by the third position estimation unit 103c.

[0061] The reception determination unit 103d determines whether or not the "GNSS information" can be acquired in real time, and if it is determined that the "GNSS information" can be acquired, the first position estimation unit 103a estimates the current position of the vehicle V based on the "GNSS information" (first estimation). Specifically, the reception determination unit 102d assumes a case in which radio waves cannot be received from the artificial satellite SA due to an obstacle or the like around the vehicle V, and determines whether or not radio waves can be received from the artificial satellite SA. If the reception determination unit 103d determines that it cannot acquire "GNSS information", it further determines whether or not it can acquire "environmental information", and if it determines that it can acquire "environmental information", the second position estimation unit 103b estimates the current position of the vehicle V based on the "environmental information" (second estimation). If the reception determination unit 103d determines that it cannot acquire "environmental information", it further determines whether or not it can acquire "traveling information", and if it determines that it can acquire "traveling information", the third position estimation unit 103c estimates the current position of the vehicle V based on the "traveling information" (third estimation). If the reception determination unit 103d determines that the "environmental information" cannot be acquired at the certain time, the self-position estimation unit 103 ends the self-position estimation process.

[0062] In addition, the first position estimation unit 103a acquires "GNSS information" and estimates the current position of the vehicle V using an "absolute position" calculated by single-unit positioning, but it may also estimate the current position of the vehicle V using a "relative position" calculated by relative positioning. The "relative position" of vehicle V is the three-dimensional position of vehicle V that is determined by receiving GNSS radio waves at a reference station ST located at a known point, obtaining the distance with the smaller measurement error from reference station ST (the distance between each satellite SA and vehicle V), and calculating each measured distance (corresponding to GNSS correction information). The calculation method of the "relative position" includes a calculation method using the RTK positioning method (interferometric positioning method) and a calculation method using the DGPS positioning method (relative positioning method). Either calculation method may be used. The first position estimation unit 103a acquires the above-mentioned "GNSS correction information" necessary for relative positioning from the reference station ST, and estimates the current position of the vehicle V using the "relative position" calculated by the relative positioning. The positional accuracy of "relative position" is higher than that of "absolute position", and is said to be around ±40 cm.

[0063] Alternatively, the first position estimation unit 103a may further acquire "driving information" of the vehicle V through the inertial measurement device 22, calculate a "corrected absolute position (corrected relative position)" by correcting the absolute position (relative position) of the vehicle V based on the "GNSS information (GNSS correction information)" and the "driving information", and estimate the current position of the vehicle V using the "corrected absolute position (corrected relative position)". The "corrected absolute position" of vehicle V is the three-dimensional position of vehicle V obtained by combining GNSS information and driving information of vehicle V (also called IMU information) to determine its position. The "corrected relative position" of vehicle V is the three-dimensional position of vehicle V obtained by combining GNSS correction information and driving information of vehicle V to determine its position. The position accuracy of the "corrected absolute position" is higher than that of the "absolute position." The position accuracy of the "corrected relative position" is also higher than that of the "corrected absolute position," and is said to be about ±5 cm.

[0064] The first position estimation unit 103a may estimate the current position of the vehicle V using any of the above-mentioned "absolute position," "relative position," "corrected absolute position," or "corrected relative position," but it is preferable to estimate the current position of the vehicle V using the "corrected relative position," which has the highest position accuracy.

[0065] The driving control device 1 can record the driving trajectory (past driving route) of the vehicle V by storing the position information obtained by the self-position estimation unit 103 in the memory unit 100, and the driving trajectory of the vehicle V is stored in the memory unit 100. This driving trajectory of the vehicle V is used to determine whether or not the vehicle V is on a planned driving route, and to set a new planned driving route that leads the vehicle V onto the planned driving route as necessary.

[0066] <<2. Estimation of self-position and driving control using map information>> When estimating the self-position, the driving control device 1 uses the "map information" shown in FIG. 6 described above, thereby controlling the driving of the vehicle V while estimating the current position of the vehicle V with higher accuracy. In detail, the driving control device 1 uses "map information" including information on "reference points (first reference point, second reference point)" to recognize the "space (first space, second space, third space)" reached upon reaching the reference point, performs self-location estimation according to the space, and controls the driving of the vehicle V while estimating the current position of the vehicle V. Specifically, it is as follows.

[0067] (Create and update map information) The "map information" stored in the memory unit 100 includes map information, spatial information including information on the first space, the second space, and the third space, and reference point information including information on the first reference point and the second reference point, as shown in FIG. 6, and has been created in advance by the driving control system S. The "map information" is updated by the reference point identification unit 105, the reference point recording unit 106, and the map creation unit 107. Note that the "map information" may be newly created by the reference point identification unit 105, the reference point recording unit 106, and the map creation unit 107 based on the map information.

[0068] The reference point identification unit 105 identifies the position changed from a state (first estimation state) in which the self-position estimation unit 103 estimates the current position of the vehicle V based on "GNSS information" to a state (second estimation state) in which the self-position estimation unit 103 estimates the current position of the vehicle V based on "environmental information" as the "first reference point (entrance reference point)." The reference point identification unit 105 also identifies as the "first reference point" a position that has been changed from the above-mentioned first estimation state to a state (third estimation state) in which the self-position estimation unit 103 estimates the current position of the vehicle V based on the "driving information." Furthermore, the reference point identification unit 105 identifies the position changed from the second estimated state or the third estimated state to the first estimated state as a "second reference point (exit reference point)."

[0069] In detail, when the estimated state of the current position based on "GNSS information" (first estimated state) is changed to the estimated state of the current position based on "environmental information" (second estimated state), the reference point identification unit 105 identifies the current position based on "GNSS information" acquired at the time of the change as the "first reference point." The "GNSS information" acquired at the time of the change can be said to be, in other words, the "GNSS information" acquired just before the change. The same applies when the first estimated state is changed to the third estimated state.

[0070] In addition, when the second estimated state is changed to the first estimated state, the reference point identification unit 105 identifies the current position based on the “GNSS information” acquired at the time of the change as the “second reference point.” "GNSS information" obtained at the time of the change can be said to be "GNSS information" obtained immediately after the change. In this way, when estimating the current position of vehicle V, it is possible to determine the position of the reference point with higher accuracy by determining the position of the reference point based on the "GNSS information" acquired immediately before or after the change.

[0071] In addition, when the estimated state of the current position based on the "driving information" of vehicle V (third estimated state) is changed to the estimated state of the current position based on "GNSS information" (first estimated state), the reference point identification unit 105 identifies the current position based on the "driving information" acquired at the time of the change as the "second reference point." The reason is that when the third estimated state is changed to the first estimated state, a position error occurs at the change point, as described below (see Figure 7). Therefore, a more accurate reference point is identified by using the current position information based on the "driving information" acquired just before the change, rather than the current position information based on the "GNSS information" acquired after the change.

[0072] The reference point recording unit 106 records information on the first and second reference points identified by the reference point identifying unit 105, and saves the information in the storage unit 100 as recorded information (history information) of the reference points. The map creation unit 107 updates the "map information" based on the history information of the reference points recorded by the reference point recording unit 106. Specifically, the map information included in the "map information" is updated with new information on the first reference point and the second reference point. The driving control device 1 appropriately transmits map information updated by the map creation unit 107, that is, information on the reference points, to a management server (cloud server) not shown. In this way, the cruise control system S can update existing map information at any time by aggregating the record information of the reference points that have been recorded and updated by various vehicles V (cruise control devices 1) in the management server. The vehicle V (cruise control device 1) can obtain the updated map information and use the map information.

[0073] (Self-location estimation using map information) The recognition unit 108 uses map information to recognize that the vehicle V has reached a reference point (first reference point, second reference point) recorded by the reference point recording unit 106 while the vehicle V is traveling along a predetermined planned driving route or within a certain period of time after stopping. When the recognition unit 108 performs the above recognition, the estimation mode switching unit 109 switches the estimation mode at the reference point.

[0074] Specifically, when the vehicle V is traveling in the "first space" in the map information shown in FIG. 6, the recognition unit 108 recognizes that the vehicle V has reached the first reference point (the boundary point between the first space and the second space). Then, the estimation mode switching unit 109 switches from a “first estimation mode (also referred to as a first estimation state)” in which the self-position estimation unit 103 estimates the current position of the vehicle V based on “GNSS information” to a “second estimation mode (also referred to as a second estimation state)” in which the self-position estimation unit 103 estimates the current position of the vehicle V based on “environmental information”. The self-position estimation unit 103 estimates the current position of the vehicle V in the second estimation mode set by the estimation mode switching unit 109. Then, the traveling control unit 104 controls the traveling of the vehicle V in the "second space" while estimating the current position of the vehicle V in the second estimation mode.

[0075] Moreover, when the vehicle V is traveling in the "second space" in the map information shown in FIG. 6, the recognition unit 108 recognizes that the vehicle V has reached the second reference point. Then, the estimation mode switching unit 109 switches the self-position estimation unit 103 from the "second estimation mode" to the "first estimation mode." The self-position estimation unit 103 estimates the current position of the vehicle V in the first estimation mode. Then, the traveling control unit 104 controls the traveling of the vehicle V in the "first space" while estimating the current position of the vehicle V in the first estimation mode.

[0076] In addition, when the vehicle V is traveling in the "first space" in the map information shown in FIG. 6, the recognition unit 108 recognizes that the vehicle V has reached the first reference point (the boundary point between the first space and the third space). Then, the estimation mode switching unit 109 switches from the "first estimation mode" to a "third estimation mode (also referred to as a third estimation state)" in which the self-position estimation unit 103 estimates the current position of the vehicle V based on the "traveling information". The self-position estimation unit 103 estimates the current position of the vehicle V in the third estimation mode. Then, the traveling control unit 104 controls the traveling of the vehicle V in the "third space" while estimating the current position of the vehicle V in the third estimation mode. The same applies to switching from the "third estimation mode" to the "first estimation mode".

[0077] In this way, the vehicle V (cruising control device 1) recognizes the reference points (first reference point, second reference point), and the cruising control device 1 can timely switch the estimation method of the vehicle V's own position (can perform switching processing immediately) when the vehicle V reaches the reference point. In other words, the cruising control device 1 can smoothly control the traveling of the vehicle V at the timing to switch the self-position estimation.

[0078] (Preparing for mode switching) The cruise control device 1 may prepare for switching the self-position estimation (start the activation for switching) when the vehicle V approaches the reference point based on the information of the reference point (first reference point, second reference point) included in the "map information." This is described in detail as follows. The detection unit 110 detects that the vehicle V has arrived within a certain distance from a reference point included in the "map information" while the vehicle V is traveling along a predetermined planned travel route based on the "map information." When the detection unit 110 detects the vehicle V, the estimation mode switching unit 109 makes preparations for switching the estimation mode at the reference point.

[0079] Specifically, when the vehicle V is traveling in the "first space", the detection unit 110 detects that the vehicle V has arrived within a certain distance of a first reference point (the boundary point between the first space and the second space) included in the "map information". Then, the estimation mode switching unit 109 prepares to switch from the first estimation mode to the second estimation mode at the first reference point. That is, the estimation mode switching unit 109 prepares to a state in which the self-position can be estimated based on the environmental information (prepares for starting the self-position estimation by the in-vehicle sensor 10, and starts the start). By doing so, the self-location estimation method can be switched at a more timely manner, and the current location of the vehicle V can be estimated with greater accuracy.

[0080] (Setting the driving correction route) As shown in Figure 7, the process of changing from the "third estimation mode (third estimation state)" in which self-position estimation is performed using "driving information" to the "first estimation mode (first estimation state)" in which self-position estimation is performed using "GNSS information" will be described in more detail. As described above, the “third estimation mode” is performed when the vehicle V is in a tunnel or under an overpass, or when the vehicle V has just moved from the “second space” to the “first space”, etc. At this time, the vehicle V acquires “traveling information” of the vehicle V by the inertial measurement device 22. Here, as shown in Fig. 7, a position error may occur between the current position estimated by the "third estimation mode" based on the travel information and the current position estimated by the "first estimation mode" based on the GNSS information. For example, this may occur when the accuracy of the information on the current position of the vehicle V in the third space becomes low and the vehicle V deviates somewhat from the planned travel route. In this case, the current position information (position information immediately before switching) at the second reference point (exit reference point) based on the "third estimation mode" is a position along the planned driving route (a position different from the actual position), whereas the current position information (position information immediately after switching) based on the "first estimation mode" is a position off the planned driving route (the actual position).

[0081] When a position error occurs as described above, the cruise control device 1 calculates the position error and sets a corrected travel route to guide the vehicle V to the planned travel route. The cruise control device 1 then controls the vehicle V to travel along the corrected travel route, and when the vehicle V returns to the planned travel route, controls the vehicle V to travel along the planned travel route to guide the vehicle V to the destination position. The specific process is as follows.

[0082] As shown in FIG. 7, when the vehicle V travels in the "third space" in the "third estimation mode" and reaches the second reference point (the boundary point between the third space and the first space), the recognition unit 108 recognizes that the vehicle V has reached the second reference point. When the recognition unit 108 performs the above recognition, the estimation mode switching unit 109 switches from the "third estimation mode" to the "first estimation mode" at the second reference point. Then, the position error measurement unit 111 measures the position error between the current position of the vehicle V (a position different from the actual position) estimated in the "third estimation mode" at the second reference point and the current position of the vehicle V (actual position) estimated in the "first estimation mode." The corrected route setting unit 112 sets a corrected travel route for leading the vehicle to the planned travel route based on the position error measured at the second reference point. Then, the driving control unit 104 controls the driving of the vehicle V along the above-mentioned corrected driving route, and when the vehicle V returns to the planned driving route, controls the driving of the vehicle V along the planned driving route, and guides the vehicle V to the destination position.

[0083] As described above, even if a position error occurs at a reference point when estimating the vehicle V's own position, a new driving correction route based on the position error can be set, the vehicle V can be smoothly guided to the planned driving route, and the vehicle V can be driven to the destination position. In addition to the case shown in FIG. 7, a position error may occur when the mode is changed from the "third estimation mode (third estimated state)" to the "second estimation mode (second estimated state)."

[0084] <<3. Recognizing the direction of travel>> The driving control unit 104 controls the driving of the vehicle V based on the “position information (current position)” of the vehicle V estimated by the self-position estimation unit 103 and the “traveling direction” of the vehicle V recognized by the travelling direction recognition unit 113. The "direction of travel" indicates the direction in which the vehicle V travels after the estimation state (estimation mode) is changed by the self-position estimation unit 103 (estimation mode switching unit 109), and is also called the traveling vector (movement vector) of the vehicle V. By the driving control device 1 recognizing the "direction of travel," when the method of self-position estimation is changed (switched), the behavior of the vehicle V immediately after the change (immediately after switching) can be grasped, making it possible to control the driving of the vehicle V more smoothly. The specific process is as follows.

[0085] (Recognition of direction of travel) The self-position estimation unit 103 estimates the current position of the vehicle V based on the "first estimated state", the "second estimated state", and the "third estimated state". Then, when the self-position estimation unit 103 changes the estimated state while the vehicle V is traveling or within a certain time after the vehicle V has stopped, the traveling direction recognition unit 113 recognizes the "traveling direction" of the vehicle V based on the manner in which the state is changed. In other words, the traveling direction recognition unit 113 recognizes the "traveling direction" of the vehicle V based on the manner in which the information used to estimate the self-position (GNSS information, environmental information, traveling information) changes.

[0086] When the self-position estimation unit 103 changes the first estimated state to the second estimated state, the traveling direction recognition unit 113 recognizes the traveling direction of the vehicle V as a "first traveling direction." The "first travel direction" indicates the direction in which the vehicle V travels from the "first space" to the "second space", in other words, the direction in which the vehicle V travels from the "outdoor space" to the "indoor space". Furthermore, when the self-position estimation unit 103 changes the second estimated state to the first estimated state, the traveling direction recognition unit 113 recognizes the traveling direction of the vehicle V as a "second traveling direction." The "second travel direction" indicates the direction in which the vehicle V travels from the "second space" to the "first space", in other words, the direction in which the vehicle V travels from the "indoor space" to the "outdoor space". Specifically, this is as shown in "Data regarding the traveling direction at the time of self-location estimation" in FIG.

[0087] According to FIG. 8, when the information used to estimate the vehicle's own position changes from "GNSS information" to "environmental information" (when the first estimated state is changed to the second estimated state), the travel direction recognition unit 113 recognizes the travel direction of the vehicle V as the "first travel direction." The same is true when the information used to estimate the vehicle's position changes from "GNSS information" to "driving information" and then to "environmental information" (when the information is changed from the first estimated state to the third estimated state and then to the second estimated state).

[0088] When the information used to estimate the vehicle's position changes from "GNSS information" to "driving information" and then to "GNSS information" (when the information is changed from the first estimated state to the third estimated state and then back to the first estimated state), the travel direction recognition unit 113 recognizes the travel direction of the vehicle V as the "third travel direction." The "third travel direction" indicates the direction in which the vehicle V travels from the "first space" temporarily through the "third space" to the "first space"; in other words, it indicates the direction in which the vehicle V travels from the "outdoor space" temporarily through the "indoor space" and then back to the "outdoor space." This occurs when the vehicle V is temporarily unable to acquire GNSS information (unable to communicate with the outside), for example when the vehicle V is temporarily traveling inside a tunnel or under an overpass.

[0089] When the information used to estimate the vehicle's own position changes from "environmental information" to "GNSS" (when the estimation state is changed from the second estimation state to the first estimation state), the travel direction recognition unit 113 recognizes the travel direction of the vehicle V as the "second travel direction." The same applies when the information used to estimate the vehicle's own position temporarily changes from "environmental information" to "driving information" and then to "GNSS information" (when the information is changed from the second estimated state to the third estimated state and then to the first estimated state). When the information used to estimate the vehicle's position temporarily changes from "environmental information" to "driving information" and then back to "environmental information" (when the second estimated state is changed from the third estimated state to the second estimated state), the vehicle V's direction of travel is not set. This is because when the "second space" and the "third space" are regarded as "indoor spaces" and the "first space" is regarded as an "outdoor space", there is no movement between the "indoor space" and the "outdoor space". In other words, this indicates that there has been no change in the vehicle V's direction of travel.

[0090] (Timing for recognizing direction of travel) The timing at which the traveling direction recognizing unit 113 recognizes the traveling direction of the vehicle V is as follows. When the vehicle V is moving and the state is changed from the "first estimated state" to the "second estimated state," the travel direction recognition unit 113 recognizes the "first travel direction" at the time when the self-position estimation unit 103 starts to estimate the current position of the vehicle V based on the "environmental information." In addition, when the vehicle V is moving and the state is changed from the "second estimated state" to the "first estimated state", the travel direction recognition unit 113 recognizes the "second travel direction" at the time when the self-position estimation unit 103 starts to estimate the current position of the vehicle V based on the "GNSS information". Specifically, this is as shown in "Data regarding the traveling direction at the time of self-location estimation" in FIG.

[0091] According to Figure 8, when the information used to estimate the vehicle's position changes from "GNSS information" to "environmental information" (when the first estimation state is changed to the second estimation state), the travel direction recognition unit 113 recognizes the travel direction (first travel direction) of the vehicle V at the timing when the vehicle's position estimation unit 103 starts estimating the current position of the vehicle V based on the "environmental information". In addition, when the information used to estimate the vehicle's own position changes from "environmental information" to "GNSS information" (when the second estimation state is changed to the first estimation state), the travel direction recognition unit 113 recognizes the travel direction (second travel direction) of the vehicle V at the timing when the self-position estimation unit 103 starts to estimate the current position of the vehicle V based on the "GNSS information". In addition, when the information used to estimate the vehicle's own position changes from "GNSS information" to "driving information" and then back to "GNSS information" (when the information is changed from the first estimated state to the third estimated state and then back to the first estimated state), the traveling direction recognition unit 113 recognizes the traveling direction of the vehicle V (third traveling direction) at the timing when the vehicle's own position estimation unit 103 starts to estimate the current position of the vehicle V based on the "GNSS information".

[0092] In this way, when the self-location estimation method is changed, the traveling direction recognition unit 113 recognizes the traveling direction of the vehicle V at the timing when it starts acquiring information (GNSS information or environmental information) that is obtained immediately after the change. In this way, when the information used to estimate the self-position changes, the driving control unit 104 can control the driving of the vehicle V by using "information obtained after the change (e.g., environmental information)" and "the traveling direction of the vehicle V (e.g., the first traveling direction)" recognized at the timing when the acquisition of the information starts. In other words, the driving of the vehicle V can be controlled while grasping the behavior of the vehicle V.

[0093] (Estimation state switching position) When the self-position estimation unit 103 changes the "first estimated state based on GNSS information" to the "second estimated state based on environmental information" and the traveling direction recognition unit 113 recognizes the "first traveling direction," the reference point identification unit 105 identifies the position where the self-position estimation unit 103 started to estimate the self-position of the vehicle V based on the "environmental information" as the "reference point (first reference point)." In addition, when the state is changed from the "second estimated state based on environmental information" to the "first estimated state based on GNSS information" and the "second traveling direction" is recognized, the reference point identification unit 105 identifies the position where the self-position estimation unit 103 started to estimate the self-position of the vehicle V based on the GNSS information as the "reference point (second reference point)." Specifically, this is as shown in "Data regarding the traveling direction at the time of self-location estimation" in FIG. In this way, when the information used to estimate the vehicle's position changes, the position of the reference point can be determined based on "the information obtained after the change" and "the direction of travel of vehicle V," making it possible to determine the reference point at a more accurate position.

[0094] On the other hand, as shown in Figure 8, when the reference point identification unit 105 changes from a "first estimated state based on GNSS information" to a "third estimated state based on driving information" and then to a "second estimated state based on environmental information" and the traveling direction recognition unit 113 recognizes the "first traveling direction," it identifies the position where the self-position estimation unit 103 started to estimate the self-position of the vehicle V based on the "driving information" as the "reference point (first reference point)" (second in Figure 8). In addition, when the reference point identification unit 105 changes from the "first estimated state based on GNSS information" to the "third estimated state based on driving information" and then to the "first estimated state based on GNSS" and the "third traveling direction" is recognized, it identifies the position where the self-position estimation unit 103 started to estimate the self-position of the vehicle V based on the "driving information" as the "reference point (second reference point)" (third in Figure 8). As described above (as explained in FIG. 7), a position error occurs between the current position estimated by the "third estimated state" based on the driving information and the current position estimated by the "first estimated state (second estimated state)" based on the GNSS information (environmental information). Therefore, a more accurate reference point is identified by using current position information based on the "driving information" acquired immediately before the change, rather than current position information based on the "GNSS information (environmental information)" acquired after the change. For this reason, the reference point identification unit 105 identifies the position where acquisition of current position information based on the "driving information" starts as the reference point.

[0095] After the reference point is identified by the reference point identification unit 105 and recorded by the reference point recording unit 106, the self-position estimation unit 103 (estimation mode switching unit 109) changes the estimation mode at the reference point, and the travel direction recognition unit 113 recognizes the travel direction of the vehicle V. Then, the driving control unit 104 controls the driving of the vehicle V based on the current position of the vehicle V estimated by the self-position estimation unit 103 and the traveling direction of the vehicle V recognized by the traveling direction recognition unit 113. In this way, by switching the estimation method for the vehicle's position using the reference point and recognizing the traveling direction of the vehicle V, it is possible to grasp with higher accuracy the behavior of the vehicle V when it passes the reference point. As a result, the traveling of the vehicle V can be controlled more smoothly.

[0096] (Advantages of knowing reference points and direction of travel) In the driving control device 1, there are cases where the vehicle V already has "information within the second space" as map information ("Case 1"), and cases where the vehicle V does not already have "information within the second space" as map information ("Case 2"). The above "Case 1" refers to, for example, either the vehicle V itself having visited the location in the past, or the vehicle V having acquired information about the location from another vehicle. The above "Case 2" refers to a case different from the above "Case 1."

[0097] As for the above "Case 1," when vehicle V has "information within the second space" as map information, the map information is stored in each vehicle V with information on the first space, second space, and third space associated with information on the reference point, and is also managed by a management server (cloud server). Therefore, even if there are similar places in the space while the vehicle V is traveling, the vehicle V can identify the corresponding map information (spatial information) by recognizing the reference point. Examples of similar places include places that have structures with similar positions and shapes of pillars or positions and shapes of windows, or places that have buildings built by the same construction company. As shown in Fig. 9, the map information includes spatial information and reference point information in association with each other, as well as directional information (north, south, east, and west) as map information. The vehicle V can recognize the traveling direction of the vehicle V by identifying the information on the reference points (entrance reference point, exit reference point) and the directional information.

[0098] In the above-mentioned "Case 1," as shown in Fig. 9, when the vehicle V moves from the first space to the second space, it unfolds (sets for use) the "map information" and sets the illumination range of the lidar 13 (radar 12) within a pre-specified range. In other words, the illumination range of the lidar 13 is not set to the entire range (there is no need to tilt the vehicle V to illuminate the entire range). The vehicle V can use the "map information" to recognize objects (structures, moving objects, etc.) within the preset illumination range of the lidar 13, while using the "driving information" to control the direction of travel, distance traveled, etc. of the vehicle V. By limiting the search range in this manner, the search process can be shortened, the processing speed of self-location estimation can be increased, and the accuracy of self-location estimation within the second space can be improved. This is the advantage of the vehicle V being able to know the reference point and the direction of travel.

[0099] As an example of the above "Case 1," assume a case in which vehicle V moves from the first space (south side) to the second space (north side), then turns 90 degrees within the second space and travels to the east, and then moves from the second space (west side) to the first space (east side), as shown in Figure 9. In this case, even if vehicle V is unable to estimate its own position based on "environmental information" when it moves from the first space to the second space, vehicle V can use "map information" to identify spatial information, reference point information, and direction information to recognize its direction of travel, and thereby determine to what position it should go straight and at what position and to what extent it should turn.

[0100] On the other hand, in the "above case 2," if the vehicle V does not have "information within the second space" as map information, the vehicle V naturally cannot grasp information about the second space. Therefore, when the vehicle V moves from the first space to the second space, it is necessary to set the illumination range of the lidar 13 to the entire range. That is, it is necessary to perform a search in all directions in the second space (also called a full search). This is because there may be similar locations in different parts of the space, and if the vehicle V does not perform a full search in such a case, the vehicle V will not be able to travel accurately within the second space (the vehicle V will go back and forth and circle around in the same position).

[0101] If the vehicle V searches the second space in all directions as in the above-mentioned "Case 2," the search process takes time. Also, there is a risk of an error in the estimation process of the vehicle's own position in the second space.

[0102] <<4. Autonomous Driving Control>> The driving control unit 104 controls the overall ECU 31 based on the "environmental information" obtained by the environmental information acquisition unit 101 and the "position information (current position) of the vehicle V" obtained by the self-position estimation unit 103, and performs "autonomous driving control" of the vehicle V (see FIG. 10A). In addition, when performing "autonomous driving control" of the vehicle V, the driving control unit 104 may acquire "vehicle information" of the vehicle V from the on-board ECU 30 and further combine the "vehicle information" to control the overall ECU 31.

[0103] When the vehicle V starts traveling along the planned traveling route of the vehicle V, the traveling control unit 104 performs “autonomous driving control” and starts the autonomous driving of the vehicle V. In more detail, when the vehicle V starts traveling, the "autonomous driving mode" is set, and the traveling control unit 104 performs autonomous driving control in the "autonomous driving mode" state. Thereafter, the vehicle V travels toward the destination of the planned travel route while the driving mode change unit 116 changes the driving mode between the "autonomous driving mode" and the "relative driving mode". Note that, when the target vehicle FV to be followed has already been detected and position information of the target vehicle FV is obtained in real time at the timing when the vehicle V starts traveling, the driving mode may be changed from "autonomous driving mode" to "relative driving mode" by the driving mode change unit 116. In that case, the driving control unit 104 performs relative driving control with the "relative driving mode" set, and starts driving the vehicle V relative to the target vehicle FV. Alternatively, when the vehicle V starts driving, the "remote driving mode" is set instead of the "autonomous driving mode", and the driving control unit 104 may perform remote driving control with the "remote driving mode" set.

[0104] The vehicle detection unit 114 detects that a predetermined leading vehicle traveling ahead of the vehicle V is a target vehicle FV to be followed on the planned traveling route of the vehicle V (see FIG. 10B). "Target vehicles to be followed" include not only vehicles traveling on a planned driving route that at least partially matches the planned driving route of vehicle V, but also vehicles that will travel the same route as the planned driving route of vehicle V over a certain driving distance (driving time). For example, this applies to vehicles traveling around vehicle V when traveling on a highway or general road where there are no branch points within a certain travel distance (travel time).

[0105] Specifically, the vehicle detection unit 114 detects that a predetermined preceding vehicle is a target vehicle FV based on the recognition result of the identification mark 60 of the preceding vehicle recognized by the imaging device 11. For example, when the first identification mark 60a of the target vehicle FV is recognized, the vehicle detection unit 114 detects that the target vehicle FV is located ahead of the vehicle V. Alternatively, when the seventh identification mark 60g of the target vehicle FV is recognized, the vehicle detection unit 114 detects that the target vehicle FV is present to the right of the vehicle V.

[0106] More specifically, the vehicle detection unit 114 obtains the recognition results of each identification mark 60a-60l of the target vehicle FV from the imaging device 11 in real time, and can accurately detect the relative position of the target vehicle FV with respect to vehicle V in real time based on the vehicle identification information of the target vehicle FV (shape and size of the target vehicle FV) and the mark position information embedded in each identification mark 60a-60l. For example, the cruise control device 1 can accurately detect that the target vehicle FV is traveling in a forward position slightly to the left of the vehicle V, or that the target vehicle FV is traveling parallel to the vehicle V and slightly ahead of the vehicle V. In this case, the relative position of the target vehicle FV may be specified, for example, by a three-dimensional coordinate position with the vehicle V as the center position. In this way, as shown in Fig. 10B, the vehicle V can be driven relative to the target vehicle FV while maintaining an appropriate distance between the vehicle V and the target vehicle FV. Also, as shown in Fig. 10C, the vehicle V can be driven autonomously so that the vehicle V can appropriately overtake the target vehicle FV.

[0107] Although the vehicle detection unit 114 detects the target vehicle FV based on the recognition result of the identification mark 60, the target vehicle FV may be detected by other detection means. For example, the vehicle detection unit 114 may use the in-vehicle communication device 40 to wirelessly obtain vehicle identification information of the target vehicle FV from a vehicle information transmission device 50 mounted on the target vehicle FV, and detect the target vehicle FV based on the vehicle identification information. In other words, the target vehicle FV may be in a state where it can be detected by an identification mark 60 attached to the target vehicle FV, or the target vehicle FV may be in a state where it can be detected by wireless communication with a vehicle information transmission device 50 mounted on the target vehicle FV.

[0108] The communication unit 115 receives target vehicle information including at least the position information of the target vehicle FV detected by the vehicle detection unit 114. More specifically, when the vehicle detection unit 114 detects the target vehicle FV, the communication unit 115 starts communication with the vehicle information transmission device 50 via the network. The communication unit 115 then receives the position information of the target vehicle FV and information on the planned driving route from the vehicle information transmission device 50 mounted on the target vehicle FV. The location information acquisition unit 501 of the vehicle information transmission device 50 acquires the "current location information" of the target vehicle FV in real time in the same manner as the self-location estimation unit 103 described above.

[0109] <<5. Mode change (autonomous driving ⇒ relative driving)>> The operation mode change unit 116 changes the operation mode from the "autonomous operation mode (autonomous operation control)" to the "relative operation mode (relative operation control)" when a predetermined relative operation start condition is satisfied. Specifically, when autonomous driving control is being performed with the "autonomous driving mode" set as shown in FIG. 10A, when a target vehicle FV is detected by the vehicle detection unit 114 and target vehicle information is received by the communication unit 115, the driving mode change unit 116 changes from the "autonomous driving mode" to the "relative driving mode" as shown in FIG. 10B. More specifically, when the vehicle detection unit 114 detects a leading vehicle as a "predetermined relative driving start condition", it determines whether the leading vehicle is a target vehicle FV, and if it is determined that the leading vehicle is a target vehicle FV, it recognizes the leading vehicle as the target vehicle FV. Then, the driving mode change unit 116 changes from the "autonomous driving mode" to the "relative driving mode". In addition, if it is determined that the preceding vehicle is not the target vehicle FV, even if the preceding vehicle is detected, the driving mode change unit 116 will not change the mode because the ``specified relative driving start condition'' is not satisfied. Here, the "target vehicle FV" is a vehicle that has a vehicle ID pre-registered by the cruise control device 1 (storage unit 100) mounted on the vehicle V and is identified by that vehicle ID. If that vehicle ID is set for the preceding vehicle, the "predetermined relative driving start condition" is satisfied, and if that vehicle ID is not set, that condition is not satisfied.

[0110] In detail, when the target vehicle FV is detected while autonomous driving control is being performed with the "autonomous driving mode" set, the driving mode change unit 116 sets the "relative driving mode" with the "autonomous driving mode" set. In other words, while keeping the "autonomous driving mode" in an enabled state, the "relative driving mode" is changed from an disabled state to an enabled state. At this time, the driving mode change unit 116 prioritizes and continues the "autonomous driving mode" with both modes set. In other words, the traveling control unit 104 continues to perform autonomous driving control. Then, when the driving mode change unit 116 obtains target vehicle information of the target vehicle FV while the autonomous driving control is continuing with both modes set, the driving mode change unit 116 prioritizes execution of the "relative driving mode" with both modes set. In other words, the traveling control unit 104 newly performs relative driving control. Note that, when autonomous driving control continues with both modes set, if target vehicle information of the target vehicle FV cannot be obtained, i.e., if wireless communication with the vehicle information transmission device 50 mounted on the target vehicle FV cannot be established, the driving mode change unit 116 returns the "relative driving mode" that was once set to an unset state. In other words, the "relative driving mode" is returned from an enabled state to an disabled state. At this time, since the "autonomous driving mode" remains in the set state (enabled state), the driving control unit 104 continues to perform autonomous driving control.

[0111] <<6. Relative Operation Control>> The driving control unit 104 controls the overall ECU 31 based on the "environmental information", "position information of the vehicle V", and "target vehicle information of the target vehicle FV", and performs "relative driving control" of the vehicle V with respect to the target vehicle FV (see FIG. 10B). In addition, when executing the "relative driving control", the driving control unit 104 can perform appropriate relative driving according to the vehicle type (shape, size, driving performance, fuel efficiency, displacement, etc.) of the target vehicle FV by further combining the "vehicle identification information of the target vehicle FV" obtained from the recognition result of the identification mark 60 and controlling the overall ECU 31.

[0112] Furthermore, the "relative driving control" performed by the driving control unit 104 is a control process that specifies position information for the vehicle V to drive on a driving trajectory drawn based on the position information of the target vehicle FV, based on the "position information of the target vehicle FV" included in the target vehicle information acquired from the target vehicle FV. In this relative driving control, control is performed to drive on the driving trajectory at a predetermined position information with a set distance depending on the driving speed of the vehicle V in order to appropriately ensure an inter-vehicle distance between the vehicle V and the target vehicle FV. Specifically, the running speed acquisition unit 117 acquires "running information (acceleration and angular velocity)" of the vehicle V from the inertial measurement device 22, and acquires the "running speed" of the vehicle V in real time by integrating the acceleration and angular velocity. Then, the driving control unit 104 refers to the "inter-vehicle distance data" shown in Figure 11 stored in the memory unit 100, identifies the position information of the vehicle V based on the position information of the target vehicle FV, and performs relative driving control to drive the vehicle V relative to the target vehicle FV based on the position information of the vehicle V and environmental information. In this relative driving control, a process is performed to correct and correct the trajectory based on the "position information of vehicle V" so that the vehicle V actually travels along the position information identified based on the position information of the target vehicle FV. In other words, this is a process to correct the deviation (error) between the position information of the moving body that is identified based on the position information of the target vehicle FV and the position information of the moving body that is actually traveling, and to correct the trajectory. As a result, the storage unit 100 stores the actual travel path of the vehicle V (the travel path based on the position information of the vehicle V).

[0113] The "inter-vehicle distance data" shown in FIG. 11 is a data table showing the correspondence between the traveling speed of the vehicle V and the set inter-vehicle distance. For example, when the traveling speed (average traveling speed) of the vehicle V is "80 km / h", the set inter-vehicle distance between the vehicle V and the target vehicle FV is set to "40 to 70 m". In addition, the "inter-vehicle distance data" may be graph data in which the traveling speed of vehicle V is on the X-axis and the set inter-vehicle distance is on the Y-axis, and the set inter-vehicle distance increases in proportion to the traveling speed (increases quadratically).

[0114] The traveling speed acquisition unit 117 may calculate the "traveling speed" of the vehicle V by processing the "GNSS information (GNSS correction information)" and the "acceleration and angular velocity information" using a Kalman filter to calculate the "speed" of the vehicle V. In this way, the "traveling speed" can be calculated with higher accuracy. In addition, when obtaining "speed information" of the vehicle V, a wheel speed sensor may be newly installed on the vehicle V and the "speed information" may be obtained through the wheel speed sensor.

[0115] The driving control unit 104 performs relative driving control by maintaining a set inter-vehicle distance according to the driving speed of vehicle V, but it may also perform relative driving control of vehicle V with respect to the target vehicle FV based on the synchronization state of vehicle V and target vehicle FV (for example, a state in which when the target vehicle FV travels "1 m", vehicle V also travels "1 m"). In the case of a synchronized state, the driving control unit 104 acquires environmental information around the vehicle V, position information of the vehicle V, and target vehicle information including position information of the target vehicle FV in real time, and combines this information to perform relative driving control.

[0116] <<7. Mode change (relative driving ⇒ autonomous driving)>> (When the target vehicle stops) When relative driving control is being performed with the "relative driving mode" set as shown in Fig. 10B, if the "predetermined condition according to the driving state" of the target vehicle FV is satisfied, the driving mode change unit 116 changes the mode from the relative driving mode to the "autonomous driving mode." Then, the driving control unit 104 performs autonomous driving control in the "autonomous driving mode" as shown in Fig. 10C. A "specified condition according to the driving state" is when the behavior of the target vehicle FV detects that in order for the vehicle V to drive efficiently, it has become necessary for the vehicle V to overtake the target vehicle FV, or that it has become necessary for the vehicle V to drive along a different route than the target vehicle FV. For example, this may be the case when the behavior of the target vehicle FV detects that the target vehicle FV has stopped on the side of the road (on the shoulder) or has started to stop. Another example is when the behavior of the target vehicle FV detects that the target vehicle FV has started traveling a route different from the planned route (specifically, a route toward a rest area). In other words, the "predetermined condition according to the driving state" can also be rephrased as a "relative driving release condition" for releasing the relative driving control of the vehicle V. The following description will be given assuming that a traveling target vehicle FV stops at the side of the road as shown in FIG. 10C.

[0117] When relative driving control is being performed with the "relative driving mode" set as shown in Figure 10B, the environmental information acquisition unit 101 detects that the target vehicle FV has stopped (started stopping) on ​​the side of the road as detection information regarding the driving state of the target vehicle FV. The driving mode change unit 116 determines that a predetermined condition corresponding to the traveling state of the target vehicle FV is met when it is detected that the target vehicle FV has stopped at the side of the road based on the detection result by the environmental information acquisition unit 101. Then, the driving mode change unit 116 changes the mode from the "relative driving mode" to the "autonomous driving mode." Then, the driving control unit 104 performs autonomous driving control in the "autonomous driving mode". Specifically, while grasping driving environment information around the vehicle V, the driving control unit 104 performs autonomous driving control of the vehicle V so as to overtake the target vehicle FV as shown in FIG. 10C. Since the "autonomous driving mode" is always set (enabled), the driving control unit 104 can smoothly transition from relative driving control to autonomous driving control.

[0118] (When the target vehicles separate at a branch point) In addition to the above conditions, when relative driving control is being performed with the "relative driving mode" set, if a predetermined condition according to the planned driving route of the target vehicle FV is satisfied, the driving mode change unit 116 changes from the relative driving mode to the "autonomous driving mode." Then, the driving control unit 104 performs autonomous driving control in the "autonomous driving mode." The "predetermined condition according to the planned driving route" refers to a case where it is detected that the planned driving route of the target vehicle FV and the planned driving route of the vehicle V no longer match. For example, it is possible that the planned driving route of the target vehicle FV has been acquired in advance and that the planned driving route no longer matches, or that the planned driving route of the target vehicle FV has been changed and the changed planned driving route no longer matches. The following description will be given assuming that the target vehicle FV and the vehicle V separate at a branch point.

[0119] The communication unit 115 receives, from the vehicle information transmission device 50, "target vehicle information" including position information of the target vehicle FV and information on the planned driving route. 10B, when relative driving control is being performed with the "relative driving mode" set, if it is detected that the planned driving routes of both vehicles no longer match based on the target vehicle information obtained by the communication unit 115, the driving mode change unit 116 considers that the "predetermined condition according to the driving state" is satisfied, and then changes from the relative driving mode to the "autonomous driving mode." Then, the traveling control unit 104 performs autonomous driving control in the "autonomous driving mode". Specifically, the traveling control unit 104 separates from the target vehicle FV at a predetermined branch point and starts autonomous driving control of the vehicle V.

[0120] The above configuration makes it possible to realize a driving control device 1 that enables the vehicle V to travel relative to the target vehicle FV and that can change the driving state of the vehicle V as necessary. In addition, by using the driving control device 1, it is possible to receive position information of the target vehicle FV in real time and switch between "autonomous driving control" and "relative driving control" depending on the behavior (changes in driving conditions) of the target vehicle FV.

[0121] <<8. Remote operation control>> Next, the "remote operation control" will be described. The image processor 118 acquires external image data of the vehicle V from each of the multiple image capture devices 11a-11i, and creates a composite image (composite image data) by combining the respective external images based on predetermined layout information. By generating the above-mentioned composite video and transmitting the generated composite video data to the remote control device 70, data communication costs can be reduced compared to the case of transmitting a plurality of external video data.

[0122] The communication unit 115 executes transmission and reception of data between the driving control device 1 and the remote control device 70 by using the in-vehicle communication device 40 . Specifically, the communication unit 115 transmits to the remote control device 70 the “environmental information” obtained by the environmental information acquisition unit 101 and the “current location information” obtained by the self-location estimation unit 103 as information necessary for “remote driving” of the vehicle V. In addition, the communication unit 115 receives "driving operation information" of the vehicle V from the remote control device 70 that has accepted a user input by an operator. The driving control unit 104 controls the integrated ECU 31 based on the “driving operation information” of the vehicle V acquired from the remote operation device 70, and executes “remote driving control” of the vehicle V.

[0123] With the above configuration, it is possible to realize a driving control device 1 that is also capable of performing "remote driving control" in which an operator remotely controls the vehicle V to drive it. Therefore, it is possible to switch between "remote driving control" and "relative driving control" depending on the behavior of the target vehicle FV. When switching from "remote driving control" to "relative driving control", the operator is freed from the task of remotely driving the vehicle V.

[0124] <Travel control method (movement control method)> Next, an example of the process of the driving control program (driving control operation method) executed by the driving control system S will be described with reference to FIGS. The above program in this embodiment is a program for realizing the above-mentioned environmental information acquisition unit 101, driving information acquisition unit 102, self-position estimation unit 103, driving control unit 104, reference point identification unit 105, reference point recording unit 106, map creation unit 107, recognition unit 108, estimation mode switching unit 109, detection unit 110, position error measurement unit 111, correction route setting unit 112, travel direction recognition unit 113, vehicle detection unit 114, communication unit 115, driving mode change unit 116, driving speed acquisition unit 117, and image processing unit 118 as functional components of the driving control device 1 equipped with a memory unit 100, and the CPU (processor) of the driving control device 1 executes this driving control program. The above program is executed upon receiving an operation instruction from a user (specifically, a driver of the vehicle V or an external operator).

[0125] FIG. 12 is a process flow diagram showing the flow of processes performed in the driving control device 1, and showing a driving control method (1) related to self-position estimation. FIG. 13 is a process flow diagram showing a driving control method (2) for estimating a vehicle's own position using map information. FIG. 14 is a process flow diagram showing the travel direction based driving control method (3). FIG. 15 is a process flow diagram showing a driving control method (4) related to a change in the driving mode.

[0126] The cruise control flow (1) shown in FIG. 12 starts with step 1 (S1) in which the cruise control device 1 starts the process of self-position estimation when the vehicle V starts traveling.

[0127] In step 2, the self-position estimation unit 103 (reception determination unit 103d) determines whether or not the "GNSS information" of the vehicle V can be received in real time. If it is determined that "GNSS information" can be received (Step 2: Yes), proceed to Step 3, where the first position estimation unit 103a acquires the "GNSS information" necessary for independent positioning and calculates the "absolute position" of vehicle V by independent positioning. On the other hand, if it is determined that the “GNSS information” cannot be received (step 2: No), the process proceeds to step 7.

[0128] In step 4, the first position estimation unit 103a estimates the current position of the vehicle V based on the "absolute position" of the vehicle V. Then, in step 5, the driving control unit 104 performs driving control of the vehicle V while estimating the current position of the vehicle V. Then, in step 6, the cruise control device 1 ends the estimation of its own position and the cruise control when the vehicle V has arrived at the destination position. If the vehicle V has not arrived at the destination position, the process returns to step 2.

[0129] In step 7, the reception determination unit 103d determines whether or not "environmental information" about the surroundings of the vehicle V can be received in real time. If it is determined that the "environmental information" can be received (step 7: Yes), the process proceeds to step 8, where the second position estimation unit 103b acquires the "environmental information" of the vehicle V. Then, the process proceeds to step 4, where the second position estimation unit 103b estimates the current position of the vehicle V based on the "environmental information" of the vehicle V. Then, the process proceeds to step 5, where the driving control unit 104 performs driving control of the vehicle V while estimating the current position of the vehicle V. In step 6, the driving control device 1 ends the estimation of its own position and driving control when the vehicle V arrives at the destination position. On the other hand, if it is determined that the “environmental information” cannot be acquired (step 7: No), the process proceeds to step 9.

[0130] In step 9, the reception determination unit 103d determines whether or not the "travel information" of the vehicle V can be received in real time. If it is determined that the "traveling information" can be received (step 9: Yes), the process proceeds to step 10, where the third position estimation unit 103c acquires the "traveling information" of the vehicle V. Then, the process proceeds to step 4, where the third position estimation unit 103c estimates the current position of the vehicle V based on the "travel information" of the vehicle V. Then, the process proceeds to step 5, where the driving control unit 104 performs driving control of the vehicle V while estimating the current position of the vehicle V. In step 6, the driving control device 1 ends the estimation of its own position and driving control when the vehicle V arrives at the destination position. On the other hand, if it is determined that the "driving information" cannot be acquired (step 9: No), the estimation of the self-position and the driving control are terminated. After going through the above steps, the process of FIG. 12 is completed.

[0131] Next, as shown in FIG. 13, a process flow of the driving control method (2) for estimating the vehicle's own position using map information will be described. The flow starts from step 101 (S101) in which the driving control device 1 starts the driving control process when the vehicle V starts to drive.

[0132] In step 102, the self-position estimation unit 103 estimates the self-position of the vehicle V in a “first estimation mode” based on the GNSS information. Then, the driving control unit 104 controls the driving of the vehicle V based on the map information and the “position information (current position)” of the vehicle V.

[0133] In step 103, the recognition unit 108 recognizes that the vehicle V has reached a first reference point (entrance reference point) using map information while the vehicle V is traveling along a predetermined planned traveling route. Then, in step 104, the estimation mode switching unit 109 switches the estimation mode at the first reference point. Specifically, the estimation mode switching unit 109 switches from a "first estimation mode" based on GNSS information to a "second estimation mode" based on environmental information. Then, in step 105, the self-position estimation unit 103 estimates the current position of the vehicle V in the “second estimation mode” set by the estimation mode switching unit 109. Then, the traveling control unit 104 controls the traveling of the vehicle V based on the map information and the “position information” of the vehicle V. The estimation mode switching unit 109 may also switch from the "first estimation mode" to a "third estimation mode" based on the driving information.

[0134] In step 106, the recognition unit 108 recognizes that the vehicle V has reached a second reference point (exit reference point) using the map information while the vehicle V is traveling along a predetermined planned traveling route. Then, in step 107, the estimation mode switching unit 109 switches the estimation mode at the second reference point. Specifically, the estimation mode switching unit 109 switches from the "second estimation mode" back to the "first estimation mode". Then, in step 108, the self-position estimation unit 103 estimates the current position of the vehicle V in the “first estimation mode” set by the estimation mode switching unit 109. Then, the traveling control unit 104 controls the traveling of the vehicle V based on the map information and the “position information” of the vehicle V.

[0135] Finally, in step 109, the cruise control device 1 ends the cruise control when the vehicle V has arrived at the destination position. If the vehicle V has not arrived at the destination position, the process returns to step . After going through the above steps, the process of FIG. 13 is completed.

[0136] Next, as shown in FIG. 14, a process flow of the driving control method (3) based on the traveling direction will be described. In this flow, the process first starts from step 201 (S201) in which the driving control device 1 starts the driving control process when the vehicle V starts to drive.

[0137] In step 202, the self-position estimation unit 103 estimates the self-position of the vehicle V based on a predetermined estimated state (the first estimated state or the second estimated state). Then, the traveling control unit 104 controls the traveling of the vehicle V based on the “position information (current position)” of the vehicle V.

[0138] In step 203, the self-position estimation unit 103 changes the estimated state of the self-position in accordance with a change in the external environment of the vehicle V while the vehicle V is traveling. Then, in step 204, based on the manner in which the estimated state is changed, the traveling direction recognition unit 113 recognizes the "traveling direction" of the vehicle V. In other words, based on the manner in which the information used for estimating the vehicle's own position (GNSS information, environmental information, and driving information) is changed, the traveling direction recognition unit 113 recognizes the "traveling direction" of the vehicle V. Specifically, when the self-position estimation unit 103 changes the state from the "first estimated state" to the "second estimated state," the travel direction recognition unit 113 recognizes the travel direction of the vehicle V as the "first travel direction" (see FIG. 8). More specifically, when the state is changed from the "first estimated state" to the "second estimated state", the travel direction recognition unit 113 recognizes the "first travel direction" at the time when the self-position estimation unit 103 starts estimating the current position of the vehicle V based on the "environmental information".

[0139] In step 205, the reference point identification unit 105 identifies the change position (switching position) of the estimated state as a reference point. Specifically, when the "first estimated state" is changed to the "second estimated state" and the "first traveling direction" is recognized, the reference point identification unit 105 identifies the position where the self-position estimation unit 103 starts estimating the self-position of the vehicle V based on the "environmental information" as the "first reference point."

[0140] In step 206, the self-position estimation unit 103 estimates the self-position of the vehicle V based on the changed estimated state. Then, the traveling control unit 104 controls the traveling of the vehicle V based on the “position information (current position)” of the vehicle V.

[0141] Finally, in step 207, the cruise control device 1 ends the cruise control when the vehicle V has arrived at the destination position. If the vehicle V has not arrived at the destination position, the process returns to step 202. After going through the above steps, the process of FIG. 14 is completed.

[0142] Next, as shown in FIG. 15, a process flow of the driving control method (4) related to the change of the driving mode will be described. In this flow, first, the driving control device 1 sets the "autonomous driving mode" when the host vehicle V starts to drive. The flow starts from step S301. The driving control device 1 may be set to a "remote control driving mode" instead of the "autonomous driving mode". If the "remote control driving mode" is set, the driving control unit 104 performs remote control driving control of the host vehicle V in step S303 described below.

[0143] Next, in step S302, the environmental information acquisition unit 101 starts acquiring "environmental information" around the host vehicle V, and the self-position estimation unit 103 starts acquiring "position information of the host vehicle V." Then, in step S303, the driving control unit 104 controls the integrated ECU 31 based on the environmental information and the position information of the host vehicle V, and performs "autonomous driving control" of the host vehicle V (see FIG. 10A).

[0144] Next, in step S304, the vehicle detection unit 114 detects whether or not a predetermined preceding vehicle is a target vehicle FV to be followed up on the planned travel route of the host vehicle V. Specifically, the vehicle detection unit 114 determines whether a specific preceding vehicle is a target vehicle FV based on the recognition result of the identification mark 60 of the specific preceding vehicle recognized by the imaging device 11, based on the above-mentioned specified relative driving start condition. If the vehicle detection unit 114 determines that the vehicle is a target vehicle FV by satisfying a predetermined relative driving start condition (step S304: Yes), the process proceeds to step S305. On the other hand, if the vehicle detection unit 114 does not determine that the vehicle is a target vehicle FV because the predetermined relative driving start condition is not satisfied (step S304: No), the process returns to step S302. In other words, the autonomous driving control in the "autonomous driving mode" is continued.

[0145] Next, in step S305, the driving mode change unit 116 sets the "relative driving mode" in the state in which the "autonomous driving mode" is set. In other words, the "relative driving mode" is changed from an invalid state to an valid state while the "autonomous driving mode" is set to an valid state.

[0146] Next, in step S306, the communication unit 115 attempts to receive “target vehicle information” including “position information of the target vehicle FV” detected by the vehicle detection unit 114. More specifically, the communication unit 115 starts communication with the vehicle information transmission device 50 mounted on the target vehicle FV via the network, and attempts to receive position information of the target vehicle FV from the vehicle information transmission device 50.

[0147] If the communication unit 115 receives position information of the target vehicle FV from the target vehicle FV (step S306: Yes), the process proceeds to step S307, and the driving control unit 104 controls the overall ECU 31 based on the ``environmental information,'' ``position information of the host vehicle V,'' and ``target vehicle information of the target vehicle FV,'' and performs ``relative driving control'' of the host vehicle V relative to the target vehicle FV (see Figure 10B). On the other hand, if the communication unit 115 does not receive position information of the target vehicle FV (step S306: No), proceed to step S308, and with the "autonomous driving mode" set, the driving mode change unit 116 changes the "relative driving mode" from an enabled state to an disabled state, cancels it, and then returns to step S302.

[0148] Next, in step S309, the driving mode change unit 116 determines whether or not the target vehicle FV satisfies a "predetermined condition" when relative driving control is being performed with the "relative driving mode" set. Specifically, the driving mode change unit 116 determines whether the target vehicle FV satisfies "predetermined conditions according to the driving conditions" or whether the target vehicle FV satisfies "predetermined conditions according to the planned driving route". In addition, when the driving mode change unit 116 determines that either the "specified condition according to the driving state" or the "specified condition according to the planned driving route" of the target vehicle FV is satisfied, it determines that the above-mentioned "specified condition" is satisfied.

[0149] If it is determined that the target vehicle FV satisfies the "predetermined condition" (step S309: Yes), the process proceeds to step S310, where the driving mode change unit 116 changes the "relative driving mode" from an enabled state to an disabled state and cancels it. Then, in step S311, the traveling control unit 104 performs autonomous driving control in the "autonomous driving mode" as shown in FIG. 10C. For example, when a "predetermined condition according to the driving state" is met by detecting that the target vehicle FV has stopped while driving, the driving mode change unit 116 cancels the "relative driving mode", and the driving control unit 104 switches to relative driving control to perform autonomous driving control. On the other hand, if it is determined that the target vehicle FV does not satisfy the "predetermined condition" (step S309: No), the process returns to step S307.

[0150] Finally, in step S312, if the driving control device 1 determines that the vehicle V has arrived at the destination or that the autonomous driving control in the autonomous driving mode should be terminated (step S312: Yes), the process of FIG. 15 is terminated. On the other hand, if the cruise control device 1 continues to control the driving of the host vehicle V (step S312: No), the process returns to step S302.

[0151] According to the above driving control program, it is possible to more accurately estimate the current position of a traveling vehicle. In addition, the vehicle V can travel relative to the target vehicle FV, and the driving state of the vehicle V can be changed as necessary.

[0152] <Other embodiments> In the above embodiment, a driving control program is stored in a recording medium readable by the driving control device 1, and the driving control device 1 reads and executes the program to execute processing. Here, the recording medium readable by the driving control device 1 refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. In addition, a terminal (mobile terminal) serving as the driving control device 1 may be used to start up dedicated software, and the driving control program may be executed on a web browser.

[0153] In the above embodiment, the driving control device, the driving control method, and the driving control program according to the present invention have been mainly described. However, the above embodiment is merely an example for facilitating understanding of the present invention, and is not intended to limit the present invention. The present invention can be modified or improved without departing from the spirit of the present invention, and the present invention naturally includes equivalents thereof. [Explanation of symbols]

[0154] S Driving control system (movement control system) V Vehicle, own vehicle (moving object) V1 Electric Power Steering V1a Handle V2 Electric Throttle V2a Accelerator Pedal V3 Electromagnetic Brake Device V3a Brake Pedal FV Target vehicle (target moving object) 1. Travel control device (movement control device) 10 Vehicle-mounted sensor (first sensor, external sensor) 11 Imaging device 11a to 11i: 1st imaging device to 9th imaging device 12 Radar (millimeter wave radar) 12a~12d Radar 1~4 13 Rider 13a~13e 1st Rider~5th Rider 20 Vehicle Locator 21 GNSS receiver (RTK-GNSS receiver) 22 Inertial Measurement Unit (IMU, second sensor, internal sensor) 30 Automotive ECU 31 Integrated ECU 32 Steering ECU 33 Accelerator ECU 34 Brake ECU 40 In-vehicle communication device 50 Vehicle information transmission device (information transmission device) 51 Vehicle Locator 51a GNSS receiver 51b Inertial measurement device 52 Vehicle-mounted communication device 60 Identification Mark 60a~60l 1st identification mark~12th identification mark 70 Remote control device (operation device) 71 Display Monitor 72 Display Navigation Monitor 73 Handle 74 Accelerator pedal 75 Brake pedal 76 Operation switch 100 Storage section 101 Environmental Information Acquisition Department 102 Travel information acquisition unit (movement information acquisition unit) 103 Self-position estimation part 103a Reception determination unit 103b First position estimation section 103c Second position estimation section 103d Third position estimation section 104 Driving control unit 105 Reference point identification part 106 Reference Point Recording Section 107 Map Creation Department 108 Recognition part 109 Estimation mode switching section 110 Detection unit 111 Position error measurement section 112 Correction path setting section 113 Traveling direction recognition unit 114 Vehicle detection unit 115 Communications Department 116 Operation mode change section 117 Travel speed acquisition unit 118 Video Processing Unit 500 storage section 501 Location information acquisition unit 502 Communication Department (Second Communication Department) 700 Storage section 701 Communications Department (3rd Communications Department) 702 Screen display section 703 Operation Data Creation Department 704 User Notification Unit SA satellite ST reference station

Claims

1. A movement control device for controlling movement of a moving object, a self-position estimation unit that acquires GNSS information through a GNSS receiver mounted on the moving object and estimates a current position of the moving object based on the GNSS information; an environmental information acquisition unit that acquires environmental information around the moving object through a sensor mounted on the moving object; a travel direction recognition unit that recognizes a travel direction of the moving object, the self-location estimation unit, when unable to acquire the GNSS information, estimates a current location of the moving object based on the environmental information acquired by the environmental information acquisition unit; The movement control device includes: a reference point identification unit which identifies, as a first reference point, a position where a first traveling direction is recognized by the traveling direction recognition unit and where a first estimated state in which the self-location estimation unit estimates the current position of the moving object based on the GNSS information is changed to a second estimated state in which the self-location estimation unit estimates the current position of the moving object based on the environmental information, and which identifies, as a second reference point, a position where a second traveling direction different from the first traveling direction is recognized by the traveling direction recognition unit and where a second estimated state is changed from the second estimated state to the first estimated state, a reference point recording unit that records a reference point identified by the reference point identifying unit, the reference point being a position at which a traveling direction of the moving object is recognized and an estimated state is changed; a switching unit that switches an estimation state by the self-position estimation unit based on the reference point recorded by the reference point recording unit, the switching unit switches from the first estimated state to the second estimated state when the moving object reaches the first reference point or when the moving object reaches within a certain distance from the first reference point; the self-location estimation unit estimates a current location of the moving object based on the environmental information in the second estimation state to which the self-location estimation unit has been switched; The mobile control device controls the movement of the moving body based on the current position of the moving body estimated by the self-position estimation unit and the traveling direction of the moving body recognized by the traveling direction recognition unit.

2. A movement control device for controlling movement of a moving object, a self-position estimation unit that acquires GNSS information through a GNSS receiver mounted on the moving object and estimates a current position of the moving object based on the GNSS information; an environmental information acquisition unit that acquires environmental information around the moving object through a sensor mounted on the moving object; a travel direction recognition unit that recognizes a travel direction of the moving object, the self-location estimation unit, when unable to acquire the GNSS information, estimates a current location of the moving object based on the environmental information acquired by the environmental information acquisition unit; The movement control device includes: a reference point identification unit which identifies, as a first reference point, a position where a first traveling direction is recognized by the traveling direction recognition unit and where a first estimated state in which the self-location estimation unit estimates the current position of the moving object based on the GNSS information is changed to a second estimated state in which the self-location estimation unit estimates the current position of the moving object based on the environmental information, and which identifies, as a second reference point, a position where a second traveling direction different from the first traveling direction is recognized by the traveling direction recognition unit and where a second estimated state is changed from the second estimated state to the first estimated state, a reference point recording unit that records a reference point identified by the reference point identifying unit, the reference point being a position at which a traveling direction of the moving object is recognized and an estimated state is changed; a switching unit that switches an estimation state by the self-position estimation unit based on the reference point recorded by the reference point recording unit, the switching unit switches from the second estimated state to the first estimated state when the moving object reaches the second reference point or when the moving object reaches within a certain distance from the second reference point; the self-location estimation unit estimates a current location of the moving object based on the GNSS information in the first estimation state to which the self-location estimation unit has been switched; The mobile control device controls the movement of the moving body based on the current position of the moving body estimated by the self-position estimation unit and the traveling direction of the moving body recognized by the traveling direction recognition unit.

3. The reference point is a boundary point when the moving object enters or exits a different space in a plurality of spaces divided based on an estimated state of the self-location, The first reference point and the second reference point are boundary points between a first space in which the self-location can be estimated based on the GNSS information and a second space in which the self-location cannot be estimated based on the GNSS information and the self-location can be estimated based on the environmental information, a map creation unit that creates map information including the reference point or updates the map information based on history information of the reference point recorded by the reference point recording unit; The switching unit is switching a state in which a current position of the moving object moving in the first space is estimated from the first estimation state to the second estimation state when the moving object has arrived at the first reference point included in the map information or within a certain distance from the first reference point; 3. The mobile control device according to claim 1 or 2, wherein a state for estimating the current position of the mobile body moving within the second space is switched from the second estimation state to the first estimation state when the mobile body reaches the second reference point included in the map information or within a certain distance from the second reference point.

4. The mobile control device according to claim 1 or 2, wherein the self-position estimation unit estimates the current position of the mobile body based on the switched estimation state (excluding a unit that estimates the current position of the mobile body based on an estimation state changed depending on a communication situation).

5. a movement information acquisition unit that acquires movement information of the moving object through a second sensor mounted on the moving object; the self-location estimation unit, when unable to acquire the GNSS information and the environmental information, estimates a current location of the moving object based on the movement information acquired by the movement information acquisition unit; The movement control device includes: Controlling the movement of the moving object along a predetermined planned movement route; a position error measurement unit that, when the self-location estimation unit is changed from a third estimation state in which the self-location estimation unit estimates the current location of the moving object based on the movement information to a first estimation state in which the self-location estimation unit estimates the current location of the moving object based on the GNSS information, measures a position error between the current location of the moving object estimated in the third estimation state and the current location of the moving object estimated in the first estimation state; The movement control device according to claim 1 , further comprising: a correction path setting unit that sets a movement correction path for leading the movement control device to the planned movement path based on the position error measured by the position error measuring unit.

6. a movement information acquisition unit that acquires movement information of the moving object through a second sensor mounted on the moving object; the self-location estimation unit, when unable to acquire the GNSS information and the environmental information, estimates a current location of the moving object based on the movement information acquired by the movement information acquisition unit; the reference point identification unit, when the travel direction is recognized by the travel direction recognition unit and the self-location estimation unit is changed from a third estimated state in which the current location of the moving object is estimated based on the movement information to the first estimated state, identifies a position changed from the third estimated state to the first estimated state as another reference point; The reference point recording unit records the other reference points, the switching unit switches from the third estimated state to the first estimated state at the other reference point when the moving object reaches the other reference point; The movement control device includes: Controlling the movement of the moving object along a predetermined planned movement route; a position error measuring unit that, when the switching unit switches from the third estimated state to the first estimated state at the other reference point, measures a position error between the current position of the moving object estimated in the third estimated state and the current position of the moving object estimated in the first estimated state; The movement control device according to claim 1 or 2, further comprising: a correction path setting unit that sets a movement correction path for leading the movement control device to the planned movement path based on the position error measured at the other reference point.

7. A movement control method executed by a computer for controlling movement of a moving object, comprising: The computer, acquiring GNSS information through a GNSS receiver mounted on the moving object, and estimating a current position of the moving object based on the GNSS information; acquiring environmental information around the moving body through a sensor mounted on the moving body; Recognizing the direction of travel of the moving object; When the GNSS information cannot be acquired, the current position of the moving object is estimated based on the environmental information; The computer, Identifying, as a first reference point, a position where a first travel direction is recognized and a first estimation state in which the current position of the moving body is estimated based on the GNSS information is changed to a second estimation state in which the current position of the moving body is estimated based on the environmental information, and identifying, as a second reference point, a position where a second travel direction different from the first travel direction is recognized and a position where the second estimation state is changed to the first estimation state from the second estimation state, recording the identified reference point at which the direction of travel of the moving object is recognized and the estimated state is changed; switching an estimation state based on the recorded reference points; when switching the estimated state, switching from the first estimated state to the second estimated state is performed when the moving object reaches the first reference point or when the moving object reaches within a certain distance from the first reference point; When estimating a current position of the moving object, the current position of the moving object is estimated based on the environmental information in the second estimation state to which the switching has been made; The movement control method, wherein the computer controls the movement of the moving object based on the estimated current position of the moving object and the recognized traveling direction of the moving object.

8. A computer as a movement control device for controlling the movement of a moving object, A process of acquiring GNSS information through a GNSS receiver mounted on the moving object and estimating a current position of the moving object based on the GNSS information; A process of acquiring environmental information around the moving body through a sensor mounted on the moving body; and executing a process of recognizing a traveling direction of the moving object; In the process of estimating the current position of the moving object, when the GNSS information cannot be acquired, the current position of the moving object is estimated based on the environmental information; The computer includes: a process of identifying, as a first reference point, a position changed from a first estimation state in which a first traveling direction is recognized and the current position of the moving body is estimated based on the GNSS information to a second estimation state in which the current position of the moving body is estimated based on the environmental information, and identifying, as a second reference point, a position changed from the second estimation state to the first estimation state in which a second traveling direction different from the first traveling direction is recognized and the second estimation state is changed to the first estimation state; a process of recording the specified reference point at which the direction of travel of the moving object is recognized and the estimated state is changed; and switching an estimation state based on the recorded reference point. in the process of switching the estimated state, switching from the first estimated state to the second estimated state when the moving object reaches the first reference point or when the moving object reaches within a certain distance from the first reference point; In the process of estimating a current position of the moving object, a current position of the moving object is estimated based on the environmental information in the second estimation state to which the switching has been made; A movement control program that causes the computer to execute a process of controlling the movement of the moving object based on the estimated current position of the moving object and the recognized traveling direction of the moving object.

Images