Mobile object control system and mobile object control method

The mobile body control system evaluates localization accuracy and initiates safety controls to prevent accuracy degradation, ensuring safe navigation by anticipating potential decreases in localization processing.

JP7616189B2Active Publication Date: 2025-01-17TOYOTA JIDOSHA KK
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022166257
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-10-17
Publication Date
2025-01-17
Estimated Expiration
2042-10-17

AI Technical Summary

Technical Problem

Localization processing for mobile objects often results in decreased accuracy, leading to inadequate safety measures when evacuating the object to a safe location.

Method used

A mobile body control system and method that evaluates the accuracy of future localization processing by comparing expected and actual sensor detection information with feature map information, and executes safety controls such as deceleration or stopping if accuracy falls below tolerance conditions.

Benefits of technology

Ensures improved safety by anticipating accuracy degradation and initiating safety controls before localization processing deteriorates, thereby enhancing the reliability of mobile object navigation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007616189000001
    Figure 0007616189000001
  • Figure 0007616189000002
    Figure 0007616189000002
  • Figure 0007616189000003
    Figure 0007616189000003
Patent Text Reader

Abstract

To improve the safety of a mobile body that performs localization processing.SOLUTION: A mobile body control system performs localization processing to estimate the position of a mobile body based on sensor detection information detected by an external sensor and distinctive object map information. Distinctive objects being present within a first range around the mobile body can be recognized based on the sensor detection information, and are used for localization processing. A second range is the range farther than the first range among detectable ranges of the external sensor. Expectation detection information is sensor detection information that is expected to be detected regarding a distinctive object being present in the second range, and is obtained from the distinctive object map information. Actual detection information is sensor detection information that is actually detected among the expectation detection information. Based on the actual detection information, it is estimated whether the accuracy of future localization processing satisfies tolerance conditions. If the tolerance conditions are not met, the mobile body is decelerated or stopped.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a technique for controlling a moving object that executes a localization process (self-position estimation process). [Background technology]

[0002] Patent Document 1 discloses a self-location estimation device that estimates the self-location of a moving object. The self-location estimation device calculates the self-location estimation accuracy based on the result of a self-location estimation process. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-117893 Summary of the Invention [Problem to be solved by the invention]

[0004] A localization process for estimating the position of a moving object is known. When the accuracy of the localization process is degraded, for example, it is possible to evacuate the moving object to a safe place. However, since the accuracy of the position information of the moving object has already been degraded, the control for evacuating the moving object to a safe place is not necessarily executed with high accuracy.

[0005] One object of the present disclosure is to provide a technology that can improve the safety of a moving body that performs localization processing. [Means for solving the problem]

[0006] A first aspect of the present disclosure relates to a mobile object control system for controlling a mobile object. The mobile control system is one or more storage devices for storing feature map information indicating the positions of features; One or more processors that acquire sensor detection information detected by an external sensor mounted on a moving object and execute a localization process that estimates the position of the moving object based on the sensor detection information and feature map information; Equipped with. Features present within a first range around the moving object can be recognized based on the sensor detection information and are used for localization processing. The second range is a range detectable by the external sensor that is farther than the first range. The expected detection information is sensor detection information that is expected to be detected regarding a feature present in the second range. The one or more processors may further comprise: Obtaining expected detection information based on the feature map information; Acquire actual detection information, which is sensor detection information that is actually detected from the expected detection information; Based on the actual detection information, estimate whether the accuracy of the future localization process satisfies an acceptable condition; If the permissible conditions are not met, the moving body is slowed down or stopped.

[0007] A second aspect of the present disclosure relates to a moving object control method for controlling a moving object. The moving object control method includes: obtaining feature map information indicating the location of the feature; Acquiring sensor detection information detected by an external sensor mounted on a moving object; Executing a localization process to estimate the position of the moving object based on the sensor detection information and the feature map information; Includes. Features present within a first range around the moving object can be recognized based on the sensor detection information and are used for localization processing. The second range is a range detectable by the external sensor that is farther than the first range. The expected detection information is sensor detection information that is expected to be detected regarding a feature present in the second range. The moving object control method further includes: Obtaining expected detection information based on the feature map information; acquiring actual detection information which is sensor detection information that is actually detected among the expected detection information; Estimating whether the accuracy of a future localization process satisfies an acceptable condition based on the actual detection information; and If the permissible conditions are not met, the vehicle will be slowed down or stopped. Includes. Effect of the Invention

[0008] According to the present disclosure, the accuracy of future localization processing is evaluated in advance. If it is found that the accuracy of future localization processing does not satisfy an allowable condition, safety control is executed to slow down or stop the moving body. By executing safety control before the accuracy of the localization processing decreases, it is possible to improve the safety of the moving body. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an overview of a vehicle control system according to an embodiment; [Diagram 2] FIG. 1 is a conceptual diagram for explaining a problem associated with localization processing. [Diagram 3] FIG. 11 is a conceptual diagram for explaining a pre-evaluation process according to the embodiment. [Figure 4] FIG. 11 is a conceptual diagram for explaining an example of a pre-evaluation process according to the embodiment. [Diagram 5] FIG. 11 is a conceptual diagram for explaining another example of the pre-evaluation process according to the embodiment. [Figure 6] 1 is a flowchart summarizing a process related to a pre-evaluation process according to an embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] The present disclosure relates to control of a moving body. Examples of the moving body include a vehicle, a robot, and the like. The moving body may be capable of autonomous driving. The vehicle may be a self-driving vehicle. As an example, in the following description, a case where the moving body is a vehicle will be considered. When generalizing, "vehicle" in the following description will be read as "moving body".

[0011] 1. Overview of the vehicle control system 1-1. Configuration example 1 is a block diagram showing an overview of a vehicle control system 10 according to the present embodiment. The vehicle control system 10 controls a vehicle 1. The vehicle control system 10 includes an internal sensor 20, an external sensor 30, a GNSS (Global Navigation Satellite System) sensor 40, a traveling device 50, and a control device 100.

[0012] The internal sensor 20 is mounted on the vehicle 1 and detects the traveling state of the vehicle 1. Examples of the internal sensor 20 include a vehicle speed sensor (wheel speed sensor), a steering angle sensor, an acceleration sensor, and a yaw rate sensor.

[0013] The external sensor 30 is mounted on the vehicle 1 and detects the surrounding conditions of the vehicle 1. Examples of the external sensor 30 include a LIDAR (Laser Imaging Detection and Ranging), a camera, and a radar.

[0014] The traveling device 50 includes a steering device, a drive device, and a brake device. The steering device steers the wheels. The drive device generates a drive force. The brake device generates a braking force.

[0015] The control device 100 is a computer that controls the vehicle 1. The control device 100 includes one or more processors 110 (hereinafter simply referred to as processor 110) and one or more storage devices 120 (hereinafter simply referred to as storage device 120). The processor 110 executes various processes. For example, the processor 110 includes a CPU (Central Processing Unit). The storage device 120 stores various information. Examples of the storage device 120 include a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), and the like. Typically, the control device 100 is mounted on the vehicle 1. Alternatively, a part of the control device 100 may be disposed in an external device outside the vehicle 1 and control the vehicle 1 remotely.

[0016] The storage device 120 stores a vehicle control program 210, vehicle driving information 220, sensor detection information 230, map information 240, localization result information 250, and the like.

[0017] The vehicle control program 210 is a computer program for controlling the vehicle 1. The processor 110 executes the vehicle control program 210 to realize various processes by the control device 100. The vehicle control program 210 may be recorded in a computer-readable recording medium.

[0018] The vehicle driving information 220 is information detected by the internal sensor 20, and indicates the driving state of the vehicle 1. The driving state of the vehicle 1 includes the vehicle speed, the steering angle, the acceleration, the yaw rate, and the like.

[0019] The sensor detection information 230 is information detected by the external sensor 30. For example, the sensor detection information 230 includes point cloud information obtained by a LIDAR. As another example, the sensor detection information 230 may include an image captured by a camera.

[0020] Furthermore, the sensor detection information 230 includes object information on objects around the vehicle 1. Examples of objects around the vehicle 1 include pedestrians, other vehicles, obstacles, and feature objects FE. The feature objects FE are objects (landmarks) used in the localization process described later. Examples of feature objects FE include white lines, curbs, poles, telephone poles, signs, signs, and building corners. The feature objects FE can also be called "feature amounts." The object information indicates the relative position and relative speed of an object with respect to the vehicle 1. For example, an object can be recognized based on point cloud information obtained by LIDAR, and the relative position and relative speed of the object can be obtained. As another example, an object can be recognized and identified by analyzing an image obtained by a camera, and the relative position of the object can be calculated.

[0021] The map information 240 includes a general navigation map. The map information 240 may indicate lane arrangements and road shapes. Furthermore, the map information 240 includes "feature object map information MAP-FE." The feature object map information MAP-FE indicates the position (absolute position) of a feature object FE in an absolute coordinate system. This feature object map information MAP-FE is used in the localization process described later.

[0022] 1-2. Localization processing (self-position estimation processing) The processor 110 executes a localization process to estimate the position (absolute position) of the vehicle 1. The position of the vehicle 1 will hereinafter be simply referred to as the “vehicle position.” An initial value of the vehicle position is obtained by the GNSS sensor 40, for example.

[0023] The processor 110 acquires the vehicle driving information 220, calculates the amount of movement (displacement) of the vehicle 1 based on the steering angle and vehicle speed of the vehicle 1, and estimates a rough vehicle position based on the amount of movement. The method of estimating the vehicle position based on the steering angle and vehicle speed is also called "dead reckoning."

[0024] Furthermore, the processor 110 acquires the sensor detection information 230, and recognizes (extracts) a feature FE around the vehicle 1 based on the sensor detection information 230. The object information indicates the relative position of the recognized feature FE with respect to the vehicle 1. The absolute position of the recognized feature FE is calculated by combining the vehicle position obtained by dead reckoning with the relative position of the recognized feature FE. Meanwhile, the absolute position of the feature FE is registered in the feature map information MAP-FE. The processor 110 corrects the vehicle position so that the absolute position of the recognized feature FE and the absolute position of the feature FE obtained from the feature map information MAP-FE match as closely as possible. In other words, the processor 110 corrects the vehicle position by comparing the recognition result of the feature FE by the external sensor 30 with the feature map information MAP-FE.

[0025] The processor 110 can continuously obtain a highly accurate vehicle position by repeatedly performing the position estimation by dead reckoning and the above-described position correction.

[0026] Furthermore, the processor 110 may calculate the reliability of the estimated vehicle position, i.e., the reliability of the localization process. Various methods for calculating the reliability have been proposed. For example, a probability density distribution is defined for the vehicle position estimated by the localization process. The smaller the variance of the probability density distribution, the higher the reliability of the localization process. Conversely, the larger the variance of the probability density distribution, the lower the reliability of the localization process.

[0027] The localization result information 250 indicates the result of the localization process. Specifically, the localization result information 250 indicates the vehicle position estimated by the localization process. The localization result information 250 may further indicate the reliability of the localization process.

[0028] 1-3.Vehicle driving control The processor 110 executes vehicle driving control for controlling the driving of the vehicle 1. The vehicle driving control includes steering control, acceleration control, and deceleration control. The processor 110 executes the vehicle driving control by controlling the driving device 50 (steering device, driving device, braking device).

[0029] The processor 110 also executes driving assistance control to assist the driving of the vehicle 1. The driving assistance control automatically performs at least one of steering, acceleration, and deceleration without the need for driving operation by the driver. Examples of such driving assistance control include automatic driving control, risk avoidance control, and lane keeping control. In the driving assistance control, the processor 110 generates a target route (target trajectory) of the vehicle 1 based on the vehicle driving information 220, the sensor detection information 230 (object information), the map information 240, and the localization result information 250 (vehicle position information). For example, the target route is generated so as to follow the center position of the lane. As another example, the target route is generated so as to avoid an obstacle in front of the vehicle 1. Then, the processor 110 executes vehicle driving control so that the vehicle 1 follows the target route.

[0030] In order to ensure the accuracy of driving assistance control, the accuracy of the vehicle position, that is, the accuracy of the localization process, is important.

[0031] 2. Description of the assignment 2 is a conceptual diagram for explaining a problem related to localization processing. When the vehicle 1 is at point PA, there are feature objects FE1 to FE4 around the vehicle 1. These feature objects FE1 to FE4 are visible to the external sensor 30 and are recognized based on the sensor detection information 230. The number of recognized feature objects FE1 to FE4 is sufficient for localization processing, and the localization processing is performed with high accuracy based on them.

[0032] When the vehicle 1 is at the point PB, there are feature objects FE5 to FE8 around the vehicle 1. However, these feature objects FE5 to FE8 are blocked by obstacles 3 (e.g., parked vehicles, newly installed objects) and are not visible to the external sensor 30. In other words, the feature objects FE5 to FE8 are not recognized based on the sensor detection information 230. Since the recognized feature objects FE are insufficient, the accuracy of the localization process decreases. Similarly, when a feature object FE registered in the feature map information MAP-FE is removed and lost, the recognized feature object FE becomes insufficient and the accuracy of the localization process decreases.

[0033] When the accuracy of the localization process is degraded, for example, it is possible to execute vehicle driving control to evacuate the vehicle 1 to a safe place (e.g., roadside). However, since the accuracy of the position information of the vehicle 1 has already been degraded, the vehicle driving control to evacuate the vehicle 1 to a safe place is not necessarily executed with high accuracy. This is undesirable from the viewpoint of the safety of the vehicle 1.

[0034] 3.Pre-evaluation process According to this embodiment, the processor 110 executes a "pre-evaluation process" that evaluates in advance the accuracy of the localization process in the near future. If the result of the pre-evaluation process indicates that the accuracy of the localization process in the near future does not satisfy an allowable condition, the processor 110 executes a "safety control" that decelerates or stops the vehicle 1 early. The safety control may evacuate the vehicle 1 to a safe place such as a road shoulder and stop it. It is possible to improve the safety of the vehicle 1 by detecting a decrease in the accuracy of the localization process in advance and executing the safety control before the accuracy of the localization process decreases.

[0035] The pre-evaluation process according to this embodiment will be described in more detail below.

[0036] FIG. 3 is a conceptual diagram for explaining the range detectable by the external sensor 30. The detectable range of the external sensor 30 can also be called the visual field range or the measurement range. Here, as an example, a case is considered where the external sensor 30 is a LIDAR. Distance d2 is the maximum measurement distance of the LIDAR. The range from the vehicle 1 to the distance d2 is the detectable range (measurement range) of the LIDAR. The sensor detection information 230 includes point cloud information obtained by the LIDAR.

[0037] The density of the laser light emitted from the LIDAR decreases as the distance from the LIDAR increases. Therefore, the number of point clouds obtained from a certain feature FE (e.g., a signboard) decreases as the distance between the vehicle 1 and the feature FE increases. When the number of point clouds is small, it is possible to know that the laser light is being reflected by something, but the something is not recognized (extracted, clustered) as a single object. In other words, when the number of point clouds is small, the feature FE is not recognized based on the point cloud. As the vehicle 1 approaches the feature FE, the number of point clouds obtained from the feature FE increases. When the number of point clouds reaches a certain value Nth or more, the feature FE is recognized (extracted) with sufficient accuracy based on the point cloud. The distance d1 is the distance between the vehicle 1 and the feature FE, and is the distance at which the number of point clouds becomes Nth. The distance d1 may be different for each type of feature FE. In any case, the distance d1 is smaller than the distance d2 (maximum measurement distance).

[0038] If the external sensor 30 is a camera, then "point cloud" in the above description is replaced with "pixels."

[0039] The first range R1 is a range up to a distance d1 from the vehicle 1. A feature FE existing within the first range R1 around the vehicle 1 can be recognized based on the sensor detection information 230. Then, the recognized feature FE is used in the above-mentioned localization process.

[0040] The second range R2 is a range other than the first range R1 within the detectable range of the external sensor 30. In other words, the second range R2 is a range farther than the first range R1 within the detectable range of the external sensor 30. Although some sensor detection information 230 may be obtained for a feature object FE present in the second range R2, the feature object FE is not recognized based on the obtained sensor detection information 230.

[0041] "Range definition information RNG" that defines the first range R1 and the second range R2 is prepared in advance and stored in the storage device 120. Different range definition information RNG may be prepared for each type of feature object FE. Alternatively, average range definition information RNG may be prepared for various feature objects FE.

[0042] The "expected detection information EXP" is sensor detection information 230 (e.g., point cloud information) that is expected to be detected regarding the feature FE present in the second range R2. The position of the feature FE is registered in the feature map information MAP-FE. If the feature FE is not occluded by another object, and if the feature FE is not removed, it is expected that some sensor detection information 230 will be obtained regarding the position of the feature FE indicated in the feature map information MAP-FE. Thus, the processor 110 can obtain the expected detection information EXP based on the vehicle position, the range definition information RNG, and the feature map information MAP-FE.

[0043] In order to efficiently consider features FE related to the localization process, only a second range R2 in the vicinity of the target route of the vehicle 1 may be considered. The target route of the vehicle 1 is generated in the above-mentioned driving assistance control. In this case, the processor 110 can obtain expected detection information EXP based on the vehicle position, the target route, the range definition information RNG, and the feature map information MAP-FE.

[0044] The "actual detection information ACT" is the sensor detection information 230 that is actually detected among the expected detection information EXP related to the second range R2. The processor 110 acquires the actual detection information ACT based on the expected detection information EXP and the actually detected sensor detection information 230. Then, the processor 110 estimates (determines) whether the accuracy of the future localization process satisfies the allowable condition based on at least the actual detection information ACT.

[0045] FIG. 4 shows an example of a case where the tolerance condition is satisfied. Four features FE5 to FE8 are present in the second range R2. It is expected that sensor detection information 230 will be obtained for the positions of the features FE5 to FE8 from the feature map information MAP-FE. Then, actual detection information ACT indicates that the sensor detection information 230 has actually been obtained from the positions of the features FE5 to FE8. In the future, when the vehicle 1 approaches the vicinity of the features FE5 to FE8, the features FE5 to FE8 will be recognized based on the sensor detection information 230. Because a sufficient number of features FE are available, the processor 110 estimates (determines) that the accuracy of the future localization process will satisfy the tolerance condition.

[0046] On the other hand, Fig. 5 shows an example of a case where the tolerance condition is not satisfied. The features FE5 and FE7 are blocked by an obstacle 3 (e.g., a parked vehicle) and are not visually recognized by the external sensor 30. The features FE6 and FE8 are also removed and are also not visually recognized by the external sensor 30. Therefore, the actual detection information ACT indicates that the sensor detection information 230 is not obtained from the positions of the features FE5 to FE8. In the future, when the vehicle 1 approaches the vicinity of the features FE5 to FE8, the features FE5 to FE8 will not be recognized based on the sensor detection information 230. Because there are insufficient available features FE, the processor 110 estimates (determines) that the accuracy of the future localization process will not satisfy the tolerance condition.

[0047] When it is estimated that the accuracy of the future localization process will not satisfy the tolerance condition, the processor 110 interrupts the driving assistance control and executes safety control early. The safety control includes decelerating or stopping the vehicle 1. The safety control may be to evacuate and stop the vehicle 1 to a safe place such as a road shoulder. The processor 110 executes the safety control before the accuracy of the localization process decreases, that is, when the estimation accuracy of the vehicle position is high. For example, the processor 110 starts the safety control before the vehicle 1 reaches the second range R2. This ensures the safety of the vehicle 1.

[0048] To determine whether the accuracy of future localization processes meets acceptable conditions, the processor 110 may perform the following process.

[0049] The processor 110 obtains an expected number f of features FE that are expected to be recognized when the current second range R2 becomes the first range R1 in the future, based on the expected detection information EXP. In other words, the processor 110 obtains an expected number f of features FE that can be used in future localization processing, based on the expected detection information EXP.

[0050] Further, the processor 110 estimates the number n of feature objects FE that can be recognized when the current second range R2 becomes the first range R1 in the future, based on the actual detection information ACT. In other words, the processor 110 estimates the number n of feature objects FE that can be used in future localization processing, based on the actual detection information ACT. For example, if the number Na of points obtained from the position of the expected feature object FE and its vicinity is equal to or greater than a predetermined threshold, the feature object FE is determined to be recognizable. As another example, the expected number Ne of points is calculated based on the size of the expected feature object FE, and if the ratio of the number Na of points to the expected number Ne is equal to or greater than a predetermined threshold, the feature object FE is determined to be recognizable. Note that the estimated number n of feature objects FE is equal to or less than the expected number f described above.

[0051] Various examples of cases in which the permissible conditions are not satisfied, that is, cases in which safety control is executed, are considered, as follows.

[0052] [First Example] The number of feature objects FE required for localization processing with a certain level of accuracy or higher is assumed to be m. The required number m may be a fixed value or may differ for each location. The required number m, which differs for each location, is, for example, registered in advance in feature object map information MAP-FE. If the estimated number n of feature objects FE is less than the required number m, it is determined that the tolerance condition is not satisfied. In other words, safety control is executed when the estimated number n is less than the required number m. In that case, deceleration or stopping may be selected depending on the magnitude of the estimated number n. For example, when the required number m is 6, stopping is selected when n<2, and deceleration is selected when 2≦n<5.

[0053] [Second Example] The estimated number n of feature objects FE is compared with the above-mentioned expected number f. More specifically, the ratio α (=n / f) of the estimated number n to the expected number f is calculated. If the ratio α is less than the threshold, it is determined that the tolerance condition is not satisfied. In other words, safety control is executed when the ratio α is less than the threshold. In this case, deceleration or stopping may be selected depending on the ratio α. For example, if the threshold is 70%, stopping is selected when α<50%, and deceleration is selected when 50%≦α<70%.

[0054] [Third Example] The estimated number n of feature objects FE is compared with the above-mentioned expected number f. More specifically, the difference β (=fn) between the expected number f and the estimated number n is calculated. If the difference β is greater than the threshold, it is determined that the tolerance condition is not satisfied. In other words, if the difference β is greater than the threshold, safety control is executed. In this case, deceleration or stopping may be selected depending on the difference β. For example, if the threshold is 1, stopping is selected if β>3, and deceleration is selected if 3≧β>1.

[0055] [Fourth Example] The reliability γ of the localization process based on the estimated number n of features FE is calculated. If the reliability γ is less than a threshold, it is determined that the tolerance condition is not satisfied. In other words, safety control is executed when the reliability γ is less than the threshold. In this case, deceleration or stopping may be selected depending on the reliability γ. Stopping is selected when the reliability γ is lower.

[0056] 6 is a flowchart outlining the process related to the preliminary evaluation process according to the present embodiment. A flow related to the localization process is executed separately.

[0057] In step S100, the processor 110 acquires various information such as the sensor detection information 230, the feature map information MAP-FE, the localization result information 250 (vehicle position information), the range definition information RNG, and the target route information.

[0058] In step S110, the processor 110 acquires expected detection information EXP based on the vehicle position information, the range definition information RNG, and the feature map information MAP-FE.

[0059] In step S120, the processor 110 acquires actual detection information ACT based on the expected detection information EXP and the sensor detection information 230 that is actually detected.

[0060] In step S130, the processor 110 estimates (determines) whether or not the accuracy of the future localization process satisfies an acceptable condition, based on at least the actually detected information ACT.

[0061] If the accuracy of the future localization process satisfies the allowable condition (step S130; Yes), the processor 110 continues the driving assistance control (step S140).

[0062] On the other hand, if the accuracy of the future localization process does not satisfy the allowable condition (step S130; No), the processor 110 interrupts the driving assistance control and executes safety control.

[0063] As described above, according to this embodiment, the accuracy of the localization process in the near future is evaluated in advance. If it is found that the accuracy of the localization process in the near future does not satisfy the allowable condition, safety control is executed early. By executing safety control before the accuracy of the localization process decreases, it is possible to improve the safety of the vehicle 1. [Explanation of symbols]

[0064] 1...vehicle, 10...vehicle control system, 20...internal sensor, 30...external sensor, 100...control device, 110...processor, 120...storage device, 230...sensor detection information, FE...feature, MAP-FE...feature map information

Claims

1. A mobile object control system for controlling a mobile object, one or more storage devices for storing feature map information indicating the positions of features; one or more processors that acquire sensor detection information detected by an external sensor mounted on the moving body and execute a localization process that estimates a position of the moving body based on the sensor detection information and the feature map information; Equipped with The feature existing within a first range around the moving object is recognizable based on the sensor detection information and is used for the localization process; the second range is a range detectable by the external sensor that is farther than the first range, the expected detection information is the sensor detection information that is expected to be detected regarding the feature that exists in the second range; The one or more processors further include: obtaining the expected detection information based on the feature map information; acquiring actual detection information, which is the sensor detection information that is actually detected, from the expected detection information; Based on the actual detection information, estimate whether the accuracy of the future localization process satisfies an acceptable condition; If the permissible conditions are not met, the moving body is slowed down or stopped. Mobile control system.

2. The mobile object control system according to claim 1, If the permissible condition is not satisfied, the one or more processors start a control to decelerate or stop the moving object before the moving object reaches the second range. Mobile control system.

3. 3. The mobile object control system according to claim 1, The one or more processors: estimating a number of the features to be utilized in future localization processes based on the actual detection information; Based on the estimated number of features, estimate whether the accuracy of the future localization process satisfies the tolerance condition. Mobile control system.

4. The mobile object control system according to claim 3, The one or more processors: obtaining an expected number of the features available for future localization processes based on the expected detection information; Based on the comparison between the estimated number of features and the expected number of features, a prediction is made as to whether the accuracy of the future localization process will satisfy the tolerance condition. Mobile control system.

5. A mobile object control method for controlling a mobile object, comprising: obtaining feature map information indicating the location of the feature; acquiring sensor detection information detected by an external sensor mounted on the moving object; executing a localization process for estimating a position of the moving object based on the sensor detection information and the feature map information; Including, The feature existing within a first range around the moving object is recognizable based on the sensor detection information and is used for the localization process; the second range is a range detectable by the external sensor that is farther than the first range, the expected detection information is the sensor detection information that is expected to be detected regarding the feature that exists in the second range; The moving object control method further comprises: obtaining the expected detection information based on the feature map information; acquiring actual detection information which is the sensor detection information actually detected from the expected detection information; estimating whether a future accuracy of the localization process satisfies an acceptable condition based on the actual detection information; If the permissible condition is not satisfied, the moving body is slowed down or stopped. Includes A method for controlling a moving object.

Citation Information

Patent Citations

  • Mobile body control device, program, and integrated circuit

    JP2016177749A

  • Autonomous moving device, autonomous moving method and program

    JP2019012504A

  • Vehicle control system and vehicle control method

    JP2021100827A

  • Self position estimation device and self position estimation method

    JP2021117893A

  • Unprotected Turn Early Object Detection

    JP2021505458A