Self-position estimation device

The self-position estimating device enhances vehicle position estimation accuracy by calculating difference values and correcting coefficients based on scanning positions and line intervals, addressing inaccuracies in traveling direction measurements.

JP2024161585AInactive Publication Date: 2024-11-19PIONEER IP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024143980
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2018-03-28
Filing Date
2024-08-26
Publication Date
2024-11-19
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing self-position estimation methods using Bayesian methods struggle to accurately specify the vehicle's position in the traveling direction due to the continuity of structures like white lines and broken lines, leading to inaccuracies in distance measurement.

Method used

A self-position estimating device that calculates a difference value between predicted and measured positions of marking lines using a coefficient correction based on scanning positions and line intervals, enhancing accuracy in both lateral and traveling directions.

Benefits of technology

Improves the accuracy of self-position estimation by correcting the vehicle's position using the end points of marking lines, particularly in the traveling direction, through adaptive Kalman gain and measurement noise adjustments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024161585000001_ABST
    Figure 2024161585000001_ABST
Patent Text Reader

Abstract

To highly accurately estimate a position in a travel direction of a vehicle by using a lane division line such as a white line.SOLUTION: A self-position estimation device is mounted on a mobile body and acquires a predicted position of the mobile body. Additionally, the self-position estimation device calculates a difference value between a predicted position of an end point of a lane division line that is obtained based on information on the end point of the lane division line acquired from map information and a measured position of the end point of the lane division line measured in such a manner that a measurement unit mounted on the mobile body performs scanning with a light in a predetermined direction, and estimates a self-position of the mobile body by correcting the predicted position with a value obtained by multiplying the difference value by a coefficient. Further, the self-position estimation device corrects the coefficient based on an interval of scanning positions of the measurement unit at a position where the end point of the lane division line is detected.SELECTED DRAWING: Figure 12
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a self-location estimation technology. [Background technology]

[0002] Conventionally, there have been known techniques for detecting features installed ahead of a vehicle using a radar or a camera and calibrating the vehicle's position based on the detection results. For example, Patent Document 1 discloses a technique for estimating the vehicle's position by comparing the output of a measurement sensor with position information of features registered in advance on a map. Furthermore, Patent Document 2 discloses a vehicle's position estimation technique using a Kalman filter. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-257742 [Patent Document 2] Japanese Patent Application Publication No. 2017-72422 Summary of the Invention [Problem to be solved by the invention]

[0004] In the self-location estimation based on the Bayesian method disclosed in Patent Document 2, when measuring continuously provided structures such as white lines, curbs, and guardrails, it is possible to measure the distance laterally from the vehicle's perspective, but there is a problem in that it is not possible to accurately determine the distance in the direction of travel due to the continuity in the direction of travel. Furthermore, in the case of dashed line markings, the detected length of the marking line in the fore-and-aft direction changes, so it is similarly not possible to accurately determine the position in the direction of travel.

[0005] The present invention has been made to solve the above-mentioned problems, and its main purpose is to provide a self-position estimation device that can measure lane markings such as white lines and estimate position not only in the lateral direction but also in the direction of travel with high accuracy. [Means for solving the problem]

[0006] The invention described in the claims is a self-position estimation device mounted on a moving body, and comprises: an acquisition means for acquiring a predicted position of the moving body; a difference value calculation means for calculating a difference value between the predicted position of the endpoint of the dividing line obtained based on information on the endpoint of the dividing line acquired from map information and the measured position of the endpoint of the dividing line measured by a measurement unit mounted on the moving body scanning light in a predetermined direction; and an estimation means for correcting the predicted position of the moving body by a value multiplied by a coefficient to estimate the self-position of the moving body. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic configuration diagram of a driving assistance system. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of the vehicle-mounted device. [Figure 3] This is a diagram showing a state variable vector in two-dimensional orthogonal coordinates. [Figure 4] FIG. 10 is a diagram illustrating a schematic relationship between a prediction step and a measurement update step. [Figure 5] 3 shows functional blocks of a vehicle position estimation unit. [Figure 6] We show how to transform lidar measurements into a Cartesian coordinate system. [Figure 7] This shows a method for detecting white lines using a lidar mounted on a vehicle. [Figure 8] Indicates the position of multiple scanlines within a window. [Figure 9] This section describes a method for detecting the end point of the starting part of a white line. [Figure 10] This section describes a method for detecting the end points of white lines. [Figure 11] This shows how to determine the positions of the end points when the reflection intensity changes midway along the scan line. [Figure 12] A method for calculating predicted landmark values ​​for the endpoints of white lines is shown below. [Figure 13] 10 shows the correction coefficient for the Kalman gain. [Figure 14] The correction factor for measurement noise is shown. [Figure 15] 10 is a flowchart of a vehicle position estimation process. DETAILED DESCRIPTION OF THE INVENTION

[0008] One preferred embodiment of the present invention is a self-position estimation device mounted on a moving body, comprising: an acquisition means for acquiring a predicted position of the moving body; a difference value calculation means for calculating a difference value between the predicted position of the endpoint of the demarcation line obtained based on information about the endpoint of the demarcation line acquired from map information and the measured position of the endpoint of the demarcation line measured by a measurement unit mounted on the moving body scanning light in a predetermined direction; and an estimation means for correcting the predicted position of the moving body by a value obtained by multiplying the difference value by a coefficient to estimate the self-position of the moving body, wherein the estimation means corrects the coefficient based on the interval between the scanning positions of the measurement unit at the positions where the endpoints of the demarcation line are detected.

[0009] The self-localization estimation device is mounted on a mobile body and acquires a predicted position of the mobile body. The self-localization estimation device also calculates a difference between the predicted positions of the endpoints of the lane lines, obtained based on information about the endpoints of the lane lines acquired from map information, and the measured positions of the endpoints of the lane lines, measured by scanning light in a predetermined direction using a measurement unit mounted on the mobile body. The self-localization estimation device then estimates the self-localization of the mobile body by correcting the predicted position of the mobile body using a value obtained by multiplying the difference by a coefficient. The self-localization estimation device then corrects the coefficient based on the interval between the scanning positions of the measurement unit at the positions where the endpoints of the lane lines are detected. This self-localization estimation device can improve the estimation accuracy of the self-localization in the direction of travel of the mobile body by utilizing the positions of the endpoints of the lane lines. In a preferred example, the coefficient is a Kalman gain.

[0010] In one aspect of the self-location estimation device, the estimation means corrects the coefficient using the reciprocal of the interval between the scanning positions. In another aspect, the estimation means corrects the coefficient based on the ratio of the interval between the scanning positions to the shortest interval between the scanning positions measured by the measurement unit among the intervals between the scanning positions. In this aspect, the coefficient is corrected so that the smaller the interval between the scanning positions is, the more the difference value is reflected in the estimation of the self-location.

[0011] In another aspect of the above self-location estimation device, the measurement unit detects lane lines that exist within a window defined at a predetermined position relative to the position of the moving object, and the estimation unit corrects the coefficient based on a ratio of the number of scanning lines that exist on the lane lines to a number of scanning lines that is predetermined based on the size of the window. In this aspect, the coefficient is corrected so that the greater the number of scanning lines that exist on the detected lane lines, the greater the impact of the difference value on the estimation of the self-location.

[0012] In another aspect of the self-location estimation device, the measurement unit detects a midpoint between a scanning line that is on the demarcation line and a scanning line that is not on the demarcation line, which are adjacent to each other, as an endpoint of the demarcation line. This makes it possible to determine the endpoint of the demarcation line from the positions of the scanning line that is on the demarcation line and the scanning line that is not on the demarcation line.

[0013]

[0013] Another preferred embodiment of the present invention is a self-location estimation method executed by a self-location estimation device mounted on a moving object, comprising: an acquisition step of acquiring a predicted position of the moving object; a difference calculation step of calculating a difference between the predicted positions of the endpoints of the lane lines obtained based on information about the endpoints of the lane lines acquired from map information and the measured positions of the endpoints of the lane lines measured by a measurement unit mounted on the moving object by scanning light in a predetermined direction; and an estimation step of correcting the predicted position of the moving object by a value obtained by multiplying the difference by a coefficient to estimate the self-location of the moving object, wherein the estimation step corrects the coefficient based on the interval between the scanning positions of the measurement unit at the positions where the endpoints of the lane lines are detected. This self-location estimation method can improve the accuracy of estimating the self-location in the direction of travel of the moving object by utilizing the positions of the endpoints of the lane lines.

[0014] Another preferred embodiment of the present invention is a program executed by a self-location estimation device mounted on a mobile body and including a computer, the program causing the computer to function as: an acquisition means for acquiring a predicted position of the mobile body; a difference value calculation means for calculating a difference between the predicted position of the endpoint of the lane line obtained based on information on the endpoint of the lane line acquired from map information and the measured position of the endpoint of the lane line measured by a measurement unit mounted on the mobile body scanning light in a predetermined direction; and an estimation means for correcting the predicted position of the mobile body by a value obtained by multiplying the difference value by a coefficient to estimate the self-location of the mobile body, the estimation means correcting the coefficient based on the interval between the scanning positions of the measurement unit at the positions where the endpoints of the lane line are detected. The above-mentioned self-location estimation device can be realized by executing this program on a computer. This program can be stored and accessed on a storage medium. [Example]

[0015] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. For the sake of convenience, in this specification, a character with "^" or "-" above any symbol will be referred to as "A ^ " or "A - " (where "A" is any letter). [Driving assistance system]

[0016] Fig. 1 is a schematic diagram of a driving assistance system according to this embodiment. The driving assistance system shown in Fig. 1 includes an on-board device 1 that is mounted on a vehicle and controls driving assistance for the vehicle, a Lidar (Light Detection and Ranging or Laser Illuminated Detection and Ranging) 2, a gyro sensor 3, a vehicle speed sensor 4, and a GPS receiver 5.

[0017] The vehicle-mounted device 1 is electrically connected to a lidar 2, a gyro sensor 3, a vehicle speed sensor 4, and a GPS receiver 5, and estimates the position of the vehicle (also referred to as "subject vehicle position") on which the vehicle-mounted device 1 is mounted based on the outputs of these sensors. Based on the result of estimating the subject vehicle position, the vehicle-mounted device 1 performs automatic driving control of the vehicle so that the vehicle travels along a route to a set destination. The vehicle-mounted device 1 stores a map database (DB) 10 in which road data and information on landmark features and lane lines provided near the road are registered. Examples of the landmark features include kilometer posts, 100-meter posts, delineators, traffic infrastructure facilities (e.g., signs, direction signs, traffic lights), utility poles, streetlights, and other features periodically arranged along the roadside. The vehicle-mounted device 1 then compares the map DB 10 with the outputs of the lidar 2 and the like to estimate the subject vehicle position. The vehicle-mounted device 1 is an example of a "subject vehicle position estimation device" in the present invention.

[0018] The LIDAR 2 emits a pulsed laser beam over a predetermined angular range in the horizontal and vertical directions to discretely measure the distance to an object in the external environment and generate three-dimensional point cloud information indicating the position of the object. In this case, the LIDAR 2 includes an irradiation unit that emits laser light while changing the irradiation direction, a light receiving unit that receives reflected (scattered) light from the emitted laser light, and an output unit that outputs scan data based on the light receiving signal output by the light receiving unit. In this embodiment, the irradiation range of the laser emitted by the LIDAR 2 includes at least the road surface. The scan data is generated based on the irradiation direction corresponding to the laser light received by the light receiving unit and the distance to the object in that irradiation direction of the laser light, which is determined based on the above-mentioned light receiving signal. Generally, the closer the distance to the object, the higher the accuracy of the LIDAR's distance measurement value, and the farther the distance, the lower the accuracy. The LIDAR 2, gyro sensor 3, vehicle speed sensor 4, and GPS receiver 5 each provide output data to the vehicle-mounted device 1. The LIDAR 2 is an example of a "measurement unit" in the present invention.

[0019] 2 is a block diagram showing the functional configuration of the vehicle-mounted device 1. The vehicle-mounted device 1 mainly includes an interface 11, a storage unit 12, an input unit 14, a control unit 15, and an information output unit 16. These elements are interconnected via a bus line.

[0020] The interface 11 acquires output data from sensors such as the lidar 2, the gyro sensor 3, the vehicle speed sensor 4, and the GPS receiver 5, and supplies the data to the control unit 15.

[0021] The memory unit 12 stores programs executed by the control unit 15 and information required for the control unit 15 to execute predetermined processes. In this embodiment, the memory unit 12 stores a map DB 10 including lane line information and feature information. The lane line information is information about lane lines (white lines) provided on each road, and coordinate information indicating the discrete positions of each lane line is included for each lane line. The lane line information may be information incorporated into road data for each road. In this embodiment, for dashed lane lines, coordinate information indicating the positions of their endpoints is included. The feature information is information about features other than lane lines. Here, each feature is associated with at least a feature ID corresponding to an index of the feature and location information indicating the absolute location of the feature, expressed by latitude, longitude (and altitude), etc. The map DB 10 may be updated periodically. In this case, for example, the control unit 15 receives partial map information related to the area to which the vehicle belongs from a server device that manages map information via a communication unit (not shown) and reflects the information in the map DB 10.

[0022] The input unit 14 is a button operated by the user, a touch panel, a remote controller, a voice input device, etc. The information output unit 16 is, for example, a display, a speaker, etc. that outputs information based on the control of the control unit 15.

[0023] The control unit 15 includes a CPU that executes a program and controls the entire vehicle-mounted device 1. In this embodiment, the control unit 15 includes a vehicle position estimation unit 17. The control unit 15 is an example of the acquisition means, difference value calculation means, and estimation means of the present invention.

[0024] The vehicle position estimation unit 17 corrects the vehicle position estimated from the output data of the gyro sensor 3, the vehicle speed sensor 4, and / or the GPS receiver 5 based on the distance and angle measurements from the LIDAR 2 relative to the landmarks and the position information of the landmarks extracted from the map DB 10. In this embodiment, as an example, the vehicle position estimation unit 17 alternately executes a prediction step of predicting the vehicle position from the output data of the gyro sensor 3, the vehicle speed sensor 4, etc., based on a state estimation method based on Bayesian estimation, and a measurement update step of correcting the predicted value of the vehicle position calculated in the immediately preceding prediction step. Various filters developed for Bayesian estimation can be used as state estimation filters used in these steps, such as an extended Kalman filter, an unscented Kalman filter, and a particle filter. As such, various methods for position estimation based on Bayesian estimation have been proposed.

[0025] The following briefly describes vehicle position estimation using an extended Kalman filter. As will be described later, in this embodiment, the vehicle position estimation unit 17 performs a unified vehicle position estimation process using an extended Kalman filter regardless of whether the vehicle position is estimated based on a feature or a lane marking.

[0026] FIG. 3 is a diagram showing the state variable vector x in two-dimensional Cartesian coordinates. As shown in FIG. 3, the vehicle position on a plane defined on the two-dimensional Cartesian coordinates of xy is represented by the coordinates "(x, y)" and the vehicle's orientation "Ψ". Here, the orientation Ψ is defined as the angle between the vehicle's traveling direction and the x-axis. The coordinates (x, y) indicate an absolute position in a coordinate system with a certain reference position, which corresponds to a combination of latitude and longitude, as its origin.

[0027] FIG. 4 is a diagram showing a schematic relationship between the prediction step and the measurement update step. FIG. 5 shows an example of the functional blocks of the vehicle position estimation unit 17. As shown in FIG. 4, the prediction step and the measurement update step are repeated to sequentially calculate and update the estimated value of the state variable vector "X" indicating the vehicle position. As shown in FIG. 5, the vehicle position estimation unit 17 has a position prediction unit 21 that executes the prediction step, and a position estimation unit 22 that executes the measurement update step. The position prediction unit 21 includes a dead reckoning block 23 and a position prediction block 24, and the position estimation unit 22 includes a landmark search / extraction unit 25 and a position correction block 26. In FIG. 4, the state variable vector at the reference time (i.e., the current time) "t" to be calculated is calculated as "X - (t)" or "X ^ (t)" ("State variable vector X(t) = (x(t), y(t), Ψ(t)) T "). Here, the provisional estimates (predicted values) estimated in the prediction step are indicated by " - " is added to the value, and the more accurate estimates updated in the measurement update step are marked with " ^ " is added.

[0028] In the prediction step, the dead reckoning block 23 of the vehicle position estimation unit 17 calculates the vehicle's moving speed "v" and angular velocity "ω" (collectively referred to as the "control value u(t)=(v(t), ω(t)) T "). The position prediction block 24 of the vehicle position estimation unit 17 calculates the travel distance and change in direction from the previous time by using the state variable vector X ^ The calculated travel distance and direction change are added to (t-1) to obtain the predicted value of the vehicle position at time t (also called the "predicted vehicle position") X - (t) is calculated. At the same time, the predicted vehicle position X - The covariance matrix P corresponding to the error distribution of (t) - (t)” is the covariance matrix “P ^ (t-1)".

[0029] In the measurement update step, the landmark search / extraction unit 25 of the vehicle position estimation unit 17 associates the position vectors of the landmarks registered in the map DB 10 with the scan data of the LIDAR 2. Then, when this association is established, the landmark search / extraction unit 25 of the vehicle position estimation unit 17 calculates the measurement value "Z(t)" of the associated landmark by the LIDAR 2 (referred to as the "landmark measurement value") and the predicted vehicle position X - (t) and the landmark position vector registered in the map DB 10, and the landmark measurement estimated value (called "landmark predicted value") obtained by modeling the measurement process by the lidar 2. - The landmark measurement value Z(t) is a two-dimensional vector in the vehicle's body coordinate system, which is obtained by converting the distance and scan angle of the landmark measured by the lidar 2 at time t into components with axes in the vehicle's traveling direction and lateral direction. Then, the position correction block 26 of the vehicle position estimation unit 17 calculates the landmark measurement value Z(t) and the landmark predicted value Z(t) as shown in the following equation (1): - Calculate the difference value with (t).

[0030]

number

[0031] Then, the position correction block 26 of the vehicle position estimation unit 17 calculates the landmark measurement value Z(t) and the landmark predicted value Z(t) as shown in the following equation (2): - (t) is multiplied by the Kalman gain "K(t)" and used as the predicted vehicle position X - (t) to obtain the updated state variable vector (also called the "estimated vehicle position") X ^ Calculate (t).

[0032]

number

[0033] In the measurement update step, the position correction block 26 of the vehicle position estimation unit 17 calculates the estimated vehicle position X ^ The covariance matrix P corresponding to the error distribution of (t) ^ (t) (also simply written as P(t)) into the covariance matrix P - Parameters such as the Kalman gain K(t) can be calculated in the same manner as in a known self-position estimation technique using an extended Kalman filter, for example.

[0034] In this way, the prediction step and the measurement update step are repeatedly performed, and the predicted vehicle position X - (t) and estimated vehicle position X ^ By successively calculating (t), the most probable vehicle position is calculated.

[0035] [Vehicle position estimation using lane markings] Next, a description will be given of vehicle position estimation using lane markings, which is a feature of this embodiment. In this embodiment, vehicle position estimation is performed using lane markings as landmarks. Note that, although the following description will be given of an example in which white lane markings are used, yellow lane markings can also be used in the same way.

[0036] (1) Measurement of white lines using lidar First, a method for measuring white lines using a lidar will be described. (Lidar measurements) Now, consider a Cartesian coordinate system (hereinafter referred to as the "vehicle coordinate system") with the vehicle's own position as the origin and the vehicle's traveling direction as the x-axis, as shown in Figure 6. The LIDAR measurement values ​​to the measurement target include the horizontal angle α, vertical angle β, and distance r. When these are converted to the Cartesian coordinate system, the LIDAR measurement values ​​are expressed by the following equations.

[0037]

number

[0038] (white line detection) Figure 7 shows a method for detecting white lines using a lidar 2 mounted on a vehicle. White lines are coated with retroreflective material, which gives them a strong reflection. Therefore, the vehicle-mounted device 1 installs a window in a position where the white lines on the road surface ahead of the vehicle can be easily detected, and detects and recognizes the areas of high reflection intensity within the window as white lines.

[0039] Specifically, as shown in Fig. 7, lidars 2 provided on the left and right sides of the front of the vehicle emit emitted light EL toward the road surface in front of the vehicle. A virtual window W is defined at a predetermined position in front of the vehicle. The position of the window W relative to the center O of the vehicle is determined in advance. That is, the horizontal distance L1 from the center O of the vehicle to the window W, the lateral distance L2 from the center O of the vehicle to the left and right windows W, and the length L3 of the window W are also determined in advance. The vehicle-mounted device 1 extracts scan data that falls within the window W from the scan data output from the lidar 2, and determines that a white line has been detected if the reflection intensity of the extracted scan data is higher than a predetermined threshold.

[0040] (Line spacing) By using a multi-layered lidar as the lidar 2, multiple scan lines s are formed within the window W. FIG. 8 shows the positions of the multiple scan lines s within the window W. The intervals between the multiple scan lines s within the window W (hereinafter referred to as "line intervals") become longer the farther they are from the vehicle. The upper right part of FIG. 8 shows a plan view of the scan lines within the window W as seen from above. Scan lines s1 to s are formed within the window W. 10 is formed, and the line spacing d1 to d9 of each scan line is shown. The line spacing d becomes longer as the scan line is farther from the vehicle. The lower right of FIG. 8 shows a view of the scan lines in window W as seen from the side. Similarly, the line spacing d becomes longer as the scan line is farther from the vehicle.

[0041] If the number of an arbitrary scan line is "i", the horizontal angle of the i-th scan line is α(i), the vertical angle is β(i), and the distance from the vehicle is r(i), the line spacing d(i) between the i-th scan line and the (i+1)-th scan line can be calculated using the following formula (4): Similarly, the line spacing d(i+1) between the (i+1)-th scan line and the (i+2)-th scan line can be calculated using the following formula (5), and the line spacing d(i+2) between the (i+2)-th scan line and the (i+3)-th scan line can be calculated using the following formula (6).

[0042]

number

[0043] In this way, the line spacing d between the multiple scan lines s within the window W can be determined based on the scan data from the lidar 2.

[0044] (Measurement of the end points of white lines) Next, a method for measuring the end points of a white line using a lidar will be described. Figure 9 shows a method for measuring the end points of the beginning of a white line (starting point of the white line). Within a window W, s1 to s 10 As described above, the vehicle-mounted device 1 detects the white line based on the reflection intensity of the scan data obtained by the lidar. Now, as shown in Example 1, it is assumed that the reflection intensity of the scan data changes between scan lines s2 and s3. That is, it is assumed that the reflection intensity of scan line s2 is equal to or greater than a predetermined threshold, and the reflection intensity of scan line s3 is less than the predetermined threshold. In this case, it is known that the end point of the white line exists between scan lines s2 and s3, but its exact position is unknown. Therefore, the vehicle-mounted device 1 regards the midpoint of scan lines s2 and s3 as the end point of the white line.

[0045] Similarly, if the reflection intensity of the scan data changes between scan lines s4 and s5 as shown in Example 2, the vehicle-mounted device 1 regards the midpoint of scan lines s4 and s5 as the end point of the white line. Also, if the reflection intensity of the scan data changes between scan lines s7 and s8 as shown in Example 3, the vehicle-mounted device 1 regards the midpoint of scan lines s7 and s8 as the end point of the white line.

[0046] The method for detecting the end point position of the end portion of a white line is basically the same. Figure 10 shows a method for measuring the position of the end point of the end portion of a white line (the end point of the white line). As shown in Example 4, it is assumed that the reflection intensity of the scan data changes between scan lines s2 and s3. That is, it is assumed that the reflection intensity of scan line s2 becomes less than a predetermined threshold, and the reflection intensity of scan line s3 is equal to or greater than the predetermined threshold. In this case, the vehicle-mounted device 1 regards the midpoint between scan lines s2 and s3 as the end point of the white line.

[0047] Similarly, if the reflection intensity of the scan data changes between scan lines s4 and s5 as shown in Example 5, the vehicle-mounted device 1 regards the midpoint of scan lines s4 and s5 as the end point of the white line. Also, if the reflection intensity of the scan data changes between scan lines s7 and s8 as shown in Example 6, the vehicle-mounted device 1 regards the midpoint of scan lines s7 and s8 as the end point of the white line.

[0048] Now, the i-th scan line s i and the (i+1)th scan line s i+1 If the reflection intensity of the scan data changes between x (t) is the i-th scan line s in the vehicle's direction of travel. i Position r x (i) and (i+1)th scan lines s i+1 Position r x (i+1) is calculated using the following formula:

[0049]

number

[0050] The measurement value of the white line by rider 2 is given by the following formula:

[0051]

number

[0052] 9 and 10 show the case where one scan line is detected as a set of scan data with equal reflection intensities, but the reflection intensity of the scan data may change along one scan line. In this case, it is difficult to distinguish whether the scan line is actually the end point of a white line or whether it is not actually the end point of a white line but has been detected as such due to dirt, blurring, etc.

[0053] FIG. 11 shows an example in which the reflection intensity of the scan data changes midway along a scan line. In Examples 7 and 8, the reflection intensity of the scan data changes midway along scan line s3, making it difficult to determine that scan line s3 is the endpoint of the white line. Therefore, when the reflection intensity of the scan data changes midway along a scan line, the vehicle-mounted device 1 determines the midpoint between a scan line correctly detected as a white line and a scan line that was not detected as a white line at all as the endpoint of the white line. In Example 7 of FIG. 11, the vehicle-mounted device 1 determines the midpoint between scan line s2 correctly detected as a white line and scan line s4 that was not detected as a white line at all as the endpoint of the white line. Similarly, in Example 8, the vehicle-mounted device 1 determines the midpoint between scan line s4 correctly detected as a white line and scan line s2 that was not detected as a white line at all as the endpoint of the white line.

[0054] Now, the (i-1)th scan line s iー1 and the (i+1)th scan line s i+1 The ith scan line s located between i If the reflection intensity of the scan data changes during the process, the lidar measurement value L, which indicates the position of the end point of the white line in the direction of travel of the vehicle, x(t) is the (i-1)th scan line s in the direction of travel of the vehicle. i-1 Position r x (i-1) and (i+1)th scan lines s i+1 Position r x (i+1) is used to calculate the line spacing d(t) using the following equation (9): The line spacing d(t) at this time is calculated using equation (10).

[0055]

number

[0056] From the above, if the end point of the white line can be detected, the measured value L in the direction of travel of the vehicle x (t) is the value given by equation (7) or equation (9). If the end point of the white line cannot be detected, the measured value L x (t) is not present. On the other hand, the lateral measurement value of the vehicle L y (t) is the average value of the center points of multiple scan lines detected within the window W. In this way, the lidar measurement value of the white line is obtained according to the detection result of the white line.

[0057] (2) Vehicle position estimation method Next, a vehicle position estimation method according to the embodiment will be described. (Calculation of predicted landmark values) First, a method for calculating predicted landmark values ​​of the endpoints of white lines using map data will be described. FIG. 12 shows a method for calculating predicted landmark values ​​of the endpoints of white lines. In FIG. 12, a vehicle V exists in a world coordinate system, and a vehicle coordinate system is defined with the center of the vehicle V as the origin. The coordinates of the endpoint k of a white line stored in the map DB 10 are expressed as (m x (k),m y The coordinates of the white line end point k stored in the map DB 10 are coordinates in the world coordinate system, and the vehicle-mounted device 1 converts these coordinates into the vehicle coordinate system. Specifically, the estimated vehicle position of the vehicle V is expressed as x - (t), y - (t), the estimated vehicle direction is Ψ -If (t) is used, the predicted landmark value of the white line end point k is expressed by the following equation using a rotation matrix that transforms coordinates from the world coordinate system to the vehicle coordinate system.

[0058]

number

[0059] (Kalman gain correction) Next, a method for correcting the Kalman gain depending on the detection state of the white line endpoints will be described. Fig. 13(A) shows the correction coefficients for the Kalman gain when the on-board device 1 detects the white line endpoints. The landmark measurement values ​​used for vehicle position estimation include measurement values ​​in the vehicle's forward direction and measurement values ​​in the vehicle's lateral direction. Therefore, the correction coefficient for the vehicle's forward direction is defined as the forward direction correction coefficient a(t), and the correction coefficient for the vehicle's lateral direction is defined as the lateral direction coefficient b(t).

[0060] If an end point of a white line is detected within the window W, the vehicle-mounted device 1 uses the position of the end point of the white line as the measurement value of the traveling direction. However, as mentioned above, the measurement value of the end point position of the white line is found as the midpoint of two adjacent scan lines before and after the change in reflection intensity, so the measurement accuracy of the traveling direction of the vehicle varies depending on the line spacing of the scan lines. In other words, if the line spacing is wide, the error is large, and if the line spacing is narrow, the error is small. Therefore, the length of the line spacing of the scan lines is used to correct the Kalman gain in the traveling direction. Specifically, the reciprocal of the line spacing d(t) is set as the traveling direction coefficient a(t). In other words, the traveling direction coefficient a(t) is given by a(t)=1 / d(t) When the end points of the white lines are detected, the accuracy of the measured end points of the white lines increases as the line spacing decreases, and therefore the Kalman gain is corrected to a larger value.

[0061] The lateral measurement value of the vehicle is the average value of the center points of multiple scan lines detected within the window W. If the edge points of a white line are detected within the window W, the number of scan lines present within the window W is counted as N, as shown in Figure 13(A). MLet the number of scan lines measured by the lidar on the white line be N L Then, the lateral coefficient b(t) is b(t)=N L (t) / N M When the end points of the white line are detected, the greater the number of scan lines detected on the white line, the higher the measurement accuracy of the vehicle in the lateral direction, and therefore the Kalman gain is corrected to be larger.

[0062] 13B shows the correction coefficient of the Kalman gain when the vehicle-mounted device 1 detects a white line but does not detect the end point of the white line. When a white line is not detected, no measurement value in the traveling direction of the vehicle can be obtained, so the traveling direction coefficient a(t) is a(t)=0 In addition, if the end points of the white lines are not detected, the center points of all scan lines within the window W can be measured, and the measurement accuracy in the lateral direction of the vehicle is high, so the lateral coefficient b(t) is set as follows: b(t)=1 It is set as follows.

[0063] The vehicle position estimation unit 17 corrects the Kalman gain using the traveling direction coefficient a(t) and lateral direction coefficient b(t) thus obtained. Specifically, the vehicle position estimation unit 17 multiplies the Kalman gain K(t) shown in the following equation (12) by the traveling direction coefficient a(t) and the lateral direction coefficient b(t) to generate an adaptive Kalman gain K(t)' shown in equation (13).

[0064]

number

[0065]

number

[0066] Then, the vehicle position estimating unit 17 applies the obtained adaptive Kalman gain K(t)' to the Kalman gain K(t) in equation (2) to calculate the estimated vehicle position X^(t) using the following equation (14).

[0067]

number

[0068] (Measurement noise correction) Next, a method for correcting measurement noise according to the detection state of the white line endpoints will be described. Fig. 14(A) shows the correction coefficients for measurement noise when the onboard device 1 detects the white line endpoints. The landmark measurement values ​​used for vehicle position estimation include measurement values ​​in the vehicle's forward direction and measurement values ​​in the vehicle's lateral direction. Therefore, the correction coefficient for the vehicle's forward direction is defined as the forward direction correction coefficient a(t), and the correction coefficient for the vehicle's lateral direction is defined as the lateral direction coefficient b(t).

[0069] If an end point of a white line is detected within the window W, the vehicle-mounted device 1 uses the position of the end point of the white line as the measurement value of the traveling direction. However, as mentioned above, the measurement value of the end point position of the white line is found as the midpoint of two adjacent scan lines before and after the change in reflection intensity, so the measurement accuracy of the vehicle's traveling direction varies depending on the line spacing of the scan lines. That is, if the line spacing is wide, the error is large, and if the line spacing is narrow, the error is small. Therefore, the length of the line spacing of the scan lines is used to correct the measurement noise in the traveling direction. Specifically, the ratio of the line spacing d(t) to the shortest line spacing (line spacing d9 in Figure 9) among the multiple line spacings detected is set as the traveling direction coefficient a(t). That is, the traveling direction coefficient a(t) is given by a(t)=d(t) / d9 When the end points of the white lines are detected, the accuracy of the measured end points of the white lines increases as the line spacing decreases, so correction is performed to reduce measurement noise.

[0070] The lateral measurement value of the vehicle is the average value of the center points of multiple scan lines detected within the window W. If the edge points of a white line are detected within the window W, the number of scan lines present within the window W is counted as N, as shown in Figure 14(A). M Let the number of scan lines measured by the lidar on the white line be NL Then, the horizontal coefficient b(t) is b(t)=N M / N L (t) When the endpoints of the white line are detected, the greater the number of scan lines detected on the white line, the higher the measurement accuracy of the vehicle in the lateral direction, so a correction is made to reduce measurement noise.

[0071] FIG. 14(B) shows the correction coefficient for measurement noise when the vehicle-mounted device 1 detects a white line but does not detect the end point of the white line. When a white line is not detected, a measurement value in the traveling direction of the vehicle cannot be obtained, so the traveling direction coefficient a(t) is set to a large value. For example, a(t)=10000 In addition, if the end points of the white lines are not detected, the center points of all scan lines within the window W can be measured, and the measurement accuracy in the lateral direction of the vehicle is high, so the lateral coefficient b(t) is set as follows: b(t)=1 It is set as follows.

[0072] The vehicle position estimation unit 17 multiplies the measurement noise by the travel direction coefficient a(t) and lateral direction coefficient b(t) thus obtained to generate adaptive measurement noise, and then uses this adaptive measurement noise to obtain an estimated vehicle position.

[0073] Specifically, the basic measurement noise R(t) is given by the following formula: For the target white line measurement, σ Lx 2 is the measurement noise in the direction of travel of the vehicle coordinate system, and σ Ly 2 is the measurement noise in the lateral direction of the vehicle coordinate system.

[0074]

number

[0075] Therefore, the vehicle position estimation unit 17 multiplies the measurement noise by the traveling direction coefficient a(t) and the lateral direction coefficient b(t) to obtain the following adaptive measurement noise R(t)'.

[0076]

number

[0077] Substituting this into the Kalman gain equation (12), we obtain the following adaptive Kalman gain K(t)'.

[0078]

number

[0079] Then, the vehicle position estimating unit 17 applies the obtained adaptive Kalman gain K(t)' to the Kalman gain K(t) in equation (2) to calculate the estimated vehicle position X^(t) using equation (14).

[0080] This allows the position in the direction of travel to be estimated using information on the endpoints of the broken lines, and by processing using adaptive measurement noise according to the detection accuracy of the endpoints of the white lines and the number of detected lines, appropriate processing can be performed according to the detection status of the white lines.

[0081] (3) Vehicle position estimation process 15 is a flowchart of the vehicle position estimation process executed by the vehicle position estimation unit 17. The vehicle position estimation unit 17 repeatedly executes the process of the flowchart in FIG.

[0082] First, the vehicle position estimation unit 17 determines whether or not the vehicle body speed and the angular velocity in the yaw direction of the vehicle have been detected (step S11). For example, the vehicle position estimation unit 17 detects the vehicle body speed based on the output of the vehicle speed sensor 4, and detects the angular velocity in the yaw direction based on the output of the gyro sensor 3. If the vehicle position estimation unit 17 has detected the vehicle body speed and the angular velocity in the yaw direction of the vehicle (step S11: Yes), the vehicle position estimation unit 17 calculates the estimated vehicle position X1 from one time point earlier using the detected vehicle body speed and angular velocity. ^ (t-1) Predicted vehicle position X- (t). Furthermore, the vehicle position estimation unit 17 calculates the covariance matrix at the current time from the covariance matrix of one time before (step S12). Note that if the vehicle body speed and the angular velocity of the vehicle in the yaw direction are not detected (step S11: No), the vehicle position estimation unit 17 sets the estimated vehicle position X^(t-1) of one time before as the predicted vehicle position X-(t), and sets the covariance matrix of one time before as the covariance matrix at the current time.

[0083] Next, the vehicle position estimation unit 17 determines whether or not a white line has been detected as a landmark to be used for estimating the vehicle position (step S13). Specifically, the vehicle position estimation unit 17 sets a window W as shown in Fig. 7, and determines whether or not a white line has been detected within the window W based on the reflection intensity of the scan data from the LIDAR 2. If a white line is not detected (step S13: No), the vehicle position cannot be estimated using the white line, and the process ends.

[0084] On the other hand, if a white line is detected (step S13: Yes), the vehicle position estimation unit 17 calculates predicted landmark values ​​of the white line based on the map data in the map DB 10, and calculates landmark measurement values ​​of the white line by the LIDAR 2 (step S14). Specifically, the vehicle position estimation unit 17 calculates predicted landmark values ​​of the white line endpoints by converting the coordinates of the endpoints of the white line included in the map data into the vehicle coordinate system, and sets the measurement values ​​of the white line by the LIDAR as landmark measurement values.

[0085] In addition, as described in Figures 13 and 14, the vehicle position estimation unit 17 calculates the traveling direction coefficient a(t) and the lateral direction coefficient b(t) depending on whether or not the endpoints of the white line have been detected (step S15).

[0086] Then, the vehicle position estimation unit 17 calculates the Kalman gain K(t) based on the above-mentioned equation (10) using the covariance matrix, generates the adaptive Kalman gain K(t)' shown in equation (13) or equation (17) using the traveling direction coefficient a(t) and the lateral direction coefficient b(t), and calculates the estimated vehicle position using equation (14). Furthermore, the vehicle position estimation unit 17 updates the covariance matrix as shown in equation (18) using the adaptive Kalman gain K(t)' (step S16).

[0087]

number

[0088] As described above, when the vehicle position estimation unit 17 detects the endpoints of a white line, it performs vehicle position estimation processing based on a Kalman filter, using the endpoints as landmarks. Furthermore, it calculates a traveling direction coefficient and corrects the Kalman gain based on the line spacing of the scan lines taken by the LIDAR 2 when the endpoints of the white line are detected. This enables highly accurate vehicle position estimation even in the vehicle's traveling direction.

[0089] [Variations] In the above embodiment, the vehicle-mounted device 1 detects white lines by providing windows W at the left and right positions in front of the vehicle, but if a pair of lidars 2 is also provided at the rear of the vehicle, windows W may also be provided at the left and right positions at the rear of the vehicle to detect white lines. [Explanation of symbols]

[0090] 1 Onboard device 2 Rider 3 Gyro sensor 4 Vehicle speed sensor 5 GPS receiver 10 Map DB

Claims

[Claim 1] A self-location estimation device mounted on a moving object, An acquisition means for acquiring a predicted position of the moving object; a difference value calculation means for calculating a difference value between a predicted position of the endpoint of the demarcation line obtained based on information of the endpoint of the demarcation line acquired from map information and a measured position of the endpoint of the demarcation line measured by a measuring unit mounted on the moving object by scanning light in a predetermined direction; an estimation means for estimating a self-position of the moving object by correcting a predicted position of the moving object by a value obtained by multiplying the difference value by a coefficient; A self-location estimation device comprising:

Citation Information

Patent Citations

  • Position estimation device

    JP2018025490A

  • Moving body position estimation method and moving body

    JP2013257742A

  • Information processing device, control method, program, and storage medium

    JP2017072422A