A method and device for processing lane lines

By obtaining the image data of the vehicle to the outside environment, determining and correcting the position deviation of the lane line in the map data, the problem of the lane line in the map data is solved, the reliability of the map data is improved, and the safe driving of the vehicle is ensured .

CN114387583BActive Publication Date: 2024-11-26GUANGZHOU XIAOPENG CONNECTIVITY TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202210043118.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-14
Publication Date
2024-11-26
Estimated Expiration
2042-01-14

AI Technical Summary

Technical Problem

The lane lines recorded in the map data do not match the actual lane lines in the road, resulting in a decrease in the reliability of the map data and affecting the safe driving of the vehicle.

Method used

By obtaining the image data of the vehicle to the outside environment, determining the area where the lane line is abnormal in the map data, calculating the position information of the lane line under the world coordinate system, and correcting, repairing and correcting the lane line position based on the position deviation information.

Benefits of technology

It improves the accuracy of lane lines in map data, improves the reliability of map data, and reduces the impact on the safe driving of vehicles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114387583B_ABST
    Figure CN114387583B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention provides a method and device for lane line processing, the method comprising: obtaining image data collected by a vehicle for an external environment; determining a second map area with lane line anomalies in preset map data, and determining second image data corresponding to the second map area from the image data; determining second world position information of a second lane line in the second map area in a world coordinate system according to the second image data; determining second position deviation information according to the second world position information; and correcting the second world position information using the second position deviation information. Through the embodiment of the present invention, lane line repair in map data and correction of the position of the repaired lane line are realized, the accuracy of the lane line position in the map data is ensured, the reliability of the map data is improved, and the impact on the safe driving of the vehicle is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of map technology, and in particular to a method and device for processing lane lines. Background Art

[0002] With the continuous development of smart car technology, technologies such as autonomous driving are becoming increasingly popular. Technologies such as autonomous driving usually rely on map data configured in the vehicle, and its accuracy is particularly important.

[0003] In some scenarios, there will be problems with map data, especially for lane lines. The lane lines recorded in the map data often do not match the actual lane lines on the road, thereby reducing the reliability of the map data and even affecting the safe driving of the vehicle. Summary of the invention

[0004] In view of the above problems, a method and device for lane line processing is proposed to overcome the above problems or at least partially solve the above problems, including:

[0005] A method for lane line processing, the method comprising:

[0006] Acquire image data collected by the vehicle for the external environment;

[0007] Determine a second map area in the preset map data where a lane line anomaly exists, and determine second image data corresponding to the second map area from the image data;

[0008] Determine, based on the second image data, second world position information of a second lane line in the second map area in a world coordinate system;

[0009] Determining second position deviation information according to the second world position information;

[0010] The second world position information is corrected using the second position deviation information.

[0011] Optionally, determining the second position deviation information according to the second world position information includes:

[0012] Obtain the relationship between the position and position deviation of the lane line in the world coordinate system;

[0013] The second position deviation information is determined according to the second world position information and the association relationship.

[0014] Optionally, before determining the second position deviation information according to the second world position information, the method further includes:

[0015] Determine a first map area in the preset map data where no lane line anomaly exists, and determine first image data corresponding to the first map area from the image data;

[0016] Determine first world position information of a first lane line in a first map area in a world coordinate system according to the first image data;

[0017] Obtaining the real position information of the first lane line;

[0018] First position deviation information is determined based on the first world position information and the real position information, and a correlation between the position of the lane line in the world coordinate system and the position deviation is determined based on the first world position information and the first position deviation information.

[0019] Optionally, determining first world position information of a first lane line in a first map area in a world coordinate system according to the first image data includes:

[0020] Determine first image position information of a first lane line in a first map area in the first image data;

[0021] Acquire a first camera parameter of an onboard camera of the vehicle, and determine first camera position information of the first lane line in a camera coordinate system according to the first image position information and the first camera parameter;

[0022] According to the first camera position information, first world position information of the first lane line in the world coordinate system is determined.

[0023] Optionally, determining second world position information of a second lane line in a second map area in a world coordinate system according to the second image data includes:

[0024] Determine second image position information of a second lane line in the second map area in the second image data;

[0025] Acquire a second camera parameter of the vehicle-mounted camera, and determine the second camera position information of the second lane line in the camera coordinate system according to the second image position information and the second camera parameter;

[0026] According to the second camera position information, second world position information of the second lane line in the world coordinate system is determined.

[0027] Optionally, after acquiring the image data collected by the vehicle for the external environment, the method further includes:

[0028] Adjust the image data to a bird's eye view.

[0029] Optionally, determining a second map area having a lane line abnormality in the preset map data includes:

[0030] Target position information is obtained, and based on the target position information, a second map area in preset map data where a lane line anomaly exists is determined; wherein the target position information is determined based on lane line anomaly data reported by multiple vehicles.

[0031] A lane line processing device, comprising:

[0032] An image data acquisition module is used to acquire image data collected by the vehicle for the external environment;

[0033] A second image data determination module, used to determine a second map area having lane line anomalies in the preset map data, and determine second image data corresponding to the second map area from the image data;

[0034] A second world position information determination module, used to determine second world position information of a second lane line in a second map area in a world coordinate system according to the second image data;

[0035] A second position deviation information determining module, used to determine second position deviation information according to the second world position information;

[0036] The position correction module is used to correct the second world position information using the second position deviation information.

[0037] An electronic device includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the lane line processing method as described above is implemented.

[0038] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the lane line processing method as described above is implemented.

[0039] The embodiments of the present invention have the following advantages:

[0040] In an embodiment of the present invention, by acquiring image data collected by the vehicle for the external environment, a second map area in the preset map data where a lane line anomaly exists is determined, and second image data corresponding to the second map area is determined from the image data. Based on the second image data, second world position information of the second lane line in the second map area in the world coordinate system is determined, and then based on the second world position information, second position deviation information is determined. The second world position information is corrected using the second position deviation information, thereby realizing lane line patching in the map data and correction of the position of the patched lane line, thereby ensuring the accuracy of the lane line position in the map data, improving the reliability of the map data, and reducing the impact on the safe driving of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0042] Figure 1 is a flowchart of a method for lane line processing provided by an embodiment of the present invention;

[0043] Figure 2 is a flowchart of another method for lane line processing provided by an embodiment of the present invention;

[0044] Figure 3 It is a structural block diagram of a lane line processing device provided by one embodiment of the present invention. DETAILED DESCRIPTION

[0045] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0046] Reference Figure 1 , shows a flowchart of a method for lane line processing provided by an embodiment of the present invention, which may specifically include the following steps:

[0047] Step 101: Acquire image data collected by the vehicle with respect to the external environment.

[0048] During the vehicle driving process, it may include the process of vehicle driving under human control, the process of vehicle automatic driving, the process of vehicle forward driving, and the process of vehicle reversing. Specifically, the external environment of the vehicle may be photographed through the vehicle-mounted camera (such as cameras on both sides of the vehicle), such as photographing the lane lines around the vehicle, and then image data may be obtained.

[0049] Step 102, determining a second map area having lane line anomalies in the preset map data, and determining second image data corresponding to the second map area from the image data.

[0050] The map data may be downloaded by the vehicle from the cloud, constructed using data collected by the vehicle itself, or constructed by other vehicles and then shared with the current vehicle.

[0051] In some cases, the lane line data recorded in the map data (such as the location of the lane line and other data) may not match the actual lane line on the road, resulting in lane line anomalies.

[0052] For example, lane line anomalies may occur in the following situations:

[0053] 1. The actual lane lines on the road have changed, such as the lane lines have been redrawn.

[0054] 2. The map data does not record the relevant data of lane lines.

[0055] 3. The lane line data recorded in the map data is inconsistent with the currently collected lane line data.

[0056] In the case of lane line anomalies, the lane line data recorded in the map data needs to be repaired, so the second map area where the lane line anomaly exists can be determined first, and then the second image data corresponding to the second map area where the lane line anomaly exists can be determined from the collected image data, that is, the second image data is the image data collected for the position corresponding to the second map area.

[0057] Step 103: Determine second world position information of a second lane line in a second map area in a world coordinate system based on the second image data.

[0058] After determining the second image data, lane line perception may be performed on the second image data, and further, second world position information of the second lane line in the second map area in the world coordinate system may be determined.

[0059] Specifically, lane line detection can be performed on the second image data to obtain the position of the second lane line in the image. Then, based on the intrinsic parameters, extrinsic parameters of the vehicle-mounted camera, the position of the camera in the image (i.e., the position of the camera in the image coordinate system), and the position of the ground plane, the position of the second lane line in the vehicle coordinate system can be obtained, and then the position can be converted to the world coordinate system.

[0060] Step 104: Determine second position deviation information according to the second world position information.

[0061] In some data, the lane line position error in the map data is small at close distances. As the distance between the lane line and the camera increases, the lane line reconstructed position error becomes larger and larger. The specific reason is that when the target is close, the camera takes a very clear picture with many corresponding pixels, while the distant target is small with few corresponding pixels. The actual physical size represented by a single pixel is large, and the error of one pixel represents a large error.

[0062] Specifically, based on the imaging principle of the camera, analyze the causes of the error:

[0063] 1. Camera internal parameters (including distortion).

[0064] 2. External parameters of the camera.

[0065] According to data analysis, the camera's external parameter errors will cause regular changes in the lane line position. Among them, the uneven ground factor is essentially the inaccuracy of the camera and ground external parameters (the camera and ground external parameters are fixed, and when the camera changes or the ground is uneven, the relative position changes).

[0066] Due to the large reconstruction errors of the lanes on both sides and the large lane line width errors, it may affect the subsequent lane line matching, map repair, map fusion and other functions, and may also directly lead to inaccurate reconstruction of the emergency lane and unusability. In order to correct the errors, the second world position information of the second lane line in the world coordinate system can be determined, and then the position deviation information of the second world position information can be further determined.

[0067] Step 105: Use the second position deviation information to correct the second world position information.

[0068] After determining the second position deviation information, the second world position information of the second lane line in the second map area where the lane line anomaly exists may be corrected to obtain map data after the lane line is corrected.

[0069] In one example, the map data after lane line correction can be used to perform lane line matching, map repair, map fusion and other functions, and emergency lanes can also be constructed to improve accuracy.

[0070] In an embodiment of the present invention, by acquiring image data collected by the vehicle for the external environment, a second map area in the preset map data where a lane line anomaly exists is determined, and second image data corresponding to the second map area is determined from the image data. Based on the second image data, second world position information of the second lane line in the second map area in the world coordinate system is determined, and then based on the second world position information, second position deviation information is determined. The second world position information is corrected using the second position deviation information, thereby realizing lane line patching in the map data and correction of the position of the patched lane line, thereby ensuring the accuracy of the lane line position in the map data, improving the reliability of the map data, and reducing the impact on the safe driving of the vehicle.

[0071] Reference Figure 2 , shows a flowchart of another method for lane line processing provided by an embodiment of the present invention, which may specifically include the following steps:

[0072] Step 201: Acquire image data collected by the vehicle with respect to the external environment.

[0073] In an embodiment of the present invention, after step 201, the following steps may also be included:

[0074] The image data is adjusted to a bird's eye view (BEV).

[0075] Since the lane lines are located on both sides of the vehicle, the lane lines on both sides of the vehicle can be more clearly perceived from a bird's-eye view. After obtaining the image data taken by each vehicle-mounted camera, the image data can be adjusted, such as synthesizing multiple image data to obtain a bird's-eye view.

[0076] Step 202: determine a first map area in the preset map data where no lane line anomalies exist, and determine first image data corresponding to the first map area from the image data.

[0077] In order to determine the error law of the lane line position collected by the vehicle (since the camera configuration of each vehicle is different, the error law is different, the process of determining the error law needs to be individual for each vehicle, and the first image data used to determine the error law should also be collected by the current vehicle), the first map area where no lane line anomalies exist can be determined from the map data, and then the first image data corresponding to the first map area where no lane line anomalies exist can be determined from the collected image data, that is, the first image data is the image data collected for the position corresponding to the first map area.

[0078] Step 203: Determine first world position information of a first lane line in a first map area in a world coordinate system according to the first image data.

[0079] After the first image data is determined, lane line perception may be performed on the first image data, and further, first world position information of the first lane line in the first map area in the world coordinate system may be determined.

[0080] Specifically, lane line detection can be performed on the first image data to obtain the position of the first lane line in the image. Then, based on the intrinsic parameters, extrinsic parameters of the vehicle-mounted camera, the position of the camera in the image (that is, the position of the camera in the image coordinate system), and the position of the ground plane, the position of the first lane line in the vehicle coordinate system can be obtained, and then the position can be converted to the world coordinate system.

[0081] In one embodiment of the present invention, step 203 may include:

[0082] Sub-step 11, determining first image position information of a first lane line in a first map area in first image data.

[0083] In a specific implementation, lane line detection can be performed on the first image data first, and the lane line in the first image data (i.e., the first lane line in the first map area captured) can be perceived and identified, and then the first image position information of the identified lane line in the image coordinate system of the first image data can be determined.

[0084] Sub-step 12, obtaining first camera parameters of the vehicle-mounted camera, and determining first camera position information of the first lane line in the camera coordinate system according to the first image position information and the first camera parameters.

[0085] The camera parameters may include the camera's intrinsic parameters and extrinsic parameters.

[0086] Since the first image data is taken by the vehicle's on-board camera, it is associated with the camera parameters of the vehicle-mounted camera. Therefore, after obtaining the first image position information of the first lane line in the image coordinate system, the first image position information of the first lane line in the image coordinate system can be converted into the first camera position information in the camera coordinate system according to the first camera parameters.

[0087] Sub-step 13, determining first world position information of the first lane line in the world coordinate system according to the first camera position information.

[0088] The first camera position information is relative to the camera coordinate system, and the vehicle-mounted camera is fixed on the vehicle and has a corresponding relationship with the position of the vehicle. Therefore, the first camera position information in the camera coordinate system can be converted into the position information in the vehicle coordinate system first, and then the position information of the first lane line in the vehicle coordinate system can be converted into the first world position information in the world coordinate system according to the position of the vehicle itself.

[0089] Step 204: Acquire real position information for the first lane line.

[0090] In a specific implementation, since the first map area is an area where there are no lane line anomalies, that is, the position information of the first lane line stored in the map data is reliable, the real position information of the first lane line can be obtained from the map data, which can be used as the true value of the lane line position.

[0091] Step 205, determining first position deviation information according to the first world position information and the real position information, and determining the correlation between the position of the lane line in the world coordinate system and the position deviation according to the first world position information and the first position deviation information.

[0092] After obtaining the first world position information and the real position information of the first lane line, a position deviation, that is, first position deviation information, can be determined according to the first world position information and the real position information of the first lane line.

[0093] By calculating the position deviation of the first lane line in multiple first map areas without lane line anomalies, a data fitting method can be used to determine the correlation between the position and the position deviation of the lane line in the world coordinate system, that is, the lane line position error law collected by the vehicle, according to the first world position information and the first position deviation information.

[0094] For example, the world position information is dc, and the position deviation information is Δd, where Δd=d-dc, d is the real position information, and the quadratic equation is used to fit to obtain the correlation relationship f(dc):

[0095] Δd=f(dc)

[0096] Step 206 , determining a second map area having lane line anomalies in the preset map data, and determining second image data corresponding to the second map area from the image data.

[0097] In one embodiment of the present invention, determining the second map area where a lane line abnormality exists in the preset map data may include:

[0098] Target position information is obtained, and based on the target position information, a second map area in preset map data where a lane line anomaly exists is determined; wherein the target position information is determined based on lane line anomaly data reported by multiple vehicles.

[0099] In a specific implementation, the second map area where the lane line anomaly exists may be fed back by a vehicle, and the second map area where the lane line anomaly exists in the preset map data may be determined based on target position information in the lane line anomaly data reported by multiple vehicles.

[0100] Step 207: Determine second world position information of a second lane line in a second map area in a world coordinate system based on the second image data.

[0101] In one embodiment of the present invention, step 207 may include:

[0102] Sub-step 21, determining second image position information of a second lane line in a second map area in the second image data.

[0103] In a specific implementation, lane line detection can be performed on the second image data first, and the lane line in the second image data (i.e., the second lane line in the captured second map area) can be perceived and identified, and then the second image position information of the identified lane line in the image coordinate system of the second image data can be determined.

[0104] Sub-step 22, obtaining second camera parameters of the vehicle-mounted camera, and determining second camera position information of the second lane line in the camera coordinate system according to the second image position information and the second camera parameters.

[0105] The camera parameters may include the camera's intrinsic parameters and extrinsic parameters.

[0106] Since the second image data is taken by the vehicle's on-board camera, it is associated with the camera parameters of the on-board camera. Therefore, after obtaining the second image position information of the second lane line in the image coordinate system, the second image position information of the second lane line in the image coordinate system can be converted into second camera position information in the camera coordinate system according to the second camera parameters.

[0107] Sub-step 23, determining second world position information of the second lane line in the world coordinate system according to the second camera position information.

[0108] The second camera position information is relative to the camera coordinate system, and the vehicle-mounted camera is fixed on the vehicle and has a corresponding relationship with the position of the vehicle. Therefore, the second camera position information in the camera coordinate system can be converted into the position information in the vehicle coordinate system first, and then the position information of the second lane line in the vehicle coordinate system can be converted into the second world position information in the world coordinate system according to the position of the vehicle itself.

[0109] Step 208, obtaining the correlation between the position of the lane line in the world coordinate system and the position deviation, and determining the second position deviation information according to the second world position information and the correlation relationship.

[0110] Since the correlation between the position and position deviation of the lane line in the world coordinate system is predetermined, after determining the second world position information in the world coordinate system, the second position deviation information corresponding to the second world position information can be determined according to the correlation, that is, Δd=f(dc).

[0111] Step 209: Use the second position deviation information to correct the second world position information.

[0112] After determining the second position deviation information, the second world position information of the second lane line in the second map area where the lane line anomaly exists may be corrected to obtain map data after the lane line is corrected.

[0113] For example, since the relationship between the position of the lane line in the world coordinate system and the position deviation Δd=f(dc) is determined in advance, it can be deduced and determined that:

[0114] d-dc=f(dc)

[0115] d=dc+f(dc)

[0116] That is, the real world position, that is, the corrected second world position information, can be determined based on the collected second world position information and the second position deviation information.

[0117] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0118] Reference Figure 3 , shows a schematic diagram of the structure of a lane line processing device provided by an embodiment of the present invention, which may specifically include the following modules:

[0119] The image data acquisition module 301 is used to acquire image data collected by the vehicle with respect to the external environment of the vehicle.

[0120] The second image data determination module 302 is used to determine a second map area having lane line anomalies in the preset map data, and determine second image data corresponding to the second map area from the image data.

[0121] The second world position information determination module 303 is used to determine the second world position information of the second lane line in the second map area in the world coordinate system according to the second image data.

[0122] The second position deviation information determining module 304 is used to determine the second position deviation information according to the second world position information.

[0123] The position correction module 305 is used to correct the second world position information using the second position deviation information.

[0124] In one embodiment of the present invention, the second position deviation information determining module 304 may include:

[0125] The association relationship acquisition submodule is used to obtain the association relationship between the position and position deviation of the lane line in the world coordinate system.

[0126] The association relationship determination deviation submodule is used to determine the second position deviation information according to the second world position information and the association relationship.

[0127] In one embodiment of the present invention, the method may further include:

[0128] The first image data determination module is used to determine a first map area in the preset map data where no lane line anomalies exist, and to determine first image data corresponding to the first map area from the image data.

[0129] The first world position information determination module is used to determine the first world position information of the first lane line in the first map area in the world coordinate system according to the first image data.

[0130] The real position information acquisition module is used to obtain the real position information of the first lane line.

[0131] The association relationship determination module is used to determine the first position deviation information based on the first world position information and the real position information, and to determine the association relationship between the position and the position deviation of the lane line in the world coordinate system based on the first world position information and the first position deviation information.

[0132] In one embodiment of the present invention, the first world position information determination module may include:

[0133] The first image position information determining submodule is used to determine the first image position information of the first lane line in the first map area in the first image data.

[0134] The first camera position information determination submodule is used to obtain the first camera parameters of the vehicle-mounted camera, and determine the first camera position information of the first lane line in the camera coordinate system according to the first image position information and the first camera parameters.

[0135] The first camera position determines the world position submodule, which is used to determine the first world position information of the first lane line in the world coordinate system according to the first camera position information.

[0136] In one embodiment of the present invention, the second world position information determining module 303 may include:

[0137] The second image position information determination submodule is used to determine the second image position information of the second lane line in the second map area in the second image data.

[0138] The second camera position information determination submodule is used to obtain the second camera parameters of the vehicle's onboard camera, and determine the second camera position information of the second lane line in the camera coordinate system according to the second image position information and the second camera parameters.

[0139] The second camera position determines the world position submodule, which is used to determine the second world position information of the second lane line in the world coordinate system according to the second camera position information.

[0140] In one embodiment of the present invention, the method may further include:

[0141] The bird's-eye view obtaining module is used to adjust the image data into a bird's-eye view.

[0142] In one embodiment of the present invention, the second image data determining module 302 may include:

[0143] The target position determines the second map area submodule, which is used to obtain the target position information and determine the second map area where the lane line anomaly exists in the preset map data according to the target position information; wherein the target position information is determined according to the lane line anomaly data reported by multiple vehicles.

[0144] In an embodiment of the present invention, by acquiring image data collected by the vehicle for the external environment, a second map area in the preset map data where a lane line anomaly exists is determined, and second image data corresponding to the second map area is determined from the image data. Based on the second image data, second world position information of the second lane line in the second map area in the world coordinate system is determined, and then based on the second world position information, second position deviation information is determined. The second world position information is corrected using the second position deviation information, thereby realizing lane line patching in the map data and correction of the position of the patched lane line, thereby ensuring the accuracy of the lane line position in the map data, improving the reliability of the map data, and reducing the impact on the safe driving of the vehicle.

[0145] An embodiment of the present invention further provides an electronic device, which may include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the method for lane line processing as described above is implemented.

[0146] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method for lane line processing as described above is implemented.

[0147] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0148] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0149] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0150] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0151] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0152] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0153] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0154] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0155] The above is a detailed introduction to a method and device for lane line processing. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for lane line processing, characterized in that: The method comprises: Acquire image data collected by the vehicle for the external environment; Determine a second map area in which a lane line anomaly exists in the preset map data, and determine second image data corresponding to the second map area from the image data; Determining second world position information of a second lane line in the second map area in a world coordinate system according to the second image data; determining second position deviation information according to the second world position information; Correcting the second world position information using the second position deviation information; The determining the second position deviation information according to the second world position information includes: Obtain the relationship between the position and position deviation of the lane line in the world coordinate system; determining second position deviation information according to the second world position information and the association relationship; Before determining the second position deviation information according to the second world position information, the method further includes: Determine a first map area in the preset map data where no lane line anomaly exists, and determine first image data corresponding to the first map area from the image data; Determine first world position information of a first lane line in the first map area in a world coordinate system according to the first image data; Acquire real position information of the first lane line; First position deviation information is determined based on the first world position information and the real position information, and a correlation relationship between the position of the lane line in the world coordinate system and the position deviation is determined based on the first world position information and the first position deviation information.

2. The method according to claim 1, characterized in that Determining first world position information of a first lane line in the first map area in a world coordinate system according to the first image data includes: Determine first image position information of a first lane line in the first map area in the first image data; Acquire a first camera parameter of a vehicle-mounted camera of the vehicle, and determine first camera position information of the first lane line in a camera coordinate system according to the first image position information and the first camera parameter; Determine first world position information of the first lane line in a world coordinate system according to the first camera position information.

3. The method according to any one of claims 1 to 2, characterized in that: The determining, according to the second image data, second world position information of the second lane line in the second map area in the world coordinate system includes: Determine second image position information of a second lane line in the second map area in the second image data; Acquire a second camera parameter of the vehicle-mounted camera, and determine second camera position information of the second lane line in a camera coordinate system according to the second image position information and the second camera parameter; According to the second camera position information, second world position information of the second lane line in the world coordinate system is determined.

4. The method according to claim 1, characterized in that: After acquiring the image data collected by the vehicle for the external environment, the method further includes: The image data is adjusted to a bird's-eye view.

5. The method according to claim 1, characterized in that The determining of the second map area where the lane line abnormality exists in the preset map data includes: Target position information is obtained, and based on the target position information, a second map area in preset map data where a lane line anomaly exists is determined; wherein the target position information is determined based on lane line anomaly data reported by multiple vehicles.

6. A lane line processing device, characterized in that: The device comprises: An image data acquisition module is used to acquire image data collected by the vehicle for the external environment; A second image data determination module, used to determine a second map area having lane line anomalies in the preset map data, and determine second image data corresponding to the second map area from the image data; A second world position information determination module, configured to determine second world position information of a second lane line in the second map area in a world coordinate system according to the second image data; A second position deviation information determining module, used to determine second position deviation information according to the second world position information; a position correction module, configured to correct the second world position information using the second position deviation information; The second position deviation information determining module includes: The association relationship acquisition submodule is used to obtain the association relationship between the position and position deviation of the lane line in the world coordinate system; An association relationship determination deviation submodule, used to determine the second position deviation information according to the second world position information and the association relationship; The device also includes: A first image data determination module, used to determine a first map area in the preset map data where no lane line anomalies exist, and to determine first image data corresponding to the first map area from the image data; A first world position information determination module, used to determine first world position information of a first lane line in a first map area in a world coordinate system according to the first image data; A real position information acquisition module, used to acquire the real position information of the first lane line; The association relationship determination module is used to determine the first position deviation information based on the first world position information and the real position information, and to determine the association relationship between the position and the position deviation of the lane line in the world coordinate system based on the first world position information and the first position deviation information.

7. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the method for lane line processing as claimed in any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for lane line processing according to any one of claims 1 to 5 is implemented.

Citation Information

Patent Citations

  • Lane line updating method, device, equipment and system and readable storage medium

    CN110147382A

  • Map error determination method and device

    CN110595494A

  • Three-dimensional lane line detection method and device, and storage medium

    CN112733812A

  • Method and device for positioning unmanned equipment

    CN112859131A

  • Electronic map lane line correction method and device and computer readable storage medium

    CN113408407A