Sampled data processing method of laser radar and related product
By adopting the combination of sampling module, intermediate processing module, data center module and framing module in lidar, efficient data storage and fault analysis are achieved, solving the problem of large storage resources in the existing technology, and improving troubleshooting efficiency.
Patent Information
- Application Number
- CN202310614915.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-26
- Publication Date
- 2024-11-26
AI Technical Summary
During the data interaction between the existing lidars, due to the differences in interfaces and different data formats, the storage resources are consumed and the original module needs to be adjusted, making it difficult to efficiently capture and analyze intermediate data to troubleshoot problems.
Using a combination of sampling module, at least two intermediate processing modules, data center modules and framing modules, point cloud data is stored through the data center module cache area, and data of different intermediate processing modules are captured at different times, using pass-through mode and ping-pong Operation method optimizes data storage and reduces storage resource consumption.
It effectively saves the storage resource overhead within the lidar, avoids adjustments to the original intermediate processing module, and improves the efficiency of fault analysis.
Smart Images

Figure CN119024303A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of experimental equipment, and in particular to a laser radar sampling data processing method and related products. Background Art
[0002] Laser radar is an active remote sensing device that uses photoelectric technology for detection. It combines photoelectric detection technology with laser technology and is an advanced detection method that uses laser as the detection light source. Laser radar includes a transmitting module, a scanning module, a receiving module, a data processing module, etc. The transmitting module is used to transmit the detection signal to the target, the scanning module is used to change the transmission line of the detection signal, the receiving module is used to sample the echo signal of the detection signal, and the data processing module is used to sample and process the echo signal, so as to obtain the distance, reflectivity, speed, size and other information of the detection target.
[0003] In the laser radar, the sampling data from the receiving module is sent to the data processing module for processing to obtain the initial point cloud data. Before that, it will be pre-processed by multiple intermediate processing modules in sequence, and then enter the data processing module for processing. The data before the sampling data is converted into the initial point cloud data is also called intermediate data. Different intermediate processing modules have different logics. Some do not need a data buffer, some only need a small dat_buffer, and some need a larger cache buffer.
[0004] At present, since the pre-processing process and module maturity are not high enough, it is necessary to capture some intermediate data of each pre-processing module for analysis in order to troubleshoot each pre-processing module. However, the interfaces for interaction between the pre-processing modules are different, and the data format and data volume are different. How to achieve that the data of each module can be captured is a problem. The prior art usually adds a dat_buffer to each intermediate processing module to store intermediate data, and adopts a method of connecting a set of buses to each intermediate processing module to capture the intermediate data of the datbuffer of each intermediate processing module. In order to adapt to the format of the bus, it is often necessary to adjust the original intermediate processing module. And because the intermediate data is the data before compression, the total data volume sometimes reaches hundreds of times the initial point cloud data, so the consumption of storage resources will be particularly large. Summary of the invention
[0005] The present application provides a laser radar sampling data processing method and related products, which can save storage resource overhead inside the laser radar.
[0006] In a first aspect, the present application provides a sampling data processing method of a laser radar, wherein the laser radar includes a sampling module, at least two intermediate processing modules, a data center module, and a framing module, and the method includes:
[0007] The sampling module samples the echo to obtain sampling data;
[0008] The sampled data are processed in sequence by the at least two intermediate processing modules to obtain point cloud data, wherein each of the intermediate processing modules processes the data from the upstream module to obtain intermediate data and then outputs the intermediate data to the downstream module;
[0009] Inputting the point cloud data into the buffer area of the digital center module for storage;
[0010] Reading the point cloud data from the buffer area through the framing module, and generating at least one frame of point cloud according to the point cloud data;
[0011] When the analyzed module is determined from the at least two intermediate processing modules, data is captured from the analyzed module to obtain captured data;
[0012] Switching the digital center module to input the captured data into the buffer area of the digital center module for storage;
[0013] The captured data is read from the buffer area through the framing module, and fault analysis is performed on the analyzed module according to the captured data.
[0014] Optionally, when determining the analyzed module from the at least two intermediate processing modules, the method further includes:
[0015] Controlling an intermediate processing module located downstream of the analyzed module to enter a direct-through mode;
[0016] The captured data is directly passed to the digital central module through the intermediate processing module that enters the direct-through mode.
[0017] Optionally, the at least two intermediate processing modules are connected to the digital central module via a set of buses respectively;
[0018] The captured data is input into the digital center module through a bus between the analyzed module and the digital center module.
[0019] Optionally, the laser radar has an operating mode and a detection mode.
[0020] In the working mode, the step of processing the sampled data in sequence through at least two intermediate processing modules to obtain point cloud data is executed, and the step of inputting the point cloud data into the buffer area of the digital center module for storage is executed;
[0021] In the detection mode, determining the analyzed module from the at least two intermediate processing modules is performed.
[0022] Optionally, the sampling module includes a plurality of pixels, and the sampling data includes pixel data obtained by sampling at least part of the pixels;
[0023] When it is determined that the analyzed module is determined from the at least two intermediate processing modules, the capturing of data from the analyzed module also includes:
[0024] The pixel data in different areas of the sampling module are read in batches, wherein the pixel data read once is processed by the analyzed module, and the captured data of the analyzed module is stored in the cache area of the data center module before the next reading is started.
[0025] Optionally, when the captured data corresponding to the pixel data read once is stored in the cache area of the data center module, the captured data corresponding to the pixel data read last time and stored in the cache area is overwritten.
[0026] Optionally, the step of inputting the point cloud data into a buffer area of the digital center module for storage includes:
[0027] The point cloud data corresponding to the sampled data obtained by sampling are sequentially stored in the buffer area of the digital center module according to the sampling order of the sampling module.
[0028] Wherein, the storage addresses of the point cloud data located on the same row of a frame of point cloud in the buffer area are adjacent, so that the framing module can read the point cloud data in the buffer area in order of rows;
[0029] The difference between the maximum pitch angle and the minimum pitch angle in each point cloud data in the same row of a frame of point cloud is less than a first preset angle.
[0030] Optionally, the point cloud data includes distance data and reflectivity data;
[0031] The cache area of the digital center module partitions and stores the distance data and the reflectivity data, wherein the distance data located on the same row of a frame of point cloud have adjacent storage addresses in the cache area, and the reflectivity data located on the same row of a frame of point cloud have adjacent storage addresses in the cache area.
[0032] Optionally, before determining the analyzed module from the at least two intermediate processing modules, the buffer area of the digital center module is released and divided into at least two areas;
[0033] The step of switching the digital center module to input the captured data into a buffer area of the digital center module for storage includes:
[0034] The captured data is stored in at least two areas of the buffer area of the digital center module through a ping-pong operation.
[0035] In a second aspect, the present application provides a sampling data processing device, including a sampling module, at least two intermediate processing modules, a data center module, a framing module and a grabbing module.
[0036] The sampling module is used to sample the echo to obtain sampling data;
[0037] The at least two intermediate processing modules are used to process the sampled data in sequence to obtain point cloud data; wherein each intermediate processing module is used to process the data from the upstream module to obtain intermediate data and then output it to the downstream module;
[0038] The data center module is used to input the point cloud data into the cache area of the digital center module for storage;
[0039] The framing module is used to read the point cloud data from the buffer area and generate at least one frame of point cloud according to the point cloud data;
[0040] The capture module is used to capture data from the analyzed module to obtain captured data when the analyzed module is determined from the at least two intermediate processing modules;
[0041] The data center module is also used to switch to input the captured data into the cache area of the digital center module for storage;
[0042] The framing module is further used to read the captured data from the buffer area and perform fault analysis on the analyzed module according to the captured data.
[0043] In a second aspect, the present application provides a laser radar, comprising:
[0044] Processor; and
[0045] A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to execute any one of the methods described above.
[0046] In a third aspect, the present application provides a computer-readable storage medium storing executable code, which, when executed by a processor of a laser radar, enables the laser radar to execute any one of the methods described.
[0047] In an embodiment of the present application, when it is necessary to capture the intermediate processing data of the intermediate processing module to perform fault analysis on the intermediate processing module, the intermediate data of different intermediate processing modules are captured at different time periods, and the intermediate data of different intermediate processing modules are stored in the cache area of the data center module in a time-sharing manner, so that the point cloud data and the intermediate data of different intermediate processing modules share the cache area of the data center module at different time periods, thereby saving the storage resource overhead inside the laser radar; moreover, compared with the prior art, there is no need to adjust the original intermediate processing module. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Figure 1 is a schematic diagram of an embodiment of a laser radar of the present application;
[0049] Figure 2 yes Figure 1 A schematic diagram of an embodiment of a sampling data processing method of a laser radar is shown;
[0050] Figure 3 is a schematic diagram of a portion of the structure of a laser radar in an example of the present application;
[0051] Figure 4 It is a schematic diagram of reading data from a receiving block twice in a sampling data processing method of the present application;
[0052] Figure 5 is a schematic diagram of storing the point cloud data in the buffer area of the digital center module;
[0053] Figure 6 is a schematic diagram of storing the captured data in the buffer area of the digital center module by means of ping-pong operation;
[0054] Figure 7 is a schematic diagram of an embodiment of a sampling data processing device in an embodiment of the present application;
[0055] Figure 8 It is a schematic diagram of an embodiment of a laser radar in an embodiment of the present application. DETAILED DESCRIPTION
[0056] The embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.
[0057] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.
[0058] It should be understood that although the terms "first", "second", "third", etc. may be used in this application to describe various information, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0059] Lidar is a radar system that emits laser beams to detect the position, speed and other characteristic quantities of a target. Its working principle is to use a laser transmitter to emit multiple laser beams in sequence. If the laser beam encounters an object, it will be reflected, and a receiver will receive the reflected echo. Lidar can be a mechanical Lidar, a semi-solid Lidar or a pure solid-state Lidar. Lidar calculates the time difference between the time of receiving the reflected echo and the time of emitting the laser beam, and the time difference is the flight time of the laser beam. Lidar calculates the distance, direction and other parameters of the object that reflects the echo based on the flight time, and calculates the reflectivity based on the energy of the echo and the energy of the emitted laser beam, thereby detecting the external environment.
[0060] Combine the following Figure 1 and Figure 2 The sampling data processing method of the laser radar of the present application is introduced by way of example. Figure 1 As shown, Figure 1 is a schematic diagram of an embodiment of the laser radar of the present application, Figure 2 yes Figure 1 A schematic diagram of an embodiment of a method for processing sampling data of a laser radar is shown. Figure 1 As shown, the laser radar 100 includes a sampling module 101, at least two intermediate processing modules 102, a data center module 103 and a framing module 104. Specifically, Figure 1 In the figure, the laser radar 100 includes three intermediate processing modules 102. It is understandable that in practical applications, the number of the intermediate processing modules 103 can be two or four or other numbers.
[0061] Optionally, the laser radar also includes a transmitting module 105 for emitting a laser beam, which is used to convert an electrical signal into an optical signal and transmit it. The sampling module 101 is used to receive the echo of the emitted laser beam reflected by an object, and convert the echo into an electrical signal. At least two intermediate processing modules 102 are used to process the electrical signal from the sampling module 101 in sequence, wherein each intermediate processing module processes the data from the upstream module to obtain intermediate data and then outputs it to the module located downstream, and the last intermediate processing module 102 is used to store the processed point cloud data in the cache area of the digital center module 103. Specifically, each intermediate processing module is used to calculate at least one of the following intermediate data based on the sampling signal corresponding to the echo: distance, azimuth, and reflectivity. Each intermediate data is stored as point cloud data in the cache area of the data center module 103 by the last intermediate processing module 102, wherein each point cloud point data in the point cloud data is used to characterize the object that reflects the corresponding echo.
[0062] The framing module 104 is used to read each point cloud point data from the buffer area of the data center module 103, and form at least one frame of point cloud according to the multiple point cloud point data read. Optionally, the framing module 104 can be implemented by an image signal processor (Image Signal Processing, ISP) or a microcontroller unit (Microcontroller Unit, MCU). In one example, the framing module 104 is used to obtain a frame of point cloud by collecting point cloud points for a continuous period of time. Generally speaking, the duration of each point cloud frame output by the laser radar is the same, that is, the point cloud points collected in the period are output as a frame of point cloud every fixed period. Of course, in some cases, the point cloud frame can also be output at a variable frequency, which is not limited here. The at least one frame of point cloud formed by the framing module 104 can be used for further identification and perception of the external environment.
[0063] Optionally, the laser radar may also include a scanning module (such as a MEMS galvanometer) for changing the emission direction of the emitted laser beam to achieve scanning of the laser beam within a certain field of view. The optical path of the reflected echo and the emitted laser may be coaxial, and the reflected echo returns through the scanning module-transceiver module path and is received by the receiver in the transceiver module. The laser radar may be a single-channel scan or may achieve simultaneous or interleaved scanning of multiple channels. In the case of multi-channel scanning, it may be achieved through multiple sets of transceiver modules, and the light between each channel (the emitted laser and the reflected echo) is isolated from each other.
[0064] Optionally, the sampling module includes a plurality of pixels, each pixel is used to sample echoes from different directions, and the sampling data includes pixel data obtained by sampling at least part of the pixels. Optionally, the plurality of pixels form different receiving blocks. For example, each receiving block contains a pixel array, such as a 4*8 pixel array. All receiving blocks in the sampling module can work simultaneously, or can work in time-sharing, or some receiving blocks can work simultaneously and some receiving blocks can work in time-sharing. In one example, when the laser radar emits a laser beam once, only some receiving blocks are turned on to sample the echo, and when the laser beam is emitted next time, another part of the receiving blocks are turned on to sample the echo. The receiving blocks turned on twice adjacently can be completely different, or can be partially the same.
[0065] like Figure 2 As shown, the laser radar sampling data processing method 200 includes:
[0066] Step S201: sampling the echoes through the sampling module to obtain sampling data.
[0067] Step S202: Process the sampled data in sequence through the at least two intermediate processing modules to obtain point cloud data.
[0068] Each of the intermediate processing modules processes the data from the upstream module to obtain intermediate data and then outputs the intermediate data to the downstream module.
[0069] Step S203: input the point cloud data into the buffer area of the digital center module for storage.
[0070] Step S204: reading the point cloud data from the buffer area through the framing module, and generating at least one frame of point cloud according to the point cloud data.
[0071] Step S205: when the analyzed module is determined from the at least two intermediate processing modules, data is captured from the analyzed module to obtain captured data.
[0072] Since the intermediate processing module may fail, the analyzed module can be analyzed by determining the analyzed module in the intermediate processing module, capturing data from the analyzed module, and performing data analysis. Specifically, at least some of the different intermediate processing modules capture data in different time periods. For example, each of the at least two intermediate processing modules can be determined as the analyzed module in turn, or only some of the at least two intermediate processing modules can be determined as the analyzed modules in turn. In the case where the number of intermediate processing modules is greater than 2, optionally, two intermediate processing modules can be simultaneously determined as analyzed modules at one time, and data can be captured from them at the same time.
[0073] Step S206, switching the digital center module to input the captured data into the buffer area of the digital center module for storage.
[0074] The digital center module has two groups of input links, wherein the first group of input links is used to input the point cloud data in step S203 to the cache area of the digital center module, and the second group of input links is used to input the captured data in step S205 to the cache area of the digital center module. The cache area is used to store the input data of one of the two groups of input links in the same period. One of the input links can be selected by MUX to input data to the cache area of the digital center module for storage.
[0075] When the captured data in step S205 is input through MUX selection, specifically, the captured data captured at different time periods are stored in the cache area of the digital center module at different time periods to reduce the bandwidth and storage resources consumed by the captured data. There are many methods for transmitting the captured data from the corresponding analyzed module to the cache area of the digital center module. In one example, the at least two intermediate processing modules are respectively connected to the digital center module through a group of buses; the captured data is input to the digital center module through the bus between the analyzed module and the digital center module. In one example, when it is determined that the analyzed module is determined from the at least two intermediate processing modules, before step S206, the intermediate processing module located downstream of the analyzed module is also controlled to enter the pass-through mode; the captured data is passed directly to the digital center module through the intermediate processing module entering the pass-through mode, and stored in the cache area of the digital center module. Compared with the example in which each intermediate processing module is connected to the digital center module through a set of buses, the example in which the captured data from the analyzed module is directly passed to the data center module through the intermediate processing module located downstream of the analyzed module can avoid problems such as too many interface connections and some paths being too long.
[0076] In a specific example, if Figure 3 As shown, Figure 3It is a partial structural diagram of a laser radar in an example of the present application. The laser radar 300 includes a first intermediate processing module 301, a second intermediate processing module 302, a third intermediate processing module 303, a fourth intermediate processing module 304, a data center module 305 and a framing module 306. When the first intermediate processing module 301 is determined to be the analyzed module, the second intermediate processing module 302, the third intermediate processing module 303 and the fourth intermediate processing module 304 located downstream of the first intermediate processing module 301 are controlled to enter the pass-through mode for the third time. Optionally, at least one intermediate processing module connected to the data center module 305 may not enter the pass-through mode, and the last intermediate processing module in the data link to enter the pass-through mode directly passes the intermediate data to the data center module 305. Figure 3 As shown, the fourth intermediate processing module 304 connected to the data center module 305 may not enter the pass-through mode, and the third intermediate processing module 303 directly passes the intermediate data to the data center module 305 .
[0077] The second intermediate processing module 302 and the third intermediate processing module 303 each have two groups of input links, wherein the first group of input links is used to receive intermediate data from the upstream module for processing, and then input the processed intermediate data to the downstream module, and the second group of input links is used to receive intermediate data from the upstream module and then pass it directly to the downstream module. After controlling the second intermediate processing module 302 and the third intermediate processing module 303 to enter the pass-through mode, the data captured from the first intermediate processing module 301 is selected by MUX and passed from the second group of input links of the second intermediate processing module 302, the third intermediate processing module 303 and the digital center module 306 to the cache area of the digital center module 306 for storage.
[0078] Step S207: reading the captured data from the buffer area through the framing module, and performing fault analysis on the analyzed module according to the captured data.
[0079] After the captured data of each analyzed module is stored in the buffer area of the digital center module, the framing module reads the captured data from the buffer area for analysis. For example, the captured data can be compared with the calibration data, or the captured data can be processed by a preset algorithm to determine whether the analyzed module has a fault and / or the specific fault location.
[0080] In the embodiment of the present application, when it is necessary to capture the intermediate processing data of the intermediate processing module to perform fault analysis on the intermediate processing module, the intermediate data of different intermediate processing modules are captured at different time periods, so that the intermediate data of different intermediate processing modules are stored in the cache area of the data center module in a time-sharing manner, so that the point cloud data and the intermediate data of different intermediate processing modules share the cache area of the data center module at different time periods, which can save the storage resource overhead inside the laser radar. Moreover, compared with the prior art, there is no need to adjust the original intermediate processing module.
[0081] Optionally, in an example where the sampling module includes a plurality of pixels, when it is determined that the analyzed module is determined from the at least two intermediate processing modules, before grabbing data from the analyzed module, the sampling data processing method of the present application further includes: reading the pixel data in different areas of the sampling module in batches, wherein the pixel data read once is processed by the analyzed module, and the captured data of the analyzed module is stored in the cache area of the data center module before starting the next reading. In this way, the analyzed module does not need to process all the pixel data generated by one echo at one time, but processes all the pixel data generated by one echo in batches; when grabbing data from the analyzed module, what is grabbed is the intermediate data obtained by processing the pixel data read this time, rather than the intermediate data obtained by processing the pixel data of all pixels that generate sampling data for one echo, which can reduce the amount of data grabbed each time, thereby reducing the bandwidth resources and storage resources occupied by the grabbed data.
[0082] Optionally, when the captured data corresponding to the pixel data read once is stored in the cache area of the data center module, the captured data corresponding to the pixel data read last time and stored in the cache area is overwritten, which can further reduce the storage resources occupied by the captured data.
[0083] In an alternative example, Figure 4 As shown, Figure 4 Schematic diagram of reading data from receiving blocks twice in the sampling data processing method of the present application. In this example, it is taken as an example that each echo is received by three receiving blocks, wherein each receiving block is as follows: Figure 4As shown, it includes 4 rows and 8 columns of pixels. When reading data from the receiving block to input into the first intermediate processing module, the pixel data of the 4 pixels in the first column 411 in the first receiving block 41 is first read, and the pixel data of the 4 pixels are processed by the analyzed module, and the captured data of the analyzed module is stored in the buffer area of the data center module, and then the pixel data of the 4 pixels in the second column 412 in the first receiving block 41 is read. Optionally, when the captured data corresponding to the pixel data of the 4 pixels in the second column 412 is stored in the buffer area of the data center module, the captured data corresponding to the pixel data of the 4 pixels in the first column 411 in the buffer area is overwritten.
[0084] This process is repeated until all pixel data in the first receiving block 41 are read, and then the process switches to reading pixel data of four pixels in the first column of the second receiving block of the three receiving blocks for receiving the echo. This process is repeated by analogy until all pixel data of the three receiving blocks are read. It is understood that the number of pixels in the receiving block and the number of pixels read at one time in this example are for illustration only and are not intended to be limiting.
[0085] Optionally, when storing point cloud data or captured data, the cache area of the digital center module can be stored in a modular manner to meet different storage requirements.
[0086] In some examples, the point cloud data includes distance data and reflectivity data. The cache area of the digital center module stores the distance data and the reflectivity data in partitions, wherein the storage addresses of the distance data on the same row of a frame of point cloud are adjacent in the cache area, and the storage addresses of the reflectivity data on the same row of a frame of point cloud are adjacent in the cache area.
[0087] In some examples, the laser radar emits at least two laser beams in different directions at the same time, and samples the echoes of the at least two laser beams through at least two receiving areas corresponding to the at least two laser beams, wherein each receiving area includes at least one pixel. Optionally, the point cloud data corresponding to the pixels in different receiving areas are also partitioned and stored in the buffer area.
[0088] like Figure 5 As shown, Figure 5 is a schematic diagram of storing the point cloud data in the buffer area of the digital center module. Figure 5In the example shown, the laser radar simultaneously emits two laser beams in different directions, and samples the echoes of the two laser beams through two receiving areas 51 and 52 corresponding to the two laser beams, wherein each receiving area contains at least one pixel, and the point cloud data corresponding to each pixel includes distance data and reflectivity data. In this example, the cache area of the digital center module is divided into four areas, including area 501, area 502, area 503 and area 504. Area 501 and area 503 are used to store the reflectivity data corresponding to the pixels in the two receiving areas 51 and 52, respectively. Figure 5 As shown, ref(l,m,n) is used to represent reflectivity data, where l and m respectively represent the row and column of the pixel corresponding to the reflectivity data, and n represents the data of the nth echo sampled by the corresponding pixel for the reflectivity data.
[0089] Area 502 and area 504 are used to store the distance data corresponding to the pixels in the two receiving areas. In each of the four areas of the buffer, the stored data is stored continuously in the order of the point cloud arrangement on the same line in a frame of point cloud. Figure 5 As shown, dist(l,m,n) is used to represent distance data, where l and m respectively represent the row and column of the pixel corresponding to the distance data, and n represents the data of the nth echo sampled by the corresponding pixel for the distance data.
[0090] In one example, before determining the analyzed module from the at least two intermediate processing modules, the buffer area of the digital center module is released and divided into at least two areas; when the digital center module is switched to inputting the captured data into the buffer area of the digital center module for storage in step S206, the captured data is stored in at least two areas of the buffer area of the digital center module by ping-pong operation. In this way, whenever the framing module reads the captured data from the buffer area of the digital center module, the captured data from the analyzed module can also be stored in the buffer area of the digital center module.
[0091] like Figure 6 As shown, Figure 6 is a schematic diagram of storing the captured data in the buffer area of the digital center module through a ping-pong operation. Figure 5 The buffer area of the digital center module shown in the figure is divided into two areas, where area 501 and area 502 are divided into one area, and area 503 and area 504 are divided into one area. Taking the captured data as histogram data as an example, and taking the captured data corresponding to the pixel data of 4 pixels that can be stored in the buffer area of the digital center module as an example, Figure 4In the example shown, when the framing module reads the captured data corresponding to the pixel data of the four pixels in the first column 411 from the buffer area of the digital center module, the captured data corresponding to the pixel data of the four pixels in the second column 412 can also be stored in the buffer area of the digital center module. The storage data format of each address in the buffer area is as follows: Figure 6 As shown, His(l,m,n) represents the stored captured data, l and m respectively represent the row and column where the pixel corresponding to the captured data is located, and n represents the nth data in the pixel data corresponding to the captured data.
[0092] In one example, when the point cloud data is input into the buffer area of the digital center module for storage in step S203, the point cloud data corresponding to the sampled data obtained by sampling are sequentially stored in the buffer area of the digital center module according to the sampling order of the sampling module. Moreover, the storage addresses of the point cloud data on the same row of a frame of point cloud are adjacent in the buffer area, so that the framing module can read the point cloud data in the buffer area in the order of rows. Among them, the difference between the maximum pitch angle and the minimum pitch angle in each point cloud data in the same row of a frame of point cloud is less than the first preset angle.
[0093] In actual applications, the arrangement order and sampling order of each point cloud point in a frame of point cloud image are not necessarily consistent. In the embodiment of the present application, although the point cloud data is input into the cache area according to the sampling order, the storage address of each point cloud point data is not necessarily adjacent in the output order. Instead, the storage position of each point cloud point data is determined according to the position of each point cloud point in a frame of point cloud, so that the storage addresses of two adjacent point cloud point data on a frame of point cloud image are adjacent, and then the framing module can read in row order when reading the point cloud data in the cache area.
[0094] In some examples, the laser radar is provided with a working mode and a detection mode. In the working mode, steps S202 to S204 are executed; in the detection mode, steps S205 to S207 are executed. The detection mode may be used to perform fault analysis on each intermediate processing module in the laser radar before the laser radar leaves the factory, or the detection mode may be entered by passive triggering or active triggering during operation after the laser radar leaves the factory to perform fault analysis on each intermediate processing module in the laser radar. For example, the laser radar may automatically run the detection mode at intervals or at a fixed preset time after leaving the factory to detect whether each intermediate processing module fails. Alternatively, the laser radar may enter the detection mode after receiving instructions from the user or instructions from other devices to detect whether each intermediate processing module fails. Alternatively, the laser radar may monitor each frame point cloud in real time, and when at least an abnormality is detected in each frame point cloud, the laser radar is controlled to enter the detection mode to detect whether each intermediate processing module fails.
[0095] The present application also provides a sampling data processing device. Figure 7 As shown, Figure 7 Schematic diagram of an embodiment of a sampling data processing device in an embodiment of the present application. The sampling data processing device 700 includes:
[0096] A sampling module 701, at least two intermediate processing modules 702, a data center module 703, a framing module 704 and a capture module 705,
[0097] The sampling module 701 is used to sample the echo to obtain sampling data;
[0098] The at least two intermediate processing modules 702 are used to process the sampled data in sequence to obtain point cloud data; wherein each intermediate processing module 702 is used to process the data from the upstream module to obtain intermediate data and then output it to the downstream module;
[0099] The data center module 703 is used to input the point cloud data into the cache area of the digital center module 703 for storage;
[0100] The framing module 704 is used to read the point cloud data from the buffer area and generate at least one frame of point cloud according to the point cloud data;
[0101] The capture module 705 is used for capturing data from the analyzed module to obtain captured data when the analyzed module is determined from the at least two intermediate processing modules 702;
[0102] The data center module 703 is also used to switch to input the captured data into the cache area of the digital center module for storage;
[0103] The framing module 704 is further configured to read the captured data from the buffer area, and perform fault analysis on the analyzed module according to the captured data.
[0104] Optionally, when determining the analyzed module from the at least two intermediate processing modules,
[0105] The intermediate processing module located downstream of the analyzed module is also used to enter a direct-through mode, and directly pass the captured data to the digital center module through the intermediate processing module entering the direct-through mode.
[0106] Optionally, the at least two intermediate processing modules are connected to the digital central module via a set of buses respectively;
[0107] The captured data is input into the digital center module through a bus between the analyzed module and the digital center module.
[0108] Optionally, the laser radar has an operating mode and a detection mode.
[0109] In the working mode, the step of processing the sampled data in sequence through at least two intermediate processing modules to obtain point cloud data is executed, and the step of inputting the point cloud data into the buffer area of the digital center module for storage is executed;
[0110] In the detection mode, determining the analyzed module from the at least two intermediate processing modules is performed.
[0111] Optionally, the sampling module includes a plurality of pixels, and the sampling data includes pixel data obtained by sampling at least part of the pixels;
[0112] The device also includes:
[0113] A reading module is used to read the pixel data in different areas of the sampling module in batches when an analyzed module is determined from the at least two intermediate processing modules and before capturing data from the analyzed module, wherein the pixel data read once is processed by the analyzed module, and the captured data of the analyzed module is stored in the cache area of the data center module before starting the next reading.
[0114] Optionally, when the captured data corresponding to the pixel data read once is stored in the cache area of the data center module, the captured data corresponding to the pixel data read last time and stored in the cache area is overwritten.
[0115] Optionally, when the data center module inputs the point cloud data into the cache area of the digital center module for storage, it is specifically used to:
[0116] The point cloud data corresponding to the sampled data obtained by sampling are sequentially stored in the buffer area of the digital center module according to the sampling order of the sampling module.
[0117] Wherein, the storage addresses of the point cloud data located on the same row of a frame of point cloud in the buffer area are adjacent, so that the framing module can read the point cloud data in the buffer area in order of rows;
[0118] The difference between the maximum pitch angle and the minimum pitch angle in each point cloud data in the same row of a frame of point cloud is less than a first preset angle.
[0119] Optionally, the point cloud data includes distance data and reflectivity data;
[0120] The cache area of the digital center module partitions and stores the distance data and the reflectivity data, wherein the distance data located on the same row of a frame of point cloud have adjacent storage addresses in the cache area, and the reflectivity data located on the same row of a frame of point cloud have adjacent storage addresses in the cache area.
[0121] Optionally, before determining the analyzed module from the at least two intermediate processing modules, the buffer area of the digital center module is released and divided into at least two areas;
[0122] When the data center module switches the digital center module to input the captured data into the buffer area of the digital center module for storage, the data center module is specifically used to:
[0123] The captured data is stored in at least two areas of the buffer area of the digital center module through a ping-pong operation.
[0124] The present application also provides a laser radar, such as Figure 8 As shown, Figure 8 80 is a schematic diagram of an embodiment of a laser radar in an embodiment of the present application. The laser radar 80 includes a memory 81 and a processor 82 .
[0125] The processor 82 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0126] The memory 81 may include various types of storage units, such as system memory, read-only memory (ROM) and permanent storage devices. Among them, ROM can store static data or instructions required by the processor 82 or other modules of the computer. The permanent storage device can be a readable and writable storage device. The permanent storage device can be a non-volatile storage device that will not lose the stored instructions and data even if the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In some other embodiments, the permanent storage device can be a removable storage device (such as a floppy disk, an optical drive). The system memory can be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory can store some or all instructions and data required by the processor at run time. In addition, the memory 81 can include any combination of computer-readable storage media, including various types of semiconductor storage chips (such as DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks can also be used. In some embodiments, the memory 80 may include a readable and / or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (such as a DVD-ROM, a double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (such as an SD card, a mini SD card, a Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not contain carrier waves and transient electronic signals transmitted wirelessly or wired.
[0127] The memory 81 stores executable codes, and when the executable codes are processed by the processor 82 , the processor 82 can execute part or all of the methods described above.
[0128] Alternatively, the present application can also be implemented as a computer-readable storage medium (or non-transitory machine-readable storage medium or machine-readable storage medium) on which executable code (or computer program or computer instruction code) is stored. When the executable code (or computer program or computer instruction code) is executed by a processor of an electronic device (or server, etc.), the processor executes part or all of the steps of the above-mentioned method according to the present application.
[0129] The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.
Claims
1. A method for processing sampling data of a laser radar, wherein the laser radar comprises a sampling module, at least two intermediate processing modules, a data center module and a framing module, characterized in that: include: The sampling module samples the echo to obtain sampling data; The sampled data are processed in sequence by the at least two intermediate processing modules to obtain point cloud data, wherein each of the intermediate processing modules processes the data from the upstream module to obtain intermediate data and then outputs the intermediate data to the downstream module; Inputting the point cloud data into the buffer area of the digital center module for storage; Reading the point cloud data from the buffer area through the framing module, and generating at least one frame of point cloud according to the point cloud data; When the analyzed module is determined from the at least two intermediate processing modules, data is captured from the analyzed module to obtain captured data; Switching the digital center module to input the captured data into the buffer area of the digital center module for storage; The captured data is read from the buffer area through the framing module, and fault analysis is performed on the analyzed module according to the captured data.
2. The method according to claim 1, characterized in that When determining to determine the analyzed module from the at least two intermediate processing modules, the method further includes: Controlling an intermediate processing module located downstream of the analyzed module to enter a direct-through mode; The captured data is directly passed to the digital central module through the intermediate processing module that enters the direct-through mode.
3. The method according to claim 1, characterized in that: The at least two intermediate processing modules are connected to the digital central module via a set of buses respectively; The captured data is input into the digital center module through a bus between the analyzed module and the digital center module.
4. The method according to claim 1 or 2, characterized in that: The laser radar has an operating mode and a detection mode. In the working mode, the step of processing the sampled data in sequence through at least two intermediate processing modules to obtain point cloud data is executed, and the step of inputting the point cloud data into the buffer area of the digital center module for storage is executed; In the detection mode, determining the analyzed module from the at least two intermediate processing modules is performed.
5. The method according to claim 1 or 2, characterized in that: The sampling module includes a plurality of pixels, and the sampling data includes pixel data obtained by sampling at least part of the pixels; When it is determined that the analyzed module is determined from the at least two intermediate processing modules, the capturing of data from the analyzed module also includes: The pixel data in different areas of the sampling module are read in batches, wherein the pixel data read once is processed by the analyzed module, and the captured data of the analyzed module is stored in the cache area of the data center module before the next reading is started.
6. The method according to claim 5, characterized in that When the captured data corresponding to the pixel data read once is stored in the buffer area of the data center module, the captured data corresponding to the pixel data read last time and stored in the buffer area is overwritten.
7. The method according to claim 1 or 2, characterized in that: The step of inputting the point cloud data into the buffer area of the digital center module for storage includes: The point cloud data corresponding to the sampled data obtained by sampling are sequentially stored in the buffer area of the digital center module according to the sampling order of the sampling module; Wherein, the storage addresses of the point cloud data located on the same row of a frame of point cloud in the buffer area are adjacent, so that the framing module can read the point cloud data in the buffer area in order of rows; The difference between the maximum pitch angle and the minimum pitch angle in each point cloud data in the same row of a frame of point cloud is less than a first preset angle.
8. The method according to claim 7, characterized in that The point cloud data includes distance data and reflectivity data; The cache area of the digital center module partitions and stores the distance data and the reflectivity data, wherein the distance data located on the same row of a frame of point cloud have adjacent storage addresses in the cache area, and the reflectivity data located on the same row of a frame of point cloud have adjacent storage addresses in the cache area.
9. The method according to claim 1 or 2, characterized in that: Before determining the analyzed module from the at least two intermediate processing modules, the buffer area of the digital center module is released and divided into at least two areas; The step of switching the digital center module to input the captured data into a buffer area of the digital center module for storage includes: The captured data is stored in at least two areas of the buffer area of the digital center module through a ping-pong operation.
10. A sampling data processing device, characterized in that: It includes a sampling module, at least two intermediate processing modules, a data center module, a framing module and a grabbing module. The sampling module is used to sample the echo to obtain sampling data; The at least two intermediate processing modules are used to process the sampled data in sequence to obtain point cloud data; wherein each intermediate processing module is used to process the data from the upstream module to obtain intermediate data and then output it to the downstream module; The data center module is used to input the point cloud data into the cache area of the digital center module for storage; The framing module is used to read the point cloud data from the buffer area and generate at least one frame of point cloud according to the point cloud data; The capture module is used to capture data from the analyzed module to obtain captured data when the analyzed module is determined from the at least two intermediate processing modules; The data center module is also used to switch to input the captured data into the cache area of the digital center module for storage; The framing module is further used to read the captured data from the buffer area and perform fault analysis on the analyzed module according to the captured data.
11. A laser radar, characterized in that: include: processor; as well as A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to execute the method according to any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that: An executable code is stored, and when the executable code is executed by a processor of a laser radar, the laser radar executes the method as described in any one of claims 1 to 9.
Citation Information
Patent Citations
Techniques for point cloud processing utilizing point indices
US11609334B1
Module search failure analysis
US20070168969A1
Augmenting panoramic lidar results with color
US20180329066A1
Lidar-based mapping method, device and system
US20180341022A1
Intelligent lidar sensors for autonomous vehicles
US20210255637A1
Cited By
Point cloud data processing method and device, vehicle and storage medium
CN116256725A
