Wood surface defect multi-mode imaging system based on FPGA
Through the FPGA-based multimodal imaging system for wood surface defects, the logic circuit for rapid parallel processing is used to reconstruct the height map, scattering map and color map, the problems of low efficiency and large volume of wood surface defect imaging system under the CPU architecture are solved, and the problem of low efficiency and large volume of wood surface defect imaging system under the CPU architecture is realized. Efficient and real-time detection of wood surface defects.
Patent Information
- Application Number
- CN202420399455.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-01
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2034-03-01
AI Technical Summary
The existing wood surface defect imaging system based on CPU architecture is low efficiency, large volume and high power, making it difficult to meet the requirements of real-time and efficient detection, especially when processing large amounts of parallel image data.
A multimodal imaging system for wood surface defects based on FPGA is designed, including field programmable gate array FPGA, line laser emitter and image sensor, and the logic circuit is reconstructed through height map reconstruction, scatter map reconstruction logic circuit and color map reconstruction logic circuit. Perform rapid parallel processing to achieve multimodal imaging of wood surface defects.
It realizes miniaturized and efficient wood surface defect detection, improves detection accuracy and imaging resolution, and solves the real-time and volume problems of traditional systems.
Smart Images

Figure CN222070490U_ABST
Abstract
Description
Technical Field
[0001] The utility model relates to the field of wood surface defect detection equipment, in particular to a wood surface defect multi-modal imaging system based on FPGA. Background Art
[0002] Self-detection technology for wood defects has gradually developed since the mid-20th century. The innovation of automation technology in the past decade has led to the rapid development of emerging wood non-destructive testing technology. Currently, the main detection methods for wood surface defects include X-rays, stress waves, ultrasound, infrared, lasers, and optical cameras.
[0003] In recent years, many scholars have applied digital image processing technology, computer vision technology, and pattern recognition technology to the detection of wood defects, combining fractal theory, wavelet multi-resolution analysis, and artificial neural network pattern recognition technology to study the texture segmentation, feature extraction, and pattern recognition of wood surface defects, forming a new type of detection method, feature detection method. Based on the differences in surface color, texture, and other features of boards in defective areas and non-defective areas, domestic and foreign researchers have achieved relatively rich results through machine vision and machine learning methods.
[0004] Wood is composed of a large number of tubular cells (tracheids), which are shaped like long spindles in the direction of growth. As early as 1975, Beech et al. discovered that light would scatter in the direction of wood growth, and called this phenomenon the tracheid effect, which was proposed to be used for wood defect detection. When a point laser is irradiated on the surface of wood, the laser will scatter evenly along the growth direction of the normal area of the wood, roughly in an elliptical shape; while the scattering difference in defective areas such as live knots and dead knots is not much, roughly in a circular shape. When a line laser is irradiated on the surface of wood, due to the stronger light conduction ability of the normal area of the wood, the laser will form a wider red scattering band along the growth direction of the wood, while the defective areas such as live knots and dead knots have weaker light conduction ability, and the red scattering band formed is narrower. At the same time, it is difficult to obtain height information to realize defect detection such as missing edges by two-dimensional image scanning. When the laser is irradiated on the wood at a certain tilt angle, the laser on the missing edge part and the conveyor belt will be relatively offset from the laser in the normal area due to the continued propagation of light, thereby realizing the use of two-dimensional images to obtain the relative height map of the wood.
[0005] However, the line laser scanning wood surface defect imaging system currently implemented based on the traditional CPU architecture is not good at processing a large amount of parallel image data. The PC platform faces the problems of low efficiency, large size and high power when reconstructing laser scanning images. The ARM embedded processor is small in size and low in power consumption but has poor computing performance, making it difficult to meet the real-time requirements. At the same time, it is difficult to achieve the requirements of high efficiency, small size and high speed for both traditional PC platforms and ARM embedded processor platforms. Utility Model Content
[0006] The purpose of the utility model is to provide a multimodal imaging system for wood surface defects based on FPGA. By constructing a new FPGA hardware circuit and designing a new line laser scanning multimodal imaging system for wood surface, the problems in the prior art of realizing wood surface defect scanning imaging, which require multiple sensors and have high power consumption, are large in size and have poor real-time performance, are improved.
[0007] In order to achieve the above purpose, the utility model provides the following technical solutions:
[0008] A wood surface defect multimodal imaging system based on FPGA, comprising a field programmable gate array FPGA 10, a line laser transmitter 20 and an image sensor 30;
[0009] The image sensor is connected to the field programmable gate array FPGA, the field programmable gate array FPGA is connected to the terminal through the communication unit 50, and the line laser transmitter is vertically arranged on the surface of the wood conveyor belt;
[0010] The field programmable gate array FPGA includes a height map reconstruction logic circuit 101, a scattering map reconstruction logic circuit 102, a color map reconstruction logic circuit 103, a data transmission logic circuit 104 and a Bayer to RGB module. The input ends of the height map reconstruction logic circuit, the scattering map reconstruction logic circuit and the color map reconstruction logic circuit are all connected to the Bayer to RGB module, and the output ends of the height map reconstruction logic circuit, the scattering map reconstruction logic circuit and the color map reconstruction logic circuit are all connected to the data transmission logic circuit.
[0011] Further, the scattering image reconstruction logic circuit includes: a scattering image data processing circuit, a first comparator 2051, a first replica circuit 2061, a first memory BRAM 2071 and a first trigger 2041;
[0012] The output end of the scattering image data processing circuit is connected to the input end of the first comparator, and the first comparator, the first replica circuit and the first memory BRAM are connected in sequence; the other input end of the first comparator is connected to the standard wood laser line scattering width signal end, and the input end of the first memory BRAM2071 is connected to the output end of the first trigger 2041; the input end of the first trigger is connected to the image input frame synchronization signal end;
[0013] The scattering image data processing circuit includes a first binarization circuit 2011, an accumulator 202 and a divider 203, wherein the input end of the first binarization circuit is connected to the signal end of the image red channel data, the input end of the accumulator is connected to the output end of the first binarization circuit; the input end of the divider is connected to the output end of the accumulator, and the output of the divider is the output end of the scattering image data processing circuit.
[0014] The data collected by the image sensor includes three channel data, namely, image red channel data, image green channel data and image blue channel data; the signal end of the image red channel data is obtained from the image sensor;
[0015] It is used for fast parallel processing of the line laser wood image and reconstructing a wood scattering map according to the line laser irradiating the wood image.
[0016] After the image red channel data passes through the first binarization circuit 2011, it is connected to the accumulator 202 for accumulation. The result after the accumulation is connected to the divider 203. The output value of the divider 203 is compared with the standard wood laser line scattering width in the comparator 205. The comparison result generated by the first comparator 2051 is transmitted to the first copy circuit 2061. The first copy circuit 2061 changes the content of the first memory BRAM2071 according to the comparison result. Finally, when the image input frame synchronization signal arrives, the trigger is completed through the first trigger 2041, and the content of the first memory BRAM2071 will be output through the scattering data output port.
[0017] Further, the height map reconstruction logic circuit includes: two image channel data processing circuits, an absolute value difference circuit 209, a second comparator 2052, a second copy circuit 2062, a second memory BRAM 2072 and a fourth trigger 2044;
[0018] The output ends of the two-way image channel data processing circuit are respectively connected to the two input ends of the absolute value differential circuit, the output end of the absolute value differential circuit is connected to the input end of the second comparator, the second comparator, the second replication circuit and the second memory BRAM are connected in sequence; the other input end of the second comparator is connected to the standard wood laser line position signal end, and the trigger end of the second memory BRAM2072 is connected to the output end of the fourth trigger 2044; the input end of the fourth trigger is connected to the image input frame synchronization signal end;
[0019] The two image channel data processing circuits include a parallel image red channel data processing circuit and an image green channel data processing circuit; each image channel data processing circuit includes a binarization circuit, a trigger and a counter, the input end and the output end of the binarization circuit are respectively connected to the signal end of the image channel data and the input end of the trigger, and the two input ends of the counter are respectively the output end of the trigger and the image input line synchronization signal end.
[0020] The image input frame synchronization signal terminal and the image input line synchronization signal terminal are connected to the signal acquisition terminal of the image sensor;
[0021] Image red channel data processing circuit:
[0022] The image red channel data is processed by the second binarization circuit 2012 and then connected to the second trigger 2042; at the same time, the image input line synchronization signal is used for counting of the first counter 2081. The output of the second trigger 2042 is connected to the input of the first counter 2081. After the second trigger 2042 receives the trigger signal, the first counter 2081 stops counting and outputs a count value.
[0023] Similarly, the image green channel data processing circuit:
[0024] The image green channel data input signal is connected to the third trigger 2043 after passing through the third binarization circuit 2013, and the second counter 2082 counts using the image input line synchronization signal. After the third trigger 2043 receives the trigger signal, the second counter 2082 stops counting and outputs another count value. The outputs of the two counters are processed by the absolute value difference circuit 209 to obtain an absolute difference.
[0025] The absolute difference is compared with the standard wood laser line position in the second comparator 2052. The comparison result generated by the second comparator 2052 is transmitted to the second replica circuit 2062.
[0026] The second replica circuit 2062 changes the content of the second memory BRAM 2072 according to the comparison result. Finally, when the image input frame synchronization signal arrives, the fourth trigger 2044 is triggered, and the content of the second memory BRAM 2072 is output through the high data output port.
[0027] Further, the color image reconstruction logic circuit includes: a third replica circuit 2063, a fifth trigger 2045, a sixth trigger 2046 and a third memory BRAM 2073;
[0028] The signal terminals of the image red channel data, the image green channel data, the image blue channel data and the reconstruction step input are respectively connected to the four input terminals of the third replication circuit, and the output terminal of the third replication circuit is connected to the input terminal of the third memory BRAM; another input terminal of the third replication circuit is connected to the output terminal of the fifth trigger, and the input terminal of the fifth trigger is connected to the image input line synchronization signal terminal; the input terminal of the sixth trigger is connected to the image input frame synchronization signal terminal, and another input terminal of the third memory BRAM is connected to the output terminal of the sixth trigger;
[0029] The signal end of the reconstruction step input is connected to the fixed signal setting end of the field programmable gate array FPGA, and the signal of the reconstruction step input is a fixed setting signal.
[0030] The signals of the image red channel data, the image green channel data and the image blue channel data are simultaneously input into the third copy circuit 2063. The image input line synchronization signal is also input into the fifth trigger 2045, and finally connected to the third copy circuit 2063, prompting the third copy circuit 2063 to complete the input of a line of data. The third copy circuit 2063 changes the content of the third memory BRAM 2073 according to the reconstruction step input. Finally, when the image input frame synchronization signal arrives, the trigger is completed through the fifth trigger 2045, and the content of the third memory BRAM 2073 will be output through the color data output port.
[0031] Furthermore, it also includes a synchronous dynamic random access memory DDR, and the synchronous dynamic random access memory DDR is connected to a field programmable gate array FPGA.
[0032] Used to cache the reconstructed image and change the storage content through write instructions.
[0033] Furthermore, the communication unit is a Gigabit Ethernet module.
[0034] Used to output the reconstructed image using UDP network protocol data.
[0035] Furthermore, the line laser transmitter is an infrared straight line laser module.
[0036] Used to create a distinct tracheid effect when light shines on the wood surface.
[0037] Beneficial Effects
[0038] The utility model discloses a multi-modal imaging system for wood surface defects based on FPGA, including a field programmable gate array (FPGA), a line laser transmitter and an image sensor; the image sensor is connected to the field programmable gate array (FPGA), the field programmable gate array (FPGA) is connected to the terminal through a communication unit, and the line laser is vertically arranged on the surface of the wood conveyor belt; the field programmable gate array (FPGA) includes a height map reconstruction logic circuit, a scattering map reconstruction logic circuit, a color map reconstruction logic circuit, a data transmission logic circuit and a Bayer to RGB module. Compared with a PC, FPGA realizes hardware acceleration with lower power consumption and lower resource utilization. Compared with an ARM embedded processor, various image reconstruction circuits in FPGA can be processed in real time, and can simultaneously output height images, scattering images and wood surface defect images, and has the advantages of small device size, high imaging resolution and fast rate. The problem of high-quality imaging of wood surface defects is solved to improve the contrast of defective areas. Experimental results show that it has a good effect in improving detection accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] In order to more clearly illustrate the specific implementation methods of the utility model or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the utility model. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0040] Figure 1 It is a structural schematic diagram of a wood surface defect multimodal imaging system based on FPGA in the utility model;
[0041] Figure 2 It is the wood tube wall effect under the laser beam in the utility model;
[0042] Figure 3 This is the schematic diagram of the Gigabit Ethernet module in the utility model;
[0043] Figure 4 This is the principle diagram of the synchronous dynamic random access memory DDR in the utility model;
[0044] Figure 5 This is a schematic diagram of the data transmission logic circuit in the utility model;
[0045] Figure 6 This is a schematic diagram of the internal structure of the FPGA in the utility model;
[0046] Figure 7 It is a schematic diagram of the internal structure of the scattering diagram reconstruction circuit in the utility model;
[0047] Figure 8 It is a schematic diagram of the internal structure of the height map reconstruction circuit in the utility model;
[0048] Fig. 9 It is a schematic diagram of the internal structure of the color image reconstruction circuit in the utility model;
[0049] Description of reference numerals:
[0050] Field programmable gate array-10, laser height map reconstruction logic circuit-101, scattering map reconstruction logic circuit-102, color map reconstruction logic circuit-103, data transmission logic circuit-104, line laser transmitter-20, image sensor-30, synchronous dynamic random access memory DDR-40, Gigabit Ethernet module-50, first binarization circuit-2011, second binarization circuit-2012, third binarization circuit-2013, accumulator-202, divider-203, first trigger-2041, second trigger -2042, third trigger-2043, fourth trigger-2044, fifth trigger-2045, sixth trigger-2046, first comparator-2051, second comparator-2052, first replica circuit-2061, second replica circuit-2062, third replica circuit-2063, first memory BRAM-2071, second memory BRAM-2072, third memory BRAM-2073, first counter-2081, second counter-2082, absolute value difference circuit-209. DETAILED DESCRIPTION
[0051] The technical solution of the utility model will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are part of the embodiments of the utility model, not all of the embodiments. Based on the embodiments of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the utility model.
[0052] like Figure 1-9 As shown, the utility model provides a wood surface defect multimodal imaging system based on FPGA, comprising:
[0053] Field Programmable Gate Array 10, also called FPGA (Field Programmable Gate Array), is used for wood image acquisition, processing and defect imaging;
[0054] The line laser emitter 20 does not need to be connected to other devices, and emits a red line laser perpendicular to the running direction of the conveyor belt;
[0055] An image sensor 30, which is connected to a field programmable gate array FPGA and is used to capture images on the conveyor belt and transmit them to the FPGA;
[0056] The field programmable gate array 10 is connected to the image sensor 30 and has a multimodal image reconstruction function. The multimodal image reconstruction function is further used to quickly and in parallel process the line laser irradiated wood image, and after reconstructing the line laser irradiated wood image into two images of a wood scattering map and a relative height map, jointly extract the original image to perform multimodal imaging of wood surface defects, and output the multimodal image; the field programmable gate array 10 includes a height map reconstruction logic circuit 101, a scattering map reconstruction logic circuit 102, a color map reconstruction logic circuit 103 and a data transmission logic circuit 104, which are used to quickly and in parallel process the line laser image and the original color image for image reconstruction, and finally output the multimodal image;
[0057] like Figure 1 The structural schematic diagram of the FPGA-based multimodal imaging system for wood surface defects shown in the figure avoids the problem of slow calculation speed or large size and inability to miniaturize wood image reconstruction on traditional processors and microprocessors, solves the problems of large calculation amount and poor real-time performance, and also realizes the portability and miniaturization of the surface defect inspection system.
[0058] It also includes a synchronous dynamic random access memory DDR40, which is connected to a field programmable gate array FPGA and is used for caching the reconstructed image and changing the storage content by writing instructions.
[0059] It also includes a Gigabit Ethernet module 50, which is connected to a field programmable gate array FPGA and is used to output the reconstructed image using DUP network format data.
[0060] like Figure 2 The wood vessel wall effect under the laser beam shown, the line laser emitter 20 includes an infrared straight line laser module; it is used to irradiate light onto the wood surface to form an obvious vessel cell effect.
[0061] like Figure 5The data transmission logic circuit schematic diagram shown in the figure uses the IP core AXI_DDR module provided by Xilinx to implement the data access function. In addition, the CLK_WIZ module is used to obtain the required two-way clock signal and reset signal. The data transmission logic circuit 104 also includes a DATA_PACK module, which is used to receive image data and pack the data, and then write it into the DDR. The write operation is completed by occupying the write data interface. In addition, the data transmission logic circuit also includes a read data interface, which is used to read data from the DDR and transmit it. Through the read data interface, data can be effectively read from the DDR and transmitted to other components or devices.
[0062] First, the line laser transmitter 20 emits a red line laser perpendicular to the running direction of the conveyor belt, and the image sensor transmits the image to the FPGA. The height map reconstruction logic circuit 101 and the scattering map reconstruction logic circuit 102 in the FPGA extract the laser line position and width respectively, and then compare the two with the standard conveyor belt laser line position model and the conveyor belt laser line scattering width model respectively through the comparison circuit. If the two are similar to the standard conveyor belt model, the comparison circuit sends a return signal and does not continue processing. If the comparison circuit sends a processing signal, the height map reconstruction logic circuit 101 and the scattering map reconstruction logic circuit 102 extract the laser line position and scattering width from the wood laser line image, and calculate the relative width based on the wood laser line scattering with the input standard laser line scattering width and wood laser line position, as well as the relative offset of the laser line position, and then reconstruct the scattering image and relative height image of the whole piece of wood. The color image reconstruction logic circuit 103 reconstructs the color image by inputting the step signal. Finally, the height map reconstruction logic circuit 101, the scatter map reconstruction logic circuit 102 and the color map reconstruction logic circuit 103 output to the data transmission logic circuit 104, and the data transmission logic circuit 104 caches the data to the synchronous dynamic random access memory DDR40, and accepts the read and write requirements of the Gigabit Ethernet module 50 at the same time.
[0063] like Figure 4 As shown in the schematic diagram of the synchronous dynamic random access memory DDR, after the FPGA reconstructs the image, the synchronous dynamic random access memory DDR first caches the reconstructed image in sequence. If the Gigabit Ethernet module sends a data read request signal to the data transmission logic circuit 104, the data transmission logic circuit transmits the synchronous dynamic random access memory DDR to the Gigabit Ethernet module in a first-in-first-out order through a control signal.
[0064] like Figure 3As shown in the schematic diagram of the Gigabit Ethernet module, the Gigabit Ethernet module 50 first sends a read request signal to the data transmission logic circuit 104, then receives the image data transmitted by the data transmission logic circuit 104 after the data transmission logic circuit 104 issues a read enable signal, and finally transmits the image data via the UDP network protocol.
[0065] like Figure 6 As shown in the schematic diagram of the internal architecture of the FPGA, the data of the image sensor 30 is input through the Bayer to RGB module, and the three output ports of the Bayer to RGB module are connected to the height map reconstruction logic circuit 101, the scattering map reconstruction logic circuit 102, and the color map reconstruction logic circuit 103; the output ends of the height map reconstruction logic circuit 101, the scattering map reconstruction logic circuit 102, and the color map reconstruction logic circuit 103 are all connected to the data transmission logic circuit 104, and the data transmission logic circuit 104 is double-endedly connected to the Gigabit Ethernet module 50 and the synchronous dynamic random access memory DDR40.
[0066] The binarization circuit can be obtained by referring to the utility model patent "A Binarization Acceleration Computing Circuit Based on FPGA" applied by Song Jiayu, Wang Peng and Peng Yingquan; the accumulator can be obtained by referring to the second edition of the book "Digital Signal Processing Based on FPGA" written by Gao Yajun; the divider can be obtained by referring to the fourth section of the third chapter of the second edition of the book "Digital Signal Processing Based on FPGA" written by Gao Yajun; the trigger can be obtained by referring to the sixth section of the eighth chapter of the second edition of the book "Digital Signal Processing Based on FPGA" written by Gao Yajun; the comparator can be obtained by referring to the book "Digital Electronic Technology" written by Yan Shi. The copy circuit can be obtained by referring to the third section of the fourth chapter of the book "Fundamentals of Digital Electronic Technology (Fifth Edition)" written by Yan Shi; the memory BRAM can be obtained by referring to the first section of the third chapter of the book "Xilinx Series FPGA Chip IP Core Detailed Explanation" written by Liu Donghua; the counter can be obtained by referring to the second section of the second chapter of the book "Xilinx Series FPGA Chip IP Core Detailed Explanation" written by Liu Donghua; the absolute value difference circuit can be obtained by referring to the fourth section of the eighth chapter of the book "FPGA-based Digital Signal Processing" written by Gao Yajun, the second edition.
[0067] like Figure 7The internal structure diagram of the scattering image reconstruction circuit shown in the figure, after the image red channel data passes through the first binarization circuit 2011, it is connected to the accumulator 202 for accumulation. The result after the accumulation is connected to the divider 203. The output value of the divider 203 is compared with the standard wood laser line scattering width in the first comparator 2051. The comparison result generated by the first comparator 2051 is transmitted to the first copy circuit 2061. The first copy circuit 2061 changes the content of the first memory BRAM2071 according to the comparison result. Finally, when the image input frame synchronization signal arrives, the trigger is completed through the first trigger 2041, and the content of the first memory BRAM2071 will be output through the scattering data output port.
[0068] like Figure 8 The schematic diagram of the internal structure of the height map reconstruction circuit shown in the figure, firstly, the image red channel data is processed by the second binarization circuit 2012 and then connected to the second trigger 2042. At the same time, the image input line synchronization signal is used for counting of the first counter 2081. The output of the second trigger 2042 is connected to the input of the first counter 2081. After the second trigger 2042 receives the trigger signal, the first counter 2081 stops counting and outputs a count value. Similarly, the image green channel data input signal is also connected to the third trigger 2043 after passing through the third binarization circuit 2013, and the second counter 2082 uses the image input line synchronization signal to count. After the third trigger 2043 receives the trigger signal, the second counter 2082 stops counting and outputs another count value. The outputs of the two counters are processed by the absolute value difference method circuit 209 to obtain an absolute difference value. The absolute difference value is compared with the standard wood laser line position in the second comparator 2052. The comparison result generated by the second comparator 2052 is transmitted to the second replica circuit 2062. The second replica circuit 2062 changes the content of the second memory BRAM 2072 according to the comparison result. Finally, when the image input frame synchronization signal arrives, the fourth trigger 2044 is triggered, and the content of the second memory BRAM 2072 is output through the high data output port.
[0069] like Fig. 9 As shown in the schematic diagram of the internal structure of the color image reconstruction circuit, the signals such as the image red channel data, the image green channel data and the image blue channel data are simultaneously input into the third copy circuit 2063. The image input line synchronization signal is input into the fifth trigger 2045, and finally connected to the third copy circuit 2063, prompting the third copy circuit 2063 to complete the input of a line of data. The third copy circuit 2063 changes the content of the third memory BRAM2073 according to the reconstruction step input. Finally, when the image input frame synchronization signal arrives, the trigger is completed through the sixth trigger 2046, and the content of the third memory BRAM2073 will be output through the color data output port.
[0070] The real-time performance of the FPGA-based multimodal imaging system for wood surface defects has been greatly improved. The ability of the FPGA-based embedded system to perform image binarization and image reconstruction has been greatly improved, and the reconstruction speed has been greatly improved, reaching a reconstruction speed of dozens of frames per second.
[0071] The FPGA-based multimodal imaging system for wood surface defects has a greatly reduced size, greatly improved reconstruction efficiency, significantly reduced system operating power, and high image resolution and fast speed.
[0072] The FPGA-based multimodal imaging system for wood surface defects realizes the portability and miniaturization of line laser scanning multimodal imaging of wood surface defects, and realizes wood surface defect imaging under an embedded heterogeneous architecture, improving the existing technology for realizing wood surface defect scanning imaging, which requires multiple sensors and has large size, low efficiency, or cannot be performed in real time.
[0073] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicating directions or positional relationships are based on the directions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore should not be understood as a limitation on the present invention.
[0074] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include or more of the features. In the description of the present utility model, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined. In addition, the terms "installed", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, and it can be the internal connection of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present utility model can be understood according to specific circumstances.
[0075] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the utility model, rather than to limit it. Although the utility model has been described in detail with reference to the aforementioned embodiments, ordinary technicians in this field should understand that they can still modify the technical solutions recorded in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not make the essence of the corresponding technical solution deviate from the scope of the technical solution of the embodiments of the utility model.
Claims
1. A multi-modal imaging system for wood surface defects based on FPGA, characterized in that: It comprises a field programmable gate array FPGA (10), a line laser transmitter (20) and an image sensor (30); The image sensor is connected to the field programmable gate array FPGA, the field programmable gate array FPGA is connected to the terminal through a communication unit (50), and the line laser transmitter is vertically arranged on the surface of the wood conveyor belt; The field programmable gate array FPGA comprises a height map reconstruction logic circuit (101), a scattering map reconstruction logic circuit (102), a color map reconstruction logic circuit (103), a data transmission logic circuit (104) and a Bayer to RGB module, wherein the input ends of the height map reconstruction logic circuit, the scattering map reconstruction logic circuit and the color map reconstruction logic circuit are all connected to the Bayer to RGB module, and the output ends of the height map reconstruction logic circuit, the scattering map reconstruction logic circuit and the color map reconstruction logic circuit are all connected to the data transmission logic circuit.
2. The FPGA-based wood surface defect multimodal imaging system according to claim 1 is characterized in that: The scattering image reconstruction logic circuit comprises: a scattering image data processing circuit, a first comparator (2051), a first replica circuit (2061), a first memory BRAM (2071) and a first trigger (2041); The output end of the scattering image data processing circuit is connected to the input end of the first comparator, and the first comparator, the first replica circuit and the first memory BRAM are connected in sequence; the other input end of the first comparator is connected to the standard wood laser line scattering width signal end, and the input end of the first memory BRAM is connected to the output end of the first trigger (2041); the input end of the first trigger is connected to the image input frame synchronization signal end; The scattering image data processing circuit comprises a first binarization circuit (2011), an accumulator (202) and a divider (203), wherein the input end of the first binarization circuit is connected to the signal end of the image red channel data, the input end of the accumulator is connected to the output end of the first binarization circuit; the input end of the divider is connected to the output end of the accumulator, and the output of the divider is the output end of the scattering image data processing circuit.
3. The FPGA-based wood surface defect multimodal imaging system according to claim 1 is characterized in that: The height map reconstruction logic circuit comprises: two image channel data processing circuits, an absolute value difference circuit (209), a second comparator (2052), a second replication circuit (2062), a second memory BRAM (2072) and a fourth trigger (2044); The output ends of the two-way image channel data processing circuit are respectively connected to the two input ends of the absolute value difference circuit, the output end of the absolute value difference circuit is connected to the input end of the second comparator, the second comparator, the second replication circuit and the second memory BRAM are connected in sequence; the other input end of the second comparator is connected to the standard wood laser line position signal end, and the trigger end of the second memory BRAM (2072) is connected to the output end of the fourth trigger (2044); the input end of the fourth trigger is connected to the image input frame synchronization signal end; The two image channel data processing circuits include a parallel image red channel data processing circuit and an image green channel data processing circuit; each image channel data processing circuit includes a binarization circuit, a trigger and a counter, the input end and the output end of the binarization circuit are respectively connected to the signal end of the image channel data and the input end of the trigger, and the two input ends of the counter are respectively the output end of the trigger and the image input line synchronization signal end.
4. The FPGA-based wood surface defect multimodal imaging system according to claim 1, characterized in that: The color image reconstruction logic circuit comprises: a third replica circuit (2063), a fifth trigger (2045), a sixth trigger (2046) and a third memory BRAM (2073); The signal terminals of the image red channel data, the image green channel data, the image blue channel data and the reconstruction step input are respectively connected to the four input terminals of the third replication circuit, and the output terminal of the third replication circuit is connected to the input terminal of the third memory BRAM; another input terminal of the third replication circuit is connected to the output terminal of the fifth trigger, and the input terminal of the fifth trigger is connected to the image input line synchronization signal terminal; the input terminal of the sixth trigger is connected to the image input frame synchronization signal terminal, and another input terminal of the third memory BRAM is connected to the output terminal of the sixth trigger; The signal end of the reconstruction step input is obtained from the field programmable gate array FPGA, and the signal of the reconstruction step input is a fixed setting signal.
5. The FPGA-based wood surface defect multimodal imaging system according to claim 1, characterized in that: It also includes a synchronous dynamic random access memory DDR, which is connected to a field programmable gate array FPGA.
6. The FPGA-based wood surface defect multimodal imaging system according to claim 1, characterized in that: The communication unit is a Gigabit Ethernet module.
7. The FPGA-based wood surface defect multimodal imaging system according to claim 1, characterized in that: The line laser transmitter is an infrared straight line laser module.
