Methods, electronic devices and systems for determining grayscale information of the surface of the object being measured
By using multi-line laser projection and binocular camera acquisition, combined with multi-line crosstalk compensation, shutter normalization, and multi-view fusion processing, the problem of missing grayscale information in multi-line laser 3D scanning technology was solved, and the synchronous acquisition and accuracy improvement of three-dimensional morphology and surface grayscale information were achieved.
Patent Information
- Application Number
- CN202611246869.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-17
- Publication Date
- 2026-11-17
AI Technical Summary
Existing multi-line laser 3D scanning technology only outputs three-dimensional geometric data and does not acquire grayscale information of the surface of the object being measured, which cannot meet the needs of scenarios where the three-dimensional shape urgently requires strict binding of surface grayscale information.
By controlling multiple multi-line lasers to simultaneously project laser lines onto the surface of the object under test from different spatial directions, left and right stripe images are obtained. The images are then simultaneously acquired using a binocular camera and processed with multi-line crosstalk compensation, shutter normalization, and multi-view fusion to determine the target grayscale value of each pixel position on the surface of the object under test.
This technology enables the simultaneous acquisition of 3D topography and surface grayscale information in a single scan, improving the accuracy of grayscale information on the surface of the object under test, avoiding the use of additional equipment, and ensuring the consistency between grayscale and geometric data.
Smart Images

Figure CN123111138A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of laser three-dimensional measurement technology, and more specifically, to a method, electronic device and system for determining the grayscale information of the surface of a measured object. Background Technology
[0002] Laser triangulation is one of the mainstream technologies in the field of industrial 3D vision inspection. Its basic principle is as follows: structured light is projected onto the surface of the object being measured by a laser, and an industrial camera collects the reflected stripe image from a non-coaxial direction. Based on the geometric constraint relationship between the laser plane and the camera imaging plane, the spatial 3D coordinates of each pixel on the laser line are calculated, thereby reconstructing the surface morphology of the object.
[0003] In existing technologies, in order to improve the data acquisition rate, most solutions adopt multi-line laser 3D scanning technology, which uses a multi-line laser projector to simultaneously project multiple parallel laser lines onto the surface of the object being measured within a single frame exposure. Combined with a high-resolution industrial camera, it can achieve the ability to acquire millions to tens of millions of point clouds per second, significantly shortening the scanning cycle.
[0004] However, this multi-line laser 3D scanning technology only outputs three-dimensional geometric data (point cloud / mesh) and does not acquire the grayscale information of the surface of the object being measured, which makes it impossible to meet the needs of scenarios where the three-dimensional shape urgently needs to be strictly bound to the surface grayscale information. Summary of the Invention
[0005] The purpose of this application is to provide a method, electronic device, and system for determining the grayscale information of the surface of a measured object, in order to address the shortcomings of the prior art and solve the technical problems existing in the prior art.
[0006] To achieve the above objectives, the technical solutions adopted in the embodiments of this application are as follows: In a first aspect, embodiments of this application provide a method for determining the grayscale information of the surface of a measured object, the method comprising: Multiple multi-line lasers are controlled to simultaneously project laser lines onto the surface of the object being measured from different spatial directions. Each multi-line laser projects N laser lines, and the N laser lines within the same multi-line laser are simultaneously lit or simultaneously turned off. Acquire the left and right stripe images corresponding to each of the multi-line lasers. The left and right stripe images are images formed by the reflection of N laser lines on the surface of the object being tested, which are simultaneously acquired by a binocular camera integrated in the multi-line laser. Based on the left and right stripe images corresponding to each of the multi-line lasers, determine the original grayscale value corresponding to each pixel position on the surface of the object being tested for each laser line emitted by each of the multi-line lasers. The target grayscale value of each pixel position on the surface of the object under test is determined based on the original grayscale value corresponding to each pixel position on the surface of the object under test by each laser line emitted by each multi-line laser.
[0007] Optionally, determining the target grayscale value of each pixel position on the surface of the object under test based on the original grayscale value corresponding to each pixel position on the surface of the object under test by each laser line emitted by each of the multi-line lasers includes: Multi-line crosstalk compensation processing is performed on the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test to obtain the corrected brightness value of each laser line at the current pixel position, where the current pixel position is any point on the surface of the object under test. The corrected brightness value is subjected to shutter normalization processing to obtain the shutter normalized brightness value of each laser line at the current pixel position; Perform multi-line intensity normalization processing on the shutter-normalized brightness value corresponding to the current pixel position to obtain the normalized grayscale value of each laser line corresponding to the current pixel position; The normalized grayscale values of each laser line at the current pixel position are fused from multiple perspectives to obtain the target grayscale value at the current pixel position.
[0008] Optionally, the step of performing multi-line crosstalk compensation processing on the original grayscale value corresponding to the current pixel position of each laser line emitted by each of the multi-line lasers on the surface of the object under test to obtain the corrected brightness value of each laser line at the current pixel position includes: Gaussian contour modeling is performed on the grayscale cross-sectional curve corresponding to the current pixel position on the surface of the object under test for each laser line emitted by each multi-line laser to obtain the peak position and full width at half maximum (FWHM) parameter of each laser line. Based on the peak position and full width at half maximum (FWHM) parameters of each laser line, a crosstalk matrix between laser lines is constructed. The matrix elements in this crosstalk matrix... This represents the brightness crosstalk coefficient between the j-th laser line and the i-th laser line; Based on the crosstalk matrix between the laser lines, the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test is subjected to multi-line crosstalk compensation processing to obtain the corrected brightness value of each laser line at the current pixel position.
[0009] Optionally, the step of performing multi-line crosstalk compensation processing on the original grayscale value corresponding to the current pixel position of each laser line emitted by each of the multi-line lasers on the surface of the object under test, based on the crosstalk matrix between the laser lines, to obtain the corrected brightness value of each laser line at the current pixel position, includes: Based on the crosstalk matrix between the laser lines, the original grayscale values corresponding to the current pixel positions of each laser line emitted by each multi-line laser on the surface of the object under test are deconvolved to obtain the preliminary corrected brightness values corresponding to each laser line. Based on the crosstalk matrix between the laser lines, the brightness crosstalk coefficient between adjacent laser lines is determined, and based on the brightness crosstalk coefficient between adjacent laser lines, the preliminary corrected brightness value corresponding to each laser line is compensated image by image to obtain the corrected brightness value of each laser line at the current pixel position.
[0010] Optionally, the step of performing shutter normalization processing on the corrected brightness value to obtain the shutter normalized brightness value of each laser line at the current pixel position includes: Obtain a pre-calibrated reference shutter speed for the binocular camera in each of the multi-line lasers, and determine the actual shutter speed of the binocular camera in each of the multi-line lasers; Based on the reference shutter speed of the binocular camera in each of the multi-line lasers and the actual shutter speed, the exposure correction is performed by shutter normalization on the corrected brightness value of each laser line at the current pixel position, thereby obtaining the shutter normalized brightness value of each laser line at the current pixel position.
[0011] Optionally, the step of performing multi-line intensity normalization processing on the shutter-normalized brightness value corresponding to the current pixel position to obtain the normalized grayscale value of each laser line corresponding to the current pixel position includes: Obtain the pre-calibrated power correction coefficient, the pre-constructed angle compensation mapping relationship, and the pre-measured brightness attenuation coefficient for each laser line emitted by each of the multi-line lasers; Based on the power correction coefficient of each laser line emitted by each multi-line laser, the angle compensation mapping relationship, and the brightness attenuation coefficient, the shutter-normalized brightness value of each laser line at the current pixel position is subjected to multi-line intensity normalization processing to obtain the normalized grayscale value of each laser line at the current pixel position.
[0012] Optionally, the step of performing multi-view fusion on the normalized grayscale values of each laser line corresponding to the current pixel position to obtain the target grayscale value at the current pixel position includes: Obtain the first angle between the incident angle of each laser line projected onto the surface of the object under test and the normal of the surface of the object under test, and obtain the second angle between the receiving angle of each laser line acquired by the binocular camera in each of the multi-line lasers and the normal of the surface of the object under test. Based on the first included angle and the second included angle, determine the angle quality weight corresponding to each laser line; Based on the grayscale profile of each laser line, the signal quality weight corresponding to each laser line is determined. Based on the angle quality weight and signal quality weight corresponding to each laser line, the normalized gray value corresponding to the current pixel position of each laser line is fused from multiple perspectives to obtain the target gray value of the current pixel position.
[0013] Optionally, the method further includes: Point cloud image processing is performed on the left and right stripe images corresponding to each of the multi-line lasers to obtain the three-dimensional point cloud data of the surface of the object under test. The grayscale information on the surface of the object under test and the three-dimensional point cloud data are spatially aligned and bound to obtain the three-dimensional mesh data of the surface of the object under test. The three-dimensional mesh data includes the spatial coordinates and grayscale values of each mesh vertex.
[0014] Secondly, embodiments of this application also provide an electronic device including: a processor, a storage medium, and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium via the bus, and the processor executes the machine-readable instructions to perform the steps of any of the methods provided in the first aspect.
[0015] Thirdly, embodiments of this application provide a grayscale information determination system for the surface of a measured object, comprising: M multi-line lasers and the electronic device described in the second aspect above, wherein the multi-line lasers integrate a binocular camera; and the electronic device is communicatively connected to the M multi-line lasers respectively.
[0016] The beneficial effects of this application are: This application provides a method, electronic device, and system for determining the grayscale information of the surface of a measured object. It acquires left and right fringe images corresponding to each multi-line laser. These images are formed by the reflection of N laser lines on the surface of the measured object, simultaneously acquired by a binocular camera integrated within the multi-line laser. Based on the left and right fringe images corresponding to each multi-line laser, the original grayscale value corresponding to each pixel position on the surface of the measured object for each laser line emitted by each multi-line laser is determined. Then, multi-dimensional correction is performed on the original grayscale values corresponding to each pixel position on the surface of the measured object for each laser line emitted by each multi-line laser, such as multi-line crosstalk compensation processing, shutter normalization processing, and shutter speed adjustment. Through single-view processing and multi-view fusion, the target grayscale value of each pixel position on the surface of the object under test is calculated. This realizes the conversion of the collected raw grayscale values with various errors into real, consistent, and usable surface grayscale information, ensuring that the final calculated target grayscale value can uniformly, realistically, and consistently reflect the surface material characteristics, thus improving the accuracy of the grayscale information of the surface of the object under test. Therefore, by adopting the scheme proposed in this application, no additional color camera and its matching lens and data transmission channel are required to obtain a grayscale image that uniformly, realistically, and consistently reflects the surface material characteristics, avoiding the problem of spatial or temporal misalignment between grayscale and geometric data caused by using dual sensors.
[0017] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description
[0018] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 This is a schematic diagram of the structure of a system for determining the grayscale information of the surface of an object under test, provided in an embodiment of this application. Figure 2 A flowchart illustrating a method for determining the grayscale information of the surface of a measured object, provided in an embodiment of this application; Figure 3 A flowchart illustrating another method for determining the grayscale information of the surface of a measured object, provided in an embodiment of this application; Figure 4 A flowchart illustrating another method for determining the grayscale information of the surface of a measured object, provided in an embodiment of this application; Figure 5A flowchart illustrating another method for determining the grayscale information of the surface of a measured object, provided in an embodiment of this application; Figure 6 A flowchart illustrating a method for determining the grayscale information of the surface of a measured object, provided in an embodiment of this application; Figure 7 A flowchart illustrating another method for determining the grayscale information of the surface of a measured object, provided in an embodiment of this application; Figure 8 This application provides a schematic diagram of the structure of an electronic device. Figure 9 This is a schematic diagram of a device for determining the grayscale information of the surface of an object to be measured, provided in an embodiment of this application. Detailed Implementation
[0020] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.
[0021] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.
[0022] First, the technical terms used in this application will be explained.
[0023] 1. Multi-line crosstalk refers to the phenomenon where adjacent laser lines overlap in an image when multiple laser lines are projected simultaneously (optical crosstalk). If scattered or secondary reflected light from adjacent laser lines enters the spatial neighborhood of a laser line, the brightness reading of that laser line at the current pixel position is contaminated by the light components of adjacent lines. Without processing, the directly read brightness value will produce pseudo-grayscale features, that is, periodic striped grayscale anomalies corresponding to the laser line distribution appear on the originally uniform surface.
[0024] 2. Inconsistent intensity among multi-line lasers refers to the inherent differences between different laser lines in a multi-line laser. This includes variations in factory power output (even within the same batch) and current differences in different channels of the drive circuit. Different laser lines project onto the object's surface at different incident angles, causing the intensity of reflected light received by the camera to vary with the incident angle. Furthermore, different laser lines experience varying transmission losses in the projection path, resulting in different receiving sensitivities at different positions within the camera's field of view (lens vignetting effect). Without normalization correction, the same object surface will exhibit inconsistent grayscale readings under different laser lines, leading to striped brightness jumps in the grayscale image and failing to reflect the true optical properties of the material.
[0025] 3. Multi-view grayscale inconsistency refers to the situation where, in a binocular stereo vision architecture, the left and right cameras simultaneously observe the same set of laser lines from different angles. Furthermore, during scanner movement, the same surface area may be repeatedly scanned and covered by different frames (overlapping scan areas). For non-Lambertian surfaces (especially metal workpieces), the variation in reflected light intensity with the observation angle is not negligible; the laser incident angle at the same surface point may differ in different frames / under different laser lines. Simply averaging will lead to grayscale blurring due to angle differences; however, utilizing multi-view information for consistent fusion can improve the grayscale signal-to-noise ratio and robustness.
[0026] 4. Incomparable grayscale values across multiple shutter speeds refers to the need for industrial cameras to dynamically adjust shutter speeds (exposure times) when scanning different types of surfaces. Highly reflective surfaces (such as polished metals) require extremely short shutter speeds to avoid sensor saturation; otherwise, the laser line area will be overexposed, resulting in the loss of brightness information. Lowly reflective surfaces (such as black plastics and carbon fibers) require longer shutter speeds to obtain sufficient laser reflection signals; otherwise, the signal-to-noise ratio will be too low. The same workpiece may contain multiple materials, and the shutter speed may be switched multiple times during the scanning process, resulting in a lack of uniformity in grayscale readings across different areas, making cross-regional comparisons and global defect detection impossible.
[0027] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.
[0028] Optionally, refer to Figure 1 The diagram shown is a structural schematic of the grayscale information determination system for the surface of the object under test provided in this application. Figure 1 As shown, the system includes: M multi-line lasers and electronic devices, the electronic devices being communicatively connected to the M multi-line lasers respectively; for example, the electronic devices can be processors with data processing and control functions.
[0029] A multi-line laser is used to simultaneously project N laser lines onto the surface of an object being measured. For example, N ≥ 11, and the lasers within the same multi-line laser are synchronously lit or synchronously turned off.
[0030] M multi-line lasers can simultaneously project M×N laser lines onto the surface of the object being measured from different spatial directions.
[0031] Each multi-line laser integrates a binocular camera, which includes a left camera and a right camera. The left camera is used to simultaneously acquire the left-side stripe image formed by the reflection of the N laser lines projected by the multi-line laser on the surface of the object being measured; the right camera is used to simultaneously acquire the right-side stripe image formed by the reflection of the N laser lines projected by the multi-line laser on the surface of the object being measured. In other words, the left and right stripe images formed by the reflection of the N laser lines on the surface of the object can be acquired from different perspectives.
[0032] For example, the multi-line laser uses a semiconductor laser diode (LD) as the light source, with a working wavelength of about 450nm (blue light band), and the binocular camera module has a resolution of 3 million to 16 million pixels, a frame rate of more than 100fps, and a data interface of USB 3.0 or Gigabit Ethernet.
[0033] The electronic device is used to calculate the target grayscale value of each pixel position on the surface of the object under test based on the left and right stripe images corresponding to each multi-line laser, and to spatially align and bind the target grayscale value of each pixel position on the surface of the object under test with the three-dimensional point cloud data to obtain the three-dimensional data of the object under test with grayscale information. That is, the three-dimensional shape and surface grayscale information are obtained simultaneously in a single scan without the need for secondary scans or additional sensors, which greatly improves the detection efficiency.
[0034] In addition, the same frame image from the same binocular camera simultaneously provides a data source for both geometry and grayscale, eliminating the spatial registration error and temporal deviation of independent texture cameras, and ensuring pixel-by-pixel consistency between grayscale and geometry in space and time.
[0035] It should be noted that a unified calibration process is required before the formal scanning. Specifically, during the same calibration target (a standard white diffuse reflective plate with high-precision markers) and the same image acquisition process, the following calibration data are extracted and calculated simultaneously: crosstalk matrix between laser lines, spatial plane equation L_i of each laser line (geometric calibration), Gaussian profile parameters (μ_i, σ_i), power correction coefficient P_i, angle compensation factor, brightness attenuation function, and sensor shutter response curve (grayscale / photometric calibration).
[0036] Optionally, refer to Figure 2 The diagram shown is a flowchart illustrating a method for determining the grayscale information of a measured object surface according to an embodiment of this application. This method is applied to the above-mentioned... Figure 1 The electronic device shown, wherein the method includes: S101. Control multiple multi-line lasers to simultaneously project laser lines onto the surface of the object being measured from different spatial directions.
[0037] Each multi-line laser projects N laser lines, and the N laser lines within the same multi-line laser are simultaneously lit or extinguished.
[0038] In one feasible approach, M (M≥2) multi-line lasers are deployed in a ring / arc array around the object being measured, with the optical axis angles of each multi-line laser calibrated as θ1, θ2, ..., θ... m For example, at 0°, 45°, 90°, and 135°, all multi-line lasers are controlled to simultaneously project N (M≥11) laser lines onto the surface of the object being measured from different spatial directions. Furthermore, the N lines within the same laser can utilize a common cathode constant current drive circuit to ensure simultaneous illumination and extinguishing. Therefore, this application utilizes multiple multi-line lasers to project synchronously time-sequentially and structurally distributed N-line laser groups from different viewing angles to construct cross-viewing-angle grayscale constraints.
[0039] S102. Obtain the left and right stripe images corresponding to each multi-line laser.
[0040] Among them, the left and right stripe images are images formed by the reflection of N laser lines on the surface of the object being measured, which are simultaneously acquired by a binocular camera integrated in a multi-line laser.
[0041] In one feasible approach, a binocular camera in a multi-line laser synchronously acquires two stripe images, namely left and right stripe images, formed by the reflection of N laser lines on the surface of the object being measured.
[0042] S103. Based on the left and right stripe images corresponding to each multi-line laser, determine the original grayscale value corresponding to each pixel position on the surface of the object being measured for each laser line emitted by each multi-line laser.
[0043] In one feasible approach, for the k-th multi-line laser, pre-calibrated parameters of the binocular camera in the k-th multi-line laser, such as the rotation matrix R, are used. k Translation vector t k Based on the laser plane equation, the viewing angle of the left and right stripe images corresponding to the k-th multi-line laser is determined, and the pixel position (u, v) of each laser line in the k-th multi-line laser on the surface of the object under test and the original gray value at that pixel position are obtained.
[0044] S104. Determine the target gray value of each pixel position on the surface of the object being measured based on the original gray value corresponding to each pixel position on the surface of the object being measured by each laser line emitted by each multi-line laser.
[0045] In one feasible approach, to ensure the accuracy of the final obtained grayscale information of the surface of the object under test, it is proposed that the original grayscale values corresponding to each pixel position on the surface of the object under test can be corrected in multiple dimensions, such as multi-line crosstalk compensation processing, shutter normalization processing, and multi-view fusion. The target grayscale value of each pixel position on the surface of the object under test can be calculated, thereby converting the collected original grayscale values with various errors into real, consistent, and usable surface grayscale information, ensuring that the final calculated target grayscale value can uniformly, realistically, and consistently reflect the surface material characteristics.
[0046] In summary, this application provides a method for determining the grayscale information of the surface of a measured object. In this application, left and right fringe images corresponding to each of the multi-line lasers are acquired. These left and right fringe images are images formed by the reflection of N laser lines on the surface of the measured object, simultaneously acquired by a binocular camera integrated in the multi-line laser. Based on the left and right fringe images corresponding to each multi-line laser, the original grayscale value corresponding to each pixel position on the surface of the measured object for each laser line emitted by each multi-line laser is determined. Then, multi-dimensional correction is performed on the original grayscale values corresponding to each pixel position on the surface of the measured object for each laser line emitted by each multi-line laser, such as multi-line crosstalk compensation processing, shutter normalization processing, etc. By employing gate normalization and multi-view fusion, the target grayscale values of each pixel position on the surface of the measured object are calculated. This transforms the collected raw grayscale values, which contain various errors, into true, consistent, and usable surface grayscale information. This ensures that the final calculated target grayscale values can uniformly, realistically, and consistently reflect the surface material characteristics, thus improving the accuracy of the grayscale information of the measured object's surface. Therefore, by adopting the scheme proposed in this application, no additional color camera and its matching lens or data transmission channel are required to obtain a grayscale image that uniformly, realistically, and consistently reflects the surface material characteristics. This avoids the problem of spatial or temporal misalignment between grayscale and geometric data caused by using dual sensors.
[0047] Optionally, refer to Figure 3 As shown, step S104 above includes: S201. Perform multi-line crosstalk compensation processing on the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test to obtain the corrected brightness value corresponding to the current pixel position of each laser line.
[0048] The current pixel position is any point on the surface of the object being measured.
[0049] Optionally, in order to eliminate the pseudo grayscale stripes caused by interference between adjacent laser lines and achieve the effect of restoring the true independent brightness of a single laser line, it is proposed that: the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object being measured can be subjected to multi-line crosstalk compensation processing to obtain the corrected brightness value corresponding to the current pixel position of each laser line, that is, to obtain the corrected brightness value after eliminating the interference of adjacent lines.
[0050] S202. Perform shutter normalization processing on the corrected brightness value to obtain the shutter normalized brightness value corresponding to each laser line at the current pixel position.
[0051] Optionally, in order to eliminate the brightness difference between different scan frames caused by the different exposure time (shutter speed) of the binocular camera and ensure that the brightness of the same object is consistent under different shutter speeds, it is proposed that the corrected brightness value of each laser line at the current pixel position should also be normalized by shutter speed to obtain the shutter-normalized brightness value of each laser line at the current pixel position, that is, to obtain the theoretical brightness value that should be under standard exposure.
[0052] S203. Perform multi-line intensity normalization processing on the shutter-normalized brightness value corresponding to the current pixel position to obtain the normalized gray value of each laser line at the current pixel position.
[0053] Optionally, in order to eliminate the problem of uneven output power of each laser line inside a multi-line laser (e.g., the middle line is bright and the edge line is dark), and to make all laser lines exhibit consistent brightness when illuminating the same plane, it is proposed that: the shutter-normalized brightness value corresponding to the current pixel position of each laser line can be subjected to multi-line intensity normalization processing to obtain the normalized gray value corresponding to the current pixel position of each laser line. That is, the obtained normalized gray value is no longer affected by the uneven output of the laser itself, but only reflects the reflection characteristics of the object surface.
[0054] S204. Perform multi-view fusion on the normalized gray values of each laser line at the current pixel position to obtain the target gray value at the current pixel position.
[0055] Optionally, in order to utilize the data from the left and right cameras and eliminate the difference in reflection caused by different viewing angles, it is proposed that: the normalized gray values corresponding to the current pixel position of each laser line can be fused from multiple perspectives to obtain the target gray value at the current pixel position, that is, to obtain a surface gray texture without dead angles and globally consistent, thereby obtaining the most realistic object surface texture information.
[0056] Optionally, refer to Figure 4 As shown, step S201 above includes: S301. Perform Gaussian profile modeling on the grayscale cross-sectional curve corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test, and obtain the peak position and full width at half maximum (FWHM) parameters of each laser line.
[0057] Among them, the peak position A is used to characterize the theoretical center coordinates of the laser line (sub-pixel level), reflecting its spatial positioning; Full width at half maximum (FWHM) parameter , is a Gaussian standard deviation parameter used to characterize laser lines.
[0058] It should be noted that crosstalk between laser lines exhibits spatial Gaussian decay characteristics, with the main peak energy accounting for >92%, and the crosstalk energy between adjacent laser lines decays exponentially with distance.
[0059] S302. Based on the peak position and full width at half maximum (FWHM) parameters of each laser line, construct the crosstalk matrix between laser lines.
[0060] Among them, the matrix elements in the crosstalk matrix The value represents the brightness crosstalk coefficient between the j-th laser line and the i-th laser line, which only occurs between adjacent laser lines within the same laser. It is obtained through the inverse geometric solution of a multi-line fully bright superimposed Gaussian profile. The matrix elements are... for: , .
[0061] in, For the first The peak position of the laser line For the first The peak position of the laser line For perpendicular to the first Pixel coordinates of the laser line direction. For perpendicular to the first Pixel coordinates of the laser line direction. The standard deviation parameter is Gaussian and can be pre-calibrated at the factory.
[0062] Optionally, in order to eliminate the brightness interference between adjacent laser lines on the imaging plane caused by beam overlap, lens scattering, sensor diffuse reflection or optical diffraction, i.e. crosstalk, thereby improving the spatial positioning accuracy and brightness fidelity of each laser line profile and providing high-quality input for subsequent sub-pixel center extraction, 3D reconstruction and other tasks, this embodiment proposes: along the vertical direction of each laser line (i.e. "horizontal", perpendicular to the laser line direction), extract the gray-scale cross-sectional curve corresponding to the current pixel position of each laser line on the surface of the object being measured, and perform Gaussian contour modeling on the gray-scale cross-sectional curve to obtain the peak position A and full width at half maximum (FWHM) parameter of each laser line, and construct the crosstalk matrix between laser lines based on the peak position A and FWHM parameter of each laser line.
[0063] S303. Based on the crosstalk matrix between laser lines, perform multi-line crosstalk compensation processing on the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test, and obtain the corrected brightness value corresponding to the current pixel position of each laser line.
[0064] In this embodiment, based on the crosstalk matrix between laser lines, the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test is subjected to multi-line crosstalk compensation processing to obtain the corrected brightness value corresponding to the current pixel position of each laser line, that is, the corrected brightness value after eliminating the interference of adjacent lines.
[0065] Optionally, step S303 above includes: Based on the crosstalk matrix between laser lines, the original grayscale values corresponding to the current pixel positions of each laser line emitted by each multi-line laser on the surface of the object under test are deconvolved to obtain the preliminary corrected brightness values corresponding to each laser line. Based on the crosstalk matrix between laser lines, the brightness crosstalk coefficient between adjacent laser lines is determined, and based on the brightness crosstalk coefficient between adjacent laser lines, the preliminary corrected brightness values corresponding to each laser line are compensated image by image to obtain the corrected brightness values corresponding to each laser line at the current pixel position.
[0066] In one feasible approach, based on the crosstalk matrix between laser lines, the original grayscale values corresponding to the current pixel positions of each laser line emitted by each multi-line laser on the surface of the object under test are deconvolved, i.e., the halo contribution of adjacent laser lines is eliminated. Then, based on the crosstalk matrix between laser lines, the preliminary corrected brightness values corresponding to each laser line are compensated pixel by pixel, i.e., the estimated brightness contribution of neighboring lines is eliminated pixel by pixel along the transverse direction of the laser line from the center to the edge, and the preliminary corrected brightness values corresponding to each laser line are compensated pixel by pixel, thus realizing fine pixel-by-pixel compensation of the corrected brightness values.
[0067] Optionally, refer to Figure 5 As shown, step S202 above includes: S401. Obtain the reference shutter speed pre-calibrated for the binocular camera in each multi-line laser, and determine the actual shutter speed of the binocular camera in each multi-line laser.
[0068] For example, a reference shutter speed t_ref is selected based on the pre-calibrated linear range of the sensor's photoelectric response.
[0069] S402. Based on the reference shutter speed and actual shutter speed of the binocular camera in each multi-line laser, perform shutter normalization processing on the corrected brightness value corresponding to the current pixel position of each laser line to correct the exposure, and obtain the shutter normalized brightness value corresponding to the current pixel position of each laser line.
[0070] In this embodiment, based on the reference shutter speed t_ref and the actual shutter speed t_actual of the stereo camera in the current multi-line laser, the ratio between the reference shutter speed t_ref and the actual shutter speed t_actual, i.e., t_ref / t_actual, is determined. Based on this ratio, the corrected brightness value corresponding to the current laser line at the current pixel position is normalized for exposure correction, resulting in the shutter-normalized brightness value corresponding to the current laser line at the current pixel position. For example, if the actual shutter speed is twice the reference shutter speed, the calculated brightness is divided by 2, thus obtaining the brightness value that should be present under standard exposure. This effectively eliminates brightness differences caused by different camera exposure times (shutter speeds), ensuring consistent brightness for the same object under different shutter speeds.
[0071] Optionally, for shutter speeds exceeding the sensor's linear response range, exposure compensation is performed using a pre-calibrated nonlinear correction lookup table.
[0072] Optionally, refer to Figure 6 As shown, step S203 above includes: S501. Obtain the pre-calibrated power correction coefficient, the pre-constructed angle compensation mapping relationship, and the pre-measured brightness attenuation coefficient for each laser line emitted by each multi-line laser.
[0073] The power correction factor is calculated based on the relative reflectance of each laser line on a standard white board. It can be used to correct the inherent power differences of each laser line caused by laser drive current deviation, different coupling efficiency, and differences in fiber / optical path loss.
[0074] Angle compensation mapping relationship is used to characterize angle effect compensation. It is based on the overall projection angle of each laser line to perform line-level angle compensation, and further calculates the emission direction and incident angle of each three-dimensional point independently along the longitudinal direction of the laser line to establish a point-by-point angle compensation mapping relationship, thereby eliminating the brightness difference caused by the change of emission angle of each point in a single laser line.
[0075] The brightness attenuation coefficient is used to characterize vignetting compensation. For different pixel positions within the field of view, the relative brightness attenuation coefficient is measured and stored as a lookup table.
[0076] S502. Based on the power correction coefficient, angle compensation mapping relationship, and brightness attenuation coefficient of each laser line emitted by each multi-line laser, perform multi-line intensity normalization processing on the shutter-normalized brightness value corresponding to the current pixel position of each laser line to obtain the normalized gray value corresponding to the current pixel position of each laser line.
[0077] In this embodiment, based on the power correction coefficient, angle compensation mapping relationship, and brightness attenuation coefficient of each laser line emitted by each multi-line laser, the shutter-normalized brightness value corresponding to the current pixel position of each laser line can be subjected to multi-line intensity normalization processing, and the normalized grayscale value corresponding to the current pixel position of each laser line can be calculated. This effectively eliminates the brightness inconsistencies between laser lines and within individual lines caused by hardware differences, geometric projection distortion, and optical aberrations in the multi-line laser, making the output physical brightness (or image grayscale) of all laser lines comparable and spatially consistent under the same reflection conditions. This provides a radiometrically consistent input for subsequent high-precision 3D reconstruction (such as phase unwrapping and height inversion).
[0078] Optionally, refer to Figure 6 As shown, step S204 above includes: S501. Obtain the first angle between the incident angle of each laser line projected onto the surface of the object being measured and the normal of the surface of the object being measured, and obtain the second angle between the receiving angle of each laser line acquired by the binocular camera in each multi-line laser and the normal of the surface of the object being measured.
[0079] S502. Determine the angle quality weight corresponding to each laser line based on the first included angle and the second included angle.
[0080] S503. Based on the grayscale profile of each laser line, determine the signal quality weight corresponding to each laser line.
[0081] S504. Based on the angle quality weight and signal quality weight corresponding to each laser line, perform multi-view fusion on the normalized gray value corresponding to the current pixel position of each laser line to obtain the target gray value of the current pixel position.
[0082] In this embodiment, a set of grayscale observation records from the left camera, right camera, and different scan frames is established for each pixel position. Each record includes grayscale value, laser incident direction, and camera receiving direction. Based on the first angle between the incident angle of the current laser line projected onto the surface of the object being measured and the normal of the surface of the object being measured, and the second angle between the receiving angle of the current laser line acquired by the binocular camera and the normal of the surface of the object being measured, the angle quality weight of the current laser line observation is calculated. Furthermore, based on the grayscale profile of the current laser line, the peak signal-to-noise ratio of the current laser line is determined, and based on the peak signal-to-noise ratio of the current laser line, the signal quality weight of the current laser line observation is calculated. Similarly, the angle quality weight and signal quality weight corresponding to other laser lines can be obtained. Then, the product of the angle quality weight and signal quality weight of each laser line is used as the fusion weight to perform multi-view fusion on the normalized grayscale value corresponding to each laser line at the current pixel position to obtain the fused grayscale value, which is the target grayscale value at the current pixel position.
[0083] Optionally, only two scalars, the current fused grayscale value and the cumulative weight, are maintained for each pixel location. When a new observation arrives, the weighted recursive formula is used to update the data, without having to retain all historical observation data.
[0084] Optionally, refer to Figure 7 As shown, the method also includes: S601. Perform point cloud image processing on the left and right stripe images corresponding to each multi-line laser to obtain three-dimensional point cloud data of the surface of the object under test.
[0085] S602. Spatial alignment and binding of grayscale information and 3D point cloud data on the surface of the object to be measured to obtain 3D mesh data of the surface of the object to be measured.
[0086] The 3D mesh data includes the spatial coordinates and grayscale values of each mesh vertex.
[0087] In this embodiment, the binocular triangulation method is used to process the point cloud images of the left and right stripe images corresponding to each multi-line laser to calculate the three-dimensional point cloud data of the surface of the object under test. Then, the grayscale information on the surface of the object under test and the three-dimensional point cloud data are spatially aligned and bound to output three-dimensional data with grayscale attributes. That is, the target grayscale value is used as the attribute value of the three-dimensional mesh vertex, so that each mesh vertex simultaneously contains (X,Y,Z) spatial coordinates and grayscale value. In other words, the grayscale value is mapped onto the three-dimensional mesh to realize a digital twin model with realistic surface texture, which can be used for reverse engineering, virtual assembly, appearance quality recording, etc. Thus, it is possible to obtain three-dimensional shape and surface grayscale information simultaneously in a single scan without the need for secondary scans or additional sensors, which greatly improves the detection efficiency. In addition, the same frame image of the same binocular camera simultaneously provides a data source for geometry and grayscale, eliminating the spatial registration error and temporal deviation of independent texture cameras, and ensuring the pixel-by-pixel consistency of grayscale and geometry in space and time.
[0088] Therefore, the grayscale information determination method for the surface of the object proposed in this application eliminates pseudo grayscale fringes caused by multi-line crosstalk compensation, eliminates brightness jumps between lines and differences in incident angles within lines through multi-line intensity normalization, eliminates multi-angle observation bias through multi-view weighted fusion, and eliminates cross-shutter incomparability through shutter normalization, thereby obtaining the grayscale information on the surface of the object. Therefore, this application does not require an additional color camera and its matching lens or data transmission channel to obtain a grayscale image that uniformly, realistically, and consistently reflects the surface material characteristics, avoiding the problem of spatial or temporal misalignment between grayscale and geometric data caused by using dual sensors.
[0089] In addition, the grayscale information determination method for the surface of the object to be tested proposed in this application also has the advantage of high sensitivity for surface defect detection, that is, the detection sensitivity for defects such as scratches, oxide spots, pores, and inclusions on metal / plastic surfaces is higher than that of geometric contour detection or two-dimensional image detection alone.
[0090] Simultaneously, it can spatially align and bind the grayscale information and 3D point cloud data on the surface of the object being measured to obtain the 3D mesh data of the surface of the object being measured. This allows for the simultaneous acquisition of 3D morphology and surface grayscale information in a single scan, eliminating the need for secondary scans or additional sensors, significantly improving detection efficiency, and realizing a digital twin model with realistic surface texture. This model can be used for reverse engineering, virtual assembly, appearance quality recording, etc.
[0091] Optionally, please refer to Figure 8 , Figure 8 This is a block diagram of an electronic device provided in an embodiment of this application. The electronic device includes a memory 101 and a processor 102, which are electrically connected directly or indirectly to each other to realize data transmission or interaction. The electronic device is used to execute a method for determining the grayscale information of the surface of a measured object.
[0092] Understandable. Figure 8 The structure shown is for illustrative purposes only; the electronic device may also include components that are more advanced than those shown. Figure 8 The more or fewer components shown, or having the same Figure 8 The different configurations shown. Figure 8 The components shown can be implemented using hardware, software, or a combination thereof.
[0093] Optionally, refer to Figure 9 As shown in the diagram, this application also provides a structural schematic diagram of a device for determining the grayscale information of the surface of a measured object, as follows: Figure 9 As shown, the device includes: The control module 901 is used to control multiple multi-line lasers to simultaneously project laser lines onto the surface of the object being measured from different spatial directions. Each multi-line laser projects N laser lines, and the N laser lines within the same multi-line laser are simultaneously lit or simultaneously turned off. The acquisition module 902 is used to acquire the left and right stripe images corresponding to each of the multi-line lasers. The left and right stripe images are images formed by the reflection of N laser lines on the surface of the object being tested, which are simultaneously acquired by a binocular camera integrated in the multi-line laser. The processing module 903 is used to determine the original grayscale value corresponding to each pixel position on the surface of the object being tested by each laser line emitted by each multi-line laser based on the left and right stripe images corresponding to each multi-line laser; and to determine the target grayscale value of each pixel position on the surface of the object being tested based on the original grayscale value corresponding to each pixel position on the surface of the object being tested by each laser line emitted by each multi-line laser.
[0094] Optionally, the processing module 903 is specifically used for: Multi-line crosstalk compensation processing is performed on the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test to obtain the corrected brightness value of each laser line at the current pixel position, where the current pixel position is any point on the surface of the object under test. The corrected brightness value is subjected to shutter normalization processing to obtain the shutter normalized brightness value of each laser line at the current pixel position; Perform multi-line intensity normalization processing on the shutter-normalized brightness value corresponding to the current pixel position to obtain the normalized grayscale value of each laser line corresponding to the current pixel position; The normalized grayscale values of each laser line at the current pixel position are fused from multiple perspectives to obtain the target grayscale value at the current pixel position.
[0095] Optionally, the processing module 903 is specifically used for: Gaussian contour modeling is performed on the grayscale cross-sectional curve corresponding to the current pixel position on the surface of the object under test for each laser line emitted by each multi-line laser to obtain the peak position and full width at half maximum (FWHM) parameter of each laser line. Based on the peak position and full width at half maximum (FWHM) parameters of each laser line, a crosstalk matrix between laser lines is constructed. The matrix element ε_ij in the crosstalk matrix represents the brightness crosstalk coefficient of the j-th laser line to the i-th laser line. Based on the crosstalk matrix between the laser lines, the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test is subjected to multi-line crosstalk compensation processing to obtain the corrected brightness value of each laser line at the current pixel position.
[0096] Optionally, the processing module 903 is specifically used for: Based on the crosstalk matrix between the laser lines, the original grayscale values corresponding to the current pixel positions of each laser line emitted by each multi-line laser on the surface of the object under test are deconvolved to obtain the preliminary corrected brightness values corresponding to each laser line. Based on the crosstalk matrix between the laser lines, the brightness crosstalk coefficient between adjacent laser lines is determined, and based on the brightness crosstalk coefficient between adjacent laser lines, the preliminary corrected brightness value corresponding to each laser line is compensated image by image to obtain the corrected brightness value of each laser line at the current pixel position.
[0097] Optionally, the processing module 903903 is specifically used for: Obtain a pre-calibrated reference shutter speed for the binocular camera in each of the multi-line lasers, and determine the actual shutter speed of the binocular camera in each of the multi-line lasers; Based on the reference shutter speed of the binocular camera in each of the multi-line lasers and the actual shutter speed, the exposure correction is performed by shutter normalization on the corrected brightness value of each laser line at the current pixel position, thereby obtaining the shutter normalized brightness value of each laser line at the current pixel position.
[0098] Optionally, the processing module 903 is specifically used for: Obtain the pre-calibrated power correction coefficient, the pre-constructed angle compensation mapping relationship, and the pre-measured brightness attenuation coefficient for each laser line emitted by each of the multi-line lasers; Based on the power correction coefficient of each laser line emitted by each multi-line laser, the angle compensation mapping relationship, and the brightness attenuation coefficient, the shutter-normalized brightness value of each laser line at the current pixel position is subjected to multi-line intensity normalization processing to obtain the normalized grayscale value of each laser line at the current pixel position.
[0099] Optionally, the processing module 903 is specifically used for: Obtain the first angle between the incident angle of each laser line projected onto the surface of the object under test and the normal of the surface of the object under test, and obtain the second angle between the receiving angle of each laser line acquired by the binocular camera in each of the multi-line lasers and the normal of the surface of the object under test. Based on the first included angle and the second included angle, determine the angle quality weight corresponding to each laser line; Based on the grayscale profile of each laser line, the signal quality weight corresponding to each laser line is determined. Based on the angle quality weight and signal quality weight corresponding to each laser line, the normalized gray value corresponding to the current pixel position of each laser line is fused from multiple perspectives to obtain the target gray value of the current pixel position.
[0100] Optionally, the processing module 903 is further configured to: Point cloud image processing is performed on the left and right stripe images corresponding to each of the multi-line lasers to obtain three-dimensional point cloud data of the surface of the object under test; the grayscale information on the surface of the object under test and the three-dimensional point cloud data are spatially aligned and bound to obtain three-dimensional mesh data of the surface of the object under test, wherein the three-dimensional mesh data includes: the spatial coordinates and grayscale values of each mesh vertex.
[0101] The above-described device is used to execute the method provided in the foregoing embodiments, and its implementation principle and technical effect are similar, so they will not be described again here.
[0102] These modules can be one or more integrated circuits configured to implement the above methods, such as one or more Application Specific Integrated Circuits (ASICs), one or more digital signal processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs). Alternatively, when a module is implemented using processing element scheduler code, the processing element can be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. Furthermore, these modules can be integrated together as a system-on-a-chip (SOC).
[0103] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can also be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0104] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.
[0105] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0106] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.
[0107] It will be apparent to those skilled in the art that this application is not limited to the details of the exemplary embodiments described above, and that this application can be implemented in other specific forms without departing from the spirit or essential characteristics of this application. Therefore, the embodiments should be considered illustrative and non-limiting in all respects, and the scope of this application is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be included within this application. No reference numerals in the claims should be construed as limiting the scope of the claims.
Claims
1. A method of determining gray scale information of a surface of an object under test, characterized by, The method includes: Multiple multi-line lasers are controlled to simultaneously project laser lines onto the surface of the object being measured from different spatial directions. Each multi-line laser projects N laser lines, and the N laser lines within the same multi-line laser are simultaneously lit or simultaneously turned off. Acquire the left and right stripe images corresponding to each of the multi-line lasers. The left and right stripe images are images formed by the reflection of N laser lines on the surface of the object being tested, which are simultaneously acquired by a binocular camera integrated in the multi-line laser. Based on the left and right stripe images corresponding to each of the multi-line lasers, determine the original grayscale value corresponding to each pixel position on the surface of the object being tested for each laser line emitted by each of the multi-line lasers. The target grayscale value of each pixel position on the surface of the object under test is determined based on the original grayscale value corresponding to each pixel position on the surface of the object under test by each laser line emitted by each multi-line laser.
2. The method of claim 1, wherein, The step of determining the target grayscale value of each pixel position on the surface of the object under test based on the original grayscale value corresponding to each pixel position on the surface of the object under test by each laser line emitted by each of the multi-line lasers includes: Multi-line crosstalk compensation processing is performed on the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test to obtain the corrected brightness value of each laser line at the current pixel position, where the current pixel position is any point on the surface of the object under test. The corrected brightness value is subjected to shutter normalization processing to obtain the shutter normalized brightness value of each laser line at the current pixel position; Perform multi-line intensity normalization processing on the shutter-normalized brightness value corresponding to the current pixel position to obtain the normalized grayscale value of each laser line corresponding to the current pixel position; The normalized grayscale values of each laser line at the current pixel position are fused from multiple perspectives to obtain the target grayscale value at the current pixel position.
3. The method of claim 2, wherein, The step of performing multi-line crosstalk compensation processing on the original grayscale value corresponding to the current pixel position of each laser line emitted by each of the multi-line lasers on the surface of the object under test to obtain the corrected brightness value of each laser line at the current pixel position includes: Gaussian contour modeling is performed on the grayscale cross-sectional curve corresponding to the current pixel position on the surface of the object under test for each laser line emitted by each multi-line laser to obtain the peak position and full width at half maximum (FWHM) parameter of each laser line. Based on the peak position and the full width at half maximum parameter of each laser line, a crosstalk matrix between the laser lines is constructed, and a matrix element in the crosstalk matrix represents a luminance crosstalk coefficient of the jth laser line to the ith laser line. Based on the peak position and the full width at half maximum parameter of each laser line, a crosstalk matrix between the laser lines is constructed, and a matrix element in the crosstalk matrix represents a luminance crosstalk coefficient of the jth laser line to the ith laser line. Based on the crosstalk matrix between the laser lines, the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test is subjected to multi-line crosstalk compensation processing to obtain the corrected brightness value of each laser line at the current pixel position.
4. The method of claim 3, wherein, The method of performing multi-line crosstalk compensation processing on the original grayscale value corresponding to the current pixel position of each laser line emitted by each multi-line laser on the surface of the object under test, based on the crosstalk matrix between the laser lines, to obtain the corrected brightness value of each laser line at the current pixel position includes: Based on the crosstalk matrix between the laser lines, the original grayscale values corresponding to the current pixel positions of each laser line emitted by each multi-line laser on the surface of the object under test are deconvolved to obtain the preliminary corrected brightness values corresponding to each laser line. Based on the crosstalk matrix between the laser lines, the brightness crosstalk coefficient between adjacent laser lines is determined, and based on the brightness crosstalk coefficient between adjacent laser lines, the preliminary corrected brightness value corresponding to each laser line is compensated image by image to obtain the corrected brightness value of each laser line at the current pixel position.
5. The method of claim 2, wherein, The step of performing shutter normalization processing on the corrected brightness value to obtain the shutter normalized brightness value of each laser line at the current pixel position includes: Obtain a pre-calibrated reference shutter speed for the binocular camera in each of the multi-line lasers, and determine the actual shutter speed of the binocular camera in each of the multi-line lasers; Based on the reference shutter speed of the binocular camera in each of the multi-line lasers and the actual shutter speed, the exposure correction is performed by shutter normalization on the corrected brightness value of each laser line at the current pixel position, thereby obtaining the shutter normalized brightness value of each laser line at the current pixel position.
6. The method of claim 2, wherein, The step of performing multi-line intensity normalization processing on the shutter-normalized brightness value corresponding to the current pixel position to obtain the normalized grayscale value of each laser line corresponding to the current pixel position includes: Obtain the pre-calibrated power correction coefficient, the pre-constructed angle compensation mapping relationship, and the pre-measured brightness attenuation coefficient for each laser line emitted by each of the multi-line lasers; Based on the power correction coefficient of each laser line emitted by each multi-line laser, the angle compensation mapping relationship, and the brightness attenuation coefficient, the shutter-normalized brightness value of each laser line at the current pixel position is subjected to multi-line intensity normalization processing to obtain the normalized grayscale value of each laser line at the current pixel position.
7. The method of claim 2, wherein, The step of performing multi-view fusion of the normalized grayscale values of each laser line at the current pixel position to obtain the target grayscale value at the current pixel position includes: Obtain the first angle between the incident angle of each laser line projected onto the surface of the object under test and the normal of the surface of the object under test, and obtain the second angle between the receiving angle of each laser line acquired by the binocular camera in each of the multi-line lasers and the normal of the surface of the object under test. Based on the first included angle and the second included angle, determine the angle quality weight corresponding to each laser line; Based on the grayscale profile of each laser line, determine the signal quality weight corresponding to each laser line; Based on the angle quality weight and signal quality weight corresponding to each laser line, the normalized gray value corresponding to the current pixel position of each laser line is fused from multiple perspectives to obtain the target gray value of the current pixel position.
8. The method of claim 1, wherein, The method further includes: Point cloud image processing is performed on the left and right stripe images corresponding to each of the multi-line lasers to obtain the three-dimensional point cloud data of the surface of the object under test. The grayscale information on the surface of the object under test and the three-dimensional point cloud data are spatially aligned and bound to obtain the three-dimensional mesh data of the surface of the object under test. The three-dimensional mesh data includes the spatial coordinates and grayscale values of each mesh vertex.
9. An electronic device, comprising: include: The device includes a processor, a storage medium, and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is in operation, the processor communicates with the storage medium via the bus, and the processor executes the machine-readable instructions to perform the steps of the method as described in any one of claims 1-8.
10. A system for determining gray scale information of a surface of an object under test, characterized by include: M multi-line lasers and the electronic device of claim 9, wherein the multi-line lasers integrate a binocular camera; the electronic device is communicatively connected to each of the M multi-line lasers.
