Femtosecond time multi-path error correction device and method

By scanning the pixel plane and calculating the depth distance and error of the pixel points, combining the optical path projection relationship and principal component analysis, the angle and tangent circle radius of the two planes were obtained, and error correction was performed, which solved the problem that the femtosecond time sensor was used in complex environments. The error problem caused by multiple path effects improves the accuracy and adaptability of map reconstruction of sweeping robots.

CN118915029APending Publication Date: 2024-11-08SHINE OPTICS TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411249428.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-06
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The errors caused by the multiple path effects of femtosecond time sensors in complex environments lead to deformation, misalignment and other errors in the map reconstruction process, affecting navigation accuracy and cleaning efficiency.

Method used

By scanning the pixel plane, the depth distance and error of each pixel point are calculated, the projection relationship between the optical path and the pixel plane is used, and the angle and tangent circle radius of the two planes are calculated according to the principal component analysis, and the error correction is performed.

Benefits of technology

The precise identification and quantification of multipath effect errors is achieved, the accuracy of map reconstruction is improved, the error is reduced, and the adaptability and accuracy of the method is enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118915029A_ABST
    Figure CN118915029A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of femtosecond time error correction, in particular to a femtosecond time multi-path error correction device and method. The method comprises the following steps of: scanning a pixel plane, calculating a depth distance on a pixel, calculating an error of each pixel point by utilizing a projection relation between a light path and the pixel plane, and recording the error and a corresponding angle; pixel planes are scanned, three-dimensional coordinate points are taken, the included angle between the two planes is solved through principal component analysis, the excircle radius of each pixel distance is calculated, and then error correction is carried out according to errors, angles and the excircle radiuses. According to the technical scheme, errors caused by a multi-path effect can be reduced, so that more accurate map reconstruction can be carried out.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of femtosecond time error correction, and in particular to a femtosecond time multipath error correction device and method. Background Art

[0002] With the rapid development of smart home technology, sweeping robots, as important equipment for home automated cleaning, are increasingly attracting consumers' attention for their performance and intelligence. Among them, Simultaneous Localization and Mapping (SLAM) technology is the core of sweeping robots to achieve autonomous navigation, planning of cleaning paths, and intelligent obstacle avoidance. SLAM technology uses sensors (such as lidar, cameras, etc.) on the robot to perceive the surrounding environment in real time, and build an environmental map based on it, while achieving accurate positioning of the robot in the map.

[0003] In SLAM technology, femtosecond technology (Time-of-flight, Tof) sensors are widely used in the depth perception system of sweeping robots because they can directly measure the distance of objects with high accuracy and real-time performance. However, Tof sensors face the multipath effect in practical applications.

[0004] The multipath effect mainly occurs when light is reflected or refracted multiple times in a complex environment (such as room corners, furniture edges, etc.), causing the light signal path received by the Tof sensor to be much longer than the actual straight-line distance. In particular, when the light path passes through an area where the angle between two planes is less than 90 degrees, the depth information calculated by the sensor deviates seriously from the true value due to the multiple reflections of the light within the angle, thereby introducing cumulative errors in the map reconstruction process. This error gradually accumulates as the sweeping robot traverses the room, eventually causing the constructed indoor map to be deformed, misaligned, and other errors, seriously affecting the robot's navigation accuracy and cleaning efficiency. Summary of the invention

[0005] The purpose of the present invention is to provide a femtosecond time multipath error correction device and method, which can reduce the error caused by the multipath effect so as to perform more accurate map reconstruction.

[0006] To achieve the above-mentioned purpose, in the first aspect, an embodiment of the present disclosure provides a femtosecond time multipath error correction method, comprising: by scanning the pixel plane and calculating the depth distance on the pixel, using the projection relationship between the optical path and the pixel plane, calculating the error of each pixel point, and recording the error and the corresponding angle; by scanning the pixel plane and taking the three-dimensional coordinate points, using principal component analysis to find the angle between the two planes, calculating the radius of the circumscribed circle of each pixel distance, and then performing error correction based on the error, angle and radius of the circumscribed circle.

[0007] Beneficial effects of the basic scheme: This technical scheme calculates the depth distance and its corresponding error at each pixel point, and combines the complex projection relationship between the optical path and the pixel plane. This method can accurately identify and quantify the errors caused by the multipath effect, obtain the three-dimensional coordinates of each pixel point, and accurately measure the depth information of each point on the object surface, which is convenient for subsequent error correction and three-dimensional reconstruction. At the same time, PCA analysis is performed using three-dimensional coordinate points to find the normal vector of the object surface, and then calculate the geometric features of the object surface and the angle between the two planes, confirm the geometric relationship between the two planes, and provide a more reliable basis for the calculation of the radius of the circumscribed circle and error correction. PCA also simplifies the calculation process and enhances the adaptability of the method to different scenes and object shapes.

[0008] This technical solution not only takes errors and angles into consideration, but also introduces the radius of the circumscribed circle of each pixel distance as a correction parameter, which can more accurately reflect the changing characteristics of the multipath effect at different positions and angles, thereby achieving more accurate error correction.

[0009] This technical solution can optimize the depth map for more accurate map reconstruction in indoor environments. This method can reduce the error caused by multipath effects and improve the map reconstruction accuracy of devices such as sweeping robots. It can also be widely used in machine vision, autonomous driving, robot navigation, drone mapping, industrial inspection and other fields.

[0010] As an implementable preferred solution, the depth distance calculation formula is:

[0011] in, is the depth distance, is the speed of light, is the modulation period.

[0012] As an implementable preferred solution, the pixel error calculation formula is:

[0013] in, is the error for each pixel, is the depth distance, and are the lengths of the light on different reflection paths.

[0014] As an implementable preferred solution, four different phase delays are used to modulate the emitted light, and these phase values ​​constitute a complete cycle of the sine wave. The signals corresponding to these four phases are expressed as:

[0015] in, is the phase difference, is the signal corresponding to 0° or 0 radians, 90° or The signal corresponding to radians, 180° or The signal corresponding to the radian, 270° or The signal corresponding to the radian As an implementable preferred solution, when obtaining the depth distance of each pixel, the average distance value of left-right symmetrical pixel points is taken.

[0016] As an implementable preferred solution, the angle between two planes is obtained by principal component analysis, including the following contents: The expressions for the two planes are as follows: ; Using the angle bisector formula, we can find the normal vector ; The equation of the plane containing the acute angle is .

[0017] As an implementable preferred solution, the angle plane equation is used to calculate the distance between the two planes and find the straight line distance D; using the triangle relationship, is the included angle, and the straight-line distance D is the hypotenuse, and the radius r of the circumscribed circle is calculated.

[0018] As an implementable preferred solution, using the recorded error ,angle , the radius of the circumscribed circle , error correction is performed, including the following: Using the calibration parameters Depth distance To compensate, the formula is as follows:

[0019] in, represents the distance between the two planes and the angle plane. is the depth distance after compensation.

[0020] In a second aspect, an embodiment of the present disclosure also provides a femtosecond time multipath error correction device, which utilizes the above-mentioned femtosecond time multipath error correction method.

[0021] As an implementable preferred solution, the correction device is a cylinder, and the Tof module is placed on the side of the cylinder. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a schematic diagram of the correction device structure.

[0023] Figure 2 Schematic diagram of the 90° optical path.

[0024] Figure 3 Schematic diagram of the optical path from 0 to 90°.

[0025] Figure 4 Schematic diagram of the relationship between the optical path and the camera projection plane.

[0026] Figure 5 Schematic diagram of PCA and Multipath.

[0027] Figure 6 It is a schematic diagram of the circumscribed circle of the angle between two planes. DETAILED DESCRIPTION

[0028] In order to make the technical solution and advantages of the present application clearer, the technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings. It will be understood that the specific embodiments described herein are only partial embodiments of the present invention, which are only used to explain the present application, rather than to limit the present application. It should be noted that the technical features or combinations of technical features described in the following embodiments should not be considered isolated, and they can be combined with each other to achieve better technical effects. The same reference numerals appearing in the drawings of the following embodiments represent the same features or components, which can be applied to different embodiments.

[0029] In addition, unless otherwise defined, the technical terms or scientific terms used in the description of the present invention should have the common meanings understood by those skilled in the art in the art to which the present invention belongs.

[0030] The present invention is further described in detail below in conjunction with the accompanying drawings: iTOF (Indirect Time-of-Flight) is a depth perception technology that indirectly calculates distance by measuring the phase change of light waves. Unlike dTOF (Direct Time-of-Flight) technology that directly measures the time of flight, iTOF technology does not require precise measurement of the emission and return time of light pulses, but calculates distance by modulating the light source and measuring the phase delay.

[0031] In the iTOF system, a light source (such as an LED or laser) is usually used to emit a high-frequency modulated continuous light wave (such as a sine wave), and the phase of the light wave changes over time. When the light wave hits an object and reflects back, it is received by a photosensitive element (such as a COMS sensor). Due to the phase change of the light wave, there will be a phase difference between the phase of the reflected light wave and the phase of the emitted light wave.

[0032] To improve the accuracy and robustness of the measurement, four different phase delays are used to modulate the emitted light, represented by: 0° or radian; 90° or radian; 180° or radian; 270° or radian.

[0033] These phase values ​​make up one complete cycle (360°) of the sine wave, allowing the system to capture enough information in one cycle to calculate distance.

[0034] These phase values ​​are used to modulate the emitted light waves, and each phase value corresponds to a specific point in time. When the light wave is reflected from the object, the phase of the reflected light wave will be different from the phase of the emitted light wave due to the flight time of the light wave. By measuring the phase difference, the angle of each pixel is obtained. And calculate the depth distance , depth distance The calculation formula is as follows:

[0035] in, is the speed of light, is the modulation period.

[0036] The depth distance is indirectly calculated with 4 phase delays, where 0°, 90°, 180°, and 270° are the four phases. The signals corresponding to these four phases can be expressed as:

[0037] in, is the phase difference (the value range is 0 to ), 0° or The signal corresponding to the radian, 90° or The signal corresponding to radians, 180° or The signal corresponding to the radian, 270° or The signal corresponding to radians.

[0038] Reference Figure 1The correction device is a cylinder, and the ToF module is placed on the side of the cylinder. The ToF module can shoot at a specific angle and direction to simulate the optical fiber reflection path at different angles. By measuring the optical path and angle relationship at different angles, the true depth distance is calculated for error correction.

[0039] During installation, the horizontal field of view (HFOV) of the ToF module needs to be adjusted to be the same as the field of view of the cylinder, so as to achieve the maximum semicircular shooting screen within the limited pixels to improve the utilization of the screen and the richness of information. In the vertical direction, the ToF module needs to adjust its vertical field of view (VFOV) to cover the entire screen, that is, to achieve a full screen, so as to capture the entire content from the top to the bottom of the cylinder and capture complete scene information. Since the ToF module uses laser as an active light source, the intensity of the laser can be adjusted to optimize the shooting effect and avoid overexposure and loss of details, thereby maintaining the clarity and accuracy of the entire picture. The central area is usually the brightest part of the picture, so adjust the laser intensity to ensure that the center pixel is not overexposed.

[0040] Reference Figure 2 and Figure 3 , analyzing the reflection path of light at different angles, the relationship between the line segment and the angle is as follows:

[0041]

[0042]

[0043]

[0044]

[0045]

[0046] in, is the error for each pixel, is the depth distance, and are the lengths of the light on different reflection paths, is the radius of the correction device.

[0047] Reference Figure 4 , scan the pixel plane and take the depth distance of each pixel. Since the left and right pixels are symmetrical, take the average distance value to reduce the error.

[0048] Find the error of each pixel , record the error of each pixel and the corresponding angle , while recording the radius of the calibration device Since the cross section of the correction device is symmetrical, only 0-90 degrees and the direction from O to point B need to be calculated.

[0049] Scan the pixel plane and obtain the three-dimensional coordinate points (x, y, z) on the pixels.

[0050] Reference Figure 5 and Figure 6 , the measuring point is tangent to the two sides of the calibration device to form two planes, and the angle α formed by the two planes is calculated using principal component analysis (PCA). Figure 5 The blue line in the middle is the PCA result, the orange line is the multipath problem, and the green circle is the circumscribed circle. The process includes the following: PCA is applied to find the two planes, which helps to confirm the geometric relationship between the two planes. The expression is as follows: .

[0051] Using the angle bisector formula, we can find the normal vector .

[0052] The equation of the plane containing the acute angle is .

[0053] The two planes formed by the measuring point and the calibration device continue to extend to have infinite circumscribed circles.

[0054] Use the angle plane equation to calculate the distance between the two planes (you can use the point-to-plane distance formula) and find the straight-line distance D.

[0055] Using the triangle relationship, is the included angle, and the straight-line distance D is the hypotenuse, and the radius r of the circumscribed circle is calculated.

[0056] Using recorded errors ,angle , the radius of the circumscribed circle , error correction is performed, including the following: Using the calibration parameters Depth distance To compensate, the formula is as follows:

[0057] in, Represents the distance between the two planes and the angle plane.

[0058] Repeat the calibration process at least 2 times, calibrating the left plane and the right plane in sequence.

[0059] The embodiment of the present disclosure also provides a storage medium, in which a computer program is stored. When the computer program is executed by a processor, all steps of the above-mentioned femtosecond time multipath error correction method can be implemented.

[0060] A person of ordinary skill in the art can understand that the implementation of all or part of the process in a femtosecond time multipath error correction method can be completed by instructing related hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the process of each embodiment of a femtosecond time multipath error correction method. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0061] The above contents are only embodiments of the present invention. The common sense such as the known specific structures and characteristics in the scheme is not described in detail here. The ordinary technicians in the relevant field know all the common technical knowledge in the technical field to which the invention belongs before the application date or the priority date, can obtain all the existing technologies in the field, and have the ability to apply the conventional experimental means before that date. The ordinary technicians in the relevant field can improve and implement this scheme in combination with their own abilities under the enlightenment given by this application. Some typical known structures or known methods should not become obstacles for the ordinary technicians in the relevant field to implement this application. It should be pointed out that for the technicians in this field, without departing from the structure of the present invention, several deformations and improvements can be made, which should also be regarded as the protection scope of the present invention, which will not affect the effect of the implementation of the present invention and the practicality of the patent. The protection scope required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to explain the content of the claims.

Claims

1. A femtosecond time multipath error correction method, characterized in that: include: By scanning the pixel plane and calculating the depth distance on the pixel, the error of each pixel point is calculated using the projection relationship between the optical path and the pixel plane, and the error and the corresponding angle are recorded; by scanning the pixel plane and taking the three-dimensional coordinate points, the angle between the two planes is calculated using principal component analysis, the radius of the circumscribed circle of each pixel distance is calculated, and then the error correction is performed based on the error, angle and radius of the circumscribed circle.

2. A femtosecond time multipath error correction method according to claim 1, characterized in that: The depth distance calculation formula is: in, is the depth distance, is the speed of light, is the modulation period.

3. A femtosecond time multipath error correction method according to claim 2, characterized in that: The pixel error calculation formula is: in, is the error for each pixel, is the depth distance, and are the lengths of the light on different reflection paths.

4. A femtosecond time multipath error correction method according to claim 2 or 3, characterized in that: The emitted light is modulated using four different phase delays, which constitute one complete cycle of the sine wave. The signals corresponding to these four phases are expressed as: in, is the phase difference, is the signal corresponding to 0° or 0 radians, 90° or The signal corresponding to radians, 180° or The signal corresponding to the radian, 270° or The signal corresponding to radians.

5. The femtosecond time multipath error correction method according to claim 1, characterized in that: When obtaining the depth distance of each pixel, take the average distance value of the left and right symmetrical pixels.

6. A femtosecond time multipath error correction method according to claim 1 or 5, characterized in that: The angle between two planes is obtained by principal component analysis, including the following: The expressions for the two planes are as follows: ; Using the angle bisector formula, we can find the normal vector ; The equation of the plane containing the acute angle is .

7. A femtosecond time multipath error correction method according to claim 6, characterized in that: Use the angle plane equation to calculate the distance between the two planes and find the straight line distance D; use the triangle relationship to is the included angle, and the straight-line distance D is the hypotenuse, and the radius r of the circumscribed circle is calculated.

8. A femtosecond time multipath error correction method according to claim 7, characterized in that: Using recorded errors ,angle , the radius of the circumscribed circle , error correction is performed, including the following: Using the calibration parameters Depth distance To compensate, the formula is as follows: in, represents the distance between the two planes and the angle plane. is the depth distance after compensation.

9. A femtosecond time multipath error correction device, characterized in that: A femtosecond time multipath error correction method as described in claims 1-8 is used.

10. The femtosecond time multipath error correction device according to claim 9, characterized in that: The calibration device is a cylinder, and the Tof module is placed on the side of the cylinder.