Depth imaging module and electronic device
By dividing it into short-range and long-range emission modules in the depth imaging module, using structured light and TOF algorithms, the problem of difficulty in detecting deep black, low-reverse, and small target objects in the existing technology is solved, and the 3D SLAM is realized Support and navigation performance improvements.
Patent Information
- Application Number
- CN202411124627.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-11-29
AI Technical Summary
Existing depth imaging modules are difficult to detect deep black, low-reverse, and small target objects, and single-line scanning lidar can only realize 2D-SLAM, which cannot meet the needs of more and more terminals for 3D-SLAM.
By dividing the emission module into a first luminous region and a second luminous region, the first luminous region is used to project random speckle at a close distance, the receiving module calculates the depth image of the target object through a structured light algorithm, and the second luminous region is used for long distance Random or regular speckle is projected, and the receiving module calculates the depth image of the target object through the TOF algorithm, realizing high-precision recognition and long-distance ranging for deep black, low-reverse, and small target objects.
It realizes close-range high-precision recognition and long-distance ranging for deep black, low-reverse, and small target objects, meets the needs of 3D SLAM and improves imaging quality and navigation performance.
Smart Images

Figure CN119044998A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of camera technology, and in particular to a depth imaging module and an electronic device. Background Art
[0002] The existing depth imaging modules used in sweepers are generally based on the iToF solution, which uses surface light source illumination to achieve close-range obstacle avoidance applications (even energy distribution can achieve high resolution to meet obstacle avoidance requirements, but the detection distance will decrease), and uses single-line scanning lidar to achieve the navigation function of the sweeper. However, single-line scanning lidar can only achieve 2D-SLAM (simultaneous localization and mapping). Faced with the current increasing demand for terminal intelligence, sweepers have an increasingly strong demand for 3D-SLAM.
[0003] Currently, the two emission modules, SPOT-TOF and Flood-TOF, are generally used in combination to meet different detection needs at long and short distances, but they cannot detect dark, low-reflective, and small target objects. Summary of the invention
[0004] In view of the above, it is necessary to propose a depth imaging module and an electronic device for detecting dark, low-reflective, and small target objects.
[0005] A first aspect of an embodiment of the present application provides a depth imaging module, including: a transmitting module, including a first light-emitting area and a second light-emitting area, the first light-emitting area is used to project random speckles toward a target object at a close distance, and the second light-emitting area is arranged on one side of the first light-emitting area, and is used to project random speckles or regular speckles toward a target object at a long distance; a receiving module is arranged on one side of the transmitting module, the receiving module receives the reflected light signal emitted by the first light-emitting area and calculates the depth image of the target object at a close distance through a structured light algorithm, and receives the reflected light signal emitted by the second light-emitting area and calculates the depth image of the target object at a long distance through a TOF algorithm.
[0006] In the technical solution provided in the embodiment of the present application, the transmitting module is divided into a first light-emitting area and a second light-emitting area. The first light-emitting area projects random speckles toward a target object at a close distance. The receiving module receives the reflected random speckles and calculates the depth image of the target object through a structured light algorithm, thereby realizing high-precision identification of dark, low-reflective and small target objects at close range, thereby realizing close-range obstacle avoidance. The second light-emitting area projects random speckles or regular speckles toward a target object at a long distance. The receiving module receives the reflected random speckles or regular speckles and calculates the depth image of the target object through a TOF algorithm. Long-distance ranging can be realized, meeting the requirements of 3D SLAM, thereby realizing long-distance navigation.
[0007] In a possible implementation, the first light-emitting area and the second light-emitting area are distributed in a vertical direction, the first light-emitting area is located above the second light-emitting area, and a projection area of the first light-emitting area is located below the second light-emitting area.
[0008] In the solution provided in the embodiment of the present application, by setting the light-emitting areas at different heights, it is possible to achieve illumination of different areas of the target object, wherein the first light-emitting area is responsible for the close-range area, and the second light-emitting area is responsible for the long-range area; since the first light-emitting area is located above the second light-emitting area, and its projection area is located below the second light-emitting area, this configuration can accurately control the distribution and pattern of the speckle, optimize the speckle pattern, reduce occlusion and overlap, and help improve the imaging quality, especially when it is necessary to distinguish areas of different depths in complex scenes, thereby improving the utilization efficiency of the speckle.
[0009] In a possible embodiment, the transmitting module includes a transmitter and a diffraction element, the transmitter includes the first light-emitting area and the second light-emitting area, the diffraction element is arranged in the optical path of the transmitter, the light emitted by the first light-emitting area forms a first projection area, the first projection area is divided by a reference plane into a first sub-projection area located below the reference plane and a second sub-projection area located above the reference plane, the inclination angle formed by the first sub-projection area and the reference plane ranges from 0° to a°, where 20≤a≤40, a is a rational number, and the reference plane is a plane determined by the boundary line of the first light-emitting area and the second light-emitting area which are parallel to each other and the midline of the diffraction element.
[0010] In the solution provided by the embodiment of the present application, the tilt angle range from 0° to a° allows light to illuminate the target at different angles, thereby more comprehensively covering different parts of the target object. The tilted light helps to capture subtle changes in the surface of the target object, especially when the surface of the target object has an inclined or irregular shape. Direct light (0°) may produce shadows on certain surfaces, and increasing the tilt angle can reduce this effect and provide more uniform lighting. Since the first light-emitting area projects random speckles toward the target object, within this angle range, the structured light algorithm can be used to calculate the depth, thereby achieving high-precision recognition of dark, low-reflective, and small target objects at close range to avoid obstacles at close range.
[0011] In a possible embodiment, the light emitted by the second light-emitting area forms a second projection area, and the second projection area is divided by the reference plane into a third sub-projection area located above the reference plane and a fourth sub-projection area located below the reference plane, and the inclination angle formed by the third sub-projection area and the reference plane ranges from 0° to b°, where 20≤b≤40, b is a rational number, and the light emitted by the first light-emitting area is in an opposite inclination direction to the light emitted by the second light-emitting area.
[0012] In the solution provided by the embodiment of the present application, the light of the two light-emitting areas is tilted in opposite directions, providing complementary viewing angles of the target object and helping to capture the features of the target object from different directions. The light emitted by the second light-emitting area covers a full range of tilt angles from 0° to 40°, ensuring comprehensive field of view coverage of the target object. By adjusting the value of b, the angle of the emitted light can be flexibly adjusted according to the specific characteristics of the target object and the imaging environment. In addition, when the second light-emitting area projects a regular speckle toward the target object, the energy is concentrated on the speckle, which can achieve long-distance ranging, meet the needs of 3D SLAM, and thus achieve long-distance navigation.
[0013] In a possible implementation manner, an emission angle of the first light-emitting area and an emission angle of the second light-emitting area partially overlap.
[0014] In the solution provided in the embodiment of the present application, overlapping emission angles can ensure that the same area of the target object is illuminated by light from multiple angles, which helps to capture information on the surface of the target object from different directions and enhance feature recognition. In the process of 3D surface reconstruction, overlapping emission angles help to better understand and reconstruct complex surface structures. In addition, when light at one angle is blocked, light at another angle in the overlapping area can continue to provide information about the target object, reduce the impact of shadows on imaging, and prevent angle deviations when the module is installed on equipment such as a sweeper.
[0015] In a possible implementation manner, an emission angle of an overlapping portion of the first light-emitting area and the second light-emitting area ranges from 15° to 30°.
[0016] In the solution provided in the embodiment of the present application, a smaller overlap angle (15° to 30°) helps capture subtle changes in the surface of the target object, because the light in the overlapping area provides a nearly orthogonal viewing angle, enhancing the recognition of surface features. Overlapping emission angles can provide denser measurement points, thereby improving resolution during 3D reconstruction. By precisely controlling the overlap range of the emission angles of the two light-emitting areas, the performance of imaging and measurement can be improved while maintaining the flexibility of the system.
[0017] In a possible implementation, the transmitting module further includes a third light emitting area, which is disposed between the first light emitting area and the second light emitting area and is used to emit a calibration speckle to achieve AA calibration of the transmitting module.
[0018] In the solution provided in the embodiment of the present application, the third light-emitting area is used to evaluate and determine the effect of speckle in imaging or measurement. By comparing the speckle in an ideal state emitted by the third light-emitting area with the speckle in an actual state of emission, the AA calibration of the emission module can be performed to ensure the overall performance of the system.
[0019] In a possible embodiment, the first light-emitting area includes n first sub-light-emitting areas arranged in a direction perpendicular to the optical axis, where n is a positive integer greater than or equal to 2, and the number of random speckles projected by the first sub-light-emitting areas gradually decreases from the first sub-light-emitting areas far away from the optical axis to the first sub-light-emitting areas close to the optical axis.
[0020] In the solution provided in the embodiment of the present application, by densely distributing the speckles of the first sub-light-emitting area away from the optical axis, high-precision recognition of dark, low-reflective, and small target objects at a close distance can be performed, thereby optimizing the imaging effect.
[0021] In a possible implementation, the receiving module is electrically connected to the transmitting module, and the receiving module controls the first light-emitting area and the second light-emitting area to emit light simultaneously or concurrently.
[0022] In the solution provided in the embodiment of the present application, the receiving module controls the first light-emitting area and the second light-emitting area to emit light in sequence, or controls the first light-emitting area and the second light-emitting area to emit light at the same time. The working state of each light-emitting area can be flexibly configured according to the characteristics of the target object or environmental conditions to optimize the imaging effect.
[0023] A second aspect of an embodiment of the present application further provides an electronic device, comprising a main body and a depth imaging module as described in any one of the above, wherein the depth imaging module is arranged on the main body.
[0024] In the solution provided by the embodiment of the present application, by dividing the transmitting module into a first light-emitting area and a second light-emitting area, the first light-emitting area can emit random speckles toward the target object at a close distance, and the receiving module can receive the reflected random speckles and calculate the depth image of the target object through a structured light algorithm, so as to identify dark, low-reflective and small target objects at a close distance with high precision, thereby realizing close-range obstacle avoidance, and the second light-emitting area can emit random speckles or regular speckles toward the target object at a long distance, and the receiving module receives the reflected random speckles or regular speckles and calculates the depth image of the target object through a TOF algorithm, so as to realize long-distance ranging, meet the requirements of 3DSLAM, and thus realize long-distance navigation. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.
[0026] Figure 1 It is a structural schematic diagram of the depth imaging module provided in an embodiment of the present application.
[0027] Figure 2 yes Figure 1 A structural schematic diagram of the emission angle distribution of the emission module in the depth imaging module shown.
[0028] Figure 3 yes Figure 2 A schematic diagram of the structure of the transmitter in the transmitting module is shown.
[0029] Figure 4 yes Figure 3 A schematic diagram of the optical emission effect when the first light-emitting area in the emitter is lit alone is shown.
[0030] Figure 5 yes Figure 3 Schematic diagram of the optical emission effect when the second light-emitting area in the emitter is lit separately.
[0031] Figure 6 yes Figure 3 Schematic diagram of ideal optical emission effect when the third light-emitting area in the emitter is lit separately.
[0032] Figure 7 yes Figure 3 The diagram shows the actual effect of optical emission when the third light-emitting area in the emitter is lit separately.
[0033] Figure 8 It is a schematic diagram of the structure of the first light-emitting area provided in an embodiment of the present application.
[0034] Fig. 9 It is a schematic diagram of the three-dimensional structure of the electronic device provided in an embodiment of the present application.
[0035] Main component symbols
[0036] Depth Imaging Module 100
[0037] Transmitter module 10
[0038] First light emitting area 101
[0039] The first sub-light emitting area 1011
[0040] The second light emitting area 102
[0041] The third light emitting area 103
[0042] Transmitter 11
[0043] The first light source 111
[0044] The second light source 112
[0045] The third light source 113
[0046] Diffractive element 12
[0047] Receiving module 20
[0048] Main body 200
[0049] Electronic device 1000 DETAILED DESCRIPTION
[0050] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.
[0051] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may also be a centered element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may also be a centered element. When an element is considered to be "set on" another element, it may be directly set on the other element or there may also be a centered element. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only.
[0052] In the embodiments of the present application, the terms "first", "second", and "third" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.
[0053] The data range values recorded in the embodiments of the present application shall include the end values unless otherwise specified. The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include, for example, "one or more". This form of expression, unless there is a clear contrary indication in its context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more than two. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are a kind of "or" relationship.
[0054] Moreover, references to "one embodiment" or "some embodiments" etc. described in this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in other embodiments", "in some other embodiments", etc. that appear in different places in this application do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0055] Some embodiments of the present application are described in detail. In the absence of conflict, the following embodiments and features of the embodiments can be combined with each other.
[0056] See also Figure 1 In a first aspect, an embodiment of the present application provides a depth imaging module 100 for high-precision identification of dark, low-reflective, and small target objects. The depth imaging module 100 includes a transmitting module 10 and a receiving module 20.
[0057] See also Figure 2 and Figure 3The transmitting module 10 includes a first light-emitting area 101 and a second light-emitting area 102. The first light-emitting area 101 is used to project random speckles toward a target object at a close distance, wherein random speckles refer to randomly distributed spots formed on an image due to interference, scattering or other optical effects of light waves during optical imaging. These spots usually appear as areas of varying light and dark without a fixed pattern or regularity. The second light-emitting area 102 is disposed on one side of the first light-emitting area 101, and is used to project random speckles or regular speckles toward a target object at a long distance, wherein regular speckles refer to spots with a certain regularity or periodicity formed in optical imaging. Although these spots still retain some basic characteristics of speckles, their distribution presents a predictable regularity. The receiving module 20 is disposed on one side of the transmitting module 10, and is used to receive and process light signals reflected by the target object to obtain a depth image of the target object. Specifically, the receiving module 20 receives the light signal emitted by the reflected first light-emitting area 101 and calculates the depth image of the target object through the structured light algorithm, thereby detecting the target object at a close distance. The receiving module 20 receives the light signal emitted by the reflected second light-emitting area 102 and calculates the depth image of the target object through the TOF algorithm, thereby detecting the target object at a long distance.
[0058] In the solution provided by the embodiment of the present application, the transmitting module 10 is divided into a first light-emitting area 101 and a second light-emitting area 102. The first light-emitting area 101 projects random speckles toward a target object at a close distance. The receiving module 20 receives the reflected random speckles and calculates the depth image of the target object through a structured light algorithm, thereby identifying dark, low-reflective, and small target objects at a close distance with high precision, thereby achieving close-range obstacle avoidance. The second light-emitting area 102 projects random speckles or regular speckles toward a target object at a long distance. The receiving module 20 receives the reflected random speckles or regular speckles and calculates the depth image of the target object through a TOF algorithm. Long-distance ranging can be achieved, meeting the requirements of 3D SLAM, thereby achieving long-distance navigation.
[0059] It should be noted that the short distance and the long distance may be at an interval, for example, the first light-emitting area 101 projects a random speckle distance interval of 0m-3m, and the second light-emitting area 102 projects a random speckle or a regular speckle distance interval of 4m-7m; the short distance and the long distance may also be partially overlapping, for example, the first light-emitting area 101 projects a random speckle distance interval of 0m-3m, and the second light-emitting area 102 projects a random speckle or a regular speckle distance interval of 2m-7m.
[0060] The receiving module 20 can receive the random speckles projected by the reflected first light-emitting area 101, and the random speckles or regular speckles projected by the second light-emitting area 102. For example, the total field of view of the speckles emitted by the transmitting module 10 is 110*58, and the field of view received by the receiving module 20 is 120*90. The receiving field of view of the receiving module 20 is greater than the transmitting field of view of the transmitting module 10, and the receiving module 20 can receive all the speckles projected by the reflected transmitting module 10.
[0061] In this embodiment, the second light emitting area 102 projects regular speckles toward the target object.
[0062] It is understood that in other embodiments, the second light emitting area 102 projects random speckles toward the target object, so as to provide a more consistent angular resolution at a long distance.
[0063] It can be understood that the principle of structured light is to project a pattern with a special structure (such as stripes, dots, etc.) onto the surface of the target object, and then use the receiving module 20 to capture the deformation of the reflected pattern, and calculate the three-dimensional shape and depth information of the object based on the distortion of the pattern. The principle of TOF is to calculate the distance by emitting continuous or pulsed light waves (usually infrared light) and measuring the time required for these light waves to reflect back.
[0064] In a possible implementation, the first light-emitting area 101 and the second light-emitting area 102 are distributed in a vertical direction, the first light-emitting area 101 is located above the second light-emitting area 102 , and the projection area of the first light-emitting area 101 is located below the second light-emitting area 102 .
[0065] In the solution provided in the embodiment of the present application, by setting the light-emitting areas at different heights, it is possible to achieve illumination of different areas of the target object, wherein the first light-emitting area 101 is responsible for the close-range area, and the second light-emitting area 102 is responsible for the long-range area; since the first light-emitting area 101 is located above the second light-emitting area 102, and its projection area is located below the second light-emitting area 102, this configuration can accurately control the distribution and pattern of speckles, optimize the speckle pattern, reduce occlusion and overlap, and help improve the imaging quality, especially when it is necessary to distinguish areas of different depths in complex scenes, thereby improving the utilization efficiency of the speckles.
[0066] In a possible embodiment, the transmitting module 10 includes a transmitter 11 and a diffraction element 12, the transmitter 11 includes a first light source 111 and a second light source 112, the first light source 111 corresponds to the first light-emitting area 101, the second light source 112 corresponds to the second light-emitting area 102, and the diffraction element 12 is arranged in the optical path of the transmitter 11.
[0067] The first light source 111 and the second light source 112 may be light sources such as light emitting diodes (LEDs), edge emitting lasers (EELs), vertical cavity surface emitting lasers (VCSELs), etc., and the light beams emitted by the light sources may be visible light, infrared light, ultraviolet light, etc. The first light source 111 may emit a plurality of first light beams, and the distribution of the plurality of first light beams is the same as the random speckle projected by the first light emitting area 101. The second light source 112 may emit a plurality of second light beams, and the distribution of the plurality of second light beams is the same as the random speckle or regular speckle projected by the second light emitting area 102.
[0068] In some embodiments, the diffraction element 12 is made of micro-nano technology, and the function of the diffraction optical element is to perform spatial light modulation on each incident light beam, that is, to split and replicate each light beam to form a speckle pattern of multiple speckle light spots. Among them, each speckle light spot can make at least one sensor pixel sensitive, and the interval between the speckle light spots is greater than one pixel, and the emission angle of each speckle light spot is less than 1°. Since the smaller the emission angle, the more concentrated the signal intensity, setting it to the above-mentioned emission angle range can make the detection distance farther and better avoid the multipath problem. The arrangement of multiple speckle light spots can be disordered or regular, such as an equilateral triangle or parallel intervals, alternating staggered settings, and no matter what the arrangement method is, it should satisfy that there is a clear interval between points.
[0069] In some embodiments, the diffraction element 12 is a superlens, which can shape the light beam, change the propagation direction and wavefront shape of the light beam, and thus form a speckle pattern.
[0070] In some embodiments, the emitter 11 further includes a collimator, which is disposed between the emitter 11 and the diffraction element 12. The collimator may be composed of one lens or another number of lenses, such as three.
[0071] See also Figure 4 , the first light-emitting area 101 in the transmitter 11 is lit, and the second light-emitting area 102 is turned off. At this time, the light emitted by the first light-emitting area 101 forms a first projection area S. The first projection area S is divided by the reference plane P into a first sub-projection area S1 located below the reference plane P and a second sub-projection area S2 located above the reference plane P. The inclination angle formed by the first sub-projection area S1 and the reference plane P ranges from 0° to a°, wherein the value range of a is 20-40, and the reference plane P is a plane determined by the boundary line O1 of the first light-emitting area 101 and the second light-emitting area 102 which are parallel to each other and the center line O2 of the diffraction element 12. The value of a can be 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40. Figure 4, the maximum inclination angle formed by the first sub-projection area S1 and the reference plane P is 29°.
[0072] In the solution provided by the embodiment of the present application, the tilt angle range from 0° to a° allows light to illuminate the target at different angles, thereby more comprehensively covering different parts of the target object. The tilted light helps to capture subtle changes on the surface of the target object, especially when the surface of the target object has an inclined or irregular shape. Direct light (0°) may produce shadows on certain surfaces, and increasing the tilt angle can reduce this effect and provide more uniform lighting. Since the first light-emitting area 101 projects random speckles toward the target object, within this angle range, a structured light algorithm can be used to calculate the depth, thereby achieving close-range high-precision recognition of dark, low-reflective, and small target objects to avoid obstacles at close range.
[0073] See also Figure 5 , the second light-emitting area 102 in the emitter 11 is lit, and the first light-emitting area 101 is turned off. At this time, the light emitted by the second light-emitting area 102 forms a second projection area L, and the second projection area L is divided by the reference plane P into a third sub-projection area L1 located above the reference plane P and a fourth sub-projection area L2 located below the reference plane P. The value range of the inclination angle formed by the third sub-projection area L1 and the reference plane p is 0°~b°, where 20≤b≤40, b is a rational number, and the inclination direction of the light emitted by the first light-emitting area 101 is opposite to that of the light emitted by the second light-emitting area 102. In this embodiment, the light emitted by the first light-emitting area 101 is tilted downward relative to the reference plane p, and the light emitted by the second light-emitting area 102 is tilted upward relative to the reference plane p. The value of b can be 20, 21, 22, 23, 24, 25, 26, 27, 28, 28.8, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40. Figure 5 In the figure, the maximum inclination angle formed by the emitted light of the second light emitting area 102 and the reference plane P is 28.8°.
[0074] In the solution provided in the embodiment of the present application, the light inclination directions of the two light-emitting areas are opposite, providing complementary viewing angles of the target object, which helps to capture the characteristics of the target object from different directions. The emitted light of the second light-emitting area 102 covers a full range of tilt angles from 0° to 40°, ensuring comprehensive field of view coverage of the target object. By adjusting the value of b, the angle of the emitted light can be flexibly adjusted according to the specific characteristics of the target object and the imaging environment. In addition, when the second light-emitting area 102 projects regular speckles toward the target object, the energy is concentrated on the speckles, which can achieve long-distance ranging, meet the needs of 3D SLAM, and thus achieve long-distance navigation.
[0075] In a possible implementation, the emission angle of the first light-emitting area 101 and the emission angle of the second light-emitting area 102 partially overlap.
[0076] In the solution provided in the embodiment of the present application, overlapping emission angles can ensure that the same area of the target object is illuminated by light from multiple angles, which helps to capture information on the surface of the target object from different directions and enhance feature recognition. In the process of 3D surface reconstruction, overlapping emission angles help to better understand and reconstruct complex surface structures. In addition, when light at one angle is blocked, light at another angle in the overlapping area can continue to provide information about the target object, reduce the impact of shadows on imaging, and prevent angle deviations when the module is installed on equipment such as a sweeper.
[0077] In a possible implementation, the emission angle of the overlapping portion of the first light-emitting area 101 and the second light-emitting area 102 ranges from 15° to 30°. The emission angle of the overlapping portion corresponding to the first light-emitting area 101 can range from 7.5° to 15°, and the emission angle of the overlapping portion corresponding to the second light-emitting area 102 can range from 7.5° to 15°. Figure 4 and Figure 5 It can be seen that the emission angle of the overlapping part of the first light-emitting area 101 and the second light-emitting area 102 is 23.7°. Specifically, the emission angle of the overlapping part corresponding to the first light-emitting area 101 can range to 12°, and the emission angle of the overlapping part corresponding to the second light-emitting area 102 can range to 11.7°.
[0078] In the solution provided by the embodiment of the present application, a smaller overlap angle (15° to 30°) helps to capture subtle changes in the surface of the target object, because the light in the overlapping area provides a nearly orthogonal viewing angle, which enhances the recognition of surface features. Overlapping emission angles can provide denser measurement points, thereby improving resolution during 3D reconstruction. By precisely controlling the overlap range of the emission angles of the two light-emitting areas, the performance of imaging and measurement can be improved while maintaining the flexibility of the system.
[0079] In a possible implementation, the transmitting module 10 further includes a third light emitting area 103 , which is disposed between the first light emitting area 101 and the second light emitting area 102 and is configured to emit a calibration speckle to implement AA calibration of the transmitting module 10 .
[0080] See also Figure 6 and Figure 7 , Figure 6 is a schematic diagram of an ideal optical emission effect when the third light-emitting area 103 in the emitter 11 is lit alone. Figure 7 It is a schematic diagram of the actual effect of optical emission when the third light-emitting area 103 in the emitter 11 is lit alone.
[0081] In the solution provided in the embodiment of the present application, the third light-emitting area 103 is used to evaluate and determine the effect of speckle in imaging or measurement. By comparing the speckle in an ideal state emitted by the third light-emitting area 103 with the speckle in an actual state of emission, the AA calibration of the transmitting module 10 can be performed to ensure the overall performance of the system.
[0082] It should be noted that AA calibration, namely Active Alignment technology, is an advanced process for achieving high-precision alignment during the assembly of optical modules. AA process technology monitors the position and posture of optical components in real time and uses a precise motion control system to make active adjustments to ensure that key components such as lenses and sensors achieve the best relative position and angle, thereby significantly improving the imaging quality and overall performance of the module.
[0083] It can be understood that when the transmitting module 10 includes the third light-emitting area 103 , the center line O1 of the transmitter 11 is the center dividing line of the third light-emitting area 103 .
[0084] In a possible implementation, the transmitter 11 further includes a third light source 113, which may be a light source such as a light emitting diode (LED), an edge emitting laser (EEL), or a vertical cavity surface emitting laser (VCSEL), and the light beam emitted by the light source may be visible light, infrared light, ultraviolet light, etc. The third light source 113 may emit a plurality of third light beams, and the distribution of the plurality of third light beams is the same as the distribution of the random speckles projected by the third light emitting area 103.
[0085] See also Figure 8 In a possible implementation, the first light-emitting area 101 includes n first sub-light-emitting areas 1011 arranged in a direction perpendicular to the optical axis, where n is greater than or equal to 2, and the number of random speckles gradually decreases from the first sub-light-emitting area 1011 away from the optical axis to the first sub-light-emitting area 1011 close to the optical axis. In this embodiment, the value of n is 3, from Figure 8 It can be seen that the number of random speckles in the bottom first sub-light-emitting area 1011 is the largest, and the number of random speckles in the bottom first sub-light-emitting area 1011 is the smallest. It can be understood that in other embodiments, the value of n can also be 2 or 4, but is not limited thereto, as long as the number of random speckles gradually decreases from the first sub-light-emitting area 1011 away from the optical axis to the first sub-light-emitting area 1011 close to the optical axis.
[0086] In the solution provided in the embodiment of the present application, by making the speckle of the first sub-light-emitting area 1011 far away from the optical axis densely distributed, high-precision recognition can be performed on dark, low-reflective, and small target objects that are relatively close, thereby optimizing the imaging effect.
[0087] In a possible implementation, the second light-emitting region 102 includes m second sub-light-emitting regions arranged along a direction perpendicular to the optical axis, where m is greater than or equal to 2, and the speckles in the m second sub-light-emitting regions may be evenly distributed or randomly distributed.
[0088] In a possible implementation, the receiving module 20 is electrically connected to the transmitting module 10 , and the receiving module 20 controls the first light-emitting area 101 and the second light-emitting area 102 to emit light in a time-sharing manner or simultaneously.
[0089] In the solution provided in the embodiment of the present application, the receiving module 20 is used to control the first light-emitting area 101 and the second light-emitting area 102 to emit light in a timed sequence, or to control the first light-emitting area 101 and the second light-emitting area 102 to emit light at the same time. The working state of each light-emitting area can be flexibly configured according to the characteristics of the target object or environmental conditions to optimize the imaging effect.
[0090] In a possible implementation, the receiving module 20 includes a lens, a lens holder, and a photosensitive element. The photosensitive element is disposed in the lens holder, and the lens is disposed in the lens holder and is arranged opposite to the photosensitive element.
[0091] Specifically, the lens includes at least one lens. The photosensitive element is an image sensor having at least one array pixel unit for receiving light reflected by the target object. It can be understood that in some embodiments, a filter can be further provided in the lens holder between the lens and the photosensitive element, and the filter is used to filter stray light.
[0092] See also Fig. 9 The second aspect of the embodiment of the present application further provides an electronic device 1000, including a main body 200 and a depth imaging module 100 as described above, wherein the depth imaging module 100 is disposed on the main body 200. The electronic device 1000 may be a sweeping robot, a mobile phone, or a depth camera, but is not limited thereto. In this embodiment, the electronic device 1000 is a sweeping robot.
[0093] In the solution provided in the embodiment of the present application, by dividing the transmitting module 10 into a first light-emitting area 101 and a second light-emitting area 102, the first light-emitting area 101 can emit random speckles toward a target object at a close distance, and the receiving module 20 can receive the reflected random speckles and calculate the depth image of the target object through a structured light algorithm, thereby realizing high-precision identification of dark, low-reflective, and small target objects at a close distance, thereby realizing close-range obstacle avoidance, and the second light-emitting area 102 can emit random speckles or regular speckles toward a target object at a long distance, thereby realizing long-distance ranging, meeting the requirements of 3D SLAM, and realizing long-distance navigation.
[0094] It is obvious to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential features of the present invention. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present invention is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention. Any figure mark in the claims should not be regarded as limiting the claim involved. In addition, it is obvious that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural.
[0095] Finally, it should be noted that the above implementation modes are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred implementation modes, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention.
Claims
1. A depth imaging module, characterized in that: include: The transmitting module comprises a first light-emitting area and a second light-emitting area, wherein the first light-emitting area is used to project random speckles toward a target object at a short distance, and the second light-emitting area is arranged at one side of the first light-emitting area and is used to project random speckles or regular speckles toward a target object at a long distance; A receiving module is arranged on one side of the transmitting module, and the receiving module receives the light signal emitted by the reflected first light-emitting area and calculates the depth image of the target object at a close distance through a structured light algorithm, and receives the light signal emitted by the reflected second light-emitting area and calculates the depth image of the target object at a long distance through a TOF algorithm.
2. The depth imaging module according to claim 1, characterized in that: The first light-emitting area and the second light-emitting area are distributed along a vertical direction, the first light-emitting area is located above the second light-emitting area, and a projection area of the first light-emitting area is located below the second light-emitting area.
3. The depth imaging module according to claim 1, wherein: The transmitting module includes a transmitter and a diffraction element, the transmitter includes the first light-emitting area and the second light-emitting area, the diffraction element is arranged in the optical path of the transmitter, the light emitted by the first light-emitting area forms a first projection area, the first projection area is divided by a reference plane into a first sub-projection area located below the reference plane and a second sub-projection area located above the reference plane, the inclination angle formed by the first sub-projection area and the reference plane ranges from 0° to a°, wherein 20≤a≤40, a is a rational number, and the reference plane is a plane determined by the boundary line of the first light-emitting area and the second light-emitting area which are parallel to each other and the midline of the diffraction element.
4. The depth imaging module according to claim 3, characterized in that: The light emitted by the second light-emitting area forms a second projection area, and the second projection area is divided by the reference plane into a third sub-projection area located above the reference plane and a fourth sub-projection area located below the reference plane. The inclination angle formed by the third sub-projection area and the reference plane ranges from 0° to b°, where 20≤b≤40, b is a rational number, and the light emitted from the first light-emitting area is in an opposite inclination direction to the light emitted from the second light-emitting area.
5. The depth imaging module according to claim 1, wherein: The emission angle of the first light emitting area and the emission angle of the second light emitting area partially overlap.
6. The depth imaging module according to claim 5, characterized in that: The emission angle of the overlapping portion of the first light-emitting area and the second light-emitting area ranges from 15° to 30°.
7. The depth imaging module according to claim 1, characterized in that: The transmitting module further includes a third light emitting area, which is disposed between the first light emitting area and the second light emitting area and is used to emit a calibration speckle to achieve AA calibration of the transmitting module.
8. The depth imaging module according to claim 1, wherein: The first light-emitting area includes n first sub-light-emitting areas arranged in a direction perpendicular to the optical axis, where n is a positive integer greater than or equal to 2, and the number of random speckles projected by the first sub-light-emitting areas gradually decreases from the first sub-light-emitting areas far away from the optical axis to the first sub-light-emitting areas close to the optical axis.
9. The depth imaging module according to claim 1, wherein: The receiving module is electrically connected to the transmitting module, and the receiving module controls the first light-emitting area and the second light-emitting area to emit light synchronously or simultaneously.
10. An electronic device, characterized in that: It comprises a main body and a depth imaging module as described in any one of claims 1 to 9, wherein the depth imaging module is arranged on the main body.
