Adjust the projection system of the distance sensor to optimize the beam layout
By projecting multiple beams spread out in a fan shape from each projection point in the distance sensor, and adjusting the positional relationship between the projection point and the image capturing device, optimizing the projection pattern, the problem of difficult to minimize the overlap of projection artifact trajectory is solved. , realizes the effect of efficient distance calculation and cost reduction.
Patent Information
- Application Number
- CN201880068473.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-10-03
- Filing Date
- 2018-10-18
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2039-05-25
AI Technical Summary
When the number of projected beams of existing distance sensors increases, it is difficult to minimize the overlap of projected artifact trajectories, resulting in complexity of distance calculations, and it is difficult to balance the need to maintain spatial coverage with the need to reduce the number of projected points.
By projecting the center beam from each projection point into a fan-shaped multiple beams, adjusting the positional relationship between the projection point and the image capturing device, optimizing the projection pattern to minimize overlap of projection artifact trajectories, and rotating the projection pattern latitude and longitude lines are used to adjust the shape of the projection pattern to suit the shape of the object surface.
It is achieved to minimize projection artifact trajectory overlap while maintaining spatial coverage, simplify distance calculations, and reduce manufacturing costs and sensor failure risks.
Smart Images

Figure CN111512180B_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to U.S. Provisional Patent Application Serial No. 62 / 575,505 filed on October 22, 2017, which is incorporated herein by reference in its entirety. This application is also a continuation-in-part of U.S. Patent Application Serial No. 16 / 150,918 filed on October 3, 2018, which is incorporated herein by reference in its entirety. Background Art
[0003] U.S. Patent Application Serial Nos. 14 / 920,246, 15 / 149,323, and 15 / 149,429 describe various configurations of distance sensors. Such distance sensors may be useful in a variety of applications including security, gaming, control of unmanned vehicles, and other applications.
[0004] The distance sensors described in these applications include: a projection system (e.g., including a laser, a diffractive optical element, and / or other cooperating components) that projects a light beam into a field of view. The light beam spreads out to create a pattern (a pattern of dots, a pattern of dashes, or a pattern of other artifacts). When the pattern is incident on an object in the field of view, the distance from the sensor to the object can be calculated based on the appearance of the pattern in one or more field of view images (e.g., the positional relationship of the dots, dashes, or other artifacts), which can be captured by the sensor's light receiving system (e.g., a lens, an image capture device, and / or other components). The shape and size of the object can also be determined. Summary of the invention
[0005] In an example, a method includes: projecting a projection pattern from a projection point of a distance sensor onto a surface of an object, wherein the projection pattern is created by a plurality of light beams projected from the projection point, wherein the plurality of light beams create a plurality of projection artifacts arranged on the surface of the object, wherein a layout of the plurality of projection artifacts depends on a positional relationship between the projection point and an image capture device of the distance sensor, and wherein prior to the projection, at least one parameter defining the positional relationship between the projection point and the image capture device of the distance sensor has been optimized to minimize overlap of a plurality of tracks associated with the plurality of projection artifacts; capturing an image of the object including at least a portion of the adjusted projection pattern; and using information from the image to calculate a distance from the distance sensor to the object.
[0006] In another example, a non-transitory machine-readable storage medium is encoded with instructions executable by a processor. When executed, the instructions cause the processor to perform the following operations, including: projecting a projection pattern from a projection point of a distance sensor onto a surface of an object, wherein the projection pattern is created by a plurality of light beams projected from the projection point, wherein the plurality of light beams create a plurality of projection artifacts arranged on the surface of the object, wherein the layout of the plurality of projection artifacts depends on a positional relationship between the projection point and an image capture device of the distance sensor, and wherein prior to projection, at least one parameter defining the positional relationship between the projection point and the image capture device of the distance sensor has been optimized to minimize overlap of a plurality of tracks associated with the plurality of projection artifacts; capturing an image of the object including at least a portion of the adjusted projection pattern; and using information from the image to calculate a distance from the distance sensor to the object.
[0007] In another example, an apparatus includes: an image capture device positioned to capture an image of a field of view; and a projection point positioned outside a periphery of a lens of the image capture device, the projection point configured to project multiple projection light beams into the field of view, wherein at least one parameter defining a positional relationship between the image capture device and the projection point is adjusted to minimize overlap of multiple trajectories associated with multiple projection artifacts created by the multiple projection light beams. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] Figure 1 is a schematic diagram illustrating elements of a distance sensor;
[0009] Figure 2 illustrates trajectories for a plurality of points that are part of an example pattern projected by projection points of a range sensor;
[0010] FIG3A illustrates a side view of one example of an arrangement of light beams projected from a projection point;
[0011] FIG3B illustrates a front view of a projection pattern created by the arrangement of light beams of FIG3A ;
[0012] Figure 3C illustrates simplified isometric views of the projection patterns illustrated in FIGS. 3A and 3B ;
[0013] Figure 3D illustrates the overall shape of the projection pattern of FIGS. 3A-3C in a hemispherical field of view;
[0014] FIG4A illustrates a side view of one example of an arrangement of light beams projected from a projection point;
[0015] FIG4B illustrates a front view of a projection pattern 402 created by the arrangement of light beams of FIG4A ;
[0016] Figure 4C illustrates a front view of the trajectory of the projection artifacts of FIGS. 4A and 4B when the patterns of FIGS. 4A and 4B are projected onto a flat surface;
[0017] FIG5A illustrates a side view of one example of an arrangement of light beams projected from a projection point;
[0018] Figure 5B illustrates a front view of a projection pattern created by the arrangement of light beams of FIG. 5A ;
[0019] FIG5C illustrates a side view of the projection pattern of FIGS. 5A and 5B projected onto a flat surface;
[0020] FIG5D illustrates a front view of the projection pattern of FIGS. 5A and 5B projected onto a flat surface;
[0021] Figure 5E illustrates a front view of the trajectory of the projection artifacts of FIGS. 5A-5D when the patterns of FIGS. 5A-5D are projected onto a flat surface;
[0022] Fig. 5F illustrates the overall shape of the projection pattern of FIGS. 5A-5E in a hemispherical field of view;
[0023] FIG6A illustrates a side view of one example of an arrangement of light beams projected from a projection point;
[0024] Figure 6B illustrates a front view of a projection pattern created by the arrangement of light beams of FIG. 6A ;
[0025] FIG6C illustrates a side view of the projection pattern of FIGS. 6A and 6B projected onto a flat surface;
[0026] FIG6D illustrates a front view of the projection pattern of FIGS. 6A and 6B projected onto a flat surface;
[0027] Fig. 6E illustrates a front view of the trajectory of the projection artifacts of FIGS. 6A-6D when the patterns of FIGS. 6A-6D are projected onto a flat surface;
[0028] Figure 7 illustrates an example projection beam alignment of the present disclosure;
[0029] Figure 8 A flow chart illustrating an example method for calculating a distance from a sensor to an object;
[0030] 9A is a schematic diagram illustrating a side view of an element of a distance sensor having a projection point whose position is adjusted to optimize the projection pattern;
[0031] Fig. 9Bis a schematic diagram illustrating a top view of elements of the distance sensor of FIG. 9A ;
[0032] Fig. 10A a side view illustrating a positional relationship between an example projection point and an example image capture device of a range sensor;
[0033] Fig. 10B Further illustration Fig. 10A Components of distance sensors;
[0034] Fig. 10C The diagram shows how the center of the projected pattern is adjusted. Fig. 10A The effect of the angle between the optical axes of the image capture device on the trajectory of the projection points;
[0035] Fig. 10D The diagram shows how the center of the projected pattern is adjusted. Fig. 10A The effect of the angle between the optical axes of the image capture device on the trajectory of the projection points;
[0036] FIG11A illustrates a side view of components of an example configuration of a sensor having a projection point whose position is adjusted to optimize a projection pattern;
[0037] Fig. 11B illustrates a top view of the sensor assembly illustrated in FIG. 11A ;
[0038] Figures 11C-11G is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 11A and 11B ;
[0039] FIG12A illustrates a side view of components of an example configuration of a sensor having a projected point whose position is adjusted to optimize a projected pattern;
[0040] Fig. 12B illustrates a top view of the sensor assembly illustrated in FIG. 12A ;
[0041] Figures 12C-12G is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 12A and 12B ;
[0042] FIG13A illustrates a side view of components of an example configuration of a sensor having a projected point whose position is adjusted to optimize a projected pattern;
[0043] Fig. 13B illustrates a top view of the sensor assembly illustrated in FIG. 13A ;
[0044] Figures 13C-13G is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 13A and 13B ;
[0045] FIG14A illustrates a side view of components of an example configuration of a sensor having a projection point whose position is adjusted to optimize a projection pattern;
[0046] Fig. 14B illustrates a top view of the sensor assembly illustrated in FIG. 14A ;
[0047] Figures 14C-14G is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 14A and 14B ;
[0048] FIG15A illustrates a side view of components of an example configuration of a sensor having a projected point whose position is adjusted to optimize a projected pattern;
[0049] Fig. 15B illustrates a top view of the sensor assembly illustrated in FIG. 15A ;
[0050] Figures 15C-15E is a graph plotting the trajectories of projected points emitted by the range sensors 15A and 15B;
[0051] FIG16A illustrates a side view of components of an example configuration of a sensor having a projected point whose position is adjusted to optimize a projected pattern;
[0052] Fig. 16B illustrates a top view of the sensor assembly illustrated in FIG. 16A ;
[0053] Figures 16C-16E is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 16A and 16B ;
[0054] FIG17A illustrates a side view of components of an example configuration of a sensor having a projected point whose position is adjusted to optimize the projected pattern;
[0055] Fig. 17B illustrates a top view of the sensor assembly illustrated in FIG. 17A ;
[0056] Fig. 17C is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 17A and 17B ;
[0057] FIG18A illustrates a side view of components of an example configuration of a sensor having a projection point whose position is adjusted to optimize a projection pattern;
[0058] Fig.18B illustrates a top view of the sensor assembly illustrated in FIG. 18A ;
[0059] Fig.18C is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 18A and 18B ;
[0060] FIG19A illustrates a side view of components of an example configuration of a sensor having a projection point whose position is adjusted to optimize the projection pattern;
[0061] Fig.19B illustrates a top view of the sensor assembly illustrated in FIG. 19A ;
[0062] Fig.19C is a graph plotting the loci of projected points emitted by the range sensor of FIGS. 19A and 19B ;
[0063] Fig. 20 A flow chart illustrating an example method for calculating a distance from a sensor to an object; and
[0064] Fig.21 Depicted is a high-level block diagram of an example electronic device for calculating the distance from a sensor to an object. DETAILED DESCRIPTION
[0065] The present disclosure broadly describes an apparatus, method, and non-transitory computer-readable medium for adjusting a projection system of a distance sensor to optimize a beam layout for spherical triangulation calculations. As discussed above, a distance sensor such as those described in U.S. Patent Application Serial Nos. 14 / 920,246, 15 / 149,323, and 15 / 149,429 determines the distance to an object (and, possibly, the shape and size of the object) by projecting a beam that spreads out in a field of view including the object to create a pattern (e.g., a pattern of dots, a pattern of long dashes, or a pattern of other artifacts). In some examples, the sensor includes multiple "projection points," where multiple beams can be projected from each projection point. Multiple beams can fan out to form a portion of a pattern. The appearance of the pattern may vary with the distance to the object. For example, if the pattern includes a pattern of dots, the dots may appear closer to each other when the object is closer to the sensor, and the dots may appear farther away from each other when the object is farther away from the sensor.
[0066] For example, Figure 1 is a schematic diagram illustrating elements of a distance sensor similar to the sensors described in U.S. Patent Application Serial Nos. 14 / 920,246, 15 / 149,323, and 15 / 149,429. As shown, the sensor may include a lens 100 of an image capture device. The field of view of the lens 100 may be represented by f. The sensor may also include a plurality of projection points (e.g., formed by a combination of light sources, diffractive optical elements, and / or other components) arranged around the perimeter of the lens 100; Figure 1One such projection point 102 is illustrated, where other projection points may be similarly configured and placed at different locations around the lens 100. The distance d from the central axis of the lens 100 to the central axis of the projection point 102 may also be referred to as the "baseline" of the sensor.
[0067] Multiple beams 1041-104 of projection light from projection point 102 n (hereinafter individually or collectively referred to as "beams 104"), these beams fan out and form a pattern 106 of projected artifacts (e.g., dots, dashes, etc.) when the beams 104 are incident on a surface. The plane of the pattern 106 may be parallel to the baseline d of the sensor. Figure 1 In the example shown in , the projection artifacts are points. Figure 1 The pattern 106 is illustrated when it appears at a first distance D1 from the base line d and also when it appears at a second distance D2 from the base line d.
[0068] All light beams 104 projected from the same projection point 102 will move in the same direction along the baseline d according to the object distance as described above. However, as the number of light beams 104 projected from the same projection point 102 increases, the trajectories (i.e., movement ranges) of the artifacts (e.g., dots) generated by the light beams 104 may appear to be closer together, and may even overlap in some cases.
[0069] The trajectory of the projection artifact is determined by the positional relationship between the projection optical system (e.g., an optical device group, including a light source, a diffractive optical element, and other components that project a light beam) of the distance sensor and the light receiving optical system (e.g., a lens, an image capture device, and other components that capture an image of the projection artifact) in a plane (e.g., a lateral) direction and a height direction (e.g., a direction perpendicular to the lateral direction). The trajectory of the projection artifact can appear as a radial pattern or line, and describes the movement of the projection artifact as the distance between the sensor and the object into which the projection pattern is projected changes. More specifically, the trajectory of the projection artifact describes the movement of the projection artifact relative to the image capture device of the distance sensor as the distance changes.
[0070] For example, Figure 2 The trajectory 200 for a plurality of points is shown, these points being projected points of a range sensor (e.g., such as Figure 1 102). Unshaded points represent locations of points at a first distance from the sensor baseline, while shaded points represent locations of points at a second distance from the sensor baseline. A line or track 200 connecting the unshaded points to the shaded points represents that the unshaded points and the shaded points are the same point, depicted at different distances from the sensor baseline. Figure 2As shown in , some of the points' trajectories 200 may overlap. Overlapping trajectories 200 are shown by circles 202. When overlapping of trajectories 200 occurs, it may be difficult to determine which beams projected from the projection points correspond to which points in the projection pattern. This, in turn, may complicate distance measurement calculations, since accurate calculations may rely on the ability to identify the beams that created the points visible in the image.
[0071] Thus, an increase in the number of beams projected from the projection points of the distance sensor may increase the likelihood that there will be overlap in the trajectories of the projection artifacts created by the beams (and thus increase the difficulty of the distance calculation). On the other hand, a large number of beams is generally considered advantageous because it provides better spatial coverage of the sensor field of view for distance calculation purposes. As an additional consideration, it may be desirable to keep the number of projection points to a minimum in order to minimize manufacturing costs, sensor size, and sensor failure due to component damage. However, in order to maintain spatial coverage with fewer projection points, it may be necessary to project a larger number of beams from the projection points.
[0072] Examples of the present disclosure provide a beam arrangement for a distance sensor that minimizes overlap of projection artifact trajectories as the number of beams projected from a sensor projection point increases. In particular, examples of the present disclosure provide a pattern with a distribution of projection artifacts that balances the need for spatial coverage with the need to minimize overlap of projection artifact trajectories. Examples of the disclosed patterns can be implemented by projecting from each projection point multiple beams that fan out symmetrically (at least in the x and y directions) from a central beam.
[0073] As discussed above, the trajectory of the projection artifacts can appear as radial patterns or lines. Examples of the present disclosure take into account the fact that both the projection artifact trajectory and the line of the projection pattern including multiple projection artifacts may appear to be linear. As such, the positional relationship between the projection artifact and the image capture device of the distance sensor, the direction of the central projection artifact, or the rotational phase of the projection pattern created by the multiple projection artifacts can be adjusted to minimize the overlap in the trajectories of the multiple projection artifacts that form the projection pattern. Additional examples of the present disclosure take into account the fact that when the plane forming the projection pattern is curved, the angle formed by the projection artifact trajectory and the line of the projection pattern can gradually change, which makes the uniform elimination of trajectory overlap over the entire projection pattern more challenging.
[0074] An example of the present disclosure provides a distance sensor, wherein the positional relationship between the projection optical system and the light receiving optical system of the distance sensor is adjusted in at least one of a plane (e.g., lateral) direction and a height direction (e.g., a direction perpendicular to the lateral direction). For example, each projection point can be adjusted to adjust the position of the projection point, and thereby also adjust the positional relationship between the projection point and the light receiving optical system. The adjustment of the positional relationship allows the projection pattern to be optimized in a manner that minimizes the overlap of the projection point trajectories.
[0075] In the context of the present disclosure, "adjusting" the projection point refers to adjustments made in the factory to the positional relationship between the projection point and the image capture device. For example, the adjustments can be made by calculating and selecting appropriate sizes and positions for the components of the distance sensor prior to assembly. The components can also be "pre-adjusted" during the assembly process of the distance sensor. However, any discussion of "adjusting" the projection point or its position is not meant to imply that the projection point is adjustable after assembly (e.g., in the field).
[0076] Other examples of the present disclosure describe projection patterns having a generally rectangular shape (i.e., a pattern created by a plurality of projection artifacts), wherein the projection artifacts are arranged in multiple rows and columns. In this context, the projection artifact located at the center of the projection pattern can be considered to be the "origin" of the projection pattern. The rows intersecting the origin can be referred to as the "latitude" lines of the projection pattern, and the columns intersecting the origin can be referred to as the "longitude" lines of the projection pattern. In one example, the projection angle of one or more light beams from the projection point can be adjusted so that one or more of the latitude and longitude lines of the projection pattern are rotated by a predetermined angle to achieve an adjusted projection pattern that minimizes the overlap of the projection artifact trajectories.
[0077] Fig. 3A illustrates a side view of one example of an arrangement of light beams projected from a projection point 300, while Fig. 3B illustrates a front view of a projection pattern 302 created by the arrangement of light beams of Fig. 3 A. In the examples of Figs. 3A and 3B, the arrangement of light beams is projected onto a spherical surface 304, i.e., a surface having a circular (non-flat) shape.
[0078] As shown, the projection point 300 projects a plurality of light beams 3061-306 m (hereinafter individually referred to as "beams 306" or collectively referred to as "beams 306"). The plurality of beams 306 include a central beam 306 i The remaining beams 306 extend from the central beam 306 in two directions along the x-axis and in two directions along the y-axis. i In order to simplify the drawing, the first beam 3061 and the center beam 306 are not shown in FIG. 3A. i between, and resides in the center beam 306i With the last beam 306 m The light beam 306 between them.
[0079] The composite pattern 302 created by the plurality of beams 306 includes a plurality of projected artifacts (e.g., dots) arranged in a rectangular grid, as shown in FIG. 3B . The rows of the grid extend along the x-axis of the illustrated coordinate system, while the columns of the grid extend along the y-axis. The projected artifacts 302 are ... projected artifacts 302 are arranged in a rectangular grid, as shown in FIG. 3B . The rows of the grid extend along the i The rows and columns are arranged at position angles corresponding to the x-axis and the y-axis.
[0080] The projection artifacts may be arranged in a staggered pattern (e.g., where each row or column is offset from an adjacent row or column such that all projection artifacts along a row or column may not be co-linear) or in a continuous pattern (e.g., where each row or column is aligned with an adjacent row or column such that all projection artifacts along a row or column are co-linear). Regardless of whether the pattern of projection artifacts is staggered or continuous, the pattern is regular (i.e., the placement of projection artifacts is regular rather than random), which can be seen from the projection artifacts generated by the central beam 306. i The created center projection artifact 308 extends outward. The center projection artifact 308 is located at the intersection of a “longitude line” 310 (or center column) and a “latitude line” 312 (or center row), and can be considered the “origin” of the pattern 302.
[0081] In one example, when pattern 302 is projected onto spherical surface 304, longitude lines 310 may be rotated about the y-axis by a first predetermined angle. Alternatively or additionally, latitude lines 312 may be rotated about the x-axis by a second predetermined angle. This is shown in FIG. 3B , where the shape of pattern 302 is curved to conform to the circular shape of spherical surface 304.
[0082] Since the spherical surface 304 onto which the central projection artifact 308, the rotated longitude lines 310, and / or the rotated latitude lines 312 are projected is always a plane, each row or column of the pattern 302 will include a plane passing through the central projection artifact 308. Figure 3C As shown in ( Figure 3C 3A and 3B illustrate a simplified isometric view of the projection pattern 302 illustrated in FIG. 3A and FIG. 3B ), each line of the projection artifact projected onto the plane of the spherical surface 304 will become a straight line.
[0083] exist Figure 3CIn the example illustrated in , the surface formed by the projection point 300 and the latitude lines of the pattern 302 is conical (with the projection point 300 as the top or narrow end of the cone), while the surface formed by the projection point 300 and the longitude lines of the pattern 302 is a flat or flat surface. This is why the grid lines formed by the projection points become curved. The grid lines arranged on the longitude lines are straight lines, and the rectangular shapes (the angles formed by the lines) are uniform with respect to the difference in three-dimensional position. In one example, according to the example projection pattern 302, the distance from the distance sensor to the object corresponds to the radius of the spherical surface 304 centered on the principal point of the lens of the distance sensor. The sensor can be positioned at the center of multiple projection points including the projection point 300, and the principal point can be the front node of the sensor lens.
[0084] Figure 3D The overall shape of the projection pattern 302 of FIGS. 3A-3C in a hemispherical field of view is illustrated. More specifically, Figure 3D The grid lines of the projection pattern are oriented relative to the projection point 300. As shown, the projection pattern 302 can be adjusted by rotating one or more of the latitude lines 326 and the longitude lines 328 by predetermined angles η and θ, respectively. η and θ can be equal or unequal, depending on the shape and application of the object onto which the projection pattern 302 is to be projected.
[0085] For example, the latitude line 326 can be shifted in the y-direction (ie, in a direction along the y-axis) to the new position 322. In one example, the shifting of the latitude line 326 to the new position 322 is achieved by rotating the latitude line 326 by an angle n.
[0086] Longitude line 328 may be shifted in the x-direction (ie, in a direction along the x-axis) to new location 324. In one example, shifting of longitude line 328 to new location 324 is accomplished by rotating longitude line 328 by angle θ.
[0087] Figure 3D Several example projection artifacts that may be created by this beam layout are illustrated. In addition to the central projection artifact 308 located at the intersection of the original positions of the latitude line 326 (for which n=0) and the longitude line 328 (for which θ=0), the following projection artifacts are shown: projection artifact 330, which is located at the coordinate (θ, n) from the central projection artifact 308 (e.g., shifted in both the x-direction and the y-direction) and represents the new position of the central projection artifact 308 in the adjusted pattern; projection artifact 332, which is located at the coordinate (θ, 0); and projection artifact 334, which is located at the coordinate (0, n).
[0088] 4A illustrates a side view of one example of an arrangement of light beams projected from a projection point 400, while FIG. 4B illustrates a front view of a projection pattern 402 created by the arrangement of light beams of FIG. 4A. In the examples of FIG. 4A and 4B, the arrangement of light beams is projected onto a flat surface 404.
[0089] As shown, the projection point 400 projects a plurality of light beams 4061-406 m (hereinafter individually referred to as "beams 406" or collectively referred to as "beams 406"). The plurality of beams 406 include a central beam 406 i The remaining beams 406 extend from the central beam 406 in two directions along the x-axis and in two directions along the y-axis. i In order to simplify the drawing, the first beam 4061 and the center beam 406 are not shown in FIG. 4A. i between, and resides in the center of the beam 406 i With the last beam 406 m The light beam 406 between them.
[0090] The composite pattern 402 created by the plurality of beams 406 includes a plurality of projected artifacts (e.g., dots) arranged in a rectangular grid, as shown in FIG. 4B . The rows of the grid extend along the x-axis of the illustrated coordinate system, while the columns of the grid extend along the y-axis. The projected artifacts 402 are ... i The rows and columns are arranged at position angles corresponding to the x-axis and the y-axis.
[0091] The projection artifacts may be arranged in a staggered pattern (e.g., where each row or column is offset from an adjacent row or column such that all projection artifacts along the row or column may not be co-linear) or in a continuous pattern (e.g., where each row or column is aligned with an adjacent row or column such that all projection artifacts along the row or column are co-linear). Regardless of whether the pattern of projection artifacts is staggered or continuous, the pattern is regular (i.e., the placement of the projection artifacts is regular rather than random) and may be obtained from the center beam 406. i The created center projection artifact 408 extends outward. The center projection artifact 408 is located at the intersection of the longitude line 410 and the latitude line 412, and can be considered the "origin" of the pattern 402.
[0092] Figure 4C 4A and 4B when the pattern 402 of FIGs. 4A and 4B is projected onto a flat surface 404. As shown, the tracks 414 do not overlap.
[0093] Figure 4CAlso shown is the position of lens 416 relative to projection point 400. As shown by baseline 418, projection point 400 is positioned a distance a from lens 416 in the radial or x-direction. However, in the y-direction, there is zero difference between the position of projection point 416 and the lens. In other words, lens 416 and projection point 400 can be mounted in the same plane, for example, so that projection point 400 is flush with the principal point of the image capture device (e.g., the front nodal point) of the lens in the direction of the optical axis of the image capture device.
[0094] FIG. 5A illustrates a side view of one example of an arrangement of light beams projected from a projection point 500, and FIG. Figure 5B Illustrated is a front view of a projection pattern 502 created by the arrangement of light beams of Figure 5 A. In the example of Figures 5A and 5B, the arrangement of light beams is projected onto a spherical surface 504, ie a surface having a rounded (non-flat) shape.
[0095] As shown, the projection point 500 projects a plurality of light beams 5061-506 m (hereinafter individually referred to as "beams 506" or collectively referred to as "beams 506"). The plurality of beams 506 include a central beam 506 i The remaining beams 506 are separated from the central beam 506 in two directions along the x-axis and in two directions along the y-axis. i In order to simplify the drawing, the first beam 5061 and the center beam 506 are not shown in FIG. 5A. i between, and resides in the center beam 506 i With the last beam 506 m The light beam 506 between them.
[0096] The composite pattern 502 created by the plurality of light beams 506 includes a plurality of projected artifacts (eg, dots) arranged in a rectangular grid, such as Figure 5B The rows of the grid extend along the x-axis of the illustrated coordinate system, while the columns of the grid extend along the y-axis. The grid is arranged at intervals according to a predefined rule (e.g., equal angular intervals, equal sine value intervals, etc.), from the central beam 506. i The rows and columns are arranged at position angles corresponding to the x-axis and the y-axis.
[0097] The projection artifacts may be arranged in a staggered pattern (e.g., where each row or column is offset from an adjacent row or column such that all projection artifacts along a row or column may not be co-linear) or in a continuous pattern (e.g., where each row or column is aligned with an adjacent row or column such that all projection artifacts along a row or column are co-linear). Regardless of whether the pattern of projection artifacts is staggered or continuous, the pattern is regular (i.e., the placement of projection artifacts is regular rather than random) and may be obtained from the center electron beam 506.i The created center projection artifact 508 extends outward. The center projection artifact 508 is located at the intersection of the longitude line 510 and the latitude line 512, and can be considered the "origin" of the pattern 502.
[0098] FIG. 5C illustrates a side view of the projected pattern 502 of FIGS. 5A and 5B projected onto a flat surface 516, while FIG. 5D illustrates a front view of the projected pattern 502 of FIGS. 5A and 5B projected onto a flat surface 516. As illustrated in FIG. 5C , unlike when the pattern 502 is projected onto the flat surface 516, the pattern 502 is curved. As described below in conjunction with Figure 5E As discussed, this may result in overlapping tracks of projection artifacts.This is in contrast to the example of Figures 5A and 5B, where the pattern 502 is projected onto a spherical surface 504 and maintains its generally rectangular grid shape.
[0099] Figure 5E 5A-5D when the pattern 502 of FIGs. 5A-5D is projected onto a flat surface 520. As shown, the trajectory 514 overlaps when projected onto the flat surface 520.
[0100] Figure 5E Also shown is the position of lens 516 relative to projection point 500. Projection point 500 is positioned a distance a from lens 516 in the radial or x-direction, as indicated by baseline 518. However, in the y-direction, there is zero difference between the position of projection point 500 and lens 516. In other words, lens 516 and projection point 500 may be mounted on the same plane, e.g., such that projection point 500 is flush with the principal point of the image capture device (e.g., the front nodal point) of the lens in the direction of the optical axis of the image capture device.
[0101] Fig. 5F The overall shape of the projection pattern 502 of Figures 5A-5E in a hemispherical field of view is illustrated. More specifically, Fig. 5F The grid lines of the projection pattern are oriented relative to the projection point 500. As shown, the projection pattern 502 can be adjusted by rotating one or more of the latitude lines 526 and the longitude lines 528 by predetermined angles η and θ, respectively. η and θ can be equal or unequal, depending on the shape and application of the object onto which the projection pattern 502 is to be projected.
[0102] For example, the latitude line 526 can be shifted in the y-direction (ie, in a direction along the y-axis) to the new position 522. In one example, the shifting of the latitude line 526 to the new position 522 is achieved by rotating the latitude line 526 by an angle n.
[0103] Longitude line 528 may be shifted in the x-direction (ie, in a direction along the x-axis) to new location 524. In one example, shifting of longitude line 528 to new location 524 is accomplished by rotating longitude line 528 by an angle θ.
[0104] Fig. 5F Several example projection artifacts that may be created by this beam layout are illustrated. In addition to the central projection artifact 508 located at the intersection of the original positions of the latitude line 526 (for which θ=0) and the longitude line 528 (for which η=0), the following projection artifacts are shown: projection artifact 530, which is located at coordinates (θ, η) from the central projection artifact 508 (e.g., shifted in both the x-direction and the y-direction) and represents the new position of the central projection artifact 508 in the adjusted pattern; projection artifact 532, which is located at coordinates (0, η); and projection artifact 534, which is located at coordinates (θ, 0).
[0105] FIG. 6A illustrates a side view of one example of an arrangement of light beams projected from a projection point 600, and FIG. Figure 6B Illustrated is a front view of a projection pattern 602 created by the arrangement of light beams of Figure 6 A. In the example of Figures 6A and 6B, the arrangement of light beams is projected onto a spherical surface 604, ie, a surface having a rounded (non-flat) shape.
[0106] As shown, the projection point 600 projects a plurality of light beams 6061-606 m (hereinafter individually referred to as "beams 606" or collectively referred to as "beams 606"). The plurality of beams 606 include a central beam 606 i The remaining beams 606 are separated from the central beam 606 in two directions along the x-axis and in two directions along the y-axis. i In order to simplify the drawing, the first beam 6061 and the center beam 606 are not shown in FIG. 6A. i between, and resides in the center of the beam 606 i With the last beam 606 m The light beam 606 between them.
[0107] The composite pattern 602 created by the plurality of light beams 606 includes a plurality of projected artifacts (eg, dots) arranged in a rectangular grid, such as Figure 6B The rows of the grid extend along the x-axis of the illustrated coordinate system, while the columns of the grid extend along the y-axis. The grid is arranged at intervals according to a predefined rule (e.g., equal angular intervals, equal sine value intervals, etc.), from the central beam 606. i The rows and columns are arranged at position angles corresponding to the x-axis and the y-axis.
[0108] The projection artifacts can be arranged in a staggered pattern (e.g., where each row or column is offset from an adjacent row or column such that all projection artifacts along the row or column may not be co-linear) or in a continuous pattern (e.g., where each row or column is aligned with an adjacent row or column such that all projection artifacts along the row or column are co-linear).
[0109] Whether the pattern of projection artifacts is staggered or continuous, the pattern is regular (i.e., the placement of the projection artifacts is regular rather than random) and can be seen from the center beam 606. i The created center projection artifact 608 extends outward. The center projection artifact 608 is located at the intersection of the longitude line 610 and the latitude line 612, and can be considered the "origin" of the pattern 602.
[0110] In one example, when pattern 602 is projected onto spherical surface 604 centered at central projection artifact 608, pattern 602 may take a shape similar to lines of longitude (e.g., meridians) and latitude (e.g., the equator) as viewed directly above the Earth's equator, as shown in FIG. Figure 6B as shown in .
[0111] FIG. 6C illustrates the image of FIG. 6A and FIG. 6B projected onto a flat surface. Figure 6B 6A and 6B is projected onto a flat surface, while FIG. 6D illustrates a front view of the projection pattern 602 of FIGS. 6A and 6B .
[0112] Fig. 6E Illustrated is a front view of the trajectory 620 of the projection artifacts of Figures 6A-6D when the pattern 602 of Figures 6A-6D is projected onto a flat surface 614. As illustrated, the trajectory 620 does not overlap.
[0113] Fig. 6E Also shown is the position of lens 616 relative to projection point 600. Projection point 600 is positioned a distance a from lens 616 in the radial or x-direction, as indicated by baseline 618. However, in the y-direction, there is zero difference between the position of projection point 600 and lens 616. In other words, lens 616 and projection point 600 may be mounted on the same plane, e.g., such that projection point 600 is flush with the principal point of the image capture device (e.g., the front nodal point) of the lens in the direction of the optical axis of the image capture device.
[0114] Figure 7 An example projection beam alignment of the present disclosure is illustrated. In particular, Figure 7 Various components of the distance sensor are illustrated, including the front nodal point 700 of the lens / image capture device, the first projection point 7021, and the second projection point 7022.
[0115] As illustrated, the front node 700 is positioned a lateral distance (e.g., along the x-axis) a from each of the first projection point 7021 and the second projection point 7022. The first projection point 7021 and the second projection point 7022 are positioned a distance b behind (e.g., along the z-axis) the front node 700. Additionally, an angle ω is defined between the first projection point 7021 and the second projection point 7022 (as well as between any other projection points that may be part of a distance sensor).
[0116] Taking the first projection point 7021 as an example, the first projection point 7021 projects a plurality of light beams, including the central light beam 704. Figure 7 Only the central beam 704 is illustrated in FIG. The central beam 704 creates a central projection artifact 706 of the projection pattern created by the multiple beams. Figure 7 Only the central projection artifact 706 is illustrated in FIG.
[0117] The orientation of the central beam 704 relative to the first projection point 7021 can be described by a plurality of angles. For example, an angle α can be defined between a plane 708 defined by the central beam 704 and a radial line 710 passing through a central axis 712 of the front node 700 and the first projection point 7021.
[0118] The roll axis ε shows how the central beam 706 can be rotated to adjust the position of the central projection artifact 706. The central beam can be rotated along the y-axis by an angle θ and / or along the x-axis by an angle η. In addition, an angle δ is defined between the central beam 706 and a line passing through the first projection point 7021 at an angle parallel to the central axis 712 of the front node 700.
[0119] Figure 8 9A and 9B illustrate an example method 800 for calculating the distance from a sensor to an object. In one embodiment, the distance may be calculated by a processor integrated into an imaging sensor (such as any imaging sensor such as a distance sensor) or as shown in FIG. Fig. 9B The method 800 is performed using a general purpose computing device as illustrated in FIG. 8 and discussed below.
[0120] Method 800 begins with step 802. In step 804, a projection pattern can be projected onto an object from a projection point of a range sensor. As discussed above, the projection pattern can be created by projecting a plurality of light beams from the projection point such that when the plurality of light beams are incident on the object, a pattern of projection artifacts (e.g., dots, dashes, x's, etc.) is visible at least by the imaging sensor. The pattern can include a rectangular grid into which the projection artifacts are arranged (e.g., arranged in a plurality of rows and a plurality of columns).
[0121] As also discussed above, a center projection artifact of the projection pattern is created at the intersection of a line of longitude (eg, center column) and a line of latitude (eg, center row) of the projection pattern.
[0122] In step 806, the angle at which at least one of the longitude lines and the latitude lines are projected may be rotated by a predefined amount to adjust the shape of the projection pattern, resulting in the adjusted projection pattern being projected onto the object. In one example, the shape of the projection pattern is adjusted to compensate for the shape of the object onto which the projection pattern is projected. For example, if the object has a spherical or circular surface, the projection pattern may appear distorted if not adjusted properly. Such distortion may cause the tracks of certain projection artifacts to overlap. In one example, the longitude lines may be rotated by a first predetermined angle from their original positions, and the latitude lines may be rotated by a second predetermined angle from their original positions. The first predetermined angle and the second predetermined angle may be equal or unequal.
[0123] At least one image of the object may be captured in step 808. At least a portion of the adjusted projection pattern may be visible on a surface of the object.
[0124] In step 810, the distance from the distance sensor to the object is calculated using information from the image(s) captured in step 808. In one embodiment, the distance is calculated using triangulation techniques. For example, the positional relationship between multiple projection artifacts that make up the projection pattern can be used as a basis for the calculation.
[0125] The method 800 ends at step 812. The method 800 may be repeated (in parallel or sequentially) for additional projection points of the range sensor.
[0126] It should be noted that, although not explicitly detailed, some blocks, functions, or operations of the above method 800 may include storage, display, and / or output for a particular application. In other words, any data, records, fields, and / or intermediate results discussed in the method 800 may be stored, displayed, and / or output to another device, depending on the particular application. In addition, Figure 8 The statement in the determination operation or the frame, function or operation involving the decision does not imply that both branches of the determination operation are practiced. In other words, depending on the result of the determination operation, one of the branches of the determination operation may not be implemented.
[0127] As described above, an example of the present disclosure provides a distance sensor, wherein the positional relationship between the projection optical system and the light receiving optical system of the distance sensor can be freely adjusted in at least one of a plane (e.g., a lateral) direction and a height direction (e.g., a direction perpendicular to the lateral direction).
[0128] For example, FIG. 9A is a schematic diagram illustrating a side view of elements of a distance sensor 900 having a projection point whose position is adjusted to optimize the projection pattern; Fig. 9B 9A is a schematic diagram illustrating a top view of elements of the distance sensor 900 of FIG. 9A. As illustrated, the sensor 900 may include a lens 902 of an image capture device. The sensor 900 may also include a plurality of projection points (e.g., formed by a combination of light sources, diffractive optical elements, and / or other components) arranged around the perimeter of the lens 902; FIGS. 9A and 9B illustrate one such projection point 904, where other projection points may be similarly configured and placed at different locations around the lens 902. The lateral distance L (e.g., in a direction perpendicular to the optical axis of the image capture device) from the front nodal point of the lens 902 to the central axis of the projection point 904 may also be referred to as the "baseline" of the sensor 900.
[0129] Projection point 904 projects multiple beams 9061-906 n (hereinafter individually referred to as "light beams 906" or collectively referred to as "light beams 906"), when light beams 906 are incident on a surface, they fan out and form a pattern of projected artifacts (e.g., dots, dashes, etc.), as discussed above. The direction of the center of the pattern can be perpendicular to the baseline L of the sensor 900, and the projected pattern can be symmetrical about the axis relative to the center of the projected pattern.
[0130] In one example, the projection point 904 can be adjusted to adjust the direction and / or angle at which the projection point 904 projects the plurality of light beams 906. Adjusting the projection point 904 in this manner also adjusts the positional relationship between the projection point 904 and the light receiving optical system (including the lens 902) of the sensor. In this case, the three-dimensional position of the projection point 904 can be determined by the length of the baseline L and also by the height difference b between the projection point 904 and the front node of the image capture device in the direction of the optical axis of the image capture device. In the examples illustrated in FIGS. 9A and 9B , b=0.
[0131] The direction of the center of the projected pattern relative to the optical axis of the image capture device can be determined by an angle θ in a radial direction relative to the optical axis, where θ indicates the angle between the projection beam that creates the center of the projected pattern and the optical axis of the image capture device. In addition, a rotation angle α can be defined around an axis parallel to the optical axis of the image capture device.
[0132] For example, Fig. 10A A side view of the positional relationship between an example projection point 1000 and an example image capture device 1002 of a range sensor is illustrated. Fig. 10B Further illustration Fig. 10AThe center of the projection pattern 1006 projected by the projection point 1000 onto the flat surface 1008 is denoted by reference numeral 1004 .
[0133] like Fig. 10A As shown, dimension "b" defines the difference between the height of the projection point 1000 and the height of the front node of the image capture device (where the height is defined in the direction of the optical axis of the image capture device). Dimension "a" defines the length of the baseline of the distance sensor. Examples of the present disclosure allow dimension b to be adjusted, which in turn adjusts the divergence angle of the trajectory 1012 of the projection points to minimize trajectory overlap. In this way, the inclination of the projection point trajectory 1012 and the line 1010 (e.g., row) of the projection points varies depending on the positional relationship between the projection pattern 1006 and the projection plane. However, when the line 1010 is formed as shown in FIG. Fig. 10B When line 1010 is made straight as shown in , adjustments to minimize track overlap may be made more easily than when line 1010 is made curved.
[0134] Other examples of the present disclosure also allow the angles θ and α to be adjusted relative to the spread of the projection beam projected from the projection point 1000 and the size of the distance sensor. Fig. 10C and Fig. 10D The diagram shows the adjustment of the center of the projection pattern 1004 and the Fig. 10A The influence of the angle θ between the optical axes of the image capture device 1002 on the trajectory of the projection point.
[0135] FIG. 11A illustrates a side view of components of an example configuration of a sensor 1100 having an adjustable projection point. Fig. 11B A top view of the sensor assembly illustrated in FIG. 11A is illustrated.
[0136] As shown in FIGS. 11A and 11B , the sensor 1100 includes: an image capture device 1102 including a lens; and a plurality of projection points 1104 1 - 1104 N (Hereinafter individually or collectively referred to as "projection points 1104"). In one example, sensor 1100 includes four projection points 1104 for each image capture device 1102, but may include more or fewer projection points in other examples.
[0137] The direction of the center of the projection pattern emitted by projection point 1104 (e.g., projection point 11041) relative to the optical axis 1106 of the image capture device 1102 can be determined by an angle θ in a radial direction relative to the optical axis 1106, where θ indicates the angle between the center projection light beam 1108 (i.e., the light beam that creates the center of the projection pattern) projected by projection point 1104 and the optical axis 1106 of the image capture device 1102. In the example illustrated in Figures 11A and 11B, the value of θ is forty degrees.
[0138] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis 1106 of the image capture device. In the examples illustrated in Figures 11A and 11B, the value of α is zero degrees.
[0139] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1110 of the projection point 1104 (eg, in a direction perpendicular to the optical axis 1106 of the image capture device 1102 ).
[0140] A height difference b between the projection point 1104 and the front nodal point of the image capture device 1102 in the direction of the optical axis 1106 of the image capture device may be defined as b. In the examples illustrated in FIGS. 11A and 11B , the value of b is not zero.
[0141] The angle between a line 1112 perpendicular to the optical axis 1106 of the image capture device and a line 1114 perpendicular to the central beam 1108 may be defined as β. In the example illustrated in Figures 11A and 11B, the value of β is forty degrees.
[0142] Using these definitions, the positional relationship between the image capture device 1102 and the projection points 1104 that provide the best projection pattern to minimize overlap of projection point trajectories can thus be defined as:
[0143]
[0144] Figures 11C-11G is a graph plotting the loci of projected points emitted by the distance sensor 1100 of FIGS. 11A and 11B . Figures 11C-11G In the example illustrated in , the optimal value for β is -40°; however, the actual value may be greater or less than -40°. Figures 11C-11G shows how the overlap of the projected point trajectories may vary with changes in Δβ (i.e., the difference between the optimal value and the actual value for β). Fig. 11C In the example of , α=0°, θ=40°, β=-40° and Δβ=0. Therefore, Fig. 11C An example of an optimal value for β relative to θ is illustrated. As shown, Fig. 11C The overlap of the projected point trajectories in is minimal.
[0145] exist Fig.11D In the example of α = 0°, θ = 40°, β = -46.7° and Δβ = -6.7. Fig.11E , where α = 0°, θ = 40°, β = -53.7° and Δβ = -13.7. Fig.11D Compared to the example, Fig.11E The trajectories in the example are more evenly spaced. However, the value of β deviates from the optimal value by 40°.
[0146] exist Fig.11F In the example of α = 0°, θ = 40°, β = -31.2° and Δβ = 7.8. Fig.11G , where α=0°, θ=40°, β=15.6° and Δβ=13.1. Likewise, the value of β deviates from the optimal value by 40°.
[0147] FIG. 12A illustrates a side view of components of an example configuration of a sensor 1200 having a projection point whose position is adjusted to optimize the projection pattern; Fig. 12B A top view of the sensor assembly illustrated in FIG. 12A is illustrated.
[0148] As shown in Figure 12A and Fig. 12B As shown in FIG. 1 , the sensor 1200 includes: an image capture device 1202 including a lens, and a plurality of projection points 12041-1204 n (Hereinafter individually or collectively referred to as "projection points 1204"). In one example, sensor 1200 includes four projection points 1204 for each image capture device 1202, but may include more or fewer projection points in other examples.
[0149] As described above, the direction of the center of the projection pattern emitted by the projection point 1204 (e.g., projection point 12041) relative to the optical axis 1206 of the image capture device 1202 can be determined by the angle θ in the radial direction relative to the optical axis 1206, where θ indicates the angle between the central projection light beam 1208 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1204 and the optical axis 1206 of the image capture device 1202. In the example illustrated in Figures 12A and 12B, the value of θ is forty degrees.
[0150] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis 1206 of the image capture device. In the example illustrated in Figures 12A and 12B, the value of α is thirty degrees.
[0151] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1210 of the projection point 1204 (eg, in a direction perpendicular to the optical axis 1206 of the image capture device 1202).
[0152] A height difference b between the projection point 1204 and the front node of the image capture device 1202 in the direction of the optical axis 1206 of the image capture device may be defined as b. In the examples illustrated in FIGS. 12A and 12B , the value of b is not zero.
[0153] The angle between a line 1212 perpendicular to the optical axis 1206 of the image capture device and a line 1214 perpendicular to the central beam 1208 may be defined as β. In the example illustrated in Figures 12A and 12B, the value of β is thirty-six degrees.
[0154] Figures 12C-12G is a graph plotting the trajectory of the projected points emitted by the distance sensor 1200 of FIGS. 12A and 12B. Figures 12C-12G In the example illustrated in , the optimal value for β is -36°; however, the actual value may be greater or less than -36°. Figures 12C-12G shows how the overlap of the projected point trajectories may vary with changes in Δβ (i.e., the difference between the optimal value and the actual value for β). Fig. 12C In the example of , α=30°, θ=40°, β=-36° and Δβ=0. Therefore, Fig. 12C An example of an optimal value for β relative to θ is illustrated. As shown, Fig. 12C The overlap of the projected point trajectories in is minimal.
[0155] exist Fig.12D In the example of α = 30°, θ = 40°, β = -42.3° and Δβ = -6.3. Fig.12E For comparison, α = 30°, θ = 40°, β = -46.7° and Δβ = -10.7. Fig.12F In the example of α = 30°, θ = 40°, β = -24.4° and Δβ = 11.6. Figure 12G , where α=30°, θ=40°, β=16.9° and Δβ=19.1.
[0156] FIG. 13A illustrates a side view of components of an example configuration of a sensor 1300 having a projection point whose position is adjusted to optimize the projection pattern. Fig. 13B A top view of the sensor assembly illustrated in FIG. 13A is illustrated.
[0157] As shown in Figure 13A and Fig. 13BAs shown in FIG. 1 , the sensor 1300 includes: an image capture device 1302 including a lens, and a plurality of projection points 13041-1304 n (Hereinafter individually or collectively referred to as "projection points 1304"). In one example, sensor 1300 includes four projection points 1304 for each image capture device 1302, but may include more or fewer projection points in other examples.
[0158] As described above, the direction of the center of the projection pattern emitted by the projection point 1304 (e.g., projection point 13041) relative to the optical axis 1306 of the image capture device 1302 can be determined by the angle θ in the radial direction relative to the optical axis 1306, where θ indicates the angle between the central projection light beam 1308 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1304 and the optical axis 1306 of the image capture device 1302. In the example illustrated in Figures 13A and 13B, the value of θ is forty degrees.
[0159] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis 1306 of the image capture device. In the example illustrated in Figures 13A and 13B, the value of α is sixty degrees.
[0160] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1310 of the projection point 1304 (eg, in a direction perpendicular to the optical axis 1306 of the image capture device 1302).
[0161] A height difference b between the projection point 1304 and the front node of the image capture device 1302 in the direction of the optical axis 1306 of the image capture device may be defined as b. In the examples illustrated in FIGS. 13A and 13B , the value of b is not zero.
[0162] The angle between a line 1312 perpendicular to the optical axis 1306 of the image capture device and a line 1314 perpendicular to the central beam 1308 may be defined as β. In the example illustrated in Figures 13A and 13B, the value of β is twenty-three degrees.
[0163] Figures 13C-13G is a graph plotting the trajectory of the projected points emitted by the distance sensor 1300 of FIGS. 13A and 13B. Figures 13C-13G In the example illustrated in , the optimal value for β is -22.8°. However, the actual value may be greater or less than -22.8°. Therefore, Figures 13C-13G shows how the overlap of the projected point trajectories may vary with changes in Δβ (i.e., the difference between the optimal value and the actual value for β). Fig. 13C In the example of , α=60°, θ=40°, β=22.8° and Δβ=0. Therefore, Fig. 13C An example of an optimal value for β relative to θ is illustrated. As shown, Fig. 13C The overlap of the projected point trajectories in is minimal.
[0164] exist Fig.13D In the example of α = 60°, θ = 40°, β = -35.9° and Δβ = -13.1. Fig.13E For comparison, α = 60°, θ = 40°, β = -41.2° and Δβ = -18.4. Fig.13F In the example of α = 60°, θ = 40°, β = -15.0° and Δβ = 7.8. Figure 13G , where α=60°, θ=40°, β=6.65° and Δβ=16.1.
[0165] FIG. 14A illustrates a side view of components of an example configuration of a sensor 1400 having a projection point whose position is adjusted to optimize the projection pattern; Fig. 14B A top view of the sensor assembly illustrated in FIG. 14A is illustrated.
[0166] As shown in Figure 14A and Fig. 14B As shown in FIG. 1 , the sensor 1400 includes: an image capture device 1402 including a lens, and a plurality of projection points 14041-1404 n (Hereinafter individually or collectively referred to as "projection points 1404"). In one example, sensor 1400 includes four projection points 1404 for each image capture device 1402, but may include more or fewer projection points in other examples.
[0167] As described above, the direction of the center of the projection pattern emitted by the projection point 1404 (e.g., projection point 14041) relative to the optical axis 1406 of the image capture device 1402 can be determined by the angle θ in the radial direction relative to the optical axis 1406, where θ indicates the angle between the central projection light beam 1408 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1404 and the optical axis 1406 of the image capture device 1402. In the example illustrated in Figures 14A and 14B, the value of θ is forty degrees.
[0168] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis 1406 of the image capture device. In the example illustrated in Figures 14A and 14B, the value of α is ninety degrees.
[0169] The baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1410 of the projection point 1404 (eg, in a direction perpendicular to the optical axis 1406 of the image capture device 1402).
[0170] A height difference b between the projection point 1404 and the front nodal point of the image capture device 1402 in the direction of the optical axis 1406 of the image capture device may be defined as b. In the examples illustrated in FIGS. 14A and 14B , the value of b is zero.
[0171] The angle between a line 1412 perpendicular to the optical axis 1406 of the image capture device and a line 1414 perpendicular to the central light beam 1408 may be defined as β. In the example illustrated in Figures 14A and 14B, the value of β is zero degrees.
[0172] Figures 14C-14G is a graph that plots the trajectory of the projected points emitted by the distance sensor 1400 of Figures 14A and 14B. In the examples illustrated in Figures 14C-14G, the optimal value for β is 0°; however, the actual value may be greater or less than 0°. Therefore, Figures 14C-14G shows how the overlap of the projected point trajectories may vary with changes in Δβ (i.e., the difference between the optimal value and the actual value for β). Fig. 14C In the example of , α=90°, θ=40°, β=0° and Δβ=0. Therefore, Fig. 14C An example of an optimal value of β with respect to θ is shown. As shown, Fig. 14C The overlap of the projected point trajectories in is minimal. Therefore, the projection pattern can be optimized (ie, the trajectory overlap is minimized) by setting b=0 and β=0 without making any modifications to the components of the sensor 1400.
[0173] exist Fig.14D In the example of α = 90°, θ = 40°, β = -8.6° and Δβ = -8.6. Fig.14E For comparison, α = 90°, θ = 40°, β = -16.9° and Δβ = -16.9. Fig.14F In the example of α = 90°, θ = 40°, β = 8.6° and Δβ = 8.6. Figure 14G , where α=90°, θ=40°, β=16.9° and Δβ=16.9.
[0174] FIG. 15A illustrates a side view of components of an example configuration of a sensor 1500 having a projection point whose position is adjusted to optimize the projection pattern; Fig. 15B A top view of the sensor assembly illustrated in FIG. 15A is illustrated.
[0175] As shown in FIGS. 15A and 15B , the sensor 1500 includes an image capture device 1502 including a lens, and a plurality of projection points 1504 1 - 1504 n (Hereinafter individually referred to as "projection points 1504" or collectively referred to as "projection points 1504"). In one example, sensor 1500 includes four projection points 1504 for each image capture device 1502, but may include more or fewer projection points in other examples.
[0176] As described above, the direction of the center of the projection pattern emitted by the projection point 1504 (e.g., projection point 15041) relative to the optical axis 1506 of the image capture device 1502 can be determined by the angle θ in the radial direction relative to the optical axis 1506, where θ indicates the angle between the central projection light beam 1508 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1504 and the optical axis 1506 of the image capture device 1502. In the example illustrated in Figures 15A and 15B, the value of θ is eighty degrees.
[0177] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis 1506 of the image capture device. In the example illustrated in Figures 15A and 15B, the value of α is ninety degrees.
[0178] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1510 of the projection point 1504 (eg, in a direction perpendicular to the optical axis 1506 of the image capture device 1502).
[0179] A height difference b between the projection point 1504 and the front nodal point of the image capture device 1502 in the direction of the optical axis 1506 of the image capture device may be defined as b. In the example illustrated in FIGS. 15A and 15B , the value of b is zero.
[0180] The angle between a line 1512 perpendicular to the optical axis 1506 of the image capture device and a line 1514 perpendicular to the central light beam 1508 may be defined as β. In the example illustrated in Figures 15A and 15B, the value of β is zero degrees.
[0181] Figures 15C-15E is a graph plotting the trajectory of the projected points emitted by the distance sensor 1500 of Figures 15A and 15B. In the examples illustrated in Figures 15C-15E, the optimal value for β is 0°; however, the actual value may be greater or less than 0°. Therefore, Figures 15C-15E shows how the overlap of the projected point trajectories may vary with changes in Δβ (i.e., the difference between the optimal value and the actual value for β). Fig.15D In the example of , α=90°, θ=80°, β=0° and Δβ=0. Therefore, Fig.15DAn example of an optimal value for β relative to θ is illustrated. As shown, Fig.15D The overlap of the projected point trajectories in is minimal. Therefore, the projection pattern can be optimized (ie, the trajectory overlap is minimized) by setting b=0 and β=0 without making any modifications to the components of the sensor 1500.
[0182] exist Fig. 15C In the example of α = 90°, θ = 80°, β = -16.9° and Δβ = -16.9. Fig.15E , where α=90°, θ=80°, β=−16.9° and Δβ=16.9.
[0183] FIG. 16A illustrates a side view of components of an example configuration of a sensor 1600 having a projection point whose position is adjusted to optimize the projection pattern; Fig. 16B A top view of the sensor assembly illustrated in FIG. 16A is illustrated.
[0184] As shown in FIGS. 16A and 16B , the sensor 1600 includes an image capture device 1602 including a lens, and a plurality of projection points 1604 1-1604 N (Hereinafter referred to individually or collectively as "projection points 1604"). In one example, sensor 1600 includes four projection points 1604 for each image capture device 1602, but may include more or fewer projection points in other examples.
[0185] As described above, the direction of the center of the projection pattern emitted by the projection point 1604 (e.g., projection point 16041) relative to the optical axis 1606 of the image capture device 1602 can be determined by the angle θ in the radial direction relative to the optical axis 1606, where θ indicates the angle between the central projection light beam 1608 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1604 and the optical axis 1606 of the image capture device 1602. In the example illustrated in Figures 16A and 16B, the value of θ is 70 degrees.
[0186] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis of the image capture device 1606. In the example illustrated in Figures 16A and 16B, the value of α is ninety degrees.
[0187] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1610 of the projection point 1604 (eg, in a direction perpendicular to the optical axis 1606 of the image capture device 1602).
[0188] A height difference b between the projection point 1604 and the front node of the image capture device 1602 in the direction of the optical axis 1606 of the image capture device may be defined as b. In the examples illustrated in FIGS. 16A and 16B , the value of b is zero.
[0189] The angle between a line 1612 perpendicular to the optical axis 1606 of the image capture device and a line 1614 perpendicular to the central light beam 1608 may be defined as β. In the example illustrated in Figures 16A and 16B, the value of β is zero degrees.
[0190] Figures 16C-16E is a graph plotting the trajectory of the projected points emitted by the distance sensor 1600 of FIGS. 16A and 16B. Figures 16C-16E In the example illustrated in , the optimal value for β is 0°; however, the actual value may be greater or less than 0°. Figures 16C-16E shows how the overlap of the projected point trajectories may vary with changes in Δβ (i.e., the difference between the optimal value and the actual value for β). Fig.16D In the example of , α=90°, θ=60°, β=0° and Δβ=0. Therefore, Fig.16D An example of an optimal value for β relative to θ is illustrated. As shown, Fig.16D The overlap of the projected point trajectories in is minimal. Therefore, the projection pattern can be optimized (ie, the trajectory overlap is minimized) by setting b=0 and β=0 without making any modifications to the components of the sensor 1600.
[0191] exist Fig. 16C In the example of α = 90°, θ = 60°, β = -16.9° and Δβ = -16.9. Fig.16E , where α=90°, θ=60°, β=−16.9° and Δβ=16.9.
[0192] Other examples of the present disclosure consider the fact that the basic length of triangulation is given by is given. Therefore, the longer the length of the baseline ("a") of the sensor, the higher the distance resolution in the triangulation (i.e., the amount by which the image of the projected pattern moves relative to changes in distance from the sensor) will be. As such, when the size of the sensor is limited in the direction of the baseline, it may be possible to "increase" the baseline length by increasing the height difference ("b") between the projection point and the front node of the image capture device in the direction of the optical axis of the image capture device. In this case, it may be possible to optimize the height difference b by adjusting the values of the angles θ and α.
[0193] FIG. 17A illustrates a side view of components of an example configuration of a sensor 1700 having a projection point whose position is adjusted to optimize the projection pattern; Fig. 17BA top view of the sensor assembly illustrated in FIG. 17A is illustrated.
[0194] As shown in Figure 17A and Fig. 17B As shown in FIG. 1 , the sensor 1700 includes: an image capture device 1702 including a lens, and a plurality of projection points 17041-1704 n (Hereinafter individually or collectively referred to as "projection points 1704"). In one example, sensor 1700 includes four projection points 1704 for each image capture device 1702, but may include more or fewer projection points in other examples.
[0195] As described above, the direction of the center of the projection pattern emitted by the projection point 1704 (e.g., projection point 17041) relative to the optical axis 1706 of the image capture device 1702 can be determined by the angle θ in the radial direction relative to the optical axis 1706, where θ indicates the angle between the central projection light beam 1708 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1704 and the optical axis 1706 of the image capture device 1702. In the example illustrated in Figures 17A and 17B, the value of θ is 70 degrees.
[0196] Additionally, an angle of rotation a may be defined about an axis parallel to the optical axis of the image capture device 1706. In the example illustrated in Figures 17A and 17B, the value of a is thirty degrees.
[0197] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1710 of the projection point 1704 (eg, in a direction perpendicular to the optical axis 1706 of the image capture device 1702).
[0198] A height difference b between the projection point 1704 and the front node of the image capture device 1702 in the direction of the optical axis 1706 of the image capture device may be defined as b. In the examples illustrated in FIGS. 17A and 17B , the value of b is not zero.
[0199] The angle between a line 1712 perpendicular to the optical axis 1706 of the image capture device and a line 1714 perpendicular to the central light beam 1708 may be defined as β. In the example illustrated in Figures 17A and 17B, the value of β is 67 degrees.
[0200] Fig. 17C is a graph plotting the trajectory of the projected points emitted by the distance sensor 1700 of FIGS. 17A and 17B. Fig. 17C In the example shown in , the optimal value for β is 67.2°. Fig. 17C In the example of , α = 30°, θ = 70°, β = -66.8° and Δβ = 0.4. As shown, Fig. 17CThe overlap of the projected point trajectories in is minimal.
[0201] In the examples of FIGS. 17A-17C , the value for the rotation angle α is relatively large (e.g., closer to ninety degrees than forty-five degrees). As such, the projection pattern direction (e.g., the projection direction of the center beam 1708) is close to the tangent direction of the circumference of the image capture device 1702. This may cause the projection pattern to interfere with the projection point. In addition, depending on the layout of the components, there may be additional restrictions on the direction for the rotation angle α. Therefore, the examples of the present disclosure minimize interference by appropriately selecting the values for α, θ, and b.
[0202] FIG. 18A illustrates a side view of components of an example configuration of a sensor 1800 having a projection point whose position is adjusted to optimize the projection pattern; Fig.18B A top view of the sensor assembly illustrated in FIG. 18A is illustrated.
[0203] As shown in FIGS. 18A and 18B , the sensor 1800 includes an image capture device 1802 including a lens, and a plurality of projection points 1804 1-1804 n (Hereinafter individually or collectively referred to as "projection points 1804"). In one example, sensor 1800 includes four projection points 1804 for each image capture device 1802, but may include more or fewer projection points in other examples.
[0204] As described above, the direction of the center of the projection pattern emitted by the projection point 1804 (e.g., projection point 18041) relative to the optical axis 1806 of the image capture device 1802 can be determined by the angle θ in the radial direction relative to the optical axis 1806, where θ indicates the angle between the central projection light beam 1808 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1804 and the optical axis 1806 of the image capture device 1802. In the example illustrated in Figures 18A and 18B, the value of θ is 70 degrees.
[0205] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis 1806 of the image capture device. In the example illustrated in Figures 18A and 18B, the value of α is sixty degrees.
[0206] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1810 of the projection point 1804 (eg, in a direction perpendicular to the optical axis 1806 of the image capture device 1802).
[0207] A height difference b between the projection point 1804 and the front node of the image capture device 1802 in the direction of the optical axis 1806 of the image capture device may be defined as b. In the examples illustrated in FIGS. 18A and 18B , the value of b is not zero.
[0208] The angle between a line 1812 perpendicular to the optical axis 1806 of the image capture device and a line 1814 perpendicular to the central light beam 1808 may be defined as β. In the example illustrated in Figures 18A and 18B, the value of β is 54 degrees.
[0209] Fig.18C is a graph plotting the trajectory of the projected points emitted by the distance sensor 1800 of FIGS. 18A and 18B. Fig.18C In the example shown in , the optimal value for β is -53.9°. Fig.18C In the example of , α = 60°, θ = 70°, β = -53.5° and Δβ = 0.4. As shown, Fig.18C The overlap of the projected point trajectories in is minimal.
[0210] FIG. 19A illustrates a side view of components of an example configuration of a sensor 1900 having a projection point whose position is adjusted to optimize the projection pattern; Fig.19B A top view of the sensor assembly illustrated in FIG. 19A is illustrated.
[0211] As shown in Figure 19A and Fig.19B As shown in FIG. 1 , the sensor 1900 includes: an image capture device 1902 including a lens, and a plurality of projection points 19041-1904 n (Hereinafter individually or collectively referred to as "projection points 1904"). In one example, sensor 1900 includes four projection points 1904 for each image capture device 1902, but may include more or fewer projection points in other examples.
[0212] As described above, the direction of the center of the projection pattern emitted by the projection point 1904 (e.g., projection point 19041) relative to the optical axis 1906 of the image capture device 1902 can be determined by the angle θ in the radial direction relative to the optical axis 1906, where θ indicates the angle between the central projection light beam 1908 (i.e., the light beam that creates the center of the projection pattern) projected by the projection point 1904 and the optical axis 1906 of the image capture device 1902. In the example illustrated in Figures 19A and 19B, the value of θ is 70 degrees.
[0213] Additionally, a rotation angle α may be defined about an axis parallel to the optical axis of the image capture device 1906. In the examples illustrated in Figures 19A and 19B, the value of α is zero degrees.
[0214] Baseline a defines the lateral distance from the front nodal point of the lens of the image capture device to the central axis 1910 of the projection point 1904 (eg, in a direction perpendicular to the optical axis 1906 of the image capture device 1902).
[0215] A height difference b between the projection point 1904 and the front node of the image capture device 1902 in the direction of the optical axis 1906 of the image capture device may be defined as b. In the examples illustrated in FIGS. 19A and 19B , the value of b is not zero.
[0216] The angle between a line 1912 perpendicular to the optical axis 1906 of the image capture device and a line 1914 perpendicular to the central light beam 1908 may be defined as β. In the example illustrated in Figures 19A and 19B, the value of β is 70 degrees.
[0217] Fig.19C is a graph plotting the trajectory of the projected points emitted by the distance sensor 1900 of FIGS. 19A and 19B. Fig.19C In the example illustrated in , the optimal value for β is -70°. Fig.19C In the example of , α = 0°, θ = 70°, β = -69.9° and Δβ = 0.1. As shown, Fig.19C The overlap of the projected point trajectories in is minimal.
[0218] Although the values for a, b, α, β, and θ can be uniquely determined by Formula 1, some errors may occur in setting these values. In some cases, for convenience, it may be desirable to adopt values that deviate slightly from the optimal value (e.g., within a certain predefined tolerance). For example, in the examples illustrated in Figures 11A-19C, good results (i.e., minimum overlap of the projected point trajectories) are still obtained when the value of β is within + / -10° of the optimal value.
[0219] Fig. 20 2000 for calculating the distance from a sensor to an object. In one embodiment, the distance may be calculated by a processor integrated into an imaging sensor (such as any imaging sensor of a distance sensor) or as in Fig.21 The method 2000 is performed using a dedicated computing device as shown in FIG. 2 and discussed below.
[0220] Method 2000 begins with step 2002. In step 2004, a projection pattern may be projected onto an object from a projection point of the distance sensor. In one example, before projecting the projection pattern, a positional relationship between a projection optical system (e.g., a set of optical devices including the projection point, including a light source, a diffractive optical element, and other components) of the distance sensor and a light receiving optical system (e.g., a set of optical devices including an image capture device, including a lens and other components) may be adjusted or optimized (e.g., by adjusting at least one parameter defining the positional relationship). For example, the positional relationship may be adjusted during selection and design of components of the distance sensor and / or assembly of components of the distance sensor. In one example, the positional relationship is adjusted by adjusting at least one of the following parameters: an angle θ between a central projection light beam projected by a projection point of the projection optical system and an optical axis of the light receiving optical system, a rotation angle α around an axis parallel to the optical axis of the light receiving optical system, a baseline a (i.e., a lateral distance from a front node of a lens of the light receiving optical system to a central axis of the projection point in a direction perpendicular to the optical axis of the light receiving optical system), a height difference b between the projection point and the front node in the direction of the optical axis of the light receiving optical system, and an angle β between a line perpendicular to the optical axis of the light receiving optical system and a line perpendicular to the central light beam projected from the projection point. The relationship between A, b, α, β, and θ can be determined according to the above Figure 1 to define.
[0221] As discussed above, the projection pattern projected in step 2004 may be created by projecting a plurality of light beams from a projection point so that when the plurality of light beams are incident on the object, a pattern of projection artifacts (e.g., dots, dashes, x's, etc.) is visible at least by the imaging sensor. Also as discussed above, the layout of the projection artifacts may depend on the positional relationship between the projection optical system and the light receiving optical system of the distance sensor in a plane (e.g., lateral) direction and a height direction (e.g., a direction perpendicular to the lateral direction).
[0222] At least one image of the object may be captured in step 2006. At least a portion of the projected pattern may be visible on a surface of the object.
[0223] In step 2008, the distance from the distance sensor to the object may be calculated using information from the image(s) captured in step 2006. In one embodiment, the distance is calculated using a triangulation technique. For example, the positional relationship between the multiple projection artifacts that make up the projection pattern may be used as a basis for the calculation.
[0224] The method 2000 ends in step 2010. The method 2000 may be repeated for additional projection points of the range sensor (in parallel or sequentially).
[0225] It should be noted that, although not explicitly specified, some blocks, functions, or operations of the method 2000 described above may include storage, display, and / or output for a particular application. In other words, any data, records, fields, and / or intermediate results discussed in the method 2000 may be stored, displayed, and / or output to another device, depending on the particular application. Fig. 20 The boxes, functions or operations in the embodiment do not imply that both branches of the determining operation are practiced. In other words, depending on the result of the determining operation, one of the branches of the determining operation may not be implemented.
[0226] Fig.21 A high-level block diagram of an example electronic device 2100 for calculating the distance from a sensor to an object is depicted. As such, the electronic device 2100 may be implemented as a processor of an electronic device or system, such as a distance sensor.
[0227] As in Fig.21 As depicted in FIG, the electronic device 2100 includes a hardware processor element 2102 (e.g., a central processing unit (CPU), a microprocessor, or a multi-core processor), a memory 2104 (e.g., a random access memory (RAM) and / or a read-only memory (ROM)), a module 2105 for calculating the distance from the sensor to the object, and various input / output devices 2106, such as storage devices (including but not limited to tape drives, floppy disk drives, hard disk drives, or compact disk drives), receivers, transmitters, displays, output ports, input ports, and user input devices (such as keyboards, keypads, mice, microphones, etc.).
[0228] Although one processor element is shown, it should be noted that multiple processor elements may be employed by the electronic device 2100. Furthermore, although one electronic device 2100 is shown in the figure, if the method(s) discussed above are implemented in a distributed or parallel manner for a particular illustrative example (i.e., blocks of the method(s) described above or the entire method(s) are implemented across multiple or parallel electronic devices), then the electronic device 2100 of the figure is intended to represent each of those multiple electronic devices.
[0229] It should be noted that the present disclosure may be implemented by machine-readable instructions and / or a combination of machine-readable instructions and hardware, for example, using an application specific integrated circuit (ASIC), a programmable logic array (PLA), including a field programmable gate array (FPGA), or a state machine deployed on a hardware device, a general-purpose computer, or any other hardware equivalent, for example, computer-readable instructions related to the method(s) discussed above may be used to configure a hardware processor to implement the blocks, functions, and / or operations of the method(s) disclosed above.
[0230] In one example, instructions and data (e.g., machine-readable instructions) for this module or process 2105 for calculating the distance from the sensor to the object may be loaded into the memory 2104 and executed by the hardware processor element 2102 to implement the blocks, functions, or operations discussed above in connection with the method 800 or the method 2000. In addition, when the hardware processor executes instructions to perform an "operation," this may include: the hardware processor directly performing the operation, and / or causing, directing, or cooperating with another hardware device or component (e.g., a coprocessor, etc.) to perform the operation.
[0231] A processor that executes machine-readable instructions related to the above-described method(s) may be considered a programmed processor or a specialized processor. As such, the present module 2105 of the present disclosure for calculating the distance from a sensor to an object may be stored on a tangible or physical (broadly non-transitory) computer-readable storage device or medium (e.g., volatile memory, non-volatile memory, ROM memory, RAM memory, magnetic or optical drive, device or disk, etc.). More specifically, the computer-readable storage device may include any physical device that provides the ability to store information, such as data and / or instructions to be accessed by a processor or electronic device, such as a computer or controller of a security sensor system.
[0232] It will be appreciated that variations or alternatives of the above disclosed and other features and functions may be combined into many other different systems or applications. Various currently unforeseen or unanticipated substitutions, modifications, or changes therein may then be made, which are also intended to be covered by the appended claims.
Claims
1. A method for calculating the distance from a distance sensor to an object, include: A projection pattern is projected onto a surface of an object from a projection point of a distance sensor, wherein the projection pattern is created by a plurality of light beams projected from the projection point, wherein the projection point includes a light source and a diffractive optical element, wherein the plurality of light beams create a plurality of projection artifacts arranged on the surface of the object, wherein before the projection, a positional relationship between the projection point and an image capture device of the distance sensor is adjusted by adjusting at least one of: a height difference between the projection point and a front node of the image capture device of the distance sensor in a direction of an optical axis of the image capture device, or an angle between a central light beam of the plurality of light beams and an optical axis of the image capture device, wherein the adjustment minimizes an overlap of a plurality of trajectories, wherein each of the plurality of trajectories describes a movement of one of the plurality of projection artifacts relative to the image capture device as a distance between the distance sensor and the surface of the object changes, and the positional relationship is defined according to the following formula: wherein β is an angle between a first line perpendicular to the optical axis of the image capture device and a second line perpendicular to the central beam of the plurality of beams, b is a height difference between the projection point and a front node of the image capture device in the direction of the optical axis of the image capture device, a is a lateral distance from the front node of the image capture device to the central axis of the projection point, θ is an angle between the central beam and the optical axis of the image capture device, and α is a rotation angle defined around an axis parallel to the optical axis of the image capture device; capturing an image of the object including at least a portion of the projected pattern; as well as Information from the image is used to calculate the distance from the range sensor to the object.
2. A non-transitory machine-readable storage medium encoded with instructions executable by a processor, in, When executed, the instructions cause the processor to perform the following operations, including: A projection pattern is projected onto a surface of an object from a projection point of a distance sensor, wherein the projection point includes a light source and a diffractive optical element, wherein the projection pattern is created by a plurality of light beams projected from the projection point, wherein the plurality of light beams create a plurality of projection artifacts arranged on the surface of the object, wherein before the projection, a positional relationship between the projection point and an image capture device of the distance sensor is adjusted by adjusting at least one of: a height difference between the projection point and a front node of the image capture device of the distance sensor in the direction of an optical axis of the image capture device, or an angle θ between a central light beam of the plurality of light beams and the optical axis of the image capture device, wherein the adjustment minimizes an overlap of a plurality of trajectories, wherein each of the plurality of trajectories describes a movement of one of the plurality of projection artifacts relative to the image capture device as the distance between the distance sensor and the surface of the object changes, and the positional relationship is defined according to the following formula: wherein β is an angle between a first line perpendicular to the optical axis of the image capture device and a second line perpendicular to the central beam of the plurality of beams, b is a height difference between the projection point and a front node of the image capture device in the direction of the optical axis of the image capture device, a is a lateral distance from the front node of the image capture device to the central axis of the projection point, θ is an angle between the central beam and the optical axis of the image capture device, and α is a rotation angle defined around an axis parallel to the optical axis of the image capture device; capturing an image of the object including at least a portion of the projected pattern; and Information from the image is used to calculate the distance from the range sensor to the object.
3. A distance sensor, include: an image capture device positioned to capture an image of the field of view; as well as a projection point comprising a light source and a diffractive optical element and positioned outside a periphery of a lens of the image capture device, the projection point being configured to project a plurality of projection light beams into the field of view, wherein a height difference b between the projection point and the front node of the image capture device of the distance sensor in the direction of the optical axis of the image capture device or an angle θ between the central beam of the plurality of projection beams and the optical axis of the image capture device minimizes an overlap of a plurality of trajectories, wherein each of the plurality of trajectories describes a movement of one of a plurality of projection artifacts relative to the image capture device as the distance between the distance sensor and the surface of the object onto which the projection pattern is to be projected from the projection point changes, and the positional relationship between the projection point and the image capture device is defined according to the following formula: Wherein β is the angle between a first line perpendicular to the optical axis of the image capture device and a second line perpendicular to the central beam of the multiple light beams, b is the height difference between the projection point and the front node of the image capture device in the direction of the optical axis of the image capture device, a is the lateral distance from the front node of the image capture device to the central axis of the projection point, θ is the angle between the central beam and the optical axis of the image capture device, and α is the rotation angle defined around an axis parallel to the optical axis of the image capture device.
4. The distance sensor according to claim 3, in, The positional relationship between the projection point and the image capture device is adjusted in a direction perpendicular to the optical axis of the image capture device.
5. The distance sensor according to claim 3, in, The positional relationship between the projection point and the image capture device is adjusted in a direction parallel to the optical axis of the image capture device.
6. The distance sensor according to claim 3, in, b≠0, α=0°, θ=40°, and β=40°.
7. The distance sensor according to claim 3, in, b≠0, α=30°, θ=40°, and β=36°.
8. The distance sensor according to claim 3, in, b≠0, α=60°, θ=40°, and β=23°.
9. The distance sensor according to claim 3, in, b≠0, α=30°, θ=70°, and β=67°.
10. The distance sensor according to claim 3, in, b≠0, α=60°, θ=70°, and β=54°.
11. The distance sensor according to claim 3, in, b≠0, α=0°, θ=70°, and β=70°.
12. The distance sensor according to claim 3, in, b=0, α=90°, θ=40°, and β=0°.
13. The distance sensor according to claim 3, in, b=0, α=90°, θ=80°, and β=0°.
14. The distance sensor according to claim 3, in, b=0, α=90°, θ=60°, and β=0°.
