Hybrid-refractive gradient-index optics for time-of-flight sensors
By using a gradient index optic with mixed refraction in portable electronic devices, combined with a GRIN lens and a refractive lens, the size and reliability of traditional optical devices are solved, and efficient depth information capture and three-dimensional image functions are achieved, improving optical performance.
Patent Information
- Application Number
- CN202080073510.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-12-20
- Filing Date
- 2020-10-21
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2040-10-21
AI Technical Summary
The prior art has difficulty integrating time-of-flight sensors into portable digital electronic devices, especially due to the size and reliability of traditional optics, which cannot support advanced features such as three-dimensional photography and efficient depth information capture.
Using a gradient index optical device with mixed refraction, combined with a GRIN lens and a refractive lens, a combined focal length of less than a quarter of the pitch is designed to reduce spherical aberration, and the optical detection element is realized through lens housing structure and adhesives. Accurate alignment to improve optical performance.
It realizes efficient reception of optical information in portable electronic devices, reduces aberrations and optical distortions, improves light reception efficiency and accuracy, and supports more advanced depth information capture and three-dimensional image functions.
Smart Images

Figure CN114599989B_ABST
Abstract
Description
Technical Field
[0001] The present invention generally relates to optical devices integrated into personal electronic devices. More particularly, embodiments relate to hybrid refractive gradient index optical devices for time-of-fly (TOF) sensors for integration into portable personal electronic device environments, such as cameras in smartphones. Background Art
[0002] In the past, photography was a discipline reserved for those with specialized knowledge and equipment. Over the past few decades, innovations in digital photography hardware and software, as well as the worldwide proliferation of smartphones with integrated digital cameras, have put digital photography at the fingertips of billions of consumers. In this environment of ubiquitous access to digital photography and videography, consumers increasingly expect to be able to capture moments quickly and easily using their smartphones. Advances in digital photography include advances in capturing three-dimensional information for a variety of purposes. For example, capturing depth and other three-dimensional information can support three-dimensional photography and videography, as well as advanced automation of focusing, stabilization, aberration correction, and other functions.
[0003] In some photographic applications, various time-of-flight techniques can be used to capture depth information. For example, focused light pulses can be emitted and their reflections can subsequently be received; and knowledge of various parameters (e.g., the speed of light) can be used to convert the pulse reception timing into a depth measurement. Traditionally, it has been difficult to integrate such time-of-flight techniques into portable digital electronic applications, such as smartphones. For example, some conventional methods rely on relatively large optics and / or dedicated illumination sources, which are not suitable for the space constraints of many portable digital electronic applications; while other conventional methods are often not reliable or accurate enough to support more advanced functions. Summary of the invention
[0004] Embodiments provide a time-of-flight sensor with a gradient-index optic with hybrid refraction. Some embodiments are for integration into a portable electronic device with a camera, such as a smart phone. For example, a time-of-flight imaging subsystem can receive optical information along an optical path at an imaging plane. A hybrid lens can be coupled to the TOF imaging subsystem and disposed in the optical path so that the imaging plane is substantially located at the focal plane of the hybrid lens. The hybrid lens can include a gradient index (GRIN) lens portion that is less than one-quarter pitch and a refractive lens portion having a convex optical interface. The portions of the hybrid lens together produce a combined focal length that defines a focal plane. The hybrid lens is designed so that the combined focal length is less than one-quarter pitch focal length of the GRIN lens portion and has a smaller refractive aberration than either lens portion. BRIEF DESCRIPTION OF THE DRAWINGS
[0005] The accompanying drawings, which are incorporated herein and constitute a part thereof, illustrate embodiments of the present disclosure. The drawings and the description together serve to explain the principles of the invention.
[0006] Figures 1A-1C illustrates different views of an exemplary time-of-flight (TOF) sensor system including a hybrid refractive gradient index (GRIN) lens in accordance with various embodiments;
[0007] Figure 2 An exemplary partial TOF optical receiving module with a GRIN lens having hybrid refraction according to various embodiments is shown;
[0008] Figure 3 shows an operational representation of a GRIN material segment, such as an exemplary GRIN lens portion for forming a hybrid refractive GRIN lens as described herein;
[0009] Figures 4A-4F shows a number of exemplary optical configurations of hybrid refractive GRIN lenses according to various embodiments;
[0010] Figure 5 An exemplary partial TOF optical receiving module having a hybrid refractive GRIN lens with multiple subsections according to various embodiments is shown;
[0011] Fig. 6A and Figure 6B A front view and a side view, respectively, of an exemplary portable personal electronic device (PPED) according to various embodiments are shown; and
[0012] Figure 7 A flow chart of a method for producing a time-of-flight (TOF) sensor system according to various embodiments is shown.
[0013] In the drawings, similar components and / or features may have the same reference number. In addition, various components of the same type may be distinguished by following the reference number with a second number that distinguishes between similar components. If only the first reference number is used in the specification, the specification applies to any similar component having the same first reference number, regardless of the second reference number. DETAILED DESCRIPTION
[0014] In the following description, many specific details are provided for a thorough understanding of the present invention. However, it should be understood by those skilled in the art that the present invention can be implemented without one or more of these details. In other examples, features and techniques known in the art will not be described for the sake of brevity.
[0015] Digital imaging increasingly uses depth information to support various features. For example, in three-dimensional computer graphics, depth maps are used to indicate information related to the distance of the surface of scene objects from the viewpoint. Similarly, in digital photography, depth mapping and the like can be used to support three-dimensional image capture features, enhanced autofocus features, and other features. Various techniques for obtaining such depth information are well known, such as the so-called "time of flight" (TOF) technology. TOF technology typically measures the distance of an object relative to a reference point by emitting a light beam to the object and measuring the reflection time of the emitted light. For example, light is emitted to the object at t1, the reflected light from the object is captured at t2, and the time difference between t1 and t2 is calculated. Because the speed of light is known, the distance of the object relative to the reference point can be derived based on the time difference.
[0016] This technique may have various limitations. One such limitation is that a single illumination source is typically pointed in a single direction and produces a single reflection, so that a single illumination source only produces a distance measurement of a single point (or area) on a single object in the scene. Generating more measurements (e.g., a depth map) can include changing the direction of one or more light sources (e.g., in a scan line manner) to obtain and compile information from multiple reflections. This approach is inefficient and time consuming. Some TOF methods seek improved efficiency by using an array of TOF detectors (e.g., collecting multiple depth data points at a time). However, the performance of such arrays generally tends to be highly affected by background light intensity, target surface reflections, and / or other conditions.
[0017] An innovative type of TOF sensor measures the distance of an object by emitting a first light beam and a second light beam to the object using a first light source and a second light source to illuminate the object. The emission of the first light beam and the second light beam can be configured so that the two lights converge at a first point and diverge at a second point. An optical sensor can be used to capture a first image of the object illuminated by the first light beam and to capture a second image of the object illuminated by the second light beam. An image difference between the first image and the second image of the object can be determined. Then, the distance of the object relative to the first point can be determined based on the image difference and the distance difference between the first point and the second point. Various embodiments of such a sensor may include additional features. For example, a collimator may be configured so that the first light beam and the second light beam completely overlap the first point, so that the determined image difference may indicate the degree of overlap between the first light beam and the second light beam at a given point between the first point and the second point. Additionally or alternatively, a beam structure mask may be used to structure the first light beam and structure the second light beam to include a set of sub-light spots so that each sub-light spot in the structured first light beam corresponds to a sub-light spot in the structured second light beam. For example, determining an image difference between a first image and a second image of the object may include comparing a position of a sub-light spot in the structured first light with a position of a corresponding sub-light spot in the structured second light, and a degree of overlap between the first light and the second light at a given point may be determined based on the image difference. U.S. Patent No. 10,489,925, entitled "Three Dimensions (3D) Sensing Technology Based on Multiple Structured Illumination", describes some embodiments of such a TOF sensor, which is incorporated herein by reference in its entirety.
[0018] In some of these and other TOF sensors, performance is improved by using optics to focus reflected light onto a TOF imaging element. However, such optics are often difficult to incorporate into the typical factors of many portable electronic device applications. To illustrate one difficulty, a lens can be characterized by an "F number" ("F#"), which is a dimensionless measure of the ratio between the focal length of a lens and its aperture. Such TOF applications (e.g., in portable electronics) typically use low-power illumination sources, resulting in dim reflections. Therefore, reliable detection can involve letting as much light as possible enter the detector element. However, for a lens with a particular F number, increasing the effective aperture (e.g., letting more light in to improve detection) can also proportionally increase the focal length of the lens, in a reciprocal relationship; this tends to increase the effective footprint of the lens assembly.
[0019] Additionally, some lenses, such as small refractive lenses (e.g., convex lenses), are often difficult to mount and / or control in small form factors, and they may exhibit one or more types of optical aberrations. Newer types of lenses, such as gradient index (GRIN) lenses, may be easier to mount, but have other limitations. For example, such GRIN lenses tend to have relatively large negative spherical aberrations and are often too large for such TOF applications. For example, for smartphone-type TOF applications, achieving quarter-pitch focusing in a conventional GRIN lens may involve using a GRIN lens of approximately 5 mm or more, which may be too long for many such applications.
[0020] Embodiments described herein include a novel hybrid lens comprising a GRIN lens portion and a refractive lens portion. For example, a time-of-flight (TOF) imaging subsystem can receive optical information along an optical path at an imaging plane. The hybrid lens can be coupled to the TOF imaging subsystem and disposed in the optical path so that the imaging plane is substantially located at the focal plane of the hybrid lens. The hybrid lens can include a GRIN lens portion that is less than a quarter pitch and a refractive lens portion having a convex optical interface. The portions of the hybrid lens together produce a combined focal length that defines a focal plane. The hybrid lens is designed so that the combined focal length is less than a quarter pitch focal length of the GRIN lens portion and has a smaller spherical aberration than either lens portion.
[0021] Go to Figures 1A-1C , showing different views of an exemplary time-of-flight (TOF) sensor system 100 including a hybrid refractive GRIN lens according to various embodiments. Figure 1A 1 shows a top view of an exemplary TOF sensor system 100, Figure 1B Shows Figure 1A 1 is a side view of an exemplary TOF sensor system 100 . Figure 1C Shown along Figure 1A 1 is a cross-sectional view of an exemplary TOF sensor system 100 taken at section A shown. As shown, the exemplary TOF sensor system 100 includes a substrate 110, such as a circuit board. Various parts of the exemplary TOF sensor system 100 can be mounted on the substrate 110. For example, the substrate 110 can have a TOF sensor module mounted thereon (e.g., including a TOF sensor driver board 115, supporting optical devices and other components for TOF illumination and reception), a circuit block 160 that supports the operation of the TOF sensor system 100, and a connector 165 that supports the integration of the TOF sensor system 100 into other systems (e.g., portable electronic devices).
[0022] The components of the TOF sensor system 100 can be coupled to the substrate 110 via a TOF sensor driver board 115 or any other suitable circuit and / or structure. In general, the TOF sensor system 100 includes components that project illumination onto objects in a scene and receive and process optical information based on the reflection of the illumination from the objects. As shown, the TOF sensor system 100 can include an illumination subsystem that includes a set of illumination sources 130. Each illumination source 130 can be any suitable detection light source. In some embodiments, such as Figure 1C As shown, each illumination source 130 may include a light emitter 132 and a light processor 134. Although only two illumination sources 130a and 130b are shown, any suitable number of illumination sources 130 may be used.
[0023] Illumination from the illumination source 130 can be projected through one or more cover layers 145, and reflections from objects in the scene can be received through one or more cover layers 145. The cover layer 145 can include any suitable number of layers of any suitable material, for example, to provide various optical effects. For example, the cover layer 145 can include a layer 150a of window material, such as a layer of transparent glass. In some embodiments, the cover layer 145 can also include any suitable filter 150b, optical polarizer 150c, etc. Such layers can help reduce the impact of other wavelengths (e.g., from ambient lighting and / or other light sources) on reflection detection.
[0024] The reflected light can be received by the TOF optical receiving module 120 along the optical path (e.g., via the cover layer 145). The TOF optical receiving module 120 can include any suitable optical detection element 125 (e.g., a photodiode array). As described herein, the embodiments include a novel hybrid refractive GRIN lens 140 in the optical path to facilitate receiving reflected optical information along the optical path by the TOF optical receiving module 120 (through the optical detection element 125). For example, the hybrid refractive GRIN lens 140 is configured to have a relatively large effective aperture so as to receive a large amount of light, while also being configured to focus the received illumination onto the optical detection element 125. The embodiments can also be configured to reduce aberrations, such as reducing spherical aberration, reducing coma, reducing optical distortion, and the like.
[0025] Figure 2An exemplary partial TOF optical receiving module 200 with a hybrid refractive index gradient (GRIN) lens 140 according to various embodiments is shown. As shown, the hybrid refractive GRIN lens 140 includes a GRIN lens portion 210 and a refractive lens portion 220. The hybrid refractive GRIN lens 140 can be placed in a lens housing structure 230. The lens housing structure 230 can be configured to fix the hybrid refractive GRIN lens 140 and / or other components (e.g., lens pad 240). In some embodiments, the lens housing structure 230 is made of a material that is coated or otherwise configured to reduce internal reflections at the inner wall surface of the hybrid refractive GRIN lens 140 (e.g., in the GRIN lens portion 210). In some embodiments, the lens housing structure 230 is used to help position and / or fix the hybrid refractive GRIN lens 140 relative to the optical detection element 125.
[0026] In some embodiments, the partial TOF optical receiving module 200 also includes a lens pad 240. The lens pad 240 may include any one or more components and / or materials to provide additional optical features. In some embodiments, the lens pad 240 includes an air gap and / or an adhesive, for example, to facilitate precise alignment and / or fixation of the focal plane of the hybrid refractive GRIN lens 140 with the imaging plane defined by the optical detection element 125. In other embodiments, the lens pad 240 may include one or more optical components to optimize the characteristics of the hybrid refractive GRIN lens 140. For example, the components may be shaped or otherwise configured to reduce certain types of aberrations and / or distortions.
[0027] The hybrid refractive GRIN lens 140 can be manufactured in any suitable manner. In some embodiments, the GRIN lens portion 210 is made into one or more discrete segments of GRIN lens material having one or more specific lengths. The GRIN lens material segments can generally be cylindrical with flat end faces. In such embodiments, the refractive lens portion 220 can be similarly manufactured as one or more discrete refractive lenses, such as a semi-convex lens (i.e., for a semi-convex lens, one surface is flat and the opposite surface is curved). As used herein, a "refractive" lens is broadly intended to include any lens that refracts at least because of a curved surface, such as a spherical lens, an aspherical lens, a composite lens (e.g., made of a combination of spherical and / or aspherical lenses), etc. It is worth noting that although GRIN lenses do refract light, the use of the terms "refractive lens", "refractive lens portion", etc. is intended to be distinguished from the GRIN lenses, GRIN lens portions, etc. described herein. In such embodiments, the discrete GRIN lens portion 210 can be fixed to the discrete refractive lens portion 220. In one embodiment, the GRIN lens portion 210 and the refractive lens portion 220 can be fixed within a retaining structure (e.g., a lens housing 230) in a manner that maintains the desired optical coupling between the lens portions. In another embodiment, the refractive lens portion 220 is adhered to the GRIN lens portion 210 using an adhesive having desired optical properties. For example, an embodiment may use a thin layer of transparent adhesive of substantially uniform thickness. In other embodiments, the GRIN lens portion 210 and the refractive lens portion 220 are manufactured as a single structure. In some such embodiments, a section of GRIN lens material is shaped (at least at one end) to form a refractive surface profile having the characteristics of a refractive lens. In such embodiments, the GRIN lens portion 210 and the refractive lens portion 220 can both be made from the same single section of GRIN lens material.
[0028] GRIN lenses are generally referred to in the art as a type of lens made of a material having a gradient refractive index of at least part of the material. Typically, in a GRIN lens, the refractive index varies as a function of the radial distance from the center of the material (e.g., a parabolic function). Therefore, GRIN lenses can be designed to refract light in a manner similar to traditional refractive (e.g., convex) lenses, although with certain different properties. One characteristic is that, unlike traditional refractive lenses, GRIN lenses tend to have flat input and output surfaces, which can facilitate mounting and integration with other optical devices. Another characteristic is that GRIN lenses tend to have negative spherical aberration (conventional refractive convex lenses tend to have positive spherical aberration). Another feature is that GRIN lenses can have an F number less than 1 (i.e., an effective aperture diameter larger than the focal length), which is difficult to achieve with traditional refractive (e.g., refractive) lenses. GRIN lenses also tend to have relatively low optical distortion and a relatively wide operating bandwidth (e.g., from ultraviolet to infrared).
[0029] To make it clearer, Figure 3 An operational representation 300 of a GRIN material segment is shown, such as an exemplary GRIN lens portion 210 for forming a hybrid refractive GRIN lens 140 described herein. As shown, the performance of a GRIN lens depends on a continuous variation of the refractive index in the lens material. For example, the refractive index may reach a highest value on the optical axis and a lowest value on the side surfaces of the lens (e.g., following a parabolic shape). Assuming a geometric gradient constant of g, the focal length fG and working distance s of the GRIN lens may be calculated as:
[0030] and
[0031]
[0032] Due to these geometric relationships, the length of the GRIN lens (Z l ) affects the focal length and effective working distance of the lens. Light passing through the GRIN lens material tends to follow a sinusoidal path, so the length of the GRIN lens is often expressed in "pitch". In a "full pitch" lens, the length of the GRIN lens is controlled so that gZ l By controlling the length of the GRIN lens, gZ l =π / 2 (the so-called "quarter pitch"), the focal plane of the lens is effectively located at its end face (i.e., when gZ l When π is equal to π / 2, its tangent is equal to zero, placing s in the above equation at zero distance from the end of the GRIN lens).
[0033] To date, GRIN lenses have not been used in TOF sensor applications for a variety of reasons. One reason is that the negative spherical aberration of the GRIN lens may reduce detection efficiency. Another reason is that, although a quarter-pitch GRIN lens can be used to focus the received light onto the imaging plane of the time-of-flight optical receiving module 120, a typical quarter-pitch GRIN lens may be too large for some applications. For example, a quarter-pitch GRIN lens may be approximately five millimeters long, which may be too long for effective integration into many typical portable electronic device applications. As can be seen from the equation above, reducing the length of the GRIN lens increases the focal length and working distance of the lens, which effectively offsets the reduction in lens length.
[0034] As described herein, the hybrid refractive GRIN lens 140 combines the GRIN lens portion 210 with the refractive lens portion 220 in a particular manner to produce a new synergistic optical effect. In particular, embodiments of the GRIN lens portion 210 are manufactured to have a GRIN lens length that is less than one-quarter pitch. In one embodiment, the GRIN lens portion 210 is generated to have a lens length approximately equivalent to 1 / 8 pitch (i.e., π / 4). In other embodiments, the GRIN lens portion 210 is generated to have a lens length between approximately 1 / 6 pitch and 1 / 10 pitch. As the length of the GRIN lens portion 210 decreases, its focal length increases and the magnitude of its negative spherical aberration tends to decrease (i.e., it becomes closer to zero). Embodiments of the refractive lens portion 220 are designed to have a specific focal length and positive spherical aberration.
[0035] In some embodiments, the focal length of the refractive lens portion 220 substantially matches the focal length of the GRIN lens portion 210. The combined (hybrid) focal length (f H ) can be described as:
[0036]
[0037] Among them, f G is the focal length of the GRIN lens section 210, f S is the focal length of the refractive lens portion 220. For ease of explanation, refer to the above G From the formula, we can see that halving the length of a GRIN lens (e.g., going from a quarter-pitch to an eighth-pitch lens) increases the focal length by the square root of two (√2). For example, if the focal length of a quarter-pitch GRIN is f G0 , then the focal length of a GRIN with one eighth the pitch is approximately f G0For ease of reference, the phrase "quarter pitch focal length" (or similar terminology) is used herein to refer to what the focal length of the GRIN lens portion would be if its length corresponded to a quarter pitch. If the focal length of the refractive lens portion 220 matches (also about 1.4 times f G0 ), the approximate hybrid focal length can be derived as:
[0038]
[0039] As can be seen, the hybrid focal length is less than the focal length of either the GRIN lens portion 210 or the refractive lens portion 220 alone, and is even significantly reduced (e.g., reduced by about 30% in this example) from the quarter-pitch focal length of the GRIN lens portion 210 itself. Furthermore, assume that the quarter-pitch F-number of the GRIN lens portion 210 is about 0.95. The F-number can also be increased without physically changing the GRIN lens aperture. This change in F-number can manifest as a significant increase in apparent aperture, such that the hybrid refractive GRIN lens 140 effectively receives more light than the GRIN lens portion 210 alone. For example, if the original natural aperture is 0.5, the above-described change in focal length can effectively increase the natural aperture to about 0.74.
[0040] Figures 4A-4F Multiple exemplary optical configurations of a hybrid-refractive GRIN lens 400 are shown according to various embodiments. As described above, each illustrated hybrid-refractive GRIN lens 400 includes a GRIN lens portion 210 and a refractive lens portion 220. In general, the hybrid-refractive GRIN lens 400 receives light 420, including light reflected from objects in a surrounding scene after illumination is projected onto these objects by one or more illumination sources (e.g., illumination source 130). The hybrid-refractive GRIN lens 400 focuses the received light 420 onto a hybrid focal plane 410. As described above, the hybrid focal plane 410 is defined by the integration of the focal planes of the GRIN lens portion 210 and the refractive lens portion 220. In general, it is desirable to configure the hybrid-refractive GRIN lens 400 so that the hybrid focal plane 410 is substantially located in an imaging plane, and the optical detection element 125, such as a substantially planar photodiode array, is located in the imaging plane. As shown in FIG. Figures 4A-4F As shown in different configurations of , such positioning of the hybrid focal plane 410 may or may not result in the hybrid focal plane 410 being located at the output end of the GRIN lens portion 210 or even the hybrid refractive GRIN lens 400 .
[0041] exist Figures 4A-4C In FIG. 4 , the hybrid refractive GRIN lens 400 is oriented such that the refractive lens portion 220 is away from the hybrid focal plane 410 and the GRIN lens portion 210 is toward the hybrid focal plane 410. Figure 4AIn FIG. 4 , the hybrid refractive GRIN lens 400a is configured such that the hybrid focal plane 410 is substantially located at the flat output face of the GRIN lens portion 210. For example, a configuration may be used in which the flat output face of the GRIN lens portion 210 is placed in direct contact with the flat face of the optical detection element 125 (e.g., or separated only by a very thin adhesive or other layer). Figure 4B In FIG. 4 , the hybrid refractive GRIN lens 400b is configured such that the hybrid focal plane 410 extends beyond the flat output face of the GRIN lens portion 210. For example, such a configuration may be used where a precise or adjustable air gap is used to focus the output of the GRIN lens portion 210 onto the plane of the optical detection element 125 where it would otherwise be undesirable for the GRIN lens portion 210 to directly contact the optical detection element 125. Figure 4C In FIG. 4 , the hybrid refractive GRIN lens 400 c is configured such that the hybrid focal plane 410 extends beyond the flat output surface of the GRIN lens portion 210, as shown in FIG. Figure 4B 2, and the lens pad 240 is disposed at the output face of the GRIN lens portion 210. For example, the GRIN lens portion 210 is sandwiched between the output face of the GRIN lens portion 210 and the optical detection element 125. As described herein, this configuration can be used to take advantage of certain features of the lens pad 240 and / or to separate the output of the GRIN lens portion 210 from the optical detection element 125. For example, providing Figure 4B The air gap shown may add coma or other artifacts to the optical path, and the use of lens pads 240 may provide a similar mounting gap without introducing (or even correcting for) such artifacts.
[0042] exist Figures 4D-4F , the hybrid-refractive GRIN lens 400 is oriented such that the refractive lens portion 220 faces the hybrid focal plane 410, while the GRIN lens portion 210 faces away from the hybrid focal plane 410. In some embodiments, orienting the refractive lens portion 220 toward the hybrid focal plane 410 can position the exit pupil in a manner that tends to even further reduce the effective focal length (e.g., F-number) of the hybrid-refractive GRIN lens 400. Figure 4D In FIG. 4 , the hybrid refractive GRIN lens 400d is configured such that the hybrid focal plane 410 is substantially located at the curved output face of the refractive lens portion 220. Figure 4E In FIG. 4 , the hybrid refractive GRIN lens 400e is configured such that the hybrid focal plane 410 extends beyond the curved output face of the refractive lens portion 220. For example, such a configuration may be used where a precise or adjustable air gap is used to focus the output of the hybrid refractive GRIN lens 400e onto the plane of the optical detection element 125 where it would otherwise be undesirable for the hybrid refractive GRIN lens 400e to directly contact the optical detection element 125. Figure 4FIn FIG. 4 , the hybrid refractive GRIN lens 400 f is configured such that the hybrid focal plane 410 is substantially located at the curved output surface of the refractive lens portion 220, as shown in FIG. Figure 4D As shown, the lens pad 240 is disposed on the input surface of the GRIN lens portion 210 .
[0043] As described above, by integrating the GRIN lens portion 210 and the refractive lens portion 220 into a hybrid refractive GRIN lens, as described herein, a synergistic effect can be achieved. One feature of this integration is that the effective focal length decreases as the lens length decreases. As described above, this can also effectively increase the F-number and natural aperture, thereby increasing the amount of light received for detection. In addition to the features discussed above, the integration of the refractive lens portion 220 with the GRIN lens portion 210 can also significantly reduce (e.g., even substantially eliminate) spherical aberration. The GRIN lens portion 210 tends to exhibit negative spherical aberration, and the refractive lens portion 220 tends to exhibit positive spherical aberration. The hybrid refractive GRIN lens 140 can be configured so that the positive spherical aberration caused by the refractive lens portion 220 partially or completely offsets the negative spherical aberration caused by the GRIN lens portion 210.
[0044] In some embodiments, these and other features can be expanded and / or further optimized by using multiple subassemblies. In some embodiments, the GRIN lens portion 210 can be composed of multiple subsections, and / or the refractive lens portion 220 can be composed of multiple subsections to further optimize these features (e.g., to provide additional impact on focal length, aperture, aberrations, etc.). In addition, as described herein, some embodiments use lens pads 240 to provide additional optical features. For example, the integration of the refractive lens portion 220 may introduce additional aberrations or distortions, and the lens pads 240 can be configured to counteract those aberrations or distortions.
[0045] Figure 5An exemplary partial TOF optical receiving module 500 according to various embodiments is shown, which has a hybrid refractive gradient index (GRIN) lens with multiple sub-sections. As shown, the hybrid refractive GRIN lens includes a first and a second GRIN lens section 210 and a first and a second refractive lens section 220. For clarity and context, the hybrid refractive GRIN lens is shown as being housed in a lens housing structure 230 including a lens pad 240 and integrated with an imaging plane defined by an optical detection element 125. Each sub-section of the hybrid refractive GRIN lens can provide specific features. In one embodiment, the diameter of the first GRIN lens section 210a (i.e., the first sub-section of the GRIN lens section 210) is smaller than the diameter of the second GRIN lens section 210b. This configuration can help retain (e.g., focus) some optical information at the edge of the first GRIN lens section 210a for detection. Additionally or alternatively, multiple GRIN lens sub-sections can be used to provide other features, such as by producing each sub-section with different materials, diffusion and / or other properties to produce different refractive index gradients on different sub-sections, different aberration characteristics in different sub-sections, etc. Similarly, different refractive lens subsections can be used to provide different characteristics, or for any other suitable purpose. For example, refractive lens section 220 can be composed of multiple discrete refractive lenses to provide various types of aberration correction, focusing characteristics, etc.
[0046] Fig. 6A and Figure 6B A front view and a side view of an illustrative portable personal electronic device (PPED) 600 according to various embodiments are shown, respectively. As used herein, a PPED may include a smart phone, a tablet computer, a laptop computer, a smart wearable device (e.g., a smart watch), or any other suitable device having one or more integrated digital imaging systems 610. Embodiments of the PPED 600 may also include one or more displays 620. Although not explicitly shown, some embodiments of the display 620 may have a capacitive touch screen element integrated therewith, another digital imaging system 610, a fingerprint sensor, and / or other components. The user interface component may also include one or more physical buttons 630. For example, the physical button 630 may include a power button, a volume button, etc. In some embodiments, one or more buttons are dedicated to a specific function, and one or more buttons may be dynamically assigned (e.g., by an application processor and / or other components) to various functions. Although not shown, the PPED 600 may include additional user interface components, such as optical sensors, force sensors, biosensors, accelerometers, etc.
[0047] Some or all of the digital imaging systems 610 may include a camera and a TOF sensor. The TOF sensor is configured to support the capture of depth information to support the three-dimensional features of the camera. For example, as shown in the figure, the PPED 600 may include a front (e.g., selfie) digital imaging system 610a, a back digital imaging system 610b (e.g., Figure 6B ), a pop-up digital imaging system 610c, and / or any other suitable integrated digital imaging system 610. For example, a user wishes to capture an image using one of the digital imaging systems 610. The PPED 600 initializes various hardware and software elements to enter an image acquisition mode. As part of the mode, one or more TOF sensors are used to project illumination and receive reflected optical information in response to the projected illumination. As described herein, the reflected optical information is received through various optical devices and sensors (including a hybrid refractive GRIN lens).
[0048] Figure 7 A flow chart of a method 700 for producing a time-of-flight (TOF) sensor system according to various embodiments is shown. Some embodiments of the method 700 produce a TOF sensor according to the above description. The method 700 can start at stage 704 by producing a hybrid lens having a gradient index (GRIN) lens portion and a refractive lens portion. The GRIN lens portion is sized to have a pitch of less than 0.25 (i.e., less than a quarter pitch) and a planar optical interface defining a first end of the hybrid lens. The refractive lens portion is produced to extend from the GRIN lens portion and have a convex optical interface defining a second end of the hybrid lens. The combined focal length of the GRIN lens portion and the refractive lens portion defines the focal plane of the hybrid lens. In some embodiments, the planar optical interface (of the GRIN lens portion) is a first planar optical interface, and the GRIN lens portion is produced by forming a cylindrical GRIN material to form a discrete GRIN lens extending from the first planar optical interface to the second planar optical interface. For example, the GRIN lens portion is formed by cutting a section of cylindrical GRIN lens material into a desired length. In such embodiments, the refractive lens portion can be obtained as a discrete refractive lens (e.g., a semi-convex lens) extending from a third planar optical interface to a convex optical interface, and the hybrid lens is produced by attaching the second planar optical interface to the third planar optical interface to form a hybrid lens at stage 704. In other embodiments, producing the hybrid lens at stage 704 includes forming a single cylindrical GRIN material to have a planar optical interface at a first extent and a convex optical interface at a second extent.
[0049] At stage 708, an embodiment may couple the hybrid lens to a TOF imaging subsystem configured to receive optical information along an optical path at an imaging plane. The coupling may include placing the hybrid lens in the optical path with the focal plane substantially at the imaging plane. In some embodiments, the coupling includes orienting the hybrid lens so that the refractive lens portion points toward the imaging plane. In other embodiments, the coupling includes orienting the hybrid lens so that the refractive lens portion points away from the imaging plane. In some embodiments, coupling the hybrid lens to the TOF imaging subsystem at stage 708 includes coupling a lens pad to the hybrid lens located in the optical path, the lens pad being configured to affect the propagation of light along the optical path.
[0050] Some embodiments of method 700 continue at stage 712 by coupling a TOF imaging subsystem to a substrate. For example, the substrate may be a circuit board and may include other circuits, connectors, etc. At stage 716, an embodiment may couple a set (i.e., one or more) of illumination sources to the substrate positioned relative to the TOF imaging subsystem. The positioning may enable the TOF imaging subsystem to receive optical information along an optical path at least in part in response to illumination directed toward one or more objects in the environment by the set of illumination sources and illumination reflected back by one or more objects in the environment.
[0051] It should be understood that when an element or component is referred to as "connected to" or "coupled to" another element or component in this article, it can be connected or coupled to another element or component, or there may be an intermediate element or component. On the contrary, when an element or component is referred to as "directly connected" or "directly coupled" another element or component, there is no intermediate element or component between them. It should be understood that although the terms "first", "second", "third", etc. can be used to describe various elements and components, these elements, components, and regions should not be limited by these terms. These terms are only used to distinguish an element, component from another element or component. Therefore, without departing from the teachings of the present invention, the first element and component discussed below can be referred to as the second element and component. As used herein, the terms "logical low", "low state", "low level", "logical low level", "low" or "0" are used interchangeably. The terms "logical high", "high state", "high level", "logical high level", "high" or "1" are used interchangeably.
[0052] As used herein, the terms "a", "an" and "the" may include the singular and the plural. It will be further understood that, when used in this specification, the terms "include", "comprise", "have" and variations thereof specify the presence of stated features, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, elements, components and / or combinations thereof. In contrast, when used in this specification, the term "consisting of" specifies the stated features, steps, operations, elements and / or components, and excludes additional features, steps, operations, elements and / or components. In addition, as used herein, the term "and / or" may refer to and include any possible combination of one or more related listed items.
[0053] Although the present invention is described herein with reference to illustrative embodiments, the description is not intended to be construed as limiting. On the contrary, the purpose of the illustrative embodiments is to enable those skilled in the art to better understand the spirit of the present invention. In order not to obscure the scope of the present invention, many details of well-known processes and manufacturing techniques are omitted. With reference to the specification, various modifications to the illustrative embodiments and other embodiments will be apparent to those skilled in the art. Therefore, the appended claims are intended to include any such modifications.
[0054] In addition, some features of the preferred embodiments of the present invention can be used advantageously without the need to use other features accordingly. Therefore, the foregoing description should be considered as merely an illustration of the principles of the present invention, rather than a limitation of the present invention. Those skilled in the art will appreciate variations of the above-described embodiments that fall within the scope of the present invention. Therefore, the present invention is not limited to the above-described specific embodiments and descriptions, but is limited by the appended claims and their equivalents.
Claims
1. A time-of-flight (TOF) sensor system, comprising: A TOF imaging subsystem configured to receive optical information along an optical path at an imaging plane; a hybrid lens coupled to the TOF imaging subsystem and arranged in the optical path so that the imaging plane is substantially located at the focal plane of the hybrid lens, wherein the hybrid lens comprises: a gradient-index GRIN lens portion sized to have a pitch less than 0.25 and having a planar optical interface at a first end of the hybrid lens; as well as A refractive lens portion extends from the GRIN lens portion and has a convex optical interface at a second end of the hybrid lens, wherein the refractive lens portion is configured such that a combined focal length of the GRIN lens portion and the refractive lens portion defines the focal plane.
2. The TOF sensor system according to claim 1, wherein: The combined focal length of the GRIN lens portion and the refractive lens portion is less than a quarter pitch focal length of the GRIN lens portion.
3. The TOF sensor system according to claim 1 or 2, wherein: The GRIN lens portion contributes a negative spherical aberration of |S1| to the optical path; and The refractive lens portion contributes a positive spherical aberration of |S2| to the optical path, The hybrid lens contributes a total spherical aberration of |ST| to the optical path, wherein |ST| is smaller than both |S1| and |S2|.
4. The TOF sensor system according to claim 3, wherein: |ST| is essentially zero.
5. The TOF sensor system according to any one of claims 1 to 4, wherein: The GRIN lens portion has a first focal length; and The refractive lens portion is configured to have a second focal length substantially equal to the first focal length.
6. The TOF sensor system according to any one of claims 1 to 5, wherein: The planar optical interface is a first planar optical interface; The GRIN lens portion is a discrete GRIN lens extending from the first planar optical interface to the second planar optical interface; The refractive lens portion is a discrete refractive lens extending from the third planar optical interface to the convex optical interface; and The hybrid lens is formed by coupling the second planar optical interface to the third planar optical interface.
7. The TOF sensor system according to any one of claims 1 to 5, wherein: The hybrid lens is formed from a single cylindrical GRIN material by shaping a first extent to form the planar optical interface and shaping a second extent to form the convex optical interface.
8. The TOF sensor system according to any one of claims 1 to 7, wherein: The hybrid lens is oriented in the optical path with a first end of the hybrid lens facing the imaging plane.
9. The TOF sensor system according to any one of claims 1 to 7, wherein: The hybrid lens is oriented in the optical path with a second end of the hybrid lens facing the imaging plane.
10. The TOF sensor system according to any one of claims 1 to 9, wherein: The hybrid lens is positioned such that one of the first end or the second end is in direct contact with the imaging plane.
11. The TOF sensor system according to any one of claims 1 to 10, further comprising: A lens pad, coupled to the hybrid lens, is located in the optical path and is configured to affect propagation of light along the optical path.
12. The TOF sensor system according to any one of claims 1 to 11, wherein: The imaging plane includes an array of photodetector elements.
13. The TOF sensor system according to any one of claims 1 to 12, further comprising: A TOF illumination subsystem is configured to direct illumination toward one or more objects in an environment, such that the TOF imaging subsystem is configured to receive the optical information along the optical path at least in part in response to the illumination reflected by the one or more objects in the environment.
14. The TOF sensor system according to claim 13, further comprising: A substrate on which the TOF imaging subsystem and the TOF illumination subsystem are mounted.
15. A portable electronic device having a camera system and in which the TOF sensor system according to claim 1 is integrated, wherein: The TOF sensor system is configured to provide depth mapping information to the camera system.
16. A method for producing a time-of-flight (TOF) sensor system, comprising: producing a hybrid lens having a gradient-index GRIN lens portion and a refractive lens portion, wherein the GRIN lens portion is sized to have a pitch less than 0.25 and a planar optical interface defining a first end of the hybrid lens, and the refractive lens portion is produced to extend from the GRIN lens portion and have a convex optical interface defining a second end of the hybrid lens, such that the combined focal length of the GRIN lens portion and the refractive lens portion defines a focal plane of the hybrid lens; and The hybrid lens is coupled to a TOF imaging subsystem configured to receive optical information along an optical path at an imaging plane, wherein the coupling places the hybrid lens in the optical path with the focal plane substantially located at the imaging plane.
17. The method according to claim 16, wherein: Coupling the hybrid lens with the TOF imaging subsystem includes coupling a lens pad with the hybrid lens located in the optical path, and the lens pad is configured to affect propagation of light along the optical path.
18. The method according to claim 16 or 17, wherein: The planar optical interface is a first planar optical interface; as well as Producing the hybrid lens includes: producing the GRIN lens portion by shaping cylindrical GRIN material to form discrete GRIN lenses extending from the first planar optical interface to a second planar optical interface; and obtaining the refractive lens portion as a discrete refractive lens extending from a third planar optical interface to the convex optical interface; and The second planar optical interface is attached to the third planar optical interface to form the hybrid lens.
19. The method according to any one of claims 16 to 18, wherein: Producing the hybrid lens includes shaping a single cylindrical GRIN material to have the planar optical interface at a first extent and the convex optical interface at a second extent.
20. The method according to any one of claims 16 to 18, further comprising: coupling the TOF imaging subsystem to a substrate; as well as A set of illumination sources is coupled to the substrate positioned relative to the TOF imaging subsystem such that the TOF imaging subsystem receives the optical information along the optical path in response, at least in part, to illumination directed toward one or more objects in the environment by the set of illumination sources and illumination reflected back from the one or more objects in the environment.
