Image device and image detection method
Non-circular imaging lenses with a fractional array structure address the challenge of reducing imaging device volume while maintaining high resolution by minimizing optical path differences and aberrations, resulting in improved image capture capabilities.
Patent Information
- Application Number
- JP2020180725
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-12-24
- Filing Date
- 2020-10-28
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2040-10-28
AI Technical Summary
Existing imaging devices face challenges in reducing volume while maintaining image quality and resolution, particularly due to the limitations imposed by circular lenses and their alignment with detection arrays.
The use of non-circular imaging optical lenses with a fractional array structure, where the cross-section of each lens is partially cut out to cover a larger detection area, reducing optical path differences and minimizing aberrations, combined with a detection array that includes a non-integer number of detection elements.
This configuration allows for a wider detection area with reduced optical path differences, enhancing image resolution and reducing optical aberrations, thereby enabling thinner imaging devices with improved performance.
Smart Images

Figure 0007616743000010 
Figure 0007616743000011 
Figure 0007616743000012
Abstract
Description
[Technical field]
[0001] Below, techniques related to imaging devices are provided. [Background technology]
[0002] With the development of optical technology and image processing technology, imaging devices are used in a wide range of fields such as multimedia content, security, and recognition. For example, imaging devices are installed in mobile devices, cameras, vehicles, computers, etc. to capture images, recognize objects, and obtain data for controlling devices. The volume of an imaging device is determined by the size of a lens, the focal length of the lens, the size of a sensor, etc. In order to reduce the volume of an imaging device, a multi-lens consisting of small lenses may be used. Summary of the Invention [Problem to be solved by the invention]
[0003] An imaging device according to one embodiment focuses images through a non-circular lens. [Means for solving the problem]
[0004] An image device according to one embodiment includes a detection array including a plurality of detection elements, an imaging lens array having a non-circular shape in cross section perpendicular to an optical axis and including a plurality of imaging optical lenses that transmit light received from the outside, and a focusing lens array arranged between the imaging lens array and the detection array and including a plurality of focusing lenses that transmit light that has passed through the imaging lens array to the detection elements, wherein the number of the imaging optical lenses is less than the number of the focusing lenses.
[0005] The image device may further include an additional optical lens array having a cross section perpendicular to the optical axis that is one of circular and non-circular, and disposed on the opposite side of the detector array with respect to the imaging lens array.
[0006] The imaging lens array may be a lens array disposed adjacent to the converging lens array rather than the additional optical lens array.
[0007] The image device may further include a diaphragm that is disposed on the opposite side of the detector array with respect to the imaging lens array and that passes the light.
[0008] The detection array includes a detection region that includes some of the detection elements among the plurality of detection elements, the detection region receiving light from the plurality of imaging optical lenses and being rectangular, and the cross section of each of the plurality of imaging optical lenses is shaped to correspond to a portion of a circular lens having a diameter larger than the length of the short side of the rectangular detection region.
[0009] The plurality of imaging optical lenses may be lenses formed by cutting out a part of a circular lens having a diameter larger than the length of the short side of the rectangular detection area.
[0010] Each of the plurality of imaging optical lenses may be configured to intersect with an imaginary straight line from a frame point of the diaphragm to an outer edge of the detection area.
[0011] In an outer peripheral portion of each of the plurality of imaging optical lenses, a first refraction angle of a first light ray incident so as to be parallel to a virtual straight line from a center of each of the plurality of imaging optical lenses to the outer peripheral portion of the detection area, and a second refraction angle of a second light ray incident so as to be parallel to an optical axis of each of the plurality of imaging optical lenses may be identical to each other.
[0012] A difference between a first light path by which the first light beam reaches the detector array and a second light path by which the second light beam reaches the detector array may be less than a threshold path difference.
[0013] The image device may further include a processor that generates an image based on detection information sensed by the detector array.
[0014] An image device according to one embodiment includes an imaging optical lens having a non-circular cross section perpendicular to an optical axis, which transmits light received from the outside and passes through it, and a detection array including a plurality of detection elements, which detects the light received through the imaging optical lens with detection elements within a detection area among the plurality of detection elements, and the imaging optical lens and the detection array are arranged in a fractional alignment structure.
[0015] The image device may further include an additional optical lens having a cross section perpendicular to the optical axis that is one of circular and non-circular, and disposed on the opposite side of the detector array relative to the imaging optical lens.
[0016] The imaging optical lens may be a lens that is closer to an image sensor including a collection microlens and the detector array than the additional optical lens.
[0017] The image device may further include a diaphragm disposed on the opposite side of the detector array relative to the imaging optical lens and passing the light.
[0018] The detection array includes a detection region including a portion of the detection elements among the plurality of detection elements, the detection region receiving light from the imaging optical lens and being rectangular, the cross section of the imaging optical lens being shaped like a portion of a circular lens having a diameter larger than the length of the short side of the rectangle.
[0019] The imaging optical lens may be a lens formed by cutting out a part of a circular lens having a diameter larger than the length of the short side of the rectangle.
[0020] The imaging optical lens may be a circular lens having a diameter larger than the length of the short side of the rectangle, and a portion away from a detection region corresponding to the imaging optical lens may be cut out.
[0021] The cross section of the imaging optical lens may be composed of two opposing arcs and straight line portions connecting both ends of each arc.
[0022] The cross section of the imaging optical lens may be composed of four arcs and a straight line portion connecting the four arcs.
[0023] The cross section of the imaging optical lens may have a shape corresponding to a part of a circle having a diameter equal to or greater than a diagonal length of the detection area.
[0024] The cross section of the imaging optical lens may be rectangular.
[0025] The imaging optical lens may be configured to intersect with an imaginary straight line from a frame point of the diaphragm to an outer edge of the detection area.
[0026] At an outer portion of the imaging optical lens, a first refraction angle of a first light ray incident parallel to a virtual straight line from the center of the imaging optical lens to the outer boundary of the detection area, and a second refraction angle of a second light ray incident parallel to the optical axis of the imaging optical lens are similar to each other.
[0027] A difference between a first light path by which the first light beam reaches the detector array and a second light path by which the second light beam reaches the detector array may be less than a threshold path difference.
[0028] A ratio of a cross-sectional area of the non-circular imaging optical lens to the detection area may be greater than 0.78 and less than or equal to 1.
[0029] A ratio of a cross-sectional area of the non-circular imaging optical lens to the detection area may be greater than 0.58 and less than or equal to 1.
[0030] A ratio of a cross-sectional area of the non-circular imaging optical lens to the detection area may be greater than 0.44 and less than or equal to 1.
[0031] A ratio of a cross-sectional area of the non-circular imaging optical lens to the detection area may be greater than 0.39 and less than or equal to 1.
[0032] The ratio of a cross-sectional area of the non-circular imaging optical lens to the detection area may be 0.89 or greater and 1 or less.
[0033] The image device may include a lens array in which a plurality of the non-circular imaging optical lenses are arranged.
[0034] The image device may further include a processor that generates an image based on detection information sensed by the detector array.
[0035] The image device may further include a lens array including the imaging optical lens and an additional imaging optical lens having the same shape and size as the imaging optical lens, and the imaging optical lens and the additional imaging optical lens may be arranged along the same plane.
[0036] The fractional array structure may be a structure in which the detection region includes a non-integer number of detection elements.
[0037] An image device according to one embodiment includes an imaging lens array including a plurality of non-circular imaging optical lenses that transmit light received from the outside, and a plurality of detection areas that detect light received through the non-circular imaging optical lenses, each detection area including a detection array including a plurality of detection elements.
[0038] Each detection region of the detection array can include four or more detection elements.
[0039] Each detection region of the detection array can include nine or more detection elements.
[0040] The image device may further include a diaphragm that is disposed on the opposite side of the detector array with respect to the imaging lens array and that passes the light.
[0041] The imager may further include a filter disposed between the imaging lens array and the detector array for filtering out some wavelengths of the passing light.
[0042] The imager may further include an additional optical lens having a cross section perpendicular to the optical axis of the imager that is one of circular and non-circular and disposed on the opposite side of the detector array relative to the imaging lens array.
[0043] The image device may further include a processor that generates an image based on detection information sensed by the detector array.
[0044] The ratio of the cross-sectional area of the non-circular imaging optical lens to the detector element may be from 0.78 to 1.0.
[0045] The image device may further include a focusing lens array disposed between the imaging lens array and the detection array and including a plurality of focusing lenses for transmitting light that has passed through the imaging lens array to the detection array.
[0046] The number of the plurality of focusing lenses may be greater than the number of the plurality of non-circular imaging optical lenses.
[0047] A mobile terminal according to one embodiment includes an image detection module that receives external light through a non-circular imaging optical lens and detects the external light with a plurality of detection elements to generate detection information, a processor that reconstructs an output image based on the detection information generated by the image detection module, and a memory that stores at least one of the detection information and the output image.
[0048] The image detection module may further include a plurality of focusing lenses disposed between the non-circular imaging optical lens and the plurality of detection elements, the focusing lenses transmitting light passing through the non-circular imaging optical lens to the plurality of detection elements.
[0049] The non-circular imaging optical lens may be a lens among the optical lenses that is disposed closest to the plurality of focusing lenses.
[0050] The area including the detection elements that receive light from the non-circular imaging optical lens may be rectangular, and the cross section of the non-circular imaging optical lens may be a shape that corresponds to a part of a circle having a diameter larger than the length of the short side of the rectangle.
[0051] The non-circular imaging optical lens may be a lens formed by cutting out a part of a circular lens having a diameter larger than the length of the short side of the rectangle.
[0052] An imaging device in one embodiment includes a detection array including a detection area including a plurality of detection elements and a portion of the plurality of detection elements, an imaging lens array including a plurality of imaging optical lenses each of which transmits light received from outside the imaging device and has a non-circular cross-section perpendicular to an optical axis, a focusing lens array including a plurality of focusing lenses arranged between the imaging lens array and the detection array and transmitting light passing through the imaging lens array to the detection elements, and an additional optical lens array including a plurality of additional optical lenses and arranged on the side of the imaging lens array opposite the detection array, wherein the non-circular cross-section of each of the plurality of imaging optical lenses corresponds to the circular lens having a portion cut out such that the diameter of the circular lens is greater than the length of the short side of the rectangular detection area.
[0053] Another image detection method according to one embodiment includes receiving light passing through an imaging optical lens having a non-circular cross section perpendicular to a major axis at a detection area of a detection array corresponding to the imaging optical lens, and detecting the light passing through the imaging optical lens to generate detection information for the detection area.
[0054] The step of receiving the light may include a step of receiving a first light ray at the outer periphery of the detection area, the first light ray being refracted at a first refraction angle at the outer periphery of the imaging optical lens when the light ray is incident so as to be parallel to an imaginary straight line from the center of the imaging optical lens to the outer periphery of the detection area, and a step of receiving a second light ray at the center of the detection area, the second light ray being refracted at a second refraction angle similar to the first refraction angle at the outer periphery of the imaging optical lens when the light ray is incident so as to be parallel to the optical axis of the imaging optical lens.
[0055] A difference between a first light path along which the first light beam reaches the periphery of the detection area and a second light path along which the second light beam reaches the center of the detection area may be less than a threshold path difference.
[0056] Receiving the light may include at least one detector element of the detector array receiving light that has passed through different imaging optical lenses.
[0057] The step of detecting the detection information can include a step of detecting, for each detection area corresponding to each of the plurality of imaging optical lenses, an intensity value of light reaching a detection element belonging to that area.
[0058] The image detection method may further include a step of reconstructing an image corresponding to each of the plurality of imaging optical lenses based on intensity values detected by detection elements for each of the detection regions. Effect of the Invention
[0059] An imaging device according to an embodiment can cover a larger detection area with a smaller optical path difference through a non-circular imaging lens. [Brief description of the drawings]
[0060] [Figure 1A] 1 illustrates the structure of an image device according to an embodiment. [Figure 1B] 1 illustrates the structure of an image device according to an embodiment. [Diagram 2] 1 illustrates a structure of an image device according to another embodiment. [Diagram 3] 4 illustrates an exemplary shape of a lens included in an imaging device according to one embodiment. [Figure 4] 1 illustrates a non-circular imaging optical lens included in an imaging device according to one embodiment. [Figure 5A] 1 illustrates an exemplary shape of a non-circular imaging optical lens according to one embodiment. [Figure 5B] 1 illustrates an exemplary shape of a non-circular imaging optical lens according to one embodiment. [Figure 5C] 1 illustrates an exemplary shape of a non-circular imaging optical lens according to one embodiment. [Figure 5D] 1 illustrates an exemplary shape of a non-circular imaging optical lens according to one embodiment. [Figure 5E] 1 illustrates an exemplary shape of a non-circular imaging optical lens according to one embodiment. [Figure 6] 1 is a diagram showing the relationship between the vertical length of a non-circular imaging optical lens and the diagonal length of a detection area according to an embodiment; [Figure 7] 4 illustrates the light path of an image device according to one embodiment. [Figure 8A] FIG. 2 is a diagram illustrating an MTF (Modulation Transfer Function) according to an embodiment. [Figure 8B] FIG. 1 is a diagram illustrating MTF according to an embodiment. [Figure 9] 1 is a diagram illustrating a lens array configured with non-circular lenses in an imaging device according to an embodiment. [Figure 10] 1 is a diagram illustrating an effective detection area using a square lens in an image device according to an embodiment; [Figure 11] 1 is a diagram illustrating a lens array composed of square lenses in an imaging device according to an embodiment; [Figure 12] FIG. 2 is a block diagram illustrating a configuration of an imaging device according to an embodiment. [Figure 13] FIG. 2 is a diagram illustrating a mobile terminal according to an embodiment. [Figure 14] 1 is a flowchart illustrating an image detection method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0061] The embodiments described below may be modified in various ways, and the scope of the claims is not limited to such embodiments. The same reference numerals in the drawings refer to the same elements.
[0062] Specific structural or functional descriptions disclosed herein are merely exemplary for purposes of describing embodiments, and the embodiments may be embodied in many different forms and the present invention is not limited to the embodiments described herein.
[0063] The terms used in this specification are merely used to describe certain embodiments and are not intended to limit the present invention. A singular expression includes a plural expression unless the context clearly indicates otherwise. In this specification, the terms "include" or "have" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, and should be understood as not precluding the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.
[0064] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the present invention belongs. Commonly used predefined terms should be interpreted as having a meaning consistent with the meaning they have in the context of the relevant art, and should not be interpreted as having an ideal or overly formal meaning unless expressly defined herein.
[0065] In addition, when describing the present invention with reference to the drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and duplicated descriptions thereof will be omitted. In the description of the embodiments, if a detailed description of related known technology is determined to unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.
[0066] 1A and 1B show the structure of an imaging device according to an embodiment, where Fig. 1A is a perspective view of the imaging device and Fig. 1B is a cross-sectional view of the imaging device.
[0067] The image device 100 according to one embodiment includes a lens array 110 and an image sensor 120. The lens array 110 includes lens elements, and the image sensor 120 includes detector elements. The lens elements are arranged along a plane of the lens array 110, and the detector elements are arranged along a plane of a detector array 121 in the image sensor 120. The plane of the lens array 110 is arranged parallel to the plane of the detector array 121. The lens array 110 can also be referred to as an imaging lens array, i.e., a micro multi lens array (MMLA) for imaging.
[0068] The image sensor 120 includes a detector array 121, an optical filter 122, and a condensing lens array 123. If the image sensor 120 does not include the optical filter 122, each individual condensing micro lens 123a of the condensing lens array 123 may be configured to have optical properties that pass a predetermined wavelength band and block the remaining wavelength bands other than the predetermined wavelength band.
[0069] The condensing lens array 123 includes a plurality of condensing microlenses for condensing the light that has passed through the lens array 110 onto the detection array 121. For example, the condensing lens array 123 includes the same number of condensing microlenses as the number of detection elements included in the detection array 121. The plurality of condensing microlenses are provided between the imaging optical lens and the detection array 121, and can condense and transmit the light that has passed through the imaging optical lens to the detection elements 121a corresponding to each of the condensing microlenses 123a.
[0070] For example, as shown in Fig. 1B, a condensing microlens 123a is disposed on each detection element 121a of the detection array 121 to condense light onto the detection element 121a disposed below. Also, as shown in Fig. 1B, a color filter 122a may be provided between each condensing microlens 123a and the detection element 121a.
[0071] The optical filter 122 is a filter having optical properties of passing a predetermined wavelength band and blocking the remaining wavelength band. For example, the optical filter 122 can be realized as a color filter array (CFA) including a plurality of color filters arranged along a filter plane. Each color filter 122a may be a filter that passes light of a wavelength band corresponding to an arbitrary color and blocks light of the remaining wavelength bands other than the predetermined color. For example, the color filters 122a include a red pass filter, a green pass filter, and a blue pass filter. The red pass filter passes light of a wavelength band corresponding to red and blocks light of the remaining wavelength bands except the wavelength band corresponding to red. The green pass filter passes light of a wavelength band corresponding to green and blocks light of the remaining wavelength bands except the wavelength band corresponding to green. The blue pass filter passes light of a wavelength band corresponding to blue and blocks light of the remaining wavelength bands except the wavelength band corresponding to blue. The color filters that pass color lights individually in the color filter array can be arranged in a Bayer pattern or other patterns along the filter plane. The optical filter 122 may also be an infrared blocking filter that passes the visible light band and blocks the infrared band.
[0072] The quality of an image captured and restored by the image sensor 120 according to an embodiment is determined by the number of detector elements included in the detector array 121 and the amount of light incident on the detector elements 121a. For example, the resolution of an image may be determined according to the number of detector elements included in the detector array 121, and the sensitivity of the image may be determined by the amount of light incident on the detector elements 121a, which may be determined based on the size of the detector elements 121a. The larger the size of the detector elements 121a, the more the amount of incident light increases, and the dynamic range of the detector array 121 increases. Therefore, as the number of detector elements included in the detector array 121 increases, the image sensor 120 can capture a high-resolution image, and as the size of the detector elements 121a increases, the image sensor 120 can advantageously capture a high-sensitivity image in low illumination.
[0073] The volume of the image device 100 is determined by the focal length of the lens elements 111. More specifically, the volume of the image device 100 is determined by the distance between the lens elements 111 and the detector array 121 because the image sensor 120 must be spaced apart from the lens elements 111 by a distance corresponding to the focal length of the lens elements 111 in order to collect the light refracted by the lens elements 111. Thus, the plane of the lens array 110 is spaced apart from the image sensor 120 by a distance corresponding to the focal length of the lens elements 111 included in the lens array 110. The focal length of the lens elements 111 is determined according to the viewing angle of the image device 100 and the size of the lens elements 111. When the viewing angle is fixed, the focal length increases in proportion to the size of the lens elements 111, and in order to capture an image in a certain viewing angle range, the size of the lens elements 111 must increase as the size of the detector array 121 increases.
[0074] As described above, in order to increase the image sensitivity while maintaining the viewing angle and image resolution, the volume of the image sensor 120 is increased. For example, in order to increase the image sensitivity while maintaining the image resolution, the number of detector elements included in the detector array 121 must be maintained while the size of each detector element must be increased, and thus the size of the detector array 121 is increased. Here, in order to maintain the viewing angle, the size of the lens element 111 increases as the size of the detector array 121 increases, and the focal length of the lens element 111 becomes longer, thereby increasing the volume of the image sensor 120.
[0075] According to an embodiment, the smaller the size of each lens element included in the lens array 110, in other words, the more lenses included in the same area on the lens array 110, the smaller the focal length of the lens elements 111 and the thinner the image device 100. Thus, a thinner camera can be realized. In this case, the image device 100 can reconstruct a high-resolution output image by rearranging and combining the low-resolution images captured by each lens element 111.
[0076] Each individual lens element 111 of the lens array 110 can cover a certain detection area 129 of the detection array 121 that corresponds to the size of its lens. The detection area 129 covered by the lens element 111 in the detection array 121 is determined according to the lens size of the lens element 111. The detection area 129 indicates an area of an image of the detection array 121 that a light beam having a certain viewing angle range reaches after passing through the lens element 111. The size of the detection area 129 is expressed as a distance from the center to the outermost point of the detection area 129, or a diagonal length. Light that has passed through the imaging optical lens can be received in the detection area 129 of the detection array 121 that corresponds to the imaging optical lens. In other words, the light that has passed through the individual lens element 111 can be incident on the detection element of the detection array 121 included in the detection area 129.
[0077] Each of the detection elements of the detection array 121 may generate detection information based on light rays passing through the lenses of the lens array 110. For example, the detection element 121a detects the intensity value of light received through the lens element 111 as the detection information. The image device 100 determines intensity information corresponding to an original signal for a point included in the field of view of the image device 100 based on the detection information output by the detection array 121, and restores a captured image based on the determined intensity information. For example, the individual detection elements 121a of the detection array 121 may be optical sensing elements formed of a complementary metal oxide semiconductor (CMOS) or a charge-coupled device (CCD), etc.
[0078] In addition, the detection element 121a can generate a color intensity value corresponding to a desired color as detection information by detecting light that has passed through the color filter 122a. Each of the detection elements constituting the detection array 121 can be arranged to detect a color different from that of an adjacent detection element that is spatially adjacent thereto.
[0079] In order to ensure sufficient diversity of the detection information, a captured image corresponding to the maximum resolution of the detector array 121 is derived when a full rank relationship is formed between the original signal information and the detection information corresponding to the points included in the field of view of the image device 100. The diversity of the detection information can be ensured based on parameters of the image device 100, such as the number of lenses included in the lens array 110 and the number of detection elements included in the detector array 121.
[0080] In a multi-lens array structure for imaging according to an embodiment, the imaging optical lenses and the detector array 121 are arranged in a fractional alignment structure. For example, the fractional alignment structure refers to a structure in which the detector area 129 covered by the individual lens elements 111 includes a non-integer number of detector elements. Each detector area 129 of the detector array 121 may include, for example, four or more detector elements. As a different example, the detector area 129 may include nine or more detector elements.
[0081] When the lens elements included in the lens array 110 have the same lens size, the number of lens elements included in the lens array 110 and the number of detector elements included in the detector array 121 are relatively prime relative to each other. The ratio P / L between the number L of lens elements corresponding to one axis of the lens array 110 and the number P of detector elements corresponding to one axis of the detector array 121 is determined as a real number. Each of the lens elements covers the same number of detector elements as the pixel offset corresponding to P / L. For reference, the detector area 129 shown in FIG. 1A may exemplarily include 7 / 3=2.3 detector elements along the horizontal axis and 11 / 3=3.67 detector elements along the vertical axis. Furthermore, the lens element 111 covers a non-integer number of condensing microlenses. Therefore, the number of condensing microlenses in the image sensor 120 is the same as the number of detector elements in the detector array 121, and the number of lens elements (e.g., imaging optical lenses) in the lens array 110 may be less than the number of condensing microlenses.
[0082] Due to the above-mentioned fractional array structure, the image device 100 may have an arrangement in which the optical center axis (OCA) of each lens element 111 is slightly different from each other with respect to the detector array 121. In other words, the lens elements 111 may be arranged eccentrically with respect to the detector elements 121a. For example, at least one detector element of the detector array 121 receives light rays that have passed through different imaging optical lenses. Taking FIG. 1B as an example, the fourth detector element from the left may receive light rays that have passed through the left lens element 111 and the middle lens element. Thus, each lens element 111 of the lens array 110 may receive different light field information. For reference, a light field (LF) refers to a field that indicates the direction and intensity of light rays emitted from an arbitrary target point and reflected from an arbitrary point on the object. The light field information refers to information obtained by combining a plurality of light fields. Since the direction of the chief ray of each lens element 111 also changes, each detection region 129 receives different light field information, and the image device 100 can optically obtain more detection information. The image sensor 120 can detect the intensity value of light reaching the detection element belonging to each detection region corresponding to each of the plurality of imaging optical lenses. The processor of the image sensor 120 restores images (e.g., a plurality of low-resolution images) corresponding to each of the plurality of imaging optical lenses based on the intensity value detected from the detection element of each detection region. Thus, the image device 100 can obtain a plurality of low-resolution input images through various detection information obtained as described above, and restore a higher resolution output image from the low-resolution input images.
[0083] FIG. 2 shows the structure of an image device according to another embodiment.
[0084] The image device 200 according to an embodiment includes an additional lens array 230 and an aperture 240 in addition to the imaging lens array 210 and the detection array 220. For reference, the detection array 220 is shown in Fig. 2, but the remaining components of Fig. 1 are omitted for the sake of clarity, and the present invention is not limited thereto. For example, an optical filter 122 and a focusing lens array 123 may be further disposed between the detection array 220 and the imaging lens array 210.
[0085] The imaging lens array 210 includes optical lens elements for imaging. The lens elements 211 may be referred to as imaging optical lenses, and the f-number of the image device 200 may be set by the focal length f of the imaging optical lenses 211. The imaging lens array 210, the imaging optical lenses 211, the detection array 220, and the detection area 229 are the same and / or similar to the lens array 110, the lens elements 111, the detection array 121, and the detection area 129 described above with reference to FIG. 1, respectively, and therefore detailed description thereof will be omitted.
[0086] The opening 240 includes a plurality of apertures. The aperture 241 may be formed, for example, in a circular shape and may transmit light. For example, the plurality of apertures are formed along a plane corresponding to the opening 240. The plurality of apertures are formed by being filled with a transparent material so that a cross section perpendicular to the optical axis is circular, but is not limited thereto. The light beams passing through the plurality of apertures may be transmitted to the next optical element corresponding to the apertures 241, respectively. In FIG. 2, the light beams passing through the apertures 241 in the opening 240 may be transmitted to the additional lens 231 of the additional lens array 230.
[0087] The additional lens array 230 includes a plurality of additional lenses. The plurality of additional lenses are arranged along a virtual plane corresponding to the additional lens array 230. Each of the plurality of additional lenses included in the additional lens array 230 can transmit a light ray received from a previous layer (e.g., the opening 240 in FIG. 2) to a next layer (e.g., the imaging lens array 210 in FIG. 2).
[0088] For reference, only one layer of each of the imaging lens array 210 and the additional lens array 230 is shown in Fig. 2, but the present invention is not limited thereto. The image device 200 may include a plurality of imaging lens arrays 210 and a plurality of additional lens arrays 230. Here, the imaging lens array 210, as a lens array for finally forming an image, is disposed so as to face the detection array 220 while being more adjacent to the detection array 220 than the additional lens array 230 among the lens arrays. When the condenser lens array 123 shown in Fig. 1 is disposed on the detection array 220, the condenser lens array 123 is disposed closest to the detection array 220, and the imaging lens array 210 is disposed next (e.g., second) adjacent to the detection array 220.
[0089] In this specification, the imaging lens array 210 and the additional lens array 230 may be referred to as optical lens arrays. One of the imaging lens arrays 210 is disposed closest to the condenser lens array 123 than all other optical lens arrays. The area ratio of the noncircular imaging optical lens 211 to the detection area 229 of the imaging lens array 210 closest to the image sensor 120 may be greater than the area ratio of the circular lens to the detection area 229. Therefore, the refractive power required for the light ray passing through the outer portion of the noncircular imaging optical lens 211 to reach the outer portion of the detection area 229 may be reduced. In other words, the optical error in the outer portion of the noncircular imaging optical lens 211 may be reduced.
[0090] In the following, a description will be given based on the optical elements through which an arbitrary light ray passes along the optical path from the aperture 241 to the detection array. For example, the structures and arrangements of the aperture 241, the additional optical lens 231, the imaging optical lens 211, and the detection region 229 will be mainly described, and similar descriptions will be applied to the remaining optical elements of each array.
[0091] FIG. 3 illustrates an exemplary shape of a lens included in an imaging device according to one embodiment.
[0092] In the image device, optical elements are arranged in the order of an aperture 340, an additional optical lens 330, and an imaging optical lens 310. As shown in FIG.
[0093] Aperture 340 is disposed on the opposite side of detector array 320 relative to imaging optical lens 310 and allows light to pass therethrough.
[0094] The imaging optical lens 310 has a non-circular cross section perpendicular to the main axis of the image device, and transmits light received from the outside to the detection array 320. The imaging optical lens 310 has a non-circular cross section and covers a wider detection area. The imaging optical lens 310 is configured to refract light received from an object and form an image on the plane of the detection array 320. The cross section of the imaging optical lens 310 will be described with reference to FIGS. 4 to 5E below.
[0095] The additional optical lens 330 may have a cross section perpendicular to the main axis that is either circular or noncircular, and may be provided on the opposite side of the detection array 320 with respect to the imaging optical lens 310, between the aperture 340 and the imaging optical lens 310. Although the additional optical lens 330 is shown to be a circular lens in Fig. 3, this is not limiting. For example, when multiple additional optical lenses 330 are arranged, some of the multiple additional optical lenses 330 may be circular lenses and the rest may be noncircular lenses.
[0096] The detector array 320, as described above, includes a plurality of detector elements, and light received through the imaging optical lens 310 can be detected by the detector elements within the detection region.
[0097] The image device further includes an optical filter 350. The optical filter 350 is disposed between the imaging optical lens 310 and the detector array 320 and filters out some wavelengths of light passing through the imaging optical lens 310. For example, the optical filter 350 shown in Figure 3 is an infrared filter that blocks light having wavelengths in the infrared band and passes light in the visible light band. The optical filter 350 shown in Figure 3 is distinct from the optical filter 122 in the image sensor 120 described with reference to Figures 1A and 1B.
[0098] For reference, there may be no other imaging lens disposed between the image sensor including the imaging optical lens 310 and the detector array 320. For example, when the image device includes multiple lenses such as the additional optical lens 330 and the imaging optical lens 310, the imaging optical lens 310 facing the detector array 320 is a lens that is closer to the detector array 320 than the additional optical lens 330.
[0099] FIG. 4 illustrates a non-circular imaging optical lens included in an imaging device according to one embodiment.
[0100] FIG. 4 illustrates, in a front-view, one of the imaging optics 410 of the lens array and a detection area 420 corresponding to the imaging optics 410 of the detection array.
[0101] According to one embodiment, the detection area 420 is rectangular. For example, in Fig. 4, the length of the short side of the rectangular detection area 420 is shown as a, the length of the long side is shown as b, the length from the center of the rectangle to the vertex of the rectangle (e.g., the diagonal half length) is shown as h, and the length of the diagonal of the detection area 420 is 2h, each of which is a unit of length, which may be illustratively mm (millimeter), μm (micrometer), nm (nanometer), etc.
[0102] Since the circular lens 401, which is configured to be smaller than the detection area 420, covers only a part of the detection area 420, the light received from the outside cannot reach the remaining area that is not covered by the circular lens 401. In addition, if the circular lens 401 is configured to transmit light to the remaining area, optical aberration may occur due to excessive refraction at the outer portion of the circular lens 401.
[0103] According to an embodiment, the imaging optical lens 410 is a lens in which a part of a circular lens 411 having a diameter larger than the length of the short side of a rectangle is cut out. For example, the imaging optical lens 410 is a lens in which a part 415 away from the detection region 420 corresponding to the imaging optical lens 410 is cut out from the circular lens 411 having a diameter larger than the length of the short side of the rectangle. Therefore, the cross section of the imaging optical lens 410 may have a shape corresponding to a part of a circle having a diameter larger than the length of the short side of the rectangle. Various shapes of the imaging optical lens 410 will be described below with reference to FIGS. 5A to 5E.
[0104] 5A-5E show exemplary shapes of non-circular imaging optical lenses according to one embodiment.
[0105] In this specification, the imaging optical lenses 511, 512, 513, 514, 515 may be non-circular lenses, as lenses in which a part of a circular lens is cut as described with reference to FIG. 4. According to an embodiment, the cross section of the imaging optical lenses 511, 512, 513, 514, 515 is determined according to the shape of the detection area 520. The diameter of the imaging optical lenses 511, 512, 513, 514, 515 indicates the diameter of the circular lens before cutting. The radius of the circular lens is denoted as Lh. The length from the center of the imaging optical lenses 511, 512, 513, 514, 515 to the long side of the detection area 520 is denoted as Lh'.
[0106] 5A illustrates an example in which the diameter of the imaging optical lens 511 is longer than the length a of the short side of the detection area 520 and shorter than the length b of the long side. The cross section of the imaging optical lens 511 is composed of two mutually opposing arcs 551, 552 and straight line portions 553, 554 connecting both ends of each arc. In the cross section, the first straight line portion 553 connects the first stage of the first arc 551 to the first stage of the second arc 552. The second straight line portion 554 connects the second stage of the first arc 551 to the second stage of the second arc 552.
[0107] 5B illustrates an example in which the diameter of the imaging optical lens 512 is longer than the length b of the long side of the detection area 520 and shorter than the diagonal length 2h. The upper and lower parts of the circular lens as well as both sides are away from the detection area 520, so they can be cut out. The imaging optical lens 512 is composed of four arcs 561, 563, 565, 567 and straight line portions 562, 564, 566, 568 connecting the four arcs. The first arc 561 and the third arc 565 face each other, and the second arc 563 and the fourth arc 567 face each other. The first straight portion 562 connects the first arc 561 and the second arc 563, the second straight portion 564 connects the second arc 563 and the third arc 565, the third straight portion 566 connects the third arc 565 and the fourth arc 567, and the fourth straight portion 568 connects the fourth arc 567 and the first arc 561. The first straight portion 562 and the third straight portion 566 are parallel to each other, and the second straight portion 564 and the fourth straight portion 568 are parallel to each other. The first straight portion 562 and the third straight portion 566 are perpendicular to the second straight portion 564 and the fourth straight portion 568.
[0108] FIG. 5C illustrates an example in which the diameter of the imaging optical lens 513 is equal to or greater than the diagonal length 2h of the detection region 520. The cross section of the imaging optical lens 513 is a shape corresponding to a part of a circle having a diameter equal to or greater than the diagonal length 2h of the detection region 520. The cross section of the imaging optical lens 513 cut from the above-mentioned circular lens may be a rectangle. In the cross section of the imaging optical lens 513, the first straight portion 571 and the third straight portion 573 may be parallel to each other, and the second straight portion 572 and the fourth straight portion 574 may be parallel to each other. In addition, the first straight portion 571 and the third straight portion 573 are perpendicular to the second straight portion 572 and the fourth straight portion 574.
[0109] The non-circular optical lens according to the embodiment has a cross-sectional area equal to or larger than a certain area compared to the opposing detection region 520. Fig. 5C shows an example in which the area ratio of the non-circular optical lens to the detection region 520 is 1 at maximum, and Fig. 5D shows an example in which the area ratio of the non-circular optical lens to the detection region 520 is minimum.
[0110] 5D shows a lens 514 that is smaller than the smallest diameter lens that the non-circular imaging optical lens 511 shown in FIG. 5A has before it is cut. In other words, the diameter of the non-circular imaging optical lens 511 must be larger than the diameter of the circular optical lens 514, 2Lh (=a), and the area ratio of the non-circular optical lens compared to the detection area must exceed the ratio calculated based on the circular optical lens 514. As an example shown in FIG. 5D, the ratio of the cross-sectional area of the optical lens to the corresponding detection area 520, in other words the area S of the detection area 520, is sensor Contrast the area S of the circular optical lens 514 Lens、min The area ratio can be expressed as follows:
[0111]
number
[0112] 5E shows a structure in which the diameter 2Lh of the imaging optical lens 515 has the same length as the long side b of the detection area 520, within the size range of the imaging optical lenses 511, 512, 513, and 514 described above with reference to FIGS. 5A to 5D. The imaging optical lens 515 shown in FIG. 5E covers all of the detection elements along one axis (e.g., the horizontal axis) that crosses the center of the detection area 520. In the structure shown in FIG. 5E, the area S of the detection area 520 is sensor Compared to the area S of the imaging optical lens 515 Lens、med The area ratio can be expressed as follows:
[0113]
number
[0114] FIG. 6 is a diagram showing the relationship between the vertical length of a noncircular imaging optical lens and the diagonal length of a detection area according to an embodiment.
[0115] As shown in FIG. 6, the light beam passing through the aperture of the aperture 640 is incident on the detection array through the additional optical lens 630 and the imaging optical lens 610. The imaging optical lens 610 according to an embodiment is configured to intersect with an imaginary straight line 691 from the frame point of the aperture to the outer edge of the detection region 620. A portion of the circular lens that does not intersect with the imaginary straight line 691 may be cut out. The vertical length Lh' of the imaging optical lens 610 based on the optical axis 601 is smaller than the radius Lh of the circular lens by the cut length Cut-h. For example, the vertical length Lh' of the imaging optical lens 610 may be smaller than the diagonal half length h based on the optical axis 601.
[0116] The cross-sectional shape of the imaging optical lens 610 cut out from a circular lens is as described above with reference to FIGS. 5A to 5C, but is not limited thereto.
[0117] As described above, the imaging optical lens 610 cut by the cut length Cut-h from the circular lens may be arranged so as not to overlap with other imaging optical lenses corresponding to other detection regions in the detection array. In addition, since the imaging optical lens 610 intersects with the straight line path from the aperture to the outer edge of the detection region 620, optical aberration and distortion are minimized until the light beam passing through the aperture passes through the imaging optical lens 610 and reaches the detection region 620.
[0118] For reference, Fig. 6 merely illustrates the vertical length Lh' of the noncircular imaging optical lens 610 and the diagonal half length h of the detection area on the same two-dimensional plane to explain length comparison, and the actual arrangement of the noncircular imaging optical lens 610 and the detection array is not limited to that shown in Fig. 6. For example, the imaging optical lens 610 and the detection array may be arranged as shown in Figs. 1 to 4 described above.
[0119] Figure 7 shows the light path of an image device according to one embodiment, illustrating the imaging of chief and marginal rays by an imaging optical lens 710 in a top-view diagram.
[0120] According to one embodiment, the imaging optical lens 710 is a lens cut in the shape shown in Figures 5A-5C from a circular lens having a diameter of LD', which may be the same as or similar to the diagonal length SD' of the detection area.
[0121] Here, a first refraction angle of a first light ray 781 incident on a path parallel to a virtual straight line from the center of the imaging optical lens 710 to the outer edge of the detection area 720 at the outer edge portion 715 of the imaging optical lens 710 is JPEG0007616743000004.jpg1110, and a second refraction angle of a second light ray 782 incident parallel to the optical axis of the imaging optical lens 710. JPEG0007616743000005.jpg99 may be similar to each other. The outer portion 715 includes, for example, a point separated from the center of the imaging optical lens 710 by a diagonal half length h of the detection area 720 and points around it. The first light ray 781 is refracted by the outer portion 715 of the imaging optical lens 710 and reaches the outer edge of the detection area 720. The second light ray 782 is refracted by the same outer portion 715 and reaches the center (e.g., the focus) of the detection area 720. The image sensor detects that a light ray incident so as to be parallel to a virtual straight line from the center of the imaging optical lens 710 to the outer edge of the detection area 720 is refracted at a first refraction angle at the outer portion of the imaging optical lens 710. The image sensor can receive the first light ray 781 refracted at the second refraction angle TIFF0007616743000006.tif44 at the outer periphery of the detection area 720. Also, the image sensor can receive the first light ray 781 refracted at the second refraction angle TIFF0007616743000006.tif44 at the outer periphery of the detection area 720. The second light ray 782 refracted to JPEG0007616743000007.jpg1011 can be received at the center of the detection area 720. JPEG0007616743000008.jpg1110 and the second refraction angle The smaller the angle difference of JPEG0007616743000009.jpg1213, the more the image device can capture an image of the object with reduced optical aberration and distortion.
[0122] Also, the difference between the first light path through which the first light ray 781 reaches the detection array and the second light path through which the second light ray 782 reaches the detection array may be less than the threshold path difference. In other words, in the imaging optical lens according to an embodiment, the difference between the optical path length (OPD) of the light passing through the 0.0 field of the lens (e.g., the light toward the center of the detection area) and the light passing through the 1.0 field (e.g., the light toward the outer edge of the detection area) may be reduced. The smaller the difference in the optical path length, the smaller the optical aberration and distortion. For example, in a camera lens implemented in a smartphone, the maximum size of half the size of the lens in the 1.0 field and the 0.0 field may be 10 mm. Also, the difference in the optical path length between the light passing through the 0.0 field and the light passing through the 1.0 field to reach the sensor may be within 10 mm.
[0123] 8A and 8B are diagrams illustrating an MTF (Modulation Transfer Function) according to one embodiment.
[0124] In Fig. 8A, a side-view of the image device structure shown in Fig. 3 and the MTF of the image device are shown. In Fig. 8B, a side-view of a device structure composed of a circular lens 830 different from that in Fig. 3 and the MTF of the device are shown. MTF is a kind of index showing optical performance. In MTF graphs 891 and 892, the vertical axis shows the MTF value and the horizontal axis shows the spatial frequency. In MTF graphs 891 and 892, each line shows the transition of the MTF value of a light ray incident on the aperture at an arbitrary incident angle. The transition of the MTF value may be shown by the spatial frequency. The incident angle shows the angle based on the normal perpendicular to the entrance boundary surface of the aperture.
[0125] In the image device structure shown in FIG. 8A, the light beam passing through the center and outer edge of the aperture at the opening 340 passes through the additional optical lens 330, the imaging optical lens 310, and the optical filter 350, and reaches the detection area 320. In the device structure shown in FIG. 8B, the light beam passing through the aperture at the opening 340 passes through the circular lens 830 and the optical filter 350, and reaches the detection area 320. The light beam perpendicularly incident on the aperture passes through the center of the rearmost imaging optical lens 310 in the image device structure shown in FIG. 8A, and the rearmost circular lens 830 in the device structure shown in FIG. 8B. The larger the angle of incidence between the aperture and the light beam, the more the light beam passes through the parts (e.g., outer parts) farther from the center of the rearmost imaging optical lens 310 and the rearmost circular lens 830.
[0126] The MTF does not decrease significantly even for light having a large incident angle passing through the outer periphery of the imaging optical lens 310. Meanwhile, in the MTF graph 892 of the device shown in Fig. 8B, the MTF value 899 of light having a large incident angle to the aperture and passing through the outer periphery of the circular lens 830 is rapidly attenuated as the spatial frequency increases. Therefore, the MTF graph 891 of the image device shown in Fig. 8A shows a stable value of MTF for each incident angle of the light and spatial frequency.
[0127] FIG. 9 is a diagram illustrating a lens array configured with non-circular lenses in an imaging device according to an embodiment.
[0128] The image device may include a lens array 900 in which a plurality of non-circular imaging optical lenses are arranged as an imaging array. For example, the lens array 900 is composed of an imaging optical lens 910 and an additional imaging optical lens having the same shape and size as the imaging optical lens 910. The imaging optical lens 910 and the additional imaging optical lens are arranged along the same plane. The size and shape of the detection area 920 covered by the imaging optical lens 910 and the detection area covered by the additional imaging optical lens may also be the same.
[0129] 9, the size of the detection array is M×N (mm), and a structure in which a lens array 900 includes 2×2 imaging optical lenses is shown. The detection area occupied by each imaging optical lens 910 in the detection array is M / 2×N / 2 in size.
[0130] FIG. 10 is a diagram illustrating an effective detection area using a square lens in an image device according to an embodiment.
[0131] In the same size of detection area, the available effective detection area may change depending on the size of the lens. For example, when a circular imaging lens 1001 is used in a lens array, the lens does not protrude outside the detection area 1002 assigned to each circular imaging lens 1001, so that the diameter of the circular imaging lens 1001 is limited to the length of the short side in the detection area 1002 or less. In this case, the effective detection area 1009 of the circular imaging lens 1001 is limited to a part of the detection area 1002 as shown in FIG. 10. For example, when a detection array includes detection elements that can support a maximum resolution of 108.6M (12032×9024), the resolution of the effective detection area 1009 of the circular imaging lens 1001 is limited to 81M.
[0132] Meanwhile, as described with reference to FIGS. 1 to 9, when the non-circular imaging lens 1010 is used, the effective detection area 1090 of the non-circular imaging lens 1010 is substantially the same as or similar to the detection area 1020, so that the resolution of the effective detection area 1090 is 108M. In other words, when the non-circular imaging lens 1010 is disposed, the image device uses the full region of the detection area 1020. Therefore, the image device including the non-circular imaging lens 1010 according to an embodiment can capture an image with increased resolution for the same detection area 1020 as compared to the circular imaging lens 1001.
[0133] For reference, in Fig. 10, a square lens is shown as the non-circular imaging lens 1010, but is not limited thereto. The non-circular imaging lens 1010 may have a cross section in the shape of a modified square in addition to a rectangular or square.
[0134] FIG. 11 is a diagram illustrating a lens array composed of square lenses in an imaging device according to an embodiment.
[0135] In a lens array in which lens elements are arranged along a plane in a lattice pattern, when the diameter LD' of a circular lens 1101 is equal to or greater than the diagonal length SD' of an individual detection region 1120, each circular lens 1101 has an overlapping area with another circular lens 1101. Since it is physically difficult for lenses to overlap, a noncircular imaging optical lens 1110 according to an embodiment may be configured in a shape in which a part is cut out from a circular lens 1101 having a diameter LD' equal to or greater than the diagonal length SD' of the detection region 1120. For example, a part of the circular lens 1101 that overlaps with another circular lens 1101 may be cut out. As shown in FIG. 11, the noncircular imaging optical lens 1110 cut out from a circular lens 1101 having a diameter LD' equal to or greater than the diagonal length SD' of the detection region 1120 may have a rectangular cross section. For reference, in FIG. 11, all of the non-circular imaging optical lenses 1110 in the lens array are shown as having the same shape, i.e., a rectangular cross section perpendicular to the optical axis, but this is not limited thereto, and the shape of at least one imaging lens in the lens array may be different from the shape of the other imaging lenses.
[0136] As described above, the imaging optical lens with a rectangular cross section covers the full region of each detection area 1120, maximizing the performance of the lens and reducing optical aberrations, etc. Thus, the image device can obtain an image of the object with improved resolution.
[0137] Fig. 12 is a block diagram illustrating a configuration of an image device according to an embodiment, and Fig. 13 is a diagram illustrating a mobile terminal according to an embodiment.
[0138] The image device 1200 according to an embodiment includes an aperture 1240, an additional optical lens 1230, an imaging optical lens 1210, a detection array 1220, and a processor 1260. The lens layers, such as the additional optical lens 1230 and the imaging optical lens 1210, are configured in N pieces. Here, N may be an integer of 2 or more. The additional optical lens 1230 layer may be one or more layers, and the imaging optical lens 1210 layer may also be one or more layers. The detection array 1220 includes detection elements that detect light and generate electrical signals. The aperture 1240, the additional optical lens 1230, the imaging optical lens 1210, and the detection array 1220 have been described above with reference to FIGS. 1 to 12, and therefore the remaining detailed description will be omitted. For reference, a module including the imaging optical lens 1210 and the detection array 1220 may be referred to as an image sensing module. In addition to the imaging optical lens 1210 and the detection array 1220, the image detection module may further include one or more combinations of an aperture 1240, an additional optical lens 1230, an optical filter (122 shown in Figures 1A and 1B), and a focusing lens array (123 shown in Figures 1A and 1B), depending on the design.
[0139] The processor 1260 can obtain information of the object through the aperture 1240, the additional optical lens 1230, and the imaging optical lens 1210, and can restore an image related to the object. For example, the processor 1260 generates an image based on detection information detected by the detection array 1220. For example, the processor 1260 obtains an image corresponding to each detection area from detection information detected in the individual detection area. The processor 1260 obtains as many images as the number of detection areas constituting the detection array 1220. The processor 1260 can restore a single high-resolution image by rearranging and / or reconstructing the images generated based on the detection information. However, the operation of the processor 1260 is not limited thereto.
[0140] The image device 1200 according to one embodiment may be implemented as a mobile terminal 1300 as shown in FIG.
[0141] The image detection assembly 1390 of the mobile terminal 1300 can be realized in an ultra-thin structure through an imaging lens array 1394 configured with a non-circular imaging optical lens (e.g., a lens having a square cross section). The image detection assembly 1390 receives external light through the non-circular imaging optical lens, detects the external light with a plurality of detection elements, and generates detection information. For example, the image detection assembly 1390 includes a detection array 1391, an optical filter 1392, a condenser lens array 1393, an imaging lens array 1394, an additional lens array 1395, and an aperture 1396. Each component of the image detection assembly 1390 has been described above with reference to FIG. 12, and therefore a detailed description thereof will be omitted.
[0142] The image detection assembly 1390 may be realized as a vision camera module for recognition of a smartphone camera, a DSLR camera, a vehicle / drone / CCTV, etc. For example, one or more of the rear camera 1311 and the front camera 1312 of the mobile terminal 1300 may be the image detection assembly 1390. The rear camera 1311 may include a plurality of rear camera modules, and one or more of the plurality of rear camera modules may be the image detection assembly 1390. Also, the front camera 1312 may include one or more front camera modules, and one or more of the one or more front camera modules may be the image detection assembly 1390.
[0143] The rear camera 1311 is a camera disposed on a surface of the housing of the mobile terminal 1300 other than the display 1340, for example, a camera disposed on the surface opposite the display 1340. The rear surface refers to the surface of the mobile terminal 1300 opposite the surface on which the display 1340 is disposed. The front camera 1312 is disposed on the same surface as the display 1340 on the housing of the mobile terminal 1300. The front surface refers to the surface on which the display 1340 is disposed on the mobile terminal 1300.
[0144] The image detection assembly 1390 having an ultra-thin structure transmits light to the detection array 1391 through the imaging lens array 1394, and the processor 1320 of the mobile terminal 1300 acquires an image of an object through the detection array 1391. The processor 1320 restores an output image based on detection information generated by the image detection assembly 1390. For example, the processor 1320 may acquire images equal to the number of detection areas constituting the detection array 1391, as described above with reference to FIG. 12. The input image acquired corresponding to each detection area may be a low-resolution image. The processor 1320 may restore a single output image with a high resolution for the image detection assembly 1390 by rearranging and / or reconstructing the images generated based on the detection information. For reference, only one processor 1320 is shown in FIG. 13, but the mobile terminal 1300 may include multiple processors, and at least one of the multiple processors 1320 may perform image processing on the detection information detected from the image detection module.
[0145] The memory 1330 stores at least one of the detection information and the output image, for example, the memory 1330 may temporarily or permanently store data required or calculated in the process of the processor 1320 performing an operation of restoring a high-resolution output image from the detection information.
[0146] FIG. 14 is a flow chart illustrating an image detection method according to an embodiment.
[0147] First, in step S1410, the image device transmits light received from the outside through an imaging optical lens having a non-circular cross section perpendicular to the main axis of the image device to a detection array.
[0148] Then, in step S1420, the imager detects the light received by the detector elements in the detector area of the detector array through the imaging optical lens.
[0149] However, the image detection method is not limited to the above, and may be performed in parallel and / or sequentially with at least one of the operations described above with reference to FIGS. 1 to 12.
[0150] The above-mentioned devices may be implemented with hardware components, software components, or a combination of hardware and software components. For example, the devices and components described herein may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), a programmable logic unit (PLU), a microprocessor, or other devices that execute and respond to instructions. The processing device executes an operating system (OS) and one or more software applications that run on the operating system. The processing device also accesses, stores, manipulates, processes, and generates data in response to the execution of the software. For ease of understanding, the processing device may be described as being one in which only one processing device is used, but one skilled in the art will appreciate that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.
[0151] The software may include computer programs, codes, instructions, or any combination of one or more thereof, which may configure or instruct a processing device to operate as desired, either independently or in combination. The software and / or data may be embodied in any type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave, either permanently or temporarily, to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed over computer systems coupled to a network, and may be stored and executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.
[0152] The method according to the present invention may be embodied in the form of program instructions to be executed by various computer means and recorded on a computer-readable recording medium. The recording medium may include program instructions, data files, data structures, and the like, alone or in combination. The recording medium and the program instructions may be specially designed and constructed for the purposes of the present invention, or may be well known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code, such as produced by a compiler, but also high-level language code executed by a computer using an interpreter, and the like. The hardware devices may be configured to operate as one or more software modules to perform the operations shown in the present invention, and vice versa.
[0153] Although the embodiments have been described above with reference to limited drawings, those skilled in the art may apply various technical modifications and variations based on the above description. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than described, or may be replaced or substituted with other components or equivalents to achieve appropriate results.
[0154] Therefore, the scope of the present invention should not be limited to the disclosed embodiment, but should be determined by the appended claims and their equivalents. [Explanation of symbols]
[0155] 100 Image Device 110 Lens Array 111 Lens Element 120 Image Sensor 121 Detection Array 121a Detection element 122a Color Filter 122 Optical Filters 123 Condenser Lens Array 123a Condenser microlens 129 Detection Area 200 Image Device 210 Imaging Lens Array 211 Imaging Optical Lenses 220 Detection Array 230 additional lens array 231 Additional Optical Lens 240 Opening 241 Aperture 310 Imaging Optical Lens 330 Additional Optical Lenses 340 Aperture 350 Optical Filters 410 Imaging Optical Lens 420 Detection Area 511 Imaging Optical Lens 512 Imaging Optical Lens 513 Imaging Optical Lens 514 Imaging Optical Lens 515 Imaging Optical Lens 520 Detection Area 551 arc 552 arc 553 Straight section 554 Straight section 561 arc 562 Straight section 563 arc 564 Straight section 565 arc 566 Straight section 567 arc 568 Straight section 610 Imaging Optical Lens 620 Detection Area 630 Additional Optical Lens 640 Opening 691 Imaginary Line 710 Imaging Optical Lens 715 Outer shell 720 Detection Area 781 1st ray 782 Second Ray 830 Circular Lens 900 Lens Array 910 Imaging Optical Lens 1001 Circular Imaging Lens 1002 Detection area 1010 Non-circular imaging lens 1090 Effective detection area 1101 Circular Lens 1110 Non-circular imaging optical lens 1120 Detection area 1210 Imaging optical lens 1220 Detection Array 1230 Additional Optical Lens 1240 Opening 1260 Processor 1300 Mobile Devices 1390 Image Detection Assembly 1391 Detector Array 1392 Optical Filters 1393 Condenser Lens Array 1394 Imaging Lens Array 1395 Additional Lens Array 1396 Opening 1311 Rear Camera 1340 Display
Claims
1. a detection array including a plurality of detection elements; An imaging lens array including a plurality of imaging optical lenses having a non-circular shape in a cross section perpendicular to an optical axis, the imaging lens array transmitting light received from the outside through the imaging optical lenses; a focusing lens array provided between the imaging lens array and the detection array, the focusing lens array including a plurality of focusing lenses configured to transmit light passing through the imaging lens array to the detection elements; Including, the number of the imaging optical lenses is less than the number of the plurality of condenser lenses; a first refraction angle of a first light ray incident so as to be parallel to a virtual straight line from a center of each of the plurality of imaging optical lenses to an outer periphery of a detection area, and a second refraction angle of a second light ray incident so as to be parallel to an optical axis of each of the plurality of imaging optical lenses, are equal to each other, in an outer periphery of each of the plurality of imaging optical lenses; Image device.
2. further comprising an additional optical lens array including a plurality of additional optical lenses; The image device of claim 1 , wherein each of the plurality of additional optical lenses has a cross section perpendicular to the optical axis that is one of a circular and a non-circular shape, and is disposed on an opposite side of the detection array with respect to the imaging lens array.
3. 3. The imaging device of claim 2, wherein the imaging lens array is a lens array disposed adjacent to the converging lens array rather than the additional optical lens array.
4. 4. The imaging device according to claim 1, further comprising an aperture arranged on the opposite side of the imaging lens array from the detector array and passing the light therethrough.
5. The detection array comprises: A detection region including a part of the detection elements among the plurality of detection elements, the detection area receives light from the plurality of imaging optical lenses and is rectangular; 5. The imaging device of claim 1, wherein the cross section of each of the plurality of imaging optical lenses corresponds to a portion of a circular lens having a diameter larger than a length of a short side of the rectangular detection area.
6. 6. The imaging device according to claim 5, wherein the plurality of imaging optical lenses are formed by cutting out a part of a circular lens having a diameter larger than the length of a short side of the rectangular detection area.
7. 2. The imaging device of claim 1, wherein each of the plurality of imaging optical lenses is configured to intersect with an imaginary straight line from a frame point of the aperture to an outer edge of the detection area.
8. 2. The imaging device of claim 1, wherein a difference between a first light path by which the first light ray reaches the detector array and a second light path by which the second light ray reaches the detector array is less than a threshold path difference.
9. 9. The imaging device of claim 1, further comprising a processor for generating an image based on detection information sensed by the detector array.
10. 1. An imaging device, comprising: a detection array including a plurality of detection elements and a detection region including a portion of the plurality of detection elements; an imaging lens array including a plurality of imaging optical lenses each of which transmits light received from outside the imaging device and has a non-circular cross section perpendicular to an optical axis; a plurality of focusing lenses provided between the imaging lens array and the detection array; a focusing lens array for transmitting light passing through the imaging lens array to the detector element; an additional optical lens array including a plurality of additional optical lenses and disposed on a side of the imaging lens array opposite the detection array; Including, An imaging device, wherein the non-circular cross-section of each of the plurality of imaging optical lenses corresponds to a circular lens that has been cut out such that the diameter of the circular lens is greater than the length of a shorter side of a rectangular detection area.
Citation Information
Patent Citations
Solid-state imaging device and its manufacturing method
JP2003229550A
Solid-state imaging element and device thereof
JP2006156898A
Imaging apparatus
JP2006267391A
Combined multi-array color image sensor
JP2009529291A
Imaging apparatus
JP2012100204A