Camera module

Abstract

Provided, according to an embodiment of the present invention, is a camera module comprising: a first camera and a second camera that receive first light reflected from an object and capture an image of the object; a projector disposed between the first camera and the second camera and including a light-emitting unit that irradiates second light; and a processor that generates a result image via the images captured by the first camera and the second camera, wherein either one of the first camera and the second camera includes a reception unit that receives the light irradiated from the light-emitting unit.

Description

Camera module

[0001] The present invention relates to a camera module.

[0002] As the use of camera modules to capture images and videos increases, various technologies and products for acquiring 3D images are being developed.

[0003] Depth, which is the distance between an object and a camera module, can be obtained by using a stereo camera with two cameras, or by using structured light or triangulation using a camera module.

[0004] However, in the case of a stereo camera that uses two cameras, although a high angle of view can be secured because two cameras are used, the accuracy of information about depth decreases as the distance from the object increases, and this may cause a problem in that the resolution is reduced during the image matching process of the two cameras or the coordinates of the images cannot be matched with each other.

[0005] Therefore, a means is needed to seamlessly match the images from each of the two cameras to obtain a high-resolution resulting image.

[0006] The present invention is an invention devised to solve the problems of the above-described prior art, and has as its object the improvement of the accuracy of the result image through the first image and the second image.

[0007] The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned herein will be clearly understood by those skilled in the art from the description below.

[0008] According to an embodiment of the present invention for achieving the above-described purpose, a camera module includes a first camera and a second camera that receive first light reflected from an object and capture an image of the object, a projector that is disposed between the first camera and the second camera and includes a transmitter that irradiates the second light, and a processor that generates a result image through the images captured by the first camera and the second camera, and one of the first camera or the second camera includes a receiver that receives the light irradiated from the transmitter.

[0009] According to the present embodiment, the receiving unit may be placed on only one of the first camera or the second camera.

[0010] According to the present embodiment, the first camera and the second camera include a color filter that filters the wavelength of the first light, and the color filter may include a plurality of pixels.

[0011] According to the present embodiment, the plurality of pixels may include a first pixel through which a first wavelength of the first light passes, a second pixel through which a second wavelength of the first light passes, and a clear pixel through which the first light passes.

[0012] According to the present embodiment, the wavelength of the second light irradiated by the transmitter may correspond to an infrared wavelength.

[0013] According to the present embodiment, the processor can generate depth data for the object by receiving the second light reflected from the object in the receiving unit.

[0014] According to the present embodiment, the processor can generate the result image by matching a first image captured by the first camera through the first light and a second image captured by the second camera through the depth data.

[0015] A camera module according to an embodiment of the present invention includes a first camera that captures a first image of an object through first light reflected from the object, a projector that irradiates second light to the object, a second camera that captures a second image of the object through the first light and receives the second light reflected from the object, and a processor that generates a result image through the first image and the second image, wherein the processor senses depth data for the object through the second light received from the second camera.

[0016] According to the present embodiment, the first camera and the second camera include a color filter that filters the wavelength of the first light, and the color filter may include a plurality of pixels.

[0017] According to the present embodiment, the plurality of pixels may include a first pixel through which a first wavelength of the first light passes, a second pixel through which a second wavelength of the first light passes, and a clear pixel through which the first light passes.

[0018] According to the present embodiment, the plurality of pixels may include a first pixel through which a first wavelength of the first light passes, a second pixel through which a second wavelength of the first light passes, and a third pixel through which a third wavelength of the first light passes.

[0019] According to the present embodiment, the wavelength of the second light irradiated by the second camera may correspond to an infrared wavelength.

[0020] According to the present embodiment, the processor can generate the result image by matching the first image and the second image using the depth data.

[0021] A camera module according to an embodiment of the present invention for solving the above problem may have the effect of improving the accuracy of a result image through a first image and a second image.

[0022] The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

[0023] In addition, the effects of the present invention may be described in more detail in the detailed description of the present invention, and may not necessarily be limited to what is presented above.

[0024] The summary set forth above, as well as the detailed description of preferred embodiments of the present application described below, will be better understood when read in conjunction with the accompanying drawings.

[0025] For the purpose of illustrating the present invention, preferred embodiments are shown in the drawings.

[0026] However, it should be understood that the present application is not limited to the precise arrangements and means illustrated.

[0027] FIG. 1 is a drawing illustrating a general description of a camera module according to an embodiment of the present invention;

[0028] FIG. 2 is a drawing illustrating object photography of a camera module according to an embodiment of the present invention;

[0029] FIG. 3 is a drawing illustrating the difference between the first camera and the second camera of the camera module according to an embodiment of the present invention;

[0030] FIG. 4 is a drawing illustrating a color filter and a plurality of pixels of a camera module according to an embodiment of the present invention; and

[0031] FIG. 5 is a diagram illustrating a result image generation process of a camera module according to an embodiment of the present invention.

[0032] The present invention is susceptible to various modifications and embodiments, and specific embodiments are illustrated and described in detail in the drawings. However, this is not intended to limit the present invention to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention. In describing the present invention, detailed descriptions of related known technologies will be omitted if they are deemed to obscure the gist of the present invention.

[0033] Terms such as first, second, etc. may be used to describe various components, but these components should not be limited by these terms. These terms are used solely to distinguish one component from another.

[0034] The terminology used in this application is only used to describe specific embodiments and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, it should be understood that the terms "comprises" or "has" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0035] Additionally, throughout the specification, when we say "connected," this does not only mean that two or more components are directly connected, but also that two or more components are indirectly connected through other components, that they are electrically connected as well as physically connected, or that they are referred to by different names depending on location or function but are one.

[0036] Additionally, when described as being formed or arranged "above or below" each component, "above" or "below" includes not only cases where the two components are in direct contact with each other, but also cases where one or more other components are formed or arranged between the two components. Furthermore, when expressed as "above" or "below," it can include the meaning of a downward direction as well as an upward direction based on one component.

[0037] Hereinafter, preferred embodiments of the present invention, in which the purpose of the present invention can be specifically realized, will be described with reference to the attached drawings.

[0038] Specifically, FIG. 1 is a drawing for explaining the overall description of a camera module according to an embodiment of the present invention, FIG. 2 is a drawing for explaining object photography of a camera module according to an embodiment of the present invention, FIG. 3 is a drawing for explaining the difference between a first camera and a second camera of a camera module according to an embodiment of the present invention, FIG. 4 is a drawing for explaining a color filter and a plurality of pixels of a camera module according to an embodiment of the present invention, and FIG. 5 is a drawing for explaining a result image generation process of a camera module according to an embodiment of the present invention.

[0039] First, as illustrated in FIG. 1, a camera module according to an embodiment of the present invention includes a first camera (110) and a second camera (120) that receive first light reflected from an object and capture an image of the object, a projector (200) that is disposed between the first camera (110) and the second camera (120) and includes a transmitter that irradiates the second light, and a processor (300) that generates a result image (I3) through images captured by the first camera (110) and the second camera (120).

[0040] Here, the projector (200) may not have a receiving unit for receiving the first light or the second light, but may only have a transmitting unit for irradiating the second light.

[0041] In addition, a receiving unit for receiving the second light irradiated from the projector (200) is disposed in either the first camera (110) or the second camera (120), and for example, the receiving unit may be disposed in the second camera (120).

[0042] At this time, the camera module according to the embodiment of the present invention has a receiver disposed in either the first camera (110) or the second camera (120), but in the detailed description of the present invention, in order to facilitate understanding, the receiver is disposed in the second camera (120) and is described as a standard. This is only to facilitate understanding of the invention, and it may be disposed in the first camera (110) and not necessarily in the second camera (120). The first camera (110) and the second camera (120) are only names for distinguishing a pair of cameras and should not be interpreted as being limited thereto.

[0043] For example, if a receiver is placed in the first camera (110), this can be interpreted as having the same meaning as the second camera (120) where the receiver is placed, and if a receiver is not placed in the first camera (110), this can be interpreted as having the same meaning as the second camera (120) where the receiver is not placed, and if a receiver is placed in the first camera (110), this can be interpreted and understood as having the receiver placed in the second camera (120).

[0044] That is, in the camera module according to the embodiment of the present invention, the receiver may be disposed only in one of the first camera (110) or the second camera (120), and the receiver may not be disposed in the projector (200). In this way, since the receiver is disposed only in one of the first camera (110) or the second camera (120), the projector (200) disposed between the first camera (110) and the second camera (120) may have the advantage of being able to reduce the overall volume of the product since it only has a transmitter for irradiating the second light.

[0045] Based on this, as illustrated in FIG. 1, the first light reflected from the object can be incident on the first camera (110) and the second camera (120) where no receiving unit is positioned. Here, the first camera (110) can generate a first image (I1) through the first light, and the second camera (120) can generate a second image (I2) through the first light. At this time, the projector (200) irradiates the second light toward the object, and the second light can be reflected by the object and received by the receiving unit of the second camera (120).

[0046] Here, the first light is incident on each of the first camera (110) and the second camera (120) to generate a first image (I1) and a second image (I2), but since the receiving unit that receives the second light is only placed on the second camera (120), the second light is incident on the second camera (120), and depth data can be generated by the second light incident on the second camera (120).

[0047] At this time, the processor (300) generates depth data through the elapsed time for the second light incident on the second camera (120) to be irradiated by the projector (200), reflected on the object, and incident on the receiving unit of the second camera (120), and the depth data may include the depth for the overlapping area of ​​the first image (I1) and the second image (I2).

[0048] For example, the first image (I1) and the second image (I2) are captured through the first camera (110) and the second camera (120), respectively, and the depth data formed when the second light irradiated from the projector (200) is incident on the second camera (120) is depth information for the overlapping area of ​​the first image (I1) and the second image (I2), and the depth information for the overlapping area may be information about the distance that each part of the overlapping area is to the second camera (120).

[0049] For this purpose, the second light irradiated by the projector (200) may correspond to an infrared (IR) wavelength. For example, the second light may be infrared.

[0050] In describing a camera module according to an embodiment of the present invention, depth means information about the distance for each of a plurality of pixels or a plurality of areas of a first image (I1) and a second image (I2), and depth data may mean information including all of the above-described plurality of depths.

[0051] For example, depth may be distance information for a certain part of the first image (I1), and depth data may mean a set of multiple depths for the first image (I1).

[0052] Meanwhile, the processor (300) can match the first image (I1) and the second image (I2) based on the depth data corresponding to each of the first image (I1) and the second image (I2) and generate a result image (I3) by dividing the first image (I1) and the second image (I2) by an area where the same depth is secured in the same area.

[0053] To explain this more effectively, referring to FIGS. 2 and 3, first, as shown in FIG. 2, the first light incident on the first camera (110) and the second camera (120) forms an overlapping area centered on the object, and the irradiation area of ​​the second light irradiated by the projector (200) may include the overlapping area described above. In addition, the irradiation area of ​​the second light irradiated by the projector (200) may be irradiated to a wider range than the overlapping area described above, and this can enable depth information outside the overlapping area described above to be identified to generate a 3D result image (I3).

[0054] Alternatively, if the second light is irradiated only to the overlapping area of ​​the first image (I1) and the second image (I2) from the projector (200), it can be utilized only in the process of matching the first image (I1) and the second image (I2), but if the angle of view of the second light of the projector (200) is widened so that the irradiation area of ​​the second light includes at least a part of the first image (I1) and at least a part of the second image (I2), the overall depth of the result image (I3) generated through the first image (I1) and the second image (I2) can be determined, and this can be utilized as a 3D result image (I3).

[0055] If the processor (300) matches the first image (I1) and the second image (I2) to generate the result image (I3) for the purpose of securing a wider angle of view rather than a 3D result image (I3), the projector (200) may narrow the angle of view to a space corresponding to the overlapping area and irradiate the second light, which may have the advantage of not having to adjust the performance of the projector (200) to the high performance described above. The result image (I3) generated through this may have the advantage of being able to secure a wide range of the result image (I3) that includes the depth for the overlapping area, but is secured as a range of the maximum angle of view on one side of the first image (I1) and the maximum angle of view on the other side of the second image (I2).

[0056] In addition, the projector (200) is placed between the first camera (110) and the second camera (120), which may have the advantage of making it easier to sense depth data for the overlapping area between the first image (I1) captured by the first camera (110) and the second image (I2) captured by the second camera (120).

[0057] In addition, referring to FIG. 3, the first camera (110) and the second camera (120) receive first light reflected from an object, and the first camera (110) generates a first image (I1) through the first light, and the second camera (120) generates a second image (I2). In addition, the projector (200) irradiates second light, and the second light is reflected from the object and enters the second camera (120) including a receiving unit, and the processor (300) generates depth data through the second light entering the receiving unit.

[0058] That is, in another embodiment of the present invention, the camera module may be configured such that the first camera (110), the second camera (120), and the projector (200) are individually configured. Specifically, the first camera (110) may include an image sensor that generates a first image (I1) through the first light, the second camera (120) may include the image sensor described above and a receiving unit that receives the second light, and the projector (200) may include only a transmitting unit that irradiates the second light.

[0059] Alternatively, the first camera (110) may receive only the first light, the projector (200) may transmit only the second light, and the second camera (120) may receive both the first light and the second light.

[0060] Meanwhile, the first camera (110) and the second camera (120) include a color filter (130) that filters the first light, and the color filter (130) may include a plurality of pixels. In addition, as illustrated in FIG. 4, the plurality of pixels may include a first pixel (131) that passes a first wavelength of the first light, a second pixel (132) that passes a second wavelength of the first light, and a third pixel (133) that passes a third wavelength of the first light.

[0061] For example, the first wavelength that the first pixel (131) transmits may be red light, the second wavelength that the second pixel (132) transmits may be blue light, and the third wavelength that the third pixel (133) transmits may be green light. Here, the first pixel (131) transmits the first wavelength, red light, and can reflect or absorb the second wavelength and the third wavelength, the second pixel (132) transmits the second wavelength, blue light, and can reflect or absorb the first wavelength and the third wavelength, and the third pixel (133) transmits the third wavelength, green light, and can reflect or absorb the first wavelength and the second wavelength. That is, the first pixel (131), the second pixel (132), and the third pixel (133) can selectively transmit different wavelengths of the first light.

[0062] At this time, the first pixel (131) and the second pixel (132) may be filters that only pass through the first wavelength and the second wavelength, respectively, but the third pixel (133) may also be a clear pixel that passes through the first light. For example, the first pixel (131) may pass through only the first wavelength of the first light, the second pixel (132) may pass through only the second wavelength of the first light, and the third pixel (133) may pass through the first light including the first wavelength to the third wavelength.

[0063] In this way, when the third pixel (133) is arranged as a clear pixel, the processor (300) can calculate the value of the third wavelength based on the first wavelength and the second wavelength passing through the first pixel (131) and the second pixel (132), and can correspond the value of the third wavelength to the clear pixel in the space where the first pixel (131) and the second pixel (132) are not arranged.

[0064] To explain this in more detail, referring to FIG. 5, as shown in FIG. 5, a first image (I1) captured through a first camera (110) and a second image (I2) captured through a second camera (120) include an overlapping area that overlaps with each other, and the second light irradiated from the transmitter is incident on the second camera (120) to secure depth data for the overlapping area.

[0065] Here, the processor (300) matches the depth data for the overlapping area of ​​the first image (I1) to match the depth for each pixel of the first image (I1) generated through a plurality of pixels, and also matches the depth data for the overlapping area of ​​the second image (I2) to match the depth for each pixel of the second image (I2) generated through a plurality of pixels.

[0066] Alternatively, when a first image (I1) is generated through a plurality of pixels of a first camera (110), the processor (300) may divide the first image (I1) into a plurality of regions corresponding to the plurality of pixels, and match depth data through the second light for each region to match the depth for each of the plurality of regions. Similarly, in the second camera (120), the processor (300) may divide the second image (I2) into a plurality of regions corresponding to a plurality of pixels, and match depth data through the second light for each region to match the depth for each of the plurality of regions.

[0067] At this time, the processor (300) matches areas having the same depth in the overlapping areas of the first image (I1) and the second image (I2), and since this matches the depths of multiple areas for the first image (I1) and the depths of multiple areas for the second image (I2), there is an advantage in that a result image (I3) with high accuracy can be generated.

[0068] In addition, after the processor (300) generates the result image (I3), it can irradiate the second light to the object again through the transmitter of the projector (200) and additionally secure depth data for the result image (I3) through the second light that is re-incident to the receiver. Alternatively, the projector (200) may have its field of view adjusted by the processor (300) so that a narrow field of view can be utilized to secure depth data for generating the result image (I3) and a wide field of view can be utilized to secure depth data for the result image (I3). However, this is only an example of the use of the camera module according to an embodiment of the present invention and should not be interpreted as being limited to what has been mentioned.

[0069] Alternatively, if the angle of view of the second light irradiated by the projector (200) includes the angle of view of the first camera (110) and the angle of view of the second camera (120), the first image (I1) and the second image (I2) are matched to generate a result image (I3), and then, for each area where the first image (I1) does not overlap with the second image (I2) and the area where the second image (I2) does not overlap with the first image (I1), the depth data of the result image (I3) is secured based on the depth data matched to the first image (I1) and the second image (I2), and for the overlapping area of ​​the first image (I1) and the second image (I2), the depth data can be secured based on the depth that matches with each other. That is, the hassle of irradiating the second light twice can be reduced. However, this is only an example of the use of the camera module according to an embodiment of the present invention, and should not be interpreted as being limited to what has been mentioned.

[0070] Having described preferred embodiments of the invention, it will be apparent to those skilled in the art that the invention may be embodied in other specific forms without departing from the spirit or scope thereof, in addition to the embodiments described above.

[0071] Therefore, the above-described embodiments should be considered as illustrative rather than restrictive, and accordingly, the present invention is not limited to the above description but may be modified within the scope of the appended claims and their equivalents.

Claims

1. A first camera and a second camera that receive first light reflected from an object and capture an image of the object; A projector disposed between the first camera and the second camera and including a transmitter for irradiating second light; and A processor for generating a result image through the images captured by the first camera and the second camera, A camera module, wherein either the first camera or the second camera includes a receiving unit that receives the light irradiated from the transmitting unit.

2. In paragraph 1, The above-mentioned receiver is a camera module arranged only in one of the first camera or the second camera.

3. In paragraph 1, The first camera and the second camera include a color filter that filters the wavelength of the first light, The above color filter is a camera module including a plurality of pixels.

4. In paragraph 3, The above plurality of pixels are, A first pixel through which the first wavelength of the first light passes; a second pixel through which the second wavelength of the first light passes; and A camera module including a clear pixel through which the first light passes.

5. In paragraph 1, The above processor is a camera module that receives the second light reflected from the object from the receiving unit and generates depth data for the object.

6. In paragraph 5, The above processor is a camera module that matches a first image captured by the first camera and a second image captured by the second camera through the first light using the depth data to generate the result image.

7. A first camera that captures a first image of the object through first light reflected from the object; A projector that illuminates the object with a second light; A second camera that captures a second image of the object through the first light and receives the second light reflected from the object; and A processor for generating a result image through the first image and the second image is included, The above processor is a camera module that senses depth data for the object through the second light received from the second camera.

8. In paragraph 7, The first camera and the second camera include a color filter that filters the wavelength of the first light, The above color filter is a camera module including a plurality of pixels.

9. In paragraph 8, The above plurality of pixels are, A first pixel through which the first wavelength of the first light passes; a second pixel through which the second wavelength of the first light passes; and A camera module including a clear pixel through which the first light passes.

10. In paragraph 7, The above processor is a camera module that matches the first image and the second image using the depth data to generate the result image.

Images