Information generating device and camera device

Abstract

An information generating device according to an embodiment of the present invention includes a light emitting unit that generates an output optical signal and irradiates it onto a target area, a light receiving unit that receives the input optical signal after being reflected from the target area, and a base including a first hole and a second hole spaced apart from each other, wherein the light emitting unit includes a light source, a first holder disposed on the light source and disposed in the first hole of the base, and a first lens group disposed in the first holder, the light receiving unit includes an image sensor, a second holder disposed on the image sensor and disposed in the second hole of the base, and a second lens group disposed in the second holder, the light emitting unit further includes a third holder disposed on the first holder and a diffusion member disposed in the third holder, an upper edge of the second holder is placed on an upper surface of the base, and a lower edge of the third holder is placed on an upper surface of the base.

Description

[Technical Field]

[0001] The embodiments relate to an information generating device and a camera device. [Background technology]

[0002] 3D content is being applied in a variety of fields, including games, culture, education, manufacturing, and autonomous driving, and depth information (depth map) is required to obtain 3D content. Depth information is information that indicates spatial distance and shows the perspective of one point in a 2D image relative to another. Methods used to obtain depth information include projecting IR (Infrared) structured light onto an object, using a stereo camera, and TOF (Time of Flight).

[0003] The ToF method calculates the distance to an object by measuring the time of flight, i.e., the time it takes for light to be emitted and reflected. The greatest advantage of the ToF method is that it quickly provides distance information in 3D space in real time. In addition, users can obtain accurate distance information without applying a separate algorithm or hardware correction. In addition, accurate depth information can be obtained even when measuring very close or moving objects.

[0004] Meanwhile, to acquire depth information, a light emitting unit of the camera device generates an output light signal and irradiates it onto an object, a light receiving unit of the camera device receives an input light signal reflected from the object, and a depth information generating unit of the camera device generates depth information of the object using the input light signal received by the light receiving unit.

[0005] However, when assembling the light-emitting and light-receiving parts simultaneously, precise active alignment is required, which reduces process efficiency, makes it difficult to grasp the performance and defects of individual modules, and necessitates the replacement of the entire device in the event of a malfunction.

[0006] In addition, in order to generate 3D color images, a technology has been attempted in which an RGB camera for capturing RGB images and a depth camera for capturing depth images are both installed in a single device, such as a mobile device, and the RGB images captured by the RGB camera and the depth images captured by the depth camera are matched. The depth camera can include a light-emitting unit and a light-receiving unit. To acquire depth information using the triangulation technique, a minimum baseline between the light-emitting unit and the light-receiving unit must be guaranteed.

[0007] Therefore, when both an RGB camera and a depth camera are installed in one device, the device's physical size inevitably becomes larger. Also, since the FOV (Field of View) of the RGB camera sensor and the FOV of the depth camera sensor do not exactly match, a separate calibration process is required to match the RGB image and the depth image. Summary of the Invention [Problem to be solved by the invention]

[0008] The technical problem that the present invention aims to solve is to provide an information generating device with improved assembly and process efficiency.

[0009] Another object of the present invention is to provide a small camera device capable of generating three-dimensional color images.

[0010] The problems to be solved by the examples are not limited to these, and may also include the objectives and effects that can be grasped from the means for solving the problems and embodiments described below. [Means for solving the problem]

[0011] An information generating device according to an embodiment of the present invention includes a light emitting unit that generates an output optical signal and irradiates it onto a target area, a light receiving unit that receives the input optical signal after being reflected from the target area, and a base including a first hole and a second hole spaced apart from each other, wherein the light emitting unit includes a light source, a first holder disposed on the light source and disposed in the first hole of the base, and a first lens group disposed in the first holder, the light receiving unit includes an image sensor, a second holder disposed on the image sensor and disposed in the second hole of the base, and a second lens group disposed in the second holder, the light emitting unit further includes a third holder disposed on the first holder and a diffusion member disposed in the third holder, an upper edge of the second holder is placed on an upper surface of the base, and a lower edge of the third holder is placed on an upper surface of the base.

[0012] The light-emitting unit may further include a first substrate on which the light source is arranged and a first bonding member disposed between the first substrate and a lower surface of the base to bond the first substrate to the lower surface of the base, and the light-receiving unit may further include a second substrate on which the image sensor is arranged and a second bonding member disposed between the second substrate and a lower surface of the base to bond the second substrate to the lower surface of the base, and the first substrate and the second substrate may be spaced apart from each other.

[0013] The first and second substrates may have different heights based on the top surface of the base.

[0014] The lower surface of the base may include a first region having a first thickness relative to the upper surface of the base and a second region having a second thickness different from the first thickness relative to the upper surface of the base, and the first bonding member may be disposed in the first region and the second bonding member may be disposed in the second region.

[0015] The first joining member has a first opening for accommodating the light source, and the second joining member has a second opening for accommodating the image sensor, and at least one of the first joining member and the second joining member may be in direct contact with the underside of the base.

[0016] The first bonding member may include a first substrate fixing unit fixed to the first substrate, a first base fixing unit fixed to the underside of the base, and a first adhesive disposed between the first substrate fixing unit and the first base fixing unit.

[0017] The second bonding member may include a second substrate fixing unit fixed to the second substrate, a second base fixing unit fixed to the underside of the base, and a second adhesive disposed between the second substrate fixing unit and the second base fixing unit.

[0018] The first joint member may be fastened to the first substrate and a lower surface of the base.

[0019] The second joint member may be fastened to the second substrate and a lower surface of the base.

[0020] The third holder may be threaded to rotate and couple with the first holder.

[0021] The upper edge of the second holder and the upper surface of the base may be fastened together by a fastening member.

[0022] An upper edge of the first holder may be disposed on an upper surface of the base, and the upper edge of the first holder and the upper surface of the base may be bonded together by a third adhesive.

[0023] A camera device according to an embodiment of the present invention includes a light source that outputs an output optical signal, a light receiving unit that receives an input optical signal reflected from an object and then input, and an information generating unit that generates information about the object using the input optical signal input to the light receiving unit, wherein the light receiving unit includes a beam splitter that separates the input optical signal, a first sensor that receives light reflected by the beam splitter, and a second sensor that receives light that has passed through the beam splitter, and the optical axis of the light source and the optical axis of the second sensor are parallel to each other, and the optical axis of the first sensor is perpendicular to the optical axis of the light source and the optical axis of the second sensor.

[0024] The camera device may further include a substrate, and the light source, the first sensor, and the second sensor may be sequentially arranged on the substrate along a first direction, the first direction being perpendicular to an optical axis of the light source.

[0025] The light source may be disposed in a first region of the substrate, the second sensor may be disposed in a second region of the substrate parallel to the first region and lower than the first region in a second direction perpendicular to the first direction, and the first sensor may be disposed in a third region of the substrate between the first region and the second region and perpendicular to the first region and the second region, and the second direction may be parallel to an optical axis of the light source.

[0026] The third region may be a wall surface connecting the first region and the second region.

[0027] The incident surface of the beam splitter may be coated with an IR reflective material, an IR pass filter may be further disposed between the beam splitter and the first sensor, and an IR blocking filter may be further disposed between the beam splitter and the second sensor.

[0028] The incident surface of the beam splitter may be coated with an IR-transmitting material, an IR-blocking filter may be further disposed between the beam splitter and the first sensor, and an IR-passing filter may be further disposed between the beam splitter and the second sensor.

[0029] The FOV of the first sensor and the FOV of the second sensor may be the same and overlap each other.

[0030] The optical system may further include a lens group disposed between the object and the beam splitter, for collecting an input optical signal reflected from the object and then inputting the collected optical signal into the beam splitter.

[0031] The optical system may further include an optical path converting member disposed between the lens group and the object.

[0032] One of the first sensor and the second sensor may be an RGB sensor that senses visible light, and the other may be an IR sensor that senses IR light.

[0033] The information generating unit may synthesize the RGB image of (X, Y) coordinates received from the RGB sensor and the depth information of (X, Y, Z) coordinates received from the IR sensor.

[0034] The (X, Y) coordinates of the RGB image and the (X, Y) coordinates of the depth information may be the same. [Effects of the Invention]

[0035] Embodiments of the present invention provide an information generating device with improved assembly and process efficiency.

[0036] According to the embodiment of the present invention, it is possible to obtain an information generating device that allows easy Z-direction focusing and XY-axis alignment.

[0037] According to the embodiment of the present invention, active alignment of the light emitting portion and the light receiving portion is easy.

[0038] According to the embodiment of the present invention, it is possible to obtain an information generating device in which parts can be easily replaced in the event of a defect or failure of an individual module.

[0039] According to an embodiment of the present invention, a compact camera device capable of generating three-dimensional color images can be obtained.

[0040] According to an embodiment of the present invention, a camera device can be obtained in which the calibration process for matching between an RGB image and a depth image is minimized.

[0041] The various beneficial advantages and effects of the present invention are not limited to the above, but will be more easily understood in the course of describing specific embodiments of the present invention. [Brief explanation of the drawings]

[0042] [Figure 1] FIG. 1 is a block diagram of an information generating device according to an embodiment of the present invention.

[0043] [Figure 2] 1 is a conceptual cross-sectional view of an information generating device according to an embodiment of the present invention.

[0044] [Figure 3] 1 is a perspective view of an information generating device according to an embodiment of the present invention.

[0045] [Figure 4] 1 is an exploded perspective view of an information generating device according to an embodiment of the present invention.

[0046] [Figure 5] 1 is a cross-sectional view of an information generating device according to an embodiment of the present invention.

[0047] [Figure 6] 1 is a perspective view of a base included in an information generating device according to an embodiment of the present invention.

[0048] [Figure 7] 2 is a perspective view of a first substrate, a second substrate, and a connecting member included in an information generating device according to an embodiment of the present invention. FIG.

[0049] [Figure 8] 3 is a cross-sectional view of a base, a first joint member, a second joint member, a first substrate, and a second substrate of an information generating device according to an embodiment of the present invention. FIG.

[0050] [Figure 9a] FIG. 2 is an exploded perspective view of a first joint member and a second joint member of the information generating device according to the embodiment of the present invention.

[0051] [Figure 9b] FIG. 2 is an exploded perspective view of a first joint member and a second joint member of the information generating device according to the embodiment of the present invention.

[0052] [Figure 10a] 1 shows an example of an assembly process of an information generating device according to an embodiment of the present invention.

[0053] [Figure 10b] 1 shows an example of an assembly process of an information generating device according to an embodiment of the present invention.

[0054] [Figure 10c] 1 shows an example of an assembly process of an information generating device according to an embodiment of the present invention.

[0055] [Figure 10d] 1 shows an example of an assembly process of an information generating device according to an embodiment of the present invention.

[0056] [Figure 10e] 1 shows an example of an assembly process of an information generating device according to an embodiment of the present invention.

[0057] [Figure 10f] 1 shows an example of an assembly process of an information generating device according to an embodiment of the present invention.

[0058] [Figure 11] 1 is a perspective view of a vehicle to which an information generating device according to an embodiment of the present invention is applied;

[0059] [Figure 12] 1 is a perspective view of a mobile terminal to which an information generating device according to an embodiment of the present invention is applied;

[0060] [Figure 13] FIG. 1 is an example of a block diagram of a camera device.

[0061] [Figure 14] 1 is a block diagram of a camera device according to an embodiment of the present invention.

[0062] [Figure 15] 1 is a cross-sectional view of a camera device according to an embodiment of the present invention.

[0063] [Figure 16a] 1 is a conceptual diagram showing how a camera device according to an embodiment of the present invention captures a 3D color image. [Figure 16b] 1 is a depth image acquired by a first sensor of a camera device according to an embodiment of the present invention. [Figure 16c] 10 is an RGB image captured by a second sensor of the camera device according to an embodiment of the present invention. [Figure 16d] 1 is a composite image of a depth image acquired by a first sensor and an RGB image acquired by a second sensor of a camera device according to an embodiment of the present invention.

[0064] [Figure 17] FIG. 10 is a cross-sectional view of a camera device according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0065] The present invention can be modified in various ways and can have various embodiments, and a specific embodiment will be described by way of example in the drawings. However, it is not intended to limit the present invention to the specific embodiment, and it should be understood that the present invention includes all modifications, equivalents, and alternatives that fall within the spirit and technical scope of the present invention.

[0066] Terms including ordinal numbers, such as "second," "first," etc., may be used to describe various components, but the components are not limited by the terms. Terms are used only to distinguish one component from another. For example, a second component may be designated as a "first component," and similarly, a first component may be designated as a "second component," without departing from the scope of the present invention. The term "and / or" includes a combination of multiple related listed items or any of multiple related listed items.

[0067] When a component is said to be "coupled" or "connected" to another component, it should be understood that it may be directly coupled or connected to the other component, but that there may be other components in between. Conversely, when a component is said to be "directly coupled" or "directly connected" to another component, it should be understood that there are no other components in between.

[0068] The terms used in this application are merely used to describe specific embodiments and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "have" are intended to specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, and should be understood not to preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0069] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Terms as defined in commonly used dictionaries should be interpreted to have a meaning consistent with the meaning they have in the context of the relevant art, and should not be interpreted in an idealized or overly formal sense unless expressly defined in this application.

[0070] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings, and the same or corresponding elements will be given the same reference numerals regardless of the drawing reference numerals, and redundant description thereof will be omitted.

[0071] FIG. 1 is a block diagram of an information generating device according to an embodiment of the present invention, and FIG. 2 is a conceptual cross-sectional view of an information generating device according to an embodiment of the present invention.

[0072] 1 and 2, an information generating device 1000 according to an embodiment of the present invention includes a light emitting unit 100, a light receiving unit 200, an information generating unit 300, and a control unit 400. The information generating unit 300 and the control unit 400 are similar to those shown in FIG.

[0073] The light-emitting unit 100 may generate and output an output optical signal in the form of a pulse wave or a continuous wave. The continuous wave may be in the form of a sinusoid wave or a squared wave. By generating the output optical signal in the form of a pulse wave or a continuous wave, the information generating device 1000 may detect a time difference or phase difference between the output optical signal output from the light-emitting unit 100 and the input optical signal reflected from an object and input to the light-receiving unit 200. In this specification, output light may refer to light output from the light-emitting unit 100 and incident on an object, and input light may refer to light output from the light-emitting unit 100, reaching the object, reflecting from the object, and input to the light-receiving unit 200. In this specification, the pattern of output light may be referred to as an emission pattern, and the pattern of input light may be referred to as an incident pattern. From the perspective of the object, output light may be incident light, and input light may be reflected light.

[0074] The light emitting unit 100 may include a light source 110, a lens group 120 disposed on the light source 110, and a diffusion member 130 disposed on the lens group 120. The light source 110 generates and outputs light. The light generated by the light source 110 may be infrared light with a wavelength of 770 to 3000 nm. Alternatively, the light generated by the light source 110 may be visible light with a wavelength of 380 to 770 nm. The light source 110 may use a light emitting diode (LED), and may have a configuration in which a plurality of LEDs are arranged in a certain pattern. Alternatively, the light source 110 may include an organic light emitting diode (OLED) or a laser diode (LD). Alternatively, the light source 110 may be a vertical cavity surface emitting laser (VCSEL). A VCSEL is a type of laser diode that converts an electrical signal into an optical signal and can output a wavelength of approximately 800 to 1000 nm, for example, approximately 850 nm or approximately 940 nm. If the light source 110 is a VCSEL, the light source 110 may include multiple emitters arranged in an m*n matrix.

[0075] The light source 110 repeatedly turns on and off at regular time intervals to generate an output optical signal in the form of a pulse wave or a continuous wave. The regular time interval may be the frequency of the output optical signal.

[0076] The lens group 120 may condense light output from the light source 110 and output the condensed light to the outside. The lens group 120 may be disposed above the light source 110 and spaced apart from the light source 110. Here, above the light source 110 may refer to the side from which light is output from the light source 110. The lens group 120 may include at least one lens. If the lens group 120 includes multiple lenses, the lenses may be aligned based on a central axis to form an optical system. Here, the central axis may be the same as the optical axis of the optical system. As shown in FIG. 2, the lens group 120 is disposed above the light source 110 and may include multiple lenses sequentially arranged in a direction from the diffusing member 130 to the light source 110. For example, the lens group 120 may include five lenses sequentially arranged in a direction from the diffusing member 130 to the light source 110. In this specification, the lens group 120 may be referred to as a collimator because it condenses and outputs light output from the light source 110.

[0077] The diffusion member 130 receives the light output from the light source 110 and the lens group 120, and then refracts or diffracts the received light and outputs it.

[0078] The light receiving unit 200 may receive an optical signal reflected from an object. At this time, the received optical signal may be an optical signal output from the light emitting unit 100 that is reflected from the object.

[0079] The light receiving unit 200 may include an image sensor 210, a filter 220 disposed on the image sensor 210, and a lens group 230 disposed on the filter 220. An optical signal reflected from an object may pass through the lens group 230. The optical axis of the lens group 230 may be aligned with the optical axis of the image sensor 210. The filter 220 may be disposed between the lens group 230 and the image sensor 210. The filter 220 may be disposed on the optical path between the object and the image sensor 210. The filter 220 may filter light having a predetermined wavelength range. The filter 220 may transmit a specific wavelength band of light. The filter 220 may pass light of a specific wavelength. For example, the filter 220 may pass light in the infrared band and block light other than the infrared band. The image sensor 210 may sense light. The image sensor 210 may receive an optical signal. The image sensor 210 may detect the optical signal and output it as an electrical signal. The image sensor 210 may detect light of a wavelength corresponding to the wavelength of light output from the light source 110. For example, the image sensor 210 may be sensitive to light in the infrared band.

[0080] The image sensor 210 may have a structure in which a plurality of pixels are arranged in a grid. The image sensor 210 may be a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor. The image sensor 210 may also include a ToF sensor that receives IR light reflected from an object and measures distance using a time difference or a phase difference.

[0081] The light receiving unit 200 and the light emitting unit 100 may be arranged side by side. The light receiving unit 200 may be arranged beside the light emitting unit 100. The light receiving unit 200 may be arranged in the same direction as the light emitting unit 100.

[0082] The information generator 300 may generate depth information of an object using an input optical signal input to the light receiver 200. For example, the information generator 300 may calculate depth information of an object using a time of flight that an output optical signal output from the light emitter 100 takes to be reflected from the object and input to the light receiver 200. For example, the information generator 300 may calculate a time difference between the output optical signal and the input optical signal using an electrical signal received by the image sensor 210, and calculate a distance between the object and the information generator 1000 using the calculated time difference. For example, the information generator 300 may calculate a phase difference between the output optical signal and the input optical signal using an electrical signal received from the sensor, and calculate a distance between the object and the information generator 1000 using the calculated phase difference.

[0083] The control unit 400 controls the operation of the light emitting unit 100, the light receiving unit 200, and the information generating unit 300. The information generating unit 300 and the control unit 400 may be implemented in the form of a printed circuit board (PCB). The information generating unit 300 and the control unit 400 may also be implemented in different configurations. Alternatively, the control unit 400 may be included in a terminal or a vehicle in which the information generating device 1000 according to an embodiment of the present invention is installed. For example, the control unit 400 may be implemented in the form of an application processor (AP) of a smartphone in which the information generating device 1000 according to an embodiment of the present invention is installed, or in the form of an electronic control unit (ECU) of a vehicle in which the information generating device 1000 according to an embodiment of the present invention is installed.

[0084] The information generating device 1000 according to an embodiment of the present invention may be a solid-state LIDAR. Unlike mechanical LIDARs that rotate 360°, a solid-state LIDAR does not include mechanical components that rotate the LIDAR device, and therefore has the advantages of being inexpensive and compact. The information generating device 1000 according to an embodiment of the present invention may be a solid-state flash LIDAR. A solid-state flash LIDAR uses an optical flash to illuminate the environment ahead with a single large-area laser pulse.

[0085] Figure 3 is an oblique view of an information generating device according to an embodiment of the present invention, Figure 4 is an exploded oblique view of an information generating device according to an embodiment of the present invention, Figure 5 is a cross-sectional view of an information generating device according to an embodiment of the present invention, Figure 6 is an oblique view of a base included in an information generating device according to an embodiment of the present invention, Figure 7 is an oblique view of a first substrate, a second substrate and a connecting member included in an information generating device according to an embodiment of the present invention, Figure 8 is a cross-sectional view of the base, first joining member, second joining member, first substrate and second substrate of an information generating device according to an embodiment of the present invention, and Figure 9 is an exploded oblique view of the first joining member and second joining member of an information generating device according to an embodiment of the present invention.

[0086] 3 and 4, an information generating device 1000 according to an embodiment of the present invention includes a light emitting unit 100, a light receiving unit 200, and a base 500. As described with reference to FIGS. 1 and 2, the information generating device 1000 further includes an information generating unit 300 and a control unit 400. Duplicate descriptions of the light emitting unit 100, the light receiving unit 200, the information generating unit 300, and the control unit 400 that are the same as those described with reference to FIGS. 1 and 2 will be omitted.

[0087] As described above, the light-emitting unit 100 generates an output optical signal and irradiates the target area with the output optical signal, and includes a light source 110, a lens group 120, and a diffusion member 130. As described above, the light-receiving unit 200 receives the input optical signal after being reflected from the target area, and includes an image sensor 210, a filter 220, and a lens group 230.

[0088] According to an embodiment of the present invention, the base 500 is combined with the light emitting unit 100 and the light receiving unit 200. The light emitting unit 100 and the light receiving unit 200 are combined with one base 500. Referring to FIG. 6 , the base 500 includes an upper surface 510 and a lower surface 520. In this specification, the surface of the base 500 that faces the light source 110 and the image sensor 210 is referred to as the lower surface 520, and the surface opposite the lower surface 520 is referred to as the upper surface 510. A first hole TH1 and a second hole TH2 are formed in the base 500. The first hole TH1 and the second hole TH2 are each formed in a direction penetrating from the upper surface 510 to the lower surface 520 of the base 500. According to an embodiment of the present invention, the lower surface 520 of the base 500 may include a first region 521 and a second region 522 having different thicknesses relative to the upper surface 510 of the base 500, and the first hole TH1 may be formed in the first region 521, and the second hole TH2 may be formed in the second region 522. For example, the lower surface 520 of the base 500 may include the first region 521 having a first thickness T1 and the second region 522 having a second thickness T2 relative to the upper surface 510 of the base 500. Although the first thickness T1 is illustrated as being greater than the second thickness T2, this is not limiting. The second thickness T2 may also be designed to be greater than the first thickness T1. The first thickness T1 and the second thickness T2 may be designed based on the effective focal length of the light-emitting unit 100 and the effective focal length of the light-receiving unit 200.

[0089] More specifically, the light emitting unit 100 includes a first holder 140 that houses the lens group 120. The first holder 140 is disposed on the light source 110 and passes through a first hole TH1 of the base 500, and the lens group 120 is disposed in the first holder 140. At this time, a thread that engages with each other may be formed on an outer circumferential surface of the first holder 140 and an inner circumferential surface of the first hole TH1 of the base 500. As a result, the first holder 140, in which the lens group 120 is housed, can be rotated and engaged with the first hole TH1 of the base 500, and in this process, Z-axis focusing and XY-axis active alignment may be easily performed.

[0090] The light receiving unit 200 includes a second holder 240 that accommodates a lens group 230. The second holder 240 is disposed on the image sensor 210 and is disposed to pass through a second hole TH2 of the base 500, and the lens group 230 is disposed in the second holder 240.

[0091] In this way, when the first holder 140 accommodating the lens group 120 of the light-emitting unit 100 is placed in the first hole TH1 formed in one base 500 and the second holder 240 accommodating the lens group 230 of the light-receiving unit 200 is placed in the second hole TH2, the light-emitting unit 100 and the light-receiving unit 200 can be assembled based on the base 500, making it easy to align and support the light-emitting unit 100 and the light-receiving unit 200.

[0092] In particular, according to the embodiment of the present invention, the upper edge of at least one of the first holder 140 and the second holder 240 is disposed to rest on the upper surface of the base 500 .

[0093] According to an embodiment of the present invention, the second holder 240 is disposed to be placed on the upper surface of the base 500. As such, the second holder 240 accommodating the lens group 230 is fixed with reference to the upper surface of the base 500, and active alignment between the lens group 230 and the image sensor 210 can be precisely performed with reference to the fixed lens group 230. At this time, the upper edge of the second holder 240 and the upper surface 510 of the base 500 can be fastened by the fastening member 700. As a result, since the second holder 240 and the base 500 are firmly fixed, the durability of the information generating device 1000 can be improved even in an environment where vibration or shaking occurs.

[0094] According to an embodiment of the present invention, the light emitting unit 100 further includes a first substrate 150 on which the light source 110 is disposed, and a first bonding member 160 disposed between the first substrate 150 and the lower surface 520 of the base 500 to bond the first substrate 150 to the lower surface 520 of the base 500. The light receiving unit 200 further includes a second substrate 250 on which the image sensor 210 is disposed, and a second bonding member 260 disposed between the second substrate 250 and the lower surface 520 of the base 500 to bond the second substrate 250 to the lower surface 520 of the base 500. As a result, the light emitting unit 100 and the light receiving unit 200 can be assembled based on the base 500, thereby facilitating the alignment and support of the light emitting unit 100 and the light receiving unit 200. Here, the first substrate 150 and the second substrate 250 may be a flexible printed circuit board (FPCB), a flexible-rigid printed circuit board (RFPCB), or a rigid printed circuit board (RPCB), respectively.

[0095] In this case, the first substrate 150 and the second substrate 250 may be disposed spaced apart from each other. Accordingly, although the light emitting unit 100 and the light receiving unit 200 are assembled based on the base 500, the distance D1 of the first substrate 150 and the distance D2 of the second substrate 250 based on the top surface 510 of the base 500 may be adjusted to be different depending on the effective focal length of the light emitting unit 100 and the effective focal length of the light receiving unit 200.

[0096] In this case, the first substrate 150 and the second substrate 250 may be connected by a connecting member 600. Referring to FIG. 7 , the connecting member 600 may be connected to the bottom surfaces of the first substrate 150 and the second substrate 250. Here, the bottom surface of the first substrate 150 may refer to the surface of the first substrate 150 opposite the surface on which the light source 110 is disposed, and the bottom surface of the second substrate 250 may refer to the surface of the second substrate 250 opposite the surface on which the image sensor 210 is disposed. The connecting member 600 may support the first substrate 150 and the second substrate 250 spaced apart from each other. In addition, electrical signals may be transmitted between the light emitting unit 100 and the light receiving unit 200 via the connecting member 600, or electrical signals may be transmitted between the light emitting unit 100 and the light receiving unit 200 and an external device via the connecting member 600. For example, at least one of the information generator 300 and the controller 400 according to an embodiment of the present invention may be implemented in the form of a chip on at least one of the first substrate 150 and the second substrate 250. An electrical signal from the image sensor 210 on the second substrate 250 may be transmitted to at least one of the information generator 300, the controller 400, and an external device through the connecting member 600. A control signal from the controller 400 or the external device may be transmitted to the light source 110 on the first substrate 150 and the image sensor 210 on the second substrate 250 through the connecting member 600.

[0097] As described above, the lower surface 520 of the base 500 may include a first region 521 and a second region 522 having different thicknesses relative to the upper surface 510 of the base 500. Referring to FIG. 8 , the first bonding member 160 is disposed in the first region 521, and the second bonding member 260 is disposed in the second region 522. The first bonding member 160 bonds the first substrate 150 to the first region 521 of the base 500, and the second bonding member 260 bonds the second substrate 250 to the second region 522 of the base 500. Accordingly, the distance D1 of the first substrate 150 and the distance D2 of the second substrate 250 may be different from each other relative to the upper surface 510 of the base 500. The effective focal length of the light emitting unit 100 may vary depending on the design of the lens group 120, and the effective focal length of the light receiving unit 200 may vary depending on the design of the lens group 230. As in the embodiment of the present invention, although the light-emitting unit 100 and the light-receiving unit 200 are combined on one base 500, if the distance D1 of the first substrate 150 on which the light source 110 is arranged and the distance D2 of the second substrate 250 on which the image sensor 210 is arranged are arranged differently based on the top surface 510 of the base 500, the degree of freedom in designing the lens group 120 of the light-emitting unit 100 and the lens group 230 of the light-receiving unit 200 can be increased, and alignment between the light-emitting unit 100 and the light-receiving unit 200 can be easily achieved.

[0098] 8 and 9, the first bonding member 160 has a first opening R1 for accommodating the light source 110, and the second bonding member 260 has a second opening R2 for accommodating the image sensor 210. At this time, at least one of the first bonding member 160 and the second bonding member 260 is in direct contact with the lower surface 520 of the base 500. In this embodiment, the first bonding member 160 and the lower surface 520 of the base 500 may be in direct contact. Here, direct contact means that no other structure is disposed between the first bonding member 160 and the lower surface 520 of the base 500. For this reason, the first bonding member 160 and the lower surface 520 of the base 500 are in direct contact and may be fastened together by a fastening member 700. Accordingly, the first substrate 150, the light source 110, and the first bonding member 160 may be fixed with reference to the lower surface 520 of the base 500, and active alignment between the light source 110 and the lens group 120 may be precisely performed with reference to the fixed light source 110. In this embodiment of the present invention, the second bonding member 260 and the lower surface 520 of the base 500 may be in direct contact. Here, direct contact means that no other structure is disposed between the second bonding member 260 and the lower surface 520 of the base 500. For this reason, the second bonding member 260 and the lower surface 520 of the base 500 may be in direct contact and fastened together by the fastening member 700. Accordingly, the second substrate 250, the image sensor 210, and the second bonding member 260 may be fixed with reference to the lower surface 520 of the base 500, and active alignment between the image sensor 210 and the lens group 230 may be precisely performed with reference to the fixed image sensor 210.

[0099] When the first bonding member 160 is fastened to the lower surface 520 of the base 500 via the fastening member 700, even if a malfunction occurs in the light source 110 or the chip on the first substrate 150, it is possible to replace only the malfunctioning component after releasing the fastening between the first bonding member 160 and the lower surface 520 of the base 500. Similarly, when the second bonding member 260 is fastened to the lower surface 520 of the base 500 via the fastening member 700, even if a malfunction occurs in the image sensor 210 or the chip on the second substrate 250, it is possible to replace only the malfunctioning component after releasing the fastening between the second bonding member 260 and the lower surface 520 of the base 500.

[0100] In this case, the first bonding member 160 may include a first substrate fixing unit 161 fixed to the first substrate 150, a first base fixing unit 162 fixed to the lower surface 520 of the base 500, and a first adhesive 163 disposed between the first substrate fixing unit 161 and the first base fixing unit 162. This facilitates assembly between the first substrate 150 and the base 500. Similarly, the second bonding member 260 may include a second substrate fixing unit 261 fixed to the second substrate 250, a second base fixing unit 262 fixed to the lower surface 520 of the base 500, and a second adhesive 263 disposed between the second substrate fixing unit 261 and the second base fixing unit 262. This facilitates assembly between the second substrate 250 and the base 500. In particular, when the second holder 240 accommodating the lens group 230 is fixed to the upper surface 510 of the base 500, the second base fixing unit 262 is fastened to the lower surface 520 of the base 500, and the second substrate 250 on which the image sensor 210 is disposed is shifted and tilted using the second adhesive 263 as an intermediary, thereby performing active alignment of the light receiving unit 200.

[0101] As described above, the light emitting unit 100 includes the diffusing member 130. The diffusing member 130 is disposed on the lens group 120. The diffusing member 130 receives light output from the light source 110 and the lens group 120, and then refracts or diffracts the received light before outputting it. The diffusing member 130 may be a diffractive optical element (DOE) that replicates the output pattern output from the light source 110. Alternatively, the diffusing member 130 may be a diffuser that diffuses the output pattern output from the light source 110. According to an embodiment of the present invention, the diffusing member 130 may be disposed in the third holder 170, and a lower edge of the third holder 170 is placed on the upper surface of the base 500. The third holder 170 may be disposed in the first holder 140. The outer circumferential surface of the third holder 170 may be disposed on the inner circumferential surface of the first holder 140. To this end, threads that engage with each other may be formed on the inner circumferential surface of the first holder 140 and the outer circumferential surface of the third holder 170. Accordingly, the outer circumferential surface of the third holder 170 can be rotated to be coupled to the inner circumferential surface of the first holder 140. This facilitates assembly of the diffusion member 130. In particular, precise active alignment of the light source 110, the lens group 120, and the diffusion member 130 can be performed during the process of rotating the third holder 170 to couple it to the inner circumferential surface of the first holder 140.

[0102] FIG. 10 shows an example of an assembly process for an information generating device according to an embodiment of the present invention.

[0103] 10(a), the upper edge of the second holder 240 accommodating the lens group 230 is placed on the upper surface 510 of the base 500. At this time, the upper edge of the second holder 240 and the upper surface 510 of the base 500 may be fastened together by a fastening member 700. As a result, the second holder 240 may be fixed based on the upper surface 510 of the base 500, and the second holder 240 accommodating the lens group 230 and the base 500 may be firmly fixed together, thereby improving the durability of the information generating device 1000 even in an environment where vibration or shaking occurs.

[0104] Referring to FIG. 10( b ), the second base fixing unit 262 of the second joint member 260 is fastened to the second region 522 of the lower surface 520 of the base 500 .

[0105] 10(c), a second substrate 250, an image sensor 210 disposed on the second substrate 250, and a second substrate fixing unit 261 disposed on the second substrate 250 to surround the image sensor 210 and fixed to the second substrate 250 are pre-assembled. A second adhesive 263 is applied to the upper surface of the second substrate fixing unit 261, and the second substrate fixing unit 261 is then bonded to the lower surface of the second base fixing unit 262. During the bonding process, the second substrate 250 on which the image sensor 210 is disposed can be shifted and tilted to perform active alignment between the image sensor 210 and the lens group 230. As shown, the second adhesive 263 is disposed between the second substrate fixing unit 261 and the second base fixing unit 262, and therefore, is not exposed to the outside. Here, fine focus adjustment (e.g., fine tuning) can be performed by shifting and tilting the second substrate 250 on which the image sensor 210 is disposed.

[0106] 10(d), the first substrate 150, the light source 110 disposed on the first substrate 150, and the first bonding member 160 disposed on the first substrate 150 to surround the light source 110 and fixed to the first substrate 150 are fixed to a first region 521 of a lower surface 520 of the base 500. The first bonding member 160 may be fixed to the first region 521 of the lower surface 520 of the base 500 using a fastening member 700. As such, the first substrate 150, the light source 110, and the first bonding member 160 may be fixed based on the lower surface 520 of the base 500. Here, the first bonding member 160 is illustrated as including a first substrate fixing unit 161, a first base fixing unit 162, and a first adhesive 163, but is not limited thereto. The first bonding member 160 may be designed so that one member is fixed to the first substrate 150 and the lower surface 520 of the base 500. That is, according to one embodiment of the present invention, the pre-assembled first substrate 150, light source 110, and first bonding member 160 may be fixed to the first region 521 of the lower surface 520 of the base 500. According to another embodiment of the present invention, the first base fixing unit 162 may be first fixed to the first region 521 of the lower surface 520 of the base 500, and then the pre-assembled first substrate 150, light source 110, and first substrate fixing unit 161 may be bonded to the first base fixing unit 162 using the first adhesive 163.

[0107] 10(e), the first holder 140 accommodating the lens group 120 may be disposed in the first hole TH1 so as to extend from the upper surface 510 of the base 500 through the first hole TH1. Interlocking threads are formed on the outer circumferential surface of the first holder 140 and the inner circumferential surface of the first hole TH1, allowing the first holder 140 to be fixed to the first hole TH1 while rotating. Thus, Z-axis focusing and XY-axis active alignment may be performed by rotating the first holder 140 accommodating the lens group 120. Alternatively, the upper edge of the first holder 140 may be placed on the upper surface 510 of the base 500. Instead of directly contacting the upper surface 510 of the base 500, a third adhesive (not shown) may be disposed between the upper edge of the first holder 140 and the upper surface 510 of the base 500. Active alignment between the light source 110 and the lens group 120 can be performed and focusing can be achieved by shifting or tilting the first holder 140, which accommodates the lens group 120, during the process of rotating the first holder 140 to fix the first holder 140 in the first hole TH1 or bonding the upper edge of the first holder 140 to the upper surface 510 of the base 500 with a third adhesive (not shown). Here, fine focus adjustment (e.g., fine tuning) can be achieved through the process of shifting and tilting the first holder 140.

[0108] 10(f), the third holder 170, on which the diffusion member 130 is disposed, is placed on the first holder 140. At this time, the inner circumferential surface of the first holder 140 and the outer circumferential surface of the third holder 170 may be formed with interlocking threads, and the outer circumferential surface of the third holder 170 may be rotated to couple with the inner circumferential surface of the first holder 140. During the process of rotating the third holder 170 to couple with the inner circumferential surface of the first holder 140, precise active alignment of the light source 110, the lens group 120, and the diffusion member 130 may be performed.

[0109] As such, according to one embodiment of the present invention, the second holder 240 accommodating the lens group 230 is first fixed based on the upper surface 510 of the base 500, and then active alignment of the light receiving unit 200 is performed by shifting or tilting the second substrate 250, image sensor 210, and second bonding member 260; and the first substrate 150, light source 110, and first bonding member 160 are first fixed based on the lower surface 520 of the base 500, and then active alignment of the light emitting unit 100 is performed by shifting or tilting the first holder 140 accommodating the lens group 120.

[0110] According to another embodiment of the present invention, the first holder 140 accommodating the lens group 120 may be first fixed based on the upper surface 510 of the base 500, and then active alignment of the light-emitting unit may be performed by shifting or tilting the first substrate 150, the light source 110, and the first bonding member 160. Alternatively, the second substrate 250, the image sensor 210, and the second bonding member 260 may be first fixed based on the lower surface of the base 500, and then active alignment of the light-receiving unit 200 may be performed by shifting or tilting the second holder 240 accommodating the lens group 230.

[0111] According to another embodiment of the present invention, the first holder 140 accommodating the lens group 120 and the second holder 240 accommodating the lens group 230 may be first fixed based on the top surface 510 of the base 500, and then active alignment of the light emitting unit may be performed by shifting or tilting the first substrate 150, the light source 110, and the first bonding member 160, and active alignment of the light receiving unit 200 may be performed by shifting or tilting the second substrate 250, the image sensor 210, and the second bonding member 260.

[0112] According to another embodiment of the present invention, the first substrate 150, the light source 110, and the first bonding member 160 may be fixed first based on the lower surface 520 of the base 500, and the second substrate 250, the image sensor 210, and the second bonding member 260 may be fixed first. After that, active alignment of the light emitting unit 100 may be performed by shifting or tilting the first holder 140 that houses the lens group 120, and active alignment of the light receiving unit 200 may be performed by shifting or tilting the second holder 240 that houses the lens group 230.

[0113] In this way, by assembling the light-emitting unit 100 and the light-receiving unit 200 using the upper surface 510 and the lower surface 520 of the base 500 as the reference surface, active alignment can be performed easily and precisely, and if a malfunction occurs in some components of the light-emitting unit 100 or some components of the light-receiving unit 200, only the malfunctioning component can be replaced.

[0114] FIG. 11 is a perspective view of a vehicle to which an information generating device according to an embodiment of the present invention is applied.

[0115] For example, FIG. 11 is an external view of a vehicle equipped with a vehicle driving assistance device to which an information generating device 1000 according to an embodiment is applied.

[0116] 11, a vehicle 700 according to an embodiment may include wheels 13FL and 13FR that are rotated by a power source, and a predetermined sensor, which may be, but is not limited to, a camera sensor.

[0117] The camera may be a camera sensor to which the information generating device 1000 according to the embodiment is applied. The vehicle 700 according to the embodiment may acquire image information through a camera sensor 2000 that captures a front image or a surrounding image, determine whether a lane is unidentified using the image information, and generate a virtual lane when the lane is unidentified.

[0118] For example, a camera sensor may capture an image in front of the vehicle 700 to acquire a front image, and a processor (not shown) may analyze objects included in the front image to acquire image information.

[0119] For example, if an object such as a lane marking, an adjacent vehicle, a driving obstacle, or an indirect road marking such as a median strip, a curb, or a roadside tree is captured in an image captured by a camera sensor, the processor can detect such an object and include it in the image information. At this time, the processor can obtain distance information from the detected object through the camera sensor to further complement the image information.

[0120] The image information may be information about an object captured in the image. Such a camera sensor may include an image sensor and an image processing module.

[0121] The camera sensor can process still or moving images obtained by an image sensor (eg, CMOS or CCD).

[0122] The image processing module processes still or moving images acquired through the image sensor to extract necessary information and transmit the extracted information to a processor.

[0123] In this case, the camera sensor may include, but is not limited to, a stereo camera to improve the accuracy of measuring the object and further secure information such as the distance between the vehicle 700 and the object.

[0124] The camera device according to the embodiment of the present invention may refer to a device that acquires an RGB image and a depth image and aligns them to acquire a 3D color image. For convenience of explanation, the camera device according to the embodiment of the present invention will be described mainly using the ToF (Time of Flight) principle to acquire a depth image, but is not limited thereto. The camera device according to the embodiment of the present invention may acquire a depth image using not only the ToF principle, but also the FMCW (Frequency Modulation Continuous Wave) principle or the structured light principle.

[0125] FIG. 12 is a perspective view of a mobile terminal to which an information generating apparatus according to an embodiment of the present invention is applied.

[0126] As shown in FIG. 12, the mobile terminal 1500 of the embodiment may include an information generating device 1000, a flash module 1530, and an autofocus device 1510 provided on the rear surface.

[0127] The information generating device 1000 may include an image capturing function and an autofocus function. For example, the information generating device 1000 may include an autofocus function using an image.

[0128] The information generating device 1000 processes still or moving image frames obtained by an image sensor in a shooting mode or a video call mode.

[0129] The processed image frame can be displayed on a predetermined display unit or stored in a memory.A camera (not shown) can also be disposed on the front of the mobile terminal body.

[0130] For example, the information generating device 1000 may include a first camera module and a second camera module, and the first camera module may be capable of implementing an OIS function along with an AF function.

[0131] The flash module 1530 may include a light emitting element for emitting light therein, and may be activated by the camera of the mobile terminal or by user control.

[0132] The autofocus device 1510 may include one of a surface emitting laser device package as a light emitting unit.

[0133] The autofocus device 1510 may include an autofocus function using a laser. The autofocus device 1510 may be used primarily in conditions where the image-based autofocus function of the information generating device 1000 is impaired, such as close proximity of less than 10 m or in dark environments.

[0134] The autofocus device 1510 may include a light emitting portion including a vertical cavity surface emitting laser (VCSEL) semiconductor device, and a light receiving portion such as a photodiode that converts optical energy into electrical energy.

[0135] FIG. 13 is an example of a block diagram of a camera device.

[0136] Referring to FIG. 13, the camera device 1 includes a depth camera 10, an RGB camera 20, an information generating unit 30, and a control unit 40.

[0137] The depth camera 10 may be, for example, a Time of Flight (ToF) camera, which calculates the distance to an object by measuring the time of flight, i.e., the time it takes for light to be emitted and reflected.

[0138] The RGB camera 20 can be a general camera capable of capturing two-dimensional RGB images.

[0139] The depth camera 10 and the RGB camera 20 can be placed in one device so that they can capture the same area.

[0140] The information generating unit 30 is connected to the depth camera 10 and the RGB camera 20, and can obtain a 3D color image by fusing the depth image obtained from the depth camera 10 and the RGB image obtained from the RGB camera 20.

[0141] The control unit 40 controls the depth camera 10, the RGB camera 20, and the information generating unit 30 overall.

[0142] Here, the information generation unit 30 and the control unit 40 are illustrated as being disposed adjacent to the depth camera 10 and the RGB camera 20 within the camera device 1, but this is not limitative and they may be disposed remotely from the depth camera 10 and the RGB camera 20. Alternatively, some functions of the information generation unit 30 and the control unit 40 may be included within the depth camera 10 and the RGB camera 20.

[0143] Here, the depth camera 10 includes a light emitting unit 12 and a light receiving unit 14. The light emitting unit 12 may include a light source 12-1 that generates and outputs an output optical signal, and a lens group 12-2 arranged on the light source 12-1.

[0144] The light receiving unit 14 can include a depth sensor unit 14-1, an IR pass filter 14-2 arranged on the depth sensor unit 14-1, and a lens group 14-3 arranged on the IR pass filter 14-2.

[0145] The RGB camera 20 includes an RGB sensor section 22 , an IR blocking filter 24 disposed on the RGB sensor section 22 , and a lens group 26 disposed on the IR blocking filter 24 .

[0146] In this case, the light-emitting unit 12, the light-receiving unit 14, and the RGB camera 20 of the depth camera 10 may be arranged side by side facing the object. To measure depth using the triangulation technique, a baseline of a predetermined distance is required between the light-emitting unit 12 and the light-receiving unit 14 of the depth camera 10. In addition, due to structural issues, the depth camera 10 and the RGB camera 20 may need to be spaced apart by more than a predetermined distance. This may increase the length of the camera device 1.

[0147] According to an embodiment of the present invention, the internal structure of the camera device is modified to obtain a camera device that is compact yet capable of generating 3D color images.

[0148] FIG. 14 is a block diagram of a camera device according to an embodiment of the present invention, and FIG. 15 is a cross-sectional view of the camera device according to an embodiment of the present invention.

[0149] 14 and 15, a camera device 2000 according to an embodiment of the present invention includes a light emitting unit 2100, a light receiving unit 2200, an information generating unit 2300, and a control unit 2400.

[0150] The light emitting unit 2100 may generate and output an output optical signal in the form of a pulse wave or a continuous wave. The continuous wave may be in the form of a sinusoid wave or a squared wave. By generating the output optical signal in the form of a pulse wave or a continuous wave, the camera device 2000 can detect a time difference or phase difference between the output optical signal output from the light emitting unit 2100 and the input optical signal reflected from the object and input to the light receiving unit 2200. In this specification, output light refers to light output from the light emitting unit 2100 and incident on the object, and input light refers to light output from the light emitting unit 2100, reaching the object, reflecting from the object, and input to the light receiving unit 2200. In this specification, the pattern of output light may be referred to as an emission pattern, and the pattern of input light may be referred to as an incident pattern. From the perspective of the object, output light may be incident light, and input light may be reflected light.

[0151] The light emitting unit 2100 may include a light source 2110, a lens group 2120 disposed on the light source 2110, and a diffusion member 2130 disposed on the lens group 2120. The light source 2110 generates and outputs light. The light generated by the light source 2110 may be infrared light. For example, the light generated by the light source 2110 may be infrared light having a wavelength of 770 to 3000 nm. The light source 2110 may use a light emitting diode (LED), and may have a configuration in which a plurality of LEDs are arranged in a certain pattern. Alternatively, the light source 2110 may include an organic light emitting diode (OLED) or a laser diode (LD). Alternatively, the light source 2110 may be a vertical cavity surface emitting laser (VCSEL). A VCSEL is a type of laser diode that converts an electrical signal into an optical signal and may output light having a wavelength of about 800 to 1000 nm, for example, about 850 nm or about 940 nm. If the light source 2110 is a VCSEL, the light source 2110 may include multiple emitters arranged in an m*n matrix.

[0152] The light source 2110 repeatedly turns on and off at regular time intervals to generate an output optical signal in the form of a pulse wave or a continuous wave. The regular time interval may be the frequency of the output optical signal.

[0153] The lens group 2120 may condense light output from the light source 2110 and output the condensed light to the outside. The lens group 2120 may be disposed above the light source 2110 and spaced apart from the light source 2110. Here, above the light source 2110 may refer to the side from which light is output from the light source 2110. The lens group 2120 may include at least one lens. If the lens group 2120 includes multiple lenses, the lenses may be aligned based on a central axis to form an optical system. Here, the central axis may be the same as the optical axis of the optical system. The lens group 2120 is disposed above the light source 2110 and may include multiple lenses sequentially arranged in a direction from the diffusion member 2130 to the light source 2110. For example, the lens group 2120 may include five lenses sequentially arranged in a direction from the diffusion member 2130 to the light source 2110. In this specification, the lens group 2120 may be referred to as a collimator because it condenses and outputs the light output from the light source 2110.

[0154] The diffusion member 2130 can receive the light output from the light source 2110 and the lens group 2120, and then refract or diffract the received light and output it.

[0155] The light receiving unit 2200 receives an optical signal reflected from an object and generates an electrical signal using the received optical signal. The light receiving unit 2200 includes a first sensor 2210 and a second sensor 2220. The first sensor 2210 may be a depth sensor that senses IR light, and the second sensor 2220 may be an RGB sensor that senses visible light. The optical signal received by the first sensor 2210 may be an optical signal output from the light source 2110 and reflected from the object. The optical signal received by the second sensor 2220 may be an optical signal reflected from the object. The first sensor 2210 and the second sensor 2220 may each have a structure in which a plurality of pixels are arranged in a grid. The first sensor 2210 may be a Time of Flight (ToF) sensor that receives IR light reflected from the object and measures distance using a time difference or phase difference. The second sensor 2220 may be an RGB sensor, a complementary metal oxide semiconductor (CMOS) image sensor, or a charge coupled device (CCD) image sensor.

[0156] The information generator 2300 may generate a depth image using an input optical signal input to the first sensor 2210. For example, the information generator 2300 may calculate depth information of an object using the time of flight of an output optical signal output from the light source 2110, reflected from an object, and input to the first sensor 2210. For example, the information generator 2300 may calculate a time difference between the output optical signal and the input optical signal using an electrical signal received by the first sensor 2210, and calculate the distance between the object and the camera device 2000 using the calculated time difference. For example, the information generator 2300 may calculate a phase difference between the output optical signal and the input optical signal using an electrical signal received from the sensor, and calculate the distance between the object and the camera device 2000 using the calculated phase difference. The information generator 2300 may generate an RGB image using an input optical signal input to the second sensor 2220. The RGB image may be a 2D image. The information generator 2300 may generate a 3D color image by combining the depth image and the RGB image.

[0157] The control unit 2400 controls the operation of the light emitting unit 2100, the light receiving unit 2200, and the information generating unit 2300. The information generating unit 2300 and the control unit 2400 may be implemented in the form of a printed circuit board (PCB). The information generating unit 2300 and the control unit 2400 may also be implemented in other configurations. Alternatively, the control unit 2400 may be included in a mobile terminal, an electronic device, a vision device, or a vehicle in which the camera device 2000 according to the present embodiment is installed. For example, the control unit 2400 may be implemented in the form of an application processor (AP) of a smartphone in which the camera device 2000 according to the present embodiment is installed, or in the form of an electronic control unit (ECU) of a vehicle in which the camera device 2000 according to the present embodiment is installed.

[0158] According to an embodiment of the present invention, the camera device 2000 is designed to be compact by utilizing the arrangement of the first sensor 2210 and the second sensor 2220 included in the light receiving unit 2200.

[0159] 14 and 15, the light receiving unit 2200 includes the first sensor 2210 and the second sensor 2220 described above, and further includes a beam splitter 2230 and a lens group 2240. An input optical signal reflected from an object and entering the light receiving unit 2200 is focused by the lens group 2240, and the input optical signal focused by the lens group 2240 is split by the beam splitter 2230. The beam splitter 2230 reflects a portion of the light focused by the lens group 2240 after reflection from the object and transmits the remaining portion. To this end, the beam splitter 2230 may include a semi-transmissive reflective surface.

[0160] At this time, the lens group 2240 is disposed between the object and the beam splitter 2230, and the input optical signal collected by the lens group 2240 includes both IR light (I) and visible light (R, G, B).

[0161] According to an embodiment of the present invention, the optical axis of the light source 2110 and the optical axis of the second sensor 2220 are arranged parallel to each other, and the optical axis of the first sensor 2210 is arranged perpendicular to the optical axis of the light source 2110 and the optical axis of the second sensor 2220. The incident surface of the beam splitter 2230 is arranged between the first sensor 2210 and the second sensor 2220 and is inclined with respect to the first sensor 2210 and the second sensor 2220. For example, the optical axis of the first sensor 2210 and the optical axis of the second sensor 2220 may be arranged perpendicular to each other, but the incident surface of the beam splitter 2230 may be arranged to form a 45° angle with the optical axis of the first sensor 2210 and a 45° angle with the optical axis of the second sensor 2220. Accordingly, light reflected by the incident surface of beam splitter 2230 is received by first sensor 2210, and light transmitted through the incident surface of beam splitter 2230 is received by second sensor 2220. That is, the number of optical path changes of the input optical signal reflected from the object and received by first sensor 2210 may be different from the number of optical path changes of the input optical signal reflected from the object and received by second sensor 2220. For example, the number of optical path changes of the input optical signal reflected from the object and received by first sensor 2210 may be greater than the number of optical path changes of the input optical signal reflected from the object and received by second sensor 2220. For example, the optical path of the input optical signal reflected from the object and received by first sensor 2210 may be changed once at the incident surface of beam splitter 2230, but the optical path of the input optical signal reflected from the object and received by second sensor 2220 may be changed zero times.

[0162] As described above, according to one embodiment of the present invention, the first sensor 2210 is a depth sensor, and the second sensor 2220 is an RGB sensor. To this end, the incident surface of the beam splitter 2230 may be coated with an IR-reflective material, the first filter 2212 disposed between the beam splitter 2230 and the first sensor 2210 may be an IR-pass filter, and the second filter 2222 disposed between the beam splitter 2230 and the second sensor 2220 may be an IR-blocking filter. Accordingly, IR light reflected from the incident surface of the beam splitter 2230 may be received by the first sensor 2210 and used to generate a depth image, and visible light transmitted through the incident surface of the beam splitter 2230 may be received by the second sensor 2220 and used to generate an RGB image.

[0163] 15 , the light source 2110, the first sensor 2210, and the second sensor 2220 are sequentially arranged on the substrate 2500 along a first direction. In this case, the first direction may be perpendicular to the optical axis of the light source 2110. The first direction may be parallel to the optical axis of the first sensor 2210. According to an embodiment of the present invention, the light source 2110 may be arranged in a first region 2510 of the substrate 2500, the second sensor 2220 may be arranged in a second region 2520 of the substrate 2500, and the first sensor 2210 may be arranged in a third region 2530 of the substrate 2500. Here, the second region 2520 and the third region 2530 may be arranged in the first direction relative to the first region 2510. The height of the second region 2520 may be lower than the height of the first region 2510, and the second region 2520 may be parallel to the first region 2510. Here, the height may be the height in a direction parallel to the optical axis of the light source 2110. The third region 2530 is disposed between the first region 2510 and the second region 2520 and is perpendicular to the first region 2510 and the second region 2520. For example, the third region 2530 may be a wall connecting the first region 2510 and the second region 2520. In this case, the height of the third region 2510 in the second direction may be greater than the width of the first sensor 2210. When the first sensor 2210 is disposed in the third region 2530, the length of the substrate 2500 in the first direction can be reduced by the width of the first sensor 2210, thereby providing a camera device that can generate a 3D color image and is compact in size.

[0164] Meanwhile, according to an embodiment of the present invention, the first sensor 2210, which is a depth sensor, and the second sensor 2220, which is an RGB sensor, share the lens group 2240, and therefore can be implemented in a smaller size than a camera device in which the lens group on the depth sensor side and the lens group on the RGB sensor side must be arranged separately.

[0165] In this case, the lens group 2240 may include a plurality of lenses, and the optical axis of the lens group 2240 may be aligned with the optical axis of the first sensor 2210 and the optical axis of the second sensor 2220 .

[0166] In this case, the diameter of the effective area of ​​the object side of the lens closest to the object among the lenses included in the lens group 2240 may be larger than the diameter of the effective area of ​​the image side of the lens closest to at least one of the first sensor 2210 and the second sensor 2220 among the lenses included in the lens group 2240. This can maximize the amount of light of the input optical signal that is reflected from the object and reaches at least one of the first sensor 2210 and the second sensor 2220.

[0167] For example, the lens group 2240 may include three to five lenses arranged in sequence from the object to the beam splitter 2230. The object side of the lens arranged closest to the object may bulge toward the object, and the image side of the lens arranged closest to the beam splitter 2230 may bulge toward the image, and the diameter of the effective area of ​​the object side of the lens arranged closest to the object may be larger than the diameter of the effective area of ​​the image side of the lens arranged closest to the beam splitter 2230. In this way, the lens group 2240 can correct chromatic aberration of light reflected from the object and efficiently condense the light to be incident on the semi-transmissive reflective surface of the beam splitter 2230.

[0168] When the first sensor 2210 and the second sensor 2220 share the lens group 2240, as in the embodiment of the present invention, active alignment between the lens group on the depth sensor side and the lens group on the RGB sensor side can be omitted, which can simplify the manufacturing process and increase the durability and reliability of the camera device 2000.

[0169] According to an embodiment of the present invention, the Field of View (FoV) of the first sensor 2210, which is a depth sensor, and the Field of View (FoV) of the second sensor 2220 may be the same and overlap each other. Here, the Field of View (FoV) of the first sensor 2210 and the second sensor 2220 being the same and overlapping each other may mean that 90% or more, preferably 95% or more, and more preferably 97% or more of the FoV of the first sensor 2210 overlaps with the FoV of the second sensor 2220, or that 90% or more, preferably 95% or more, and more preferably 97% or more of the FoV of the second sensor 2220 overlaps with the FoV of the first sensor 2210.

[0170] This allows the pixel coordinates of the first sensor 2210 and the pixel coordinates of the second sensor 2220 to be synchronized.

[0171] Figure 16(a) is a conceptual diagram of a camera device according to an embodiment of the present invention capturing a 3D color image, Figure 16(b) is a depth image acquired by a first sensor of the camera device according to an embodiment of the present invention, Figure 16(c) is an RGB image acquired by a second sensor of the camera device according to an embodiment of the present invention, and Figure 16(d) is a composite image of the depth image acquired by the first sensor of the camera device according to an embodiment of the present invention and the RGB image acquired by the second sensor.

[0172] 16(a), the first sensor 2210 and the second sensor 2220 in the light receiving unit 2200 of the camera device 2000 share the lens group 2240, so the FoV of the first sensor 2210 and the FoV of the second sensor 2220 are the same and overlap each other. That is, the vertical FoV (FoVV) and the horizontal FoV (FoVH) of the first sensor 2210 are the same as the vertical FoV (FoVV) and the horizontal FoV (FoVH) of the second sensor 2220, respectively.

[0173] 16(b), the depth image acquired by the first sensor 2210 is a 3D point cloud of (X, Y, Z) coordinates, where the X and Y values ​​represent two-dimensional coordinate values, and the Z value may represent the distance between the object and the camera device 2000, i.e., the depth of the object.

[0174] Referring to FIG. 16(c), the RGB image acquired by the second sensor 2220 is a two-dimensional color image of (X, Y) coordinates.

[0175] Referring to FIG. 16(d), the information generator 2300 combines the 3D point cloud of (X, Y, Z) coordinates received from the first sensor 2210 with the RGB image of (X, Y) coordinates received from the second sensor 2220, and colors the 3D point cloud with the RGB image.

[0176] 16(a), the FoV of the first sensor 2210 and the FoV of the second sensor 2220 are the same and overlap each other, so the (X, Y) coordinates of the RGB image and the (X, Y) coordinates of the 3D point cloud are the same. As such, since there is no error between the first sensor 2210, which is a depth sensor, and the second sensor 2220, which is an RGB sensor, the calculation for extrinsic calibration between the depth image of the first sensor 2210 and the RGB image of the second sensor 2220 can be minimized.

[0177] Although the above description has been given taking as an example a case where the first sensor 2210 is a depth sensor and the second sensor 2220 is an RGB sensor, the present invention is not limited to this.

[0178] According to another embodiment of the present invention, the first sensor 2210 may be an RGB sensor, and the second sensor 2220 may be a depth sensor. To this end, the incident surface of the beam splitter 2230 may be coated with an IR-transmitting material or a visible light-reflecting material, the first filter 2212 disposed between the beam splitter 2230 and the first sensor 2210 may be an IR-blocking filter, and the second filter 2222 disposed between the beam splitter 2230 and the second sensor 2220 may be an IR-transmitting filter. Accordingly, visible light reflected by the incident surface of the beam splitter 2230 may be received by the first sensor 2210 and used to generate an RGB image, and IR light transmitted through the incident surface of the beam splitter 2230 may be received by the second sensor 2220 and used to generate a depth image.

[0179] FIG. 17 is a cross-sectional view of a camera device according to another embodiment of the present invention.

[0180] 17, an optical path converting member 2600 may be further disposed between the light emitting unit 2100 and the light receiving unit 2200 and the target surface of the camera device 2000 in accordance with Fig. 15. The remaining configuration is the same as that described with reference to Figs. 14 to 16, and therefore, a duplicated description will be omitted.

[0181] Accordingly, the light output from the light emitting unit 2100 may be incident on the target surface after its optical path is changed by the optical path changing member 2600. Similarly, the light reflected from the target surface may be incident on the light receiving unit 2200 after its optical path is changed by the optical path changing member 2600.

[0182] As in other embodiments of the present invention, if an optical path converting member 2600 is further disposed between the light emitting unit 2100 and the light receiving unit 2200 of the camera device 2000 and the target surface, the space constraint problem caused by the increase in the length of the electrical components due to the beam splitter 2230 can be minimized.

[0183] The above description focuses on the embodiments, but these are merely examples and are not intended to limit the present invention. Those skilled in the art will recognize that various modifications and applications not exemplified above are possible within the scope of the essential characteristics of the present invention. For example, each component specifically illustrated in the embodiments can be modified and implemented. Differences related to such modifications and applications should be construed as being included within the scope of the present invention as defined by the appended claims.

Claims

1. a light emitting unit that generates an output optical signal and irradiates the target area; a light receiving unit for receiving an input optical signal after reflection from the target area; and a base including a first hole and a second hole spaced apart from each other; the light emitting unit includes a light source, a first holder disposed on the light source and disposed in the first hole of the base, and a first lens group disposed in the first holder; the light receiving unit includes an image sensor, a second holder disposed on the image sensor and disposed in the second hole of the base, and a second lens group disposed in the second holder; the light emitting unit further includes a third holder disposed on the first holder and a diffusion member disposed on the third holder, an upper edge of the second holder is placed on an upper surface of the base; The information generating device, wherein a lower edge of the third holder is placed on an upper surface of the base.

2. the light emitting unit further includes a first substrate on which the light source is disposed, and a first bonding member disposed between the first substrate and a lower surface of the base to bond the first substrate and the lower surface of the base, the light receiving unit further includes a second substrate on which the image sensor is disposed, and a second bonding member disposed between the second substrate and a lower surface of the base to bond the second substrate and the lower surface of the base, The information generating device according to claim 1 , wherein the first substrate and the second substrate are spaced apart from each other.

3. The information generating device according to claim 2 , wherein the first substrate and the second substrate have different heights relative to the top surface of the base.

4. the lower surface of the base includes a first region having a first thickness relative to the upper surface of the base and a second region having a second thickness relative to the upper surface of the base that is different from the first thickness; The information generating device according to claim 2 , wherein the first joint member is disposed in the first region, and the second joint member is disposed in the second region.

5. a first opening for accommodating the light source is formed in the first joining member, and a second opening for accommodating the image sensor is formed in the second joining member; The information generating device according to claim 2 , wherein at least one of the first joint member and the second joint member directly contacts a lower surface of the base.

6. 6. The information generating device of claim 5, wherein the first joining member includes a first substrate fixing unit fixed to the first substrate, a first base fixing unit fixed to the underside of the base, and a first adhesive disposed between the first substrate fixing unit and the first base fixing unit.

7. 6. The information generating device of claim 5, wherein the second joining member includes a second substrate fixing unit fixed to the second substrate, a second base fixing unit fixed to the underside of the base, and a second adhesive disposed between the second substrate fixing unit and the second base fixing unit.

8. The information generating device according to claim 5 , wherein the first joint member is fastened to the first substrate and a lower surface of the base.

9. The information generating device according to claim 5 , wherein the second bonding member is fastened to the second substrate and a lower surface of the base.

10. The information generating device according to claim 1 , wherein the third holder is provided with a screw thread for being rotated and coupled to the first holder.

Images