Camera device

Abstract

A camera device according to the present embodiment may comprise: a first light-emitting unit for irradiating an object with an infrared structured light pattern; a second light-emitting unit for irradiating the object with infrared light; a light-receiving unit including an RGB-IR sensor for detecting the infrared structured light pattern, the infrared light, and visible light, which are reflected from the object; an image processing unit for acquiring depth information, IR image information, and visible light information of the object by using the infrared structured light pattern, the infrared light, and the visible light received by the light-receiving unit; and a control unit for controlling a period for irradiating the object with the infrared structured light pattern by the first light-emitting unit and a period for irradiating the object with the infrared light by the second light-emitting unit.

Description

Camera device

[0001] This embodiment relates to a camera device.

[0002] With the recent increase in interest in 3D stereoscopic image services, devices providing stereoscopic images are being continuously researched and developed, and depth information (Depth Map) is required to acquire 3D stereoscopic images. Depth information is data representing spatial distance and indicates the perspective information of another point relative to a point in a 2D image.

[0003] Methods for acquiring depth information include stereo vision cameras, Time of Flight (ToF), and structured light.

[0004] Among these, the structured light method calculates the degree of focus from an image with a specific pattern projected onto it and obtains three-dimensional shape information of the object based on this.

[0005] Compared to other methods, this method using structured light enables 3D imaging with high-resolution, so research and development on it is continuously underway.

[0006] The present embodiment provides a camera device capable of acquiring depth information, IR image information, and visible light image information.

[0007] A camera device according to an embodiment of the present invention may include: a first light-emitting unit that irradiates an infrared structured light pattern onto an object; a second light-emitting unit that irradiates infrared light onto the object; a light-receiving unit including an RGB-IR sensor that detects an infrared structured light pattern, infrared light, and visible light reflected from the object; an image processing unit that acquires depth information, IR image information, and visible light information of the object using the infrared structured light pattern, infrared light, and visible light received by the light-receiving unit; and a control unit that controls the period of irradiating the infrared structured light pattern of the first light-emitting unit and the period of irradiating the infrared light of the second light-emitting unit.

[0008] In addition, the camera device according to the embodiment may irradiate the infrared structured light pattern of the first light-emitting unit and the infrared light of the second light-emitting unit at different times.

[0009] Additionally, the camera device according to the embodiment may irradiate the infrared structured light pattern onto the object during a first time period (t1), and the second light emitting unit may irradiate the infrared light onto the object during a second time period (t2).

[0010] Additionally, the camera device according to the embodiment does not irradiate light from the first light-emitting unit and the second light-emitting unit during the third time (t3), and the light-receiving unit can detect the visible light during the third time (t3).

[0011] In addition, the camera device according to the embodiment can set the first time (t1), the second time (t2), and the third time (t3) so that the signals of the infrared structured light pattern, the infrared light, and the visible light reflected from the object do not interfere with each other.

[0012] In addition, the camera device according to the embodiment may have the same period for the first time (t1), the second time (t2), and the third time (t3).

[0013] In addition, the camera device according to the embodiment may have at least one of the first time (t1), the second time (t2), and the third time (t3) set differently.

[0014] In addition, the camera device according to the embodiment may have the second light-emitting part positioned between the light-receiving part and the first light-emitting part.

[0015] In addition, the light receiving part of the camera device according to the embodiment may be positioned between the first light emitting part and the second light emitting part.

[0016] In addition, the camera device according to the embodiment may include a structure in which the RGB-IR sensor includes R, G, B, and IR pixels, and a first unit pixel and a second unit pixel are arranged alternately.

[0017] Additionally, the camera device according to the embodiment may have the first unit pixel comprising 2x2 pixels and having a pixel order of B, G, IR, and G clockwise from the top left, and the second unit pixel comprising 2x2 pixels and having a pixel order of R, G, IR, and G clockwise from the top left.

[0018] In addition, the camera device according to the embodiment may include a display unit that visually provides a three-dimensional image using information obtained from the image processing unit.

[0019] The camera device according to the present embodiment can acquire depth information, IR image information, and visible light image information with a single camera by using a light receiving unit to which an RGB-IR sensor is applied.

[0020] By using such depth information, IR image information, and visible light image information, three-dimensional image information of the object can be generated.

[0021] In addition, depth information, IR image information, and visible light image information can be acquired with a single camera, allowing the size of the camera device to be miniaturized.

[0022] FIG. 1 is a block diagram illustrating a camera device according to a first embodiment of the present invention.

[0023] FIG. 2 is a schematic diagram illustrating a camera device according to a first embodiment of the present invention.

[0024] FIG. 3 is a drawing illustrating a camera device and a display unit according to a first embodiment of the present invention.

[0025] FIG. 4 is a diagram illustrating the pixel structure of an image sensor according to the first embodiment of the present invention.

[0026] FIG. 5 is a drawing showing an image captured by a camera device according to the first embodiment of the present invention.

[0027] FIG. 6 is an example of utilizing a camera device according to the first embodiment of the present invention.

[0028] FIG. 7 is a perspective view illustrating a camera device according to a second embodiment of the present invention.

[0029] FIG. 8 is a perspective view illustrating the internal structure of a camera device according to a second embodiment of the present invention.

[0030] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0031] However, the technical concept of the present invention is not limited to some of the described embodiments but can be implemented in various different forms, and within the scope of the technical concept of the present invention, one or more of the components among the embodiments may be selectively combined or substituted.

[0032] In addition, terms used in the embodiments of the present invention (including technical and scientific terms) may be interpreted in a sense that is generally understood by those skilled in the art to which the present invention belongs, unless explicitly and specifically defined otherwise. Terms that are commonly used, such as terms defined in advance, may be interpreted in consideration of their meaning in the context of the relevant technology.

[0033] Furthermore, the terms used in the embodiments of the present invention are for the purpose of describing the embodiments and are not intended to limit the present invention.

[0034] In this specification, the singular form may include the plural form unless specifically stated otherwise in the text, and when described as "at least one of A and B and C (or more than one)," it may include one or more of all combinations that can be formed from A, B, and C.

[0035] In addition, terms such as first, second, A, B, (a), (b), etc., may be used when describing the components of the embodiments of the present invention. These terms are used merely to distinguish the components from other components and are not intended to limit the essence, order, or sequence of the components.

[0036] And, where it is stated that a component is 'connected', 'combined', or 'connected' to another component, this may include not only cases where the component is directly 'connected', 'combined', or 'connected' to the other component, but also cases where it is 'connected', 'combined', or 'connected' due to another component located between the component and the other component.

[0037] Furthermore, when described as being formed or placed "above" or "below" each component, "above" or "below" includes not only cases where two components are in direct contact with each other, but also cases where one or more other components are formed or placed between the two components. Additionally, when expressed as "above" or "below," it may include the meaning of a downward direction as well as an upward direction relative to a single component.

[0038] A camera device according to an embodiment of the present invention may refer to a camera that extracts depth information using a structured light method. Accordingly, the camera device may be used interchangeably with a depth information extraction device, a three-dimensional information extraction device, etc.

[0039] In the embodiments of the present invention, a case in which a three-dimensional image is acquired using structured light is described as an example. However, it is not limited thereto and can be applied not only to the structured light method but also to other three-dimensional image acquisition methods using infrared light (e.g., ToF method).

[0040]

[0041] The configuration of a camera device according to an embodiment will be described below with reference to the drawings.

[0042] FIG. 1 is a block diagram illustrating a camera device according to a first embodiment, FIG. 2 is a schematic diagram illustrating a camera device according to a first embodiment, and FIG. 3 is a diagram illustrating a camera device and a display unit according to a first embodiment.

[0043] FIG. 4 is a drawing illustrating the pixel structure of an image sensor according to a first embodiment, FIG. 5 is a drawing illustrating an image captured by a camera device according to a first embodiment, and FIG. 6 is an example of utilizing a camera device according to a first embodiment of the present invention.

[0044]

[0045] As illustrated in FIGS. 1 to 6, a camera device (100) according to the first embodiment may include a first light-emitting unit (10), a second light-emitting unit (20), a light-receiving unit (30), a control unit (40), and an image processing unit (50).

[0046] The first light-emitting unit (10) can generate a light signal output from a light source and irradiate it onto an object (70). The first light-emitting unit (10) can periodically output a light signal of a predetermined pattern. The light signal of a predetermined pattern may consist of a plurality of dots and may be referred to as structured light.

[0047] A predetermined pattern can be generated by a pre-designed algorithm, and the light signal of the predetermined pattern can be an infrared (IR) light signal. The first light-emitting unit (10) can be a structured light unit that irradiates an infrared structured light pattern onto a target (70).

[0048] The light source of the first light-emitting unit (10) may be infrared light with a wavelength of 800 nm or more. The light source may use a light-emitting diode (LED), and may have a form in which a plurality of light-emitting diodes are arranged according to a certain pattern.

[0049] In addition, the light source may include an organic light emitting diode (OLED) or a laser diode (LD).

[0050] In addition, the light source may be a VCSEL (Vertical Cavity Surface Emitting Laser). A VCSEL is a type of laser diode that converts an electrical signal into an optical signal and can output a wavelength of approximately 800 to 1000 nm. A single VCSEL may have multiple emitters, for example, hundreds of emitters, and a pattern consisting of dots can be output by each emitter.

[0051] The infrared structured light pattern of the first light-emitting unit (10) can be repeatedly switched on / off at regular time intervals by the control unit (40).

[0052]

[0053] The second light-emitting unit (20) can periodically irradiate infrared light onto the target object.

[0054] The infrared light output from the second light-emitting unit (20) may be infrared light with a wavelength of 800 nm or more. The second light-emitting unit (20) may include at least one laser diode (LD) or light-emitting diode (LED).

[0055] The infrared light of the second light-emitting unit (20) can be repeatedly switched on / off at regular intervals by the control unit (40).

[0056]

[0057] The light receiving unit (30) can receive visible light and infrared light output from the first light emitting unit (10) or the second light emitting unit (20) and reflected by the object (70).

[0058] The light receiving unit (30) may be an RGB camera. Although not shown in the drawing, the light receiving unit (30) may include a camera lens, a dual band pass filter, and an image sensor.

[0059] The light receiving unit (30) can basically capture visible light, but can also detect infrared structured light patterns and infrared light reflected by an object after light is projected from the first light emitting unit (10) or the second light emitting unit (20).

[0060] The time at which the light receiving unit (30) receives visible light, an infrared structured light pattern, and infrared light may vary depending on the time and period at which the first light emitting unit (10) or the second light emitting unit (20) projects the infrared structured light pattern and infrared light.

[0061]

[0062] As illustrated in FIGS. 2 and 3, the camera device (100) according to the first embodiment may have a first light-emitting unit (10) and a second light-emitting unit (20) arranged adjacently. The second light-emitting unit (20) may be arranged between the first light-emitting unit (10) and the light-receiving unit (30).

[0063] However, the arrangement of the light-emitting part and the light-receiving part may vary depending on the design, and the first light-emitting part (10) may be placed between the second light-emitting part (20) and the light-receiving part (30).

[0064] The light receiving unit (30) may include an RGB-IR sensor (300) capable of detecting both infrared and visible light. The pixel array structure of the RGB-IR sensor of the light receiving unit (30) is shown in FIG. 6.

[0065] As illustrated in FIG. 6, the RGB-IR sensor (300) may include R (Red), G (Green), B (Blue), and IR (Infrared) pixels. The light receiving unit (30) can acquire a color image in the visible light region using the R, G, and B pixels, and acquire an infrared image using the IR pixel.

[0066] The RGB-IR sensor (300) includes a first unit pixel (310) and a second unit pixel (320).

[0067] The first unit pixel (310) can be formed in a 2x2 pixel structure and may have a pixel order of B, G, IR, G in a clockwise direction starting from the top left.

[0068] The second unit pixel (320) can be formed in a 2x2 pixel structure and may have a pixel order of R, G, IR, G in a clockwise direction starting from the top left.

[0069] The first unit pixel (310) and the second unit pixel (320) can be repeatedly arranged to intersect each other in the first direction and the second direction. Based on the drawing, the first direction can be the horizontal direction, and the second direction can be the vertical direction.

[0070] The first unit pixel (310) can be repeatedly arranged in contact with the second unit pixel (320) in a first direction and a second direction perpendicular to the first direction. Identical unit pixels do not touch each other, and identical unit pixels can be placed in diagonal positions.

[0071] Since the first unit pixel (310) and the second unit pixel (320) are arranged repeatedly in an intersecting manner, multiple first unit pixels (310) can be positioned diagonally without touching each other.

[0072] Additionally, multiple second unit pixels (320) can be positioned diagonally without touching each other.

[0073] A light receiving unit (30) using an RGB-IR sensor (300) can acquire visible light and IR information separately. The IR image is extracted by interpolating the RGB signals of the sensor from surrounding pixels.

[0074] Although not shown in the drawing, the light receiving unit (30) may include a dual band pass filter.

[0075] A dual bandpass filter is placed between the camera lens (not shown) and the RGB-IR sensor (300), so that light collected through the camera lens can pass through the dual bandpass filter and be transmitted to the RGB-IR sensor (300).

[0076] A dual bandpass filter can be used to selectively transmit both visible light and infrared light of a specific band to the RGB-IR sensor (300).

[0077] By using a dual bandpass filter in the light receiving unit (30), the RGB-IR sensor (300) can receive infrared and visible light in the approximately 940 nm range.

[0078]

[0079] The control unit (40) can control the first light-emitting unit (10), the second light-emitting unit (20), the light-receiving unit (30), and the image processing unit (50) overall.

[0080] The control unit (40) can control the time and period during which the infrared structured light pattern of the first light-emitting unit (10) and the infrared light of the second light-emitting unit (20) are projected.

[0081] For example, the control unit (40) can project an infrared structured light pattern of the first light-emitting unit (10) for a first time (t1) and project an infrared light of the second light-emitting unit (20) for a second time (t2).

[0082] The control unit (40) may not project the light source of the first light-emitting unit (10) and the second light-emitting unit (20) during the third time (t3) so that the light-receiving unit (30) can receive only visible light.

[0083] At this time, the lengths of the first time (t1), the second time (t2), and the third time (t3) can be set equally (t1=t2=t3).

[0084] However, depending on the information generated by the image processing unit (50), the lengths of the first time (t1), the second time (t2), and the third time (t3) can be set differently from each other.

[0085] Additionally, depending on the information generated by the image processing unit (50), only one of the lengths of the first time (t1), the second time (t2), and the third time (t3) may be set differently.

[0086] For example, if the depth resolution of the depth information generated by the image processing unit (50) is below a set level, the first time (t1) can be set longer than the second time (t2) and the third time (t3). That is, the infrared structured light pattern of the first light-emitting unit (10) can be projected longer than the second time (t2) and the third time (t3).

[0087] Additionally, the control unit (40) can set the second time (t2) longer than the first time (t1) and the third time (t3) or set the third time (t3) longer than the first time (t1) and the second time (t2) according to the information generated by the image processing unit (50).

[0088] Accordingly, the lengths of the first time (t1), second time (t2), and third time (t3) can be set differently depending on the depth information, IR image information, and visible light image information generated by the image processing unit (50).

[0089] The control unit (40) can control the light sources of the first light-emitting unit (10) and the second light-emitting unit (20) so that they are not projected simultaneously but are projected at different times.

[0090] The control unit (40) can be set so that the first time (t1), the second time (t2), and the third time (t3) do not overlap each other.

[0091] That is, the first time (t1), second time (t2), and third time (t3) can be separated in time so that the infrared structured light pattern signal, infrared light signal, and visible light signal reflected from the object (70) do not interfere with each other.

[0092] The control unit (40) can control the cycles of the first time (t1), the second time (t2), and the third time (t3).

[0093] For example, if the depth resolution of the depth information generated by the image processing unit (50) is below a set level, the control unit (40) can control the first light-emitting unit (10) to project an infrared structured light pattern at a shorter period.

[0094]

[0095] The image processing unit (50) can extract depth information, extract IR images, and extract visible light images using the light signal received from the light receiving unit (30).

[0096] The image processing unit (50) can extract depth information when the light signal received by the light receiving unit (30) is an infrared structured light pattern, and can extract IR image information when the light signal received by the light receiving unit (30) is infrared light.

[0097] Additionally, the image processing unit (50) can extract visible light image information when the light signal received by the light receiving unit (30) is visible light.

[0098] FIG. 5 illustrates an example of an image extracted by an image processing unit (50). The image processing unit (50) can generate a visible light image (A) using visible light image information, generate an IR image (B) using infrared light information, and generate a depth information image (C) using infrared structured light pattern information. Although an image is presented as an example in FIG. 5, the image processing unit (50) can extract not only images but also images.

[0099] For example, the image processing unit (50) can extract depth information during the fourth time (t4). The image processing unit (50) can extract IR image information during the fifth time (t5). The image processing unit (50) can extract visible light image information during the sixth time (t6).

[0100] At this time, the lengths of the fourth hour (t4), the fifth hour (t5), and the sixth hour (t6) may vary depending on the lengths of the first hour (t1), the second hour (t2), and the third hour (t3). Additionally, the periods of the fourth hour (t4), the fifth hour (t5), and the sixth hour (t6) may vary depending on the periods of the first hour (t1), the second hour (t2), and the third hour (t3).

[0101] The image processing unit (50) can generate three-dimensional image information of an object using depth information, IR information, and visible light information.

[0102] In the first embodiment, the image processing unit (50) is exemplified as being placed inside the camera device (100), but the image processing unit (50) may be placed inside or outside the camera device (100).

[0103] Additionally, the image processing unit (50) may be positioned both inside and outside the camera device (100). The image processing unit (50) may be positioned in the camera device (100), and the image processing unit (50) may also be positioned in the display unit (60).

[0104] Additionally, the image processing unit (50) may be positioned both inside and outside the camera device (100). The image processing unit (50) may be positioned in the camera device (100), and the image processing unit (50) may also be positioned in the display unit (60).

[0105] Additionally, the image processing unit (50) can receive light from the second light-emitting unit (20), which has a wider field of view, and output the received light signal based on an indexing pattern so that the light from the first light-emitting unit (10) and the second light-emitting unit (20), which have different fields of view, can be received at a single light-receiving unit (30).

[0106] While the field of view of the first light-emitting unit (10) is 40 to 60 degrees, the field of view of the second light-emitting unit (20) can be 120 to 160 degrees. Therefore, when receiving the signal from the second light-emitting unit (20) at a single light-receiving unit (30), stronger distortion may occur in the received light signal than when receiving the signal from the first light-emitting unit (10).

[0107] In order for the light signal received from the second light-emitting unit (20) and the light signal received from the first light-emitting unit (10) to be mapped at the light-receiving unit (30), a stronger distortion correction algorithm can be applied to the light signal received from the second light-emitting unit (20) than to the light signal received from the first light-emitting unit (10).

[0108] Additionally, the image processing unit (50) may perform a first distortion correction on the optical signal received from the first light-emitting unit (10) based on the camera lens information of the light-receiving unit (30), and then perform a second distortion correction algorithm for depth information.

[0109]

[0110] The display unit (60) receives three-dimensional image information generated by the image processing unit (50) and can provide it visually.

[0111] The display unit (60) can be electrically connected to the image processing unit (50), and can be connected via a wired or wireless connection. For example, the image processing unit (50) and the display unit (60) can be connected via a cable in a physical form, and can also be connected using a wireless network.

[0112] When the image processing unit (50) and the display unit (60) are connected via a wireless network, a communication module may be additionally placed in the display unit (60).

[0113] As illustrated in FIGS. 3 and FIGS. 6, a camera device (100) is positioned inside a vehicle, and an image or video generated by the camera device (100) can be provided on a display unit (60).

[0114] For example, the camera device (100) is an in-cabin camera and can be mounted inside a vehicle and positioned at a location such as the rearview mirror or the top of the passenger seat.

[0115] Using the three-dimensional image information generated by the image processing unit (50), an image can be provided to the display unit (60).

[0116] By providing an image from the image processing unit (50) to the display unit (60), the status of personnel inside the vehicle can be monitored in real time, such as ID authentication (61), driver monitoring (62), and occupant monitoring (63).

[0117] For example, ID authentication (61) can be performed using depth information using an infrared structured light pattern. Driver monitoring (62) can be performed using IR information using infrared light. Occupant monitoring (63) can be performed using visible light information.

[0118] In the first embodiment, the camera device (100) was placed and used in an in-cabin camera inside a vehicle, but it can be used not only in vehicles but also for gesture recognition in eXtended Reality (XR) or object recognition functions in robots.

[0119] In the first embodiment, the display unit (60) is configured as a separate module, but it may also be formed as a single module with the camera device (100).

[0120]

[0121] In this first embodiment, depth information, IR image information, and visible light image information can be obtained with a single camera by using a light receiving unit (30) to which an RGB-IR sensor (300) is applied.

[0122] By using such depth information, IR image information, and visible light image information, three-dimensional image information of the object can be generated.

[0123] In addition, depth information, IR image information, and visible light image information can be acquired with a single camera, so the size of the camera device (100) can be miniaturized.

[0124] In addition, by installing a camera device equipped with a single camera in the vehicle, the status of personnel inside the vehicle can be monitored in real time, including ID authentication, driver monitoring, and occupant monitoring.

[0125]

[0126] FIG. 7 is a perspective view illustrating a camera device according to a second embodiment of the present invention, and FIG. 8 is a perspective view illustrating the internal structure of a camera device according to a second embodiment.

[0127] As illustrated in FIGS. 7 and 8, the camera device (100) may include a first light-emitting unit (10), a second light-emitting unit (20), and a light-receiving unit (30).

[0128] The camera device according to the second embodiment has a difference in that the positions of the first light-emitting part (10), the second light-emitting part (20), and the light-receiving part (30) are arranged differently compared to the first embodiment, but other configurations may be the same.

[0129] In the second embodiment, the control unit (40), image processing unit (50), display unit (60), etc. are not presented, but the same configuration as in the first embodiment may be applied. Accordingly, the same reference numerals are used to describe the configuration identical to that in the first embodiment, and the description of the identical configuration is omitted.

[0130]

[0131] The first light-emitting part (10) may include a first light source (11) formed on the first substrate (12). The first light source (11) may be an infrared structured light pattern.

[0132] The first light-emitting unit (10) can be electrically connected to the second substrate (14) and the flexible printed circuit board (FPCB) (13). A control unit (40) and an image processing unit (50) can be formed on the second substrate (14).

[0133] The second light-emitting part (20) may include a second light source (22) formed on the third substrate (21). The second light source (22) may be infrared light.

[0134] The first substrate (12), the second substrate (14), and the third substrate (21) can be rigid printed circuit boards (Rigid-PCB).

[0135] The light receiving unit (30) can be positioned between the first light emitting unit (10) and the second light emitting unit (20). By positioning the light receiving unit (30) between the first light emitting unit (10) and the second light emitting unit (20), the infrared structured light pattern of the first light emitting unit (10) and the infrared light of the second light emitting unit (20) can be separated.

[0136] Both the first light-emitting unit (10) and the second light-emitting unit (20) use an infrared light source, and the first light-emitting unit (10) and the second light-emitting unit (20) are separated by a light-receiving unit (30), so that the area of ​​the projected infrared light source can be increased.

[0137] By increasing the area of ​​the projected infrared light source, the eye-safety issue associated with the past use of infrared lighting can be improved.

[0138] In order to adjust the distance between the first light-emitting part (10) and the light-receiving part (20) according to the use of the camera device (100), the first light-emitting part (10) and the light-receiving part (30) can each be formed on different substrates.

[0139] For example, if the camera device (100) is used for an in-cabin camera inside a vehicle, the module can be completed after adjusting the distance between the first light-emitting part (10) and the light-receiving part (20) to a value set accordingly.

[0140] Additionally, if the camera device (100) is used for a robot, the module can be completed after adjusting the distance between the first light-emitting part (10) and the light-receiving part (20) to a value set accordingly.

[0141] Accordingly, to facilitate the movement of the first light-emitting part (10), the first substrate (12) and the second substrate (14) can be connected to a flexible circuit board (13).

[0142] The first light-emitting part (10), the light-receiving part (30), and the second light-emitting part (20) are arranged sequentially in the first direction, and the first substrate (12) on which the first light source (11) is arranged can be moved and arranged in the first direction on the second substrate (14).

[0143] In addition, the position of the first substrate (12) on which the first light source (11) is placed can be adjusted on the second substrate (14) to perform active alignment (AA) between the light receiving part (30) and the first light emitting part (10).

[0144] By performing active alignment of the light receiving unit (30) and the first light emitting unit (10), distortion caused by rotation or tilt of the optical system can be improved, and accordingly, the performance of the optical system can be improved.

[0145] Depending on the application of the camera device (100), the distance between the light receiving part (30) and the first light emitting part (10) can be set and the position of the first light emitting part (10) can be adjusted to consider the distance and accuracy with respect to the object.

[0146]

[0147] The camera device according to the present embodiment can acquire depth information, IR image information, and visible light image information with a single camera by using a light receiving unit to which an RGB-IR sensor is applied.

[0148] By using such depth information, IR image information, and visible light image information, three-dimensional image information of the object can be generated.

[0149] In addition, depth information, IR image information, and visible light image information can be acquired with a single camera, allowing the size of the camera device to be miniaturized.

[0150]

[0151]

[0152] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without changing its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive.

Claims

1. A first light-emitting unit that irradiates an infrared structured light pattern onto an object; A second light-emitting unit that irradiates infrared light onto the object; A light receiving unit comprising an RGB-IR sensor that detects an infrared structured light pattern, infrared light, and visible light reflected from the above-mentioned object; An image processing unit that acquires depth information, IR image information, and visible light information of an object using the infrared structured light pattern, the infrared light, and the visible light received by the light receiving unit; and A camera device comprising a control unit that controls the period for irradiating the infrared structured light pattern of the first light-emitting unit and the period for irradiating the infrared light of the second light-emitting unit.

2. In Paragraph 1, A camera device in which the infrared structured light pattern of the first light-emitting unit and the infrared light of the second light-emitting unit are irradiated at different times.

3. In Paragraph 1, During the first time (t1), the first light-emitting unit irradiates the infrared structured light pattern onto the object, and A camera device in which the second light-emitting part irradiates the infrared light onto the object during the second time (t2).

4. In Paragraph 3, During the third time (t3), the first light-emitting part and the second light-emitting part do not irradiate light, A camera device in which the light receiving part detects the visible light during the third time (t3) above.

5. In Paragraph 4, In order for the infrared structured light pattern reflected from the object, the infrared light, and the visible light signals not to interfere with each other, The above control unit is a camera device that sets the first time (t1), the second time (t2), and the third time (t3) so that they do not overlap.

6. In Paragraph 4, The periods of the first time (t1), the second time (t2), and the third time (t3) are the same camera device.

7. In Paragraph 4, A camera device in which at least one of the first time (t1), the second time (t2), and the third time (t3) has a different period.

8. In Paragraph 1, The second light-emitting part is a camera device positioned between the light-receiving part and the first light-emitting part.

9. In Paragraph 1, The light receiving part is a camera device positioned between the first light emitting part and the second light emitting part.

10. In Paragraph 1, The above RGB-IR sensor is It includes R, G, B, and IR pixels, A camera device comprising a structure in which a first unit pixel and a second unit pixel are repeatedly arranged in an alternating manner.

Images