Image processing module and camera module including same

Abstract

An image processing module according to an embodiment comprises: a position sensor for sensing the position of a camera module to generate position information; an image sensor for generating an image frame; and an image processor for correcting the image frame by using the position information, wherein the image processor synchronizes the position information and the image frame.

Description

Image processing module and camera module including the same

[0001] The present embodiment relates to an image processing module and a camera module including the same.

[0002] Recently, ultra-small camera modules are being developed and are widely used in small electronic products such as smartphones, laptops, and game consoles.

[0003] With the popularization of automobiles, micro cameras are widely used not only in small electronic devices but also in vehicles. For example, they are equipped with dashcam cameras for vehicle protection or objective data regarding traffic accidents, rear-view cameras that allow the driver to monitor blind spots behind the vehicle via a screen to ensure safety when reversing, and surrounding detection cameras that monitor the vehicle's vicinity.

[0004] The present embodiment aims to provide an image processing module that compensates for image shaking caused by vibration, and a camera module including the same.

[0005] An image processing module according to the present embodiment includes a position sensor that detects the position of a camera module and generates position information; an image sensor that generates an image frame; and an image processor that corrects the image frame through the position information, and the image processor synchronizes the position information with the image frame.

[0006] The above position sensor includes a gyroscope sensor that detects the attitude of the camera module, and the position information may include attitude information of the camera module.

[0007] The above image processor can generate shift information by calculating the accumulated position information between the start time of shooting and the time of image correction.

[0008] The image processor above can warp the image frame using the shift information.

[0009] The image processor above can crop and correct the image frame using the shift information.

[0010] A camera module according to the present embodiment comprises: a first body; a lens holder coupled to the first body; a second body coupled to the first body; a substrate assembly disposed within the second body; the substrate assembly comprises a plurality of substrates spaced apart from each other; a plurality of position sensors for detecting position information of the camera module on each of the plurality of substrates; an image sensor disposed on any one of the plurality of substrates for generating an image frame; and an image processor for correcting the image frame through the position information, wherein the image processor synchronizes the position information with the image frame.

[0011] The above position sensor includes a gyroscope sensor that detects the attitude of the camera module, and the position information may include attitude information of the camera module.

[0012] The image processor calculates the accumulated position information between the start of shooting and the image correction time to generate shift information, and the image processor can warp the image frame using the shift information.

[0013] The image processor calculates the accumulated position information between the shooting start time and the image correction time to generate shift information, and the image processor can crop the image frame using the shift information.

[0014] Through this embodiment, camera screen shaking caused by vehicle vibration can be compensated for through EIS.

[0015] In addition, image correction is possible without an actuator through electrical correction rather than mechanical correction.

[0016] In addition, by connecting spaced-apart boards with floating connectors, the signal transmission speed can be improved and the connection between boards can be facilitated.

[0017] FIG. 1 is a perspective view of a camera module according to the present embodiment.

[0018] FIG. 2 is an exploded perspective view of a camera module according to the present embodiment, viewed from the top.

[0019] FIG. 3 is a side view of a camera module according to the present embodiment.

[0020] Figure 4 is a cross-sectional view of AA in Figure 4.

[0021] Figure 5 illustrates a modified example of Figure 4.

[0022] FIG. 6 is a drawing for explaining an image processing module according to the present embodiment.

[0023] FIG. 7 is a diagram illustrating an image processing module according to the present embodiment.

[0024] FIG. 8 is a drawing for explaining an image processing module according to another embodiment of the present invention.

[0025] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0026] However, the technical concept of the present invention is not limited to some of the described embodiments but can be implemented in various different forms, and within the scope of the technical concept of the present invention, one or more of the components among the embodiments may be selectively combined or substituted.

[0027] In addition, terms used in the embodiments of the present invention (including technical and scientific terms) may be interpreted in a sense that is generally understood by those skilled in the art to which the present invention belongs, unless explicitly and specifically defined otherwise. Terms that are commonly used, such as terms defined in advance, may be interpreted in consideration of their meaning in the context of the relevant technology.

[0028] Furthermore, the terms used in the embodiments of the present invention are for the purpose of describing the embodiments and are not intended to limit the present invention.

[0029] In this specification, the singular form may include the plural form unless specifically stated otherwise in the text, and when described as "at least one of A and B and C (or more than one)," it may include one or more of all combinations that can be formed from A, B, and C.

[0030] In addition, terms such as first, second, A, B, (a), (b), etc., may be used when describing the components of the embodiments of the present invention. These terms are used merely to distinguish the components from other components and are not intended to limit the essence, order, or sequence of the components.

[0031] And, where it is stated that a component is 'connected', 'combined', or 'connected' to another component, this may include not only cases where the component is directly 'connected', 'combined', or 'connected' to the other component, but also cases where it is 'connected', 'combined', or 'connected' due to another component located between the component and the other component.

[0032] Furthermore, when described as being formed or placed "above" or "below" each component, "above" or "below" includes not only cases where two components are in direct contact with each other, but also cases where one or more other components are formed or placed between the two components. Additionally, when expressed as "above" or "below," it may include the meaning of a downward direction as well as an upward direction relative to a single component.

[0033]

[0034] FIG. 1 is a perspective view of a camera module according to the present embodiment, FIG. 2 is an exploded perspective view of the camera module according to the present embodiment viewed from the top direction, FIG. 3 is a side view of the camera module according to the present embodiment, FIG. 4 is a cross-sectional view AA of FIG. 4, FIG. 5 illustrates a modified example of FIG. 4, FIG. 6 is a drawing for explaining an image processing module according to the present embodiment, FIG. 7 is a drawing for explaining an image processing module according to the present embodiment, and FIG. 8 is a drawing for explaining an image processing module according to another embodiment of the present invention.

[0035] A camera module (10) according to one embodiment of the present invention may be a vehicle camera module. The camera module (10) may be coupled to a vehicle. The camera module (10) may be used in one or more of a front camera, a side camera, a rear camera, and a black box of a vehicle. The camera module (10) may be positioned at the front of the vehicle. The camera module (10) may be positioned at the rear of the vehicle. The camera module (10) may be coupled to the windshield of the vehicle. The camera module (10) may be coupled to the windshield at the front or rear of the vehicle. The camera module (10) may be positioned on the side of the vehicle. The camera module (10) may capture a subject and output it as an image to a display (not shown).

[0036] The camera module (10) may include a lens holder (100). The lens holder (100) may be formed of a metal material. The lens holder (100) may be formed of an aluminum material. The lens holder (100) may be placed in a first body (200). The lens holder (100) may be coupled to the first body (200). At least a portion of the lens holder (100) may be placed within the first body (200). The lens holder (100) may include a lens. The lens may include a plurality of lenses. The lens may be coupled to the lens holder (100). The lens may be placed within the lens holder (100). The lens may be aligned with the image sensor (11). The lens may be aligned with the optical axis of the image sensor (11). The optical axis of the lens may coincide with the center axis of the image sensor (11). The first body (200) may include an infrared ray filter (IR filter) disposed between the lens module and the image sensor (11). The lens holder (100) may include a first outer surface and a second outer surface disposed outside the first outer surface. The outer surface of the lens holder (110) may be formed without screw threads. The outer surface of the lens holder (110) may not include screw threads. The first outer surface and the second outer surface of the lens holder (110) may be formed without screw threads.

[0037] The lens holder (100) may include a first coupling portion (110). The first coupling portion (110) may protrude outward from the outer surface of the lens holder (100). The first coupling portion (110) may protrude outward from at least a portion of the outer surface of the lens holder (100). The first coupling portion (110) may be coupled to the first body (200). The first coupling portion (110) may be coupled to the second coupling portion (210) of the first body (200). The first coupling portion (110) may be screw-coupled to the second coupling portion (210) of the first body (200). The first coupling portion (110) may accommodate at least a portion of the first body (200) inside. The first coupling portion (110) may not overlap with the image sensor (11) in the direction of the optical axis. The first coupling part (110) may be positioned outside the image sensor (11). This prevents foreign matter from falling onto the surface of the image sensor (11) due to splitting during the screw threading between the first coupling part (110) and the second coupling part (210).

[0038] The first coupling part (110) may include a screw thread (114). The screw thread (114) may be formed on the first coupling part (110). The screw thread (114) may be formed in the groove (113) of the first coupling part (110). The screw thread (114) may face the outer surface of the lens holder (100). The screw thread (114) may be formed in a shape corresponding to the screw thread of the second coupling part (210) of the first body (200). The screw thread (114) may be screw-coupled with the screw thread of the second coupling part (210) of the first body (200).

[0039] The camera module (10) may include a first body (200). The first body (100) may be referred to as a first housing or a front body. The first body (200) may be formed in a rectangular shape with an open bottom. The first body (200) may be formed of a metal material. The first body (200) may be formed of an aluminum material. The first body (200) may be a metal body. The first body (200) and the second body (300) may form the exterior of the camera module (10). The first body (200) may be combined with the second body (300) to form an internal space. The first body (200) may be combined with the second body (300). The first body (200) may be screw-coupled with the second body (300).

[0040] The first body (200) may include a second coupling part (210). The second coupling part (210) may protrude upward from the upper surface of the first body (200). The second coupling part (210) may be coupled to the lens holder (100). The second coupling part (210) may be coupled to the first coupling part (110) of the lens holder (100). The second coupling part (210) may be inserted into the groove (113) of the first coupling part (110) of the lens holder (100). The second coupling part (210) may be placed in the groove (113) of the first coupling part (110) of the lens holder (100). The length of the second coupling part (210) in the direction of the optical axis may be longer than the length in the corresponding direction of the second part (112) of the first coupling part (110) of the lens holder (100). The inner surface of the second coupling part (210) may come into contact with the first outer surface of the lens holder (100). The inner surface of the second coupling part (210) may be formed without screw threads. The inner surface of the second coupling part (210) may include screwless threads.

[0041] The second coupling portion (210) may include a screw thread (211). The screw thread (211) may be formed on the outer surface of the second coupling portion (210). The screw thread (211) may be opposite to the screw thread (114) of the first coupling portion (110) of the lens holder (100). The screw thread (211) may engage with the screw thread (114) of the first coupling portion (110) of the lens holder (100). The screw thread (211) may be formed in a shape corresponding to the screw thread (114) of the first coupling portion (110) of the lens holder (100). The screw thread (211) may be screw-coupled with the screw thread (114) of the first coupling portion (110) of the lens holder (100).

[0042] The camera module (10) may include a second body (300). The second body (300) may be named a rear body, a lower housing, or a second housing. The second body (300) may be formed of a metal material. The second body (300) may be a metal body. The second body (300) may be formed in a square shape with an open top. The second body (300) may be placed below the first body (200). The second body (300) may be coupled to the first body (200). The second body (300) may be coupled to the first body (200) by screws. The second body (300) may also be coupled to the first body (200) by welding without screws. The second body (300) can form an internal space through combination with the first body (200). A first sealing member (710) can be disposed on the upper part of the second body (300).

[0043] The second body (300) may include a bottom plate (310) and a side plate (320) extending from the bottom plate (310). The side plate (320) may extend upward from the edge of the bottom plate (310). The second body (300) may include a plurality of side plates (320) and corners formed between the plurality of side plates (320). The second body (300) may include four side plates (320) and four corners positioned between the four side plates (320).

[0044] The second body (300) may include a connector outlet (330). The connector outlet (330) may be formed in a cylindrical shape. The connector outlet (330) may be coupled to the second body (300). The connector outlet (330) may penetrate the bottom plate (310) of the second body (300). At least a portion of the connector outlet (330) may be disposed within the second body (300), and the remainder of the connector outlet (330) may be exposed outside the second body (300).

[0045] The connector outlet (330) can be coupled to the bottom plate (310) of the second body (300). A connector (540) can be disposed inside the connector outlet (330). A second connector (542) can be disposed inside the connector outlet (330). The connector outlet (330) may include a hole. A connector (540) can be disposed in the hole. The hole of the connector outlet (330) can accommodate at least a portion of the connector (540). Through this, the connector outlet (330) can secure the connector (540).

[0046] The camera module (10) may include a fixing member (400). The fixing member (400) may be epoxy. The first coupling part (110) of the lens holder (100) and the second coupling part (210) of the first body (200) may be screw-coupled with the first coupling part (110) while the fixing member (400) is injected into the groove (230) of the first body (200).

[0047] The fixing member (400) may include a body (410). The body (410) may be disposed in the first body (200). The body (410) may be disposed in a groove of the first body (200). By screw coupling between the lens holder (100) and the first body (200), at least a portion of the body (410) of the fixing member (400) may extend between the thread (114) of the first coupling part (110) and the thread (211) of the second coupling part (210).

[0048] The fixed member (400) may include an extension portion (420). The extension portion (420) may extend upward from the body (410). The extension portion (420) may extend upward from at least a part of the body (410). The extension portion (420) may extend from the body (410) between the thread (114) of the first coupling portion (110) and the thread (211) of the second coupling portion (210). The extension portion (420) may be a part formed by moving upward according to the screw coupling of the lens holder (100) and the first body (200). The extension portion (420) may be a part formed by moving upward according to the screw coupling of the first coupling portion (110) of the lens holder (100) and the second coupling portion (210) of the first body (200).

[0049] The extension part (420) may be disposed on the inner surface of the first coupling part (110). The extension part (420) may be disposed on at least a portion of the inner surface of the first coupling part (110). The extension part (420) may be disposed on the screw thread (114) of the first coupling part (110). The extension part (420) may be disposed on the outer surface of the second coupling part (210). The extension part (420) may be disposed on at least a portion of the outer surface of the second coupling part (210). The extension part (420) may be disposed on the screw thread (211) of the second coupling part (210). The length of the extension part (420) in the optical axis direction may be smaller than the length of the first coupling part (110) in the optical axis direction. The length of the extension part (420) in the optical axis direction may be smaller than the length of the second coupling part (210) in the optical axis direction. However, it is not limited to this, and the length of the extension part (420) in the optical axis direction may be changed depending on the amount of fixing member (400) applied to the groove (230) of the first body (200).

[0050] The extension part (420) is positioned in the gap between the thread (114) of the first coupling part (110) and the thread (211) of the second coupling part (210) to firmly secure the lens holder (100). This prevents the lens holder (100) from being detached from the first body (200) due to impacts such as vibration or shaking of the vehicle. That is, the fixing member (400) may be epoxy for fixing lenses. Additionally, the extension part (420) is positioned in the gap between the thread (114) of the first coupling part (110) and the thread (211) of the second coupling part (210) to prevent moisture from penetrating the coupling surface between the lens holder (100) and the first body (200). That is, the fixing member (400) can perform a waterproofing function.

[0051]

[0052] The camera module (10) may include a substrate assembly (500).

[0053] The camera module (10) may include a substrate assembly (500). The substrate assembly (500) may be disposed within the second body (300). The substrate assembly (500) may be disposed in an internal space formed by the combination of the first body (200) and the second body (300).

[0054] The substrate assembly (500) may include a first substrate (510). The first substrate (510) may include a printed circuit board. The first substrate (510) may include a rigid printed circuit board. An image sensor (11) may be disposed on the first substrate (510). In this case, the first substrate (510) may be named a sensor substrate. The first substrate (510) may include a first surface facing the first body (200) and a second surface disposed on the opposite side of the first surface. The outer edge region of the first surface of the first substrate (510) may be coupled to the first body (200).

[0055] The substrate assembly (500) may include a second substrate (520). The second substrate (520) may include a printed circuit board. The second substrate (520) may include a rigid printed circuit board. The second substrate (520) may be placed below the first substrate (510). The second substrate (520) may be spaced apart from the first substrate (510). The second substrate (520) may be spaced apart from the first substrate (510) in the direction of the optical axis. The second substrate (520) may supply power to the first substrate (510). The second substrate (520) may be arranged parallel to the first substrate (510) in a direction perpendicular to the optical axis. The second substrate (520) may be electrically connected to a connector (540). The second substrate (520) may include a first surface facing the first substrate (510) and a second surface positioned opposite the first surface. A connector (540) may be positioned on the second surface of the second substrate (520). A first connector (541) may be positioned on the second surface of the second substrate (520). The second substrate (520) may be electrically connected to the first connector (541).

[0056] The substrate assembly (500) may include a third substrate. The third substrate may include a flexible printed circuit board (FPCB). The third substrate may electrically connect the first substrate (510) and the second substrate (520). One end of the third substrate may be connected to the first substrate (510), and the other end of the third substrate may be connected to the second substrate (520). The third substrate may have elasticity. According to another embodiment described below, the first substrate (510) and the second substrate (520) may be connected by a floating connector.

[0057] The substrate assembly (300) may include a connector (540). The connector (540) may electrically connect a cable (not shown) and a second substrate (520). The connector (540) may include a first connector (541) that is electrically connected to the second substrate (520), and a second connector (542) that extends from the first connector (541) and electrically connects the first connector (541) and the cable. The first connector (541) may be placed on a second surface of the second substrate (520). The first connector (541) may be fixed to a second surface of the second substrate (520). The first connector (541) may be electrically connected to the second substrate (520). The second connector (542) may be electrically connected to the first connector (541). The second connector (542) can be electrically connected to a cable. The second connector (542) can be placed within the connector outlet (330) of the second body (200). At least a portion of the second connector (542) can be placed within the connector outlet (330) of the second body (200), and the remainder of the second connector (542) can be placed within the second body (200).

[0058] The substrate assembly (500) may include a ground member (543). The ground member (543) may include a washer. The ground member (543) may be formed integrally with the connector (540). The ground member (543) may be coupled to the first connector (541). The ground member (543) may have a second connector (542) disposed inside it. One end of the ground member (543) may be coupled to the first connector (541), and the other end of the ground member (543) may not come into contact with the first and second connectors (542).

[0059] The camera module (10) may include a shield member (600). The shield member (600) may be referred to as a spacer, a shield can, or a support member. The shield member (600) may be an electromagnetic shielding member. The shield member (600) may block electromagnetic interference (EMI) or electromagnetic waves.

[0060] The shield member (600) may be placed below the first substrate (510). The shield member (600) may be placed on the second substrate (520). The shield member (600) may be placed between the first substrate (510) and the second substrate (520). The shield member (600) may separate the first substrate (510) and the second substrate (520) in the direction of the optical axis.

[0061] The camera module (10) may include a first sealing member (710). The first sealing member (710) may be referred to as either a gasket or a waterproof member. The first sealing member (710) may be formed of an elastic material. The first sealing member (710) may be formed in a shape corresponding to the shape of the outer edge of the first substrate (510). The hole of the first sealing member (710) may be formed larger than the outer edge of the first substrate (510). The first sealing member (710) may be placed on the outer side of the outer edge of the first substrate (510). The first sealing member (710) may be placed on the first body (200). The first sealing member (710) may be placed between the first body (200) and the second body (300). The first sealing member (710) can be placed in the space between the first body (200) and the second body (300). The height of the first sealing member (710) in the optical axis direction can be reduced after assembly compared to before assembly. That is, the first sealing member (710) can be placed between the first body (200) and the second body (200) and then, when the first body (200) and the second body (200) are combined, it can be placed between the first body (200) and the second body (300) in a compressed state in the optical axis direction to perform a waterproofing function. Through this, moisture can be prevented from penetrating through the space between the first body (200) and the second body (300).

[0062] The camera module (10) may include a second sealing member (720). The second sealing member (720) may be a waterproof member. The second sealing member (720) may be formed of an elastic material. It can prevent moisture from penetrating between the second body (300) and the connector (540). The second sealing member (720) may be spaced apart from the grounding member (543) in the direction of the optical axis. The second sealing member (720) may be positioned lower than the second substrate (520). The second sealing member (720) may be positioned on the second connector (542). The second sealing member (720) may be positioned within the second body (300). The second sealing member (720) may be positioned within the connector outlet (330) of the second body (300). Through this, moisture can be prevented from penetrating between the second body (300) and the connector (540).

[0063] The camera module (10) may include a coupling member (800). The coupling member (800) may combine the first body (200) and the second body (300). The coupling member (800) may screw-couple the first body (200) and the second body (300). The coupling member (800) may include a screw. The coupling member (800) may include a screw. The outer surface of the coupling member (800) may have screw threads formed thereon. Through this, the coupling member (800) may combine the first body (200) and the second body (300).

[0064]

[0065] The image processing module according to the present embodiment includes a position sensor (12), an image sensor (11), and an image processor (13).

[0066] The position sensor (12) can detect the position of the camera module (10) and generate position information. The position sensor (12) may be a gyro sensor that detects the attitude of the camera module (10). The gyro sensor can detect the attitude of the camera module (10) by detecting the direction of gravity. The position information may include the attitude information of the camera module (10). The position sensor (12) may be an IMU (Inertial Measurement Unit) that combines an accelerometer and a gyroscope to measure the position, velocity, and direction of an object. The position information may include information about the position, velocity, and direction of the camera module (10).

[0067] The position sensor (12) may include a plurality of position sensors that detect position information of the camera module on each of the plurality of substrates. For example, the plurality of position sensors may be respectively placed on a first substrate (510) on which an image sensor (11) is placed and on a second substrate (520) which is spaced apart from the first substrate (510) in the direction of the optical axis. The plurality of position sensors may include a first position sensor (12a) placed on the first substrate (510) and a second position sensor (12b) placed on the second substrate (520). The type of position sensor placed on the first substrate (510) and the type of position sensor placed on the second substrate (520) may be the same. The type of position sensor placed on the first substrate (510) and the type of position sensor placed on the second substrate (520) may be different. For example, the position sensor placed on the first substrate (510) may be a gyroscope sensor, and the position sensor placed on the second substrate (520) may be an IMU.

[0068] Multiple spaced-apart substrates of the substrate assembly (500) can each be connected by a floating connector (515). The floating connector (515) is used to eliminate misalignment when mounting interfaces on the substrates in the x and y directions. Through the floating connector (515), connection between multiple substrates can be facilitated. Through the floating connector (515), the speed of signal movement between components mounted on each of the multiple substrates can be improved.

[0069] The floating connector (515) can electrically connect the first substrate (510) and the second substrate (520). The floating connector (515) can connect electrical signals of a component placed on the first substrate (510) and a component placed on the second substrate (520). The floating connector (515) may include a first member (516) placed on the first substrate (510), a second member (517) placed on the second substrate (520), and a connecting member (not shown) connecting the first member (516) and the second member (517). The connecting member may be an elastic member. The first member (516) and the second member (517) may be arranged to overlap in the direction of the optical axis.

[0070] The image sensor (11) can generate an image frame or image information. The image sensor (11) can generate an image frame by converting light received from the lens of the camera module (10) into an electrical signal. The image sensor (11) can detect light that has passed sequentially through the lens included in the lens holder (100). The image sensor (11) may include a device capable of detecting incident light, such as a Charge Coupled Device (CCD) or a Complementary Metal Oxide Semiconductor (CMOS).

[0071] The image processor (13) can perform image processing on an image frame obtained through the image sensor (11). For example, image processing may include image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softing), depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, etc.

[0072] The image processor (13) can perform Electronic Image Stabilization (EIS). EIS is a technology that electronically corrects image shake and is mainly used to reduce shake that may occur during video recording or photography. EIS can process images using software algorithms.

[0073] Referring to Fig. 6, the EIS uses an accurate position sensor or motion sensor to track the cause of jitter, such as hand shaking or vehicle movement. Motion information detected by the sensor is integrated while the current video frame is output and is used to compensate for this by cropping the image visible in the video frame stream through the imaging pipeline.

[0074] While the image captured by the image sensor is being processed, the image is stabilized. The image processor tracks the data from the image sensor in real time. The data from the image sensor detects and analyzes changes in the recorded image through various algorithms (area A in Fig. 6). When the algorithm identifies image shake, a transformation (typically image translation) is initiated to compensate for the shake.

[0075] To effectively compensate for shake and move the image within specific limits using EIS, you must create an additional area at the edges using one of two methods. While the following describes two image correction methods using EIS, it is obvious that there are various other correction methods available and are not limited to these.

[0076] The first method involves digitally magnifying the central portion of the image. The scene recorded in a single image frame is part of the entire image, and its position within the image can be changed as needed. Differences between image frames are analyzed, and the image is generally divided into zones. If shake is observed in a specific area, it is interpreted as movement of the captured subject. If the movement occupies a significant portion of the image, it is identified as background movement. Consequently, the algorithm interprets the movement as shake and corrects it as necessary. Using EIS may slightly reduce the observable camera field of view after it is activated.

[0077] The second method is a hardware-based shake correction method. There is an area at the edges of the image sensor that is not used for image recording during normal operation. When shake is detected, the center coordinates of the image capture area shift accordingly.

[0078]

[0079] The image processor (13) can synchronize location information and image frames. The image processor (13) can receive location information from the location sensor (12) and receive image frames from the image sensor (11). The image processor (13) can synchronize location information and image frames based on the Fsync trigger information of the location information and the Frame Counter of the image frames. The Fsync trigger may refer to a method that forces data to be written to memory or disk at a specific point in time to prevent data loss in the event of a system failure or power loss. The Frame Counter may refer to a device or function that counts the number of frames processed during a specific period of time.

[0080] The image processor (13) can generate shift information by calculating accumulated position information between the start time of shooting and the time of image correction. The shift information may refer to shaking information caused by movement of the background within the image frame due to vehicle vibration. The shift information may exclude cases caused by movement of an object within the image frame.

[0081] The image processor (13) can warp an image frame using shift information. Warping can refer to the process of creating a new image by deforming the shape of an image. For example, warping is a process of non-linearly deforming a specific part of an image to create a new shape, and may include distortion, rotation, enlargement, and reduction of an object. Additionally, warping may include the process of mapping each pixel of an image to a new position in the image, and an interpolation technique may be used to calculate new pixel values ​​during the image warping process.

[0082] The image processor (13) can crop and correct the image frame using shift information. Cropping may refer to the process of selecting and cutting out a specific part of the image. The cropping process may be used to remove unnecessary parts from the image frame or to focus on a specific object or scene.

[0083]

[0084] FIG. 7 is a diagram illustrating the performance of EIS within a camera module (10). A Micro Processor Unit (MPU, 13) within the camera module (10) can receive position information from an IMU (12) via Serial Peripheral Interface (SPI) communication. SPI is a serial communication protocol for data communication between the MPU (13) and peripheral devices. The MPU (13) can receive image frames from an image sensor (11) via Mobile Industry Processor Interface (MIPI) communication. MIPI is a standard interface for data communication between mobile devices and other electronic devices. MIPI is widely used, particularly in smartphones, tablets, camera modules, etc., and is designed to achieve high-speed data transmission and low power consumption.

[0085] The MPU (13) is configured to perform the same role as the image processor (13) described above, and the description of the image correction process performed by the MPU (13) is omitted as it is redundant. Subsequently, the image corrected by the MPU (13) can be transmitted to a device other than the camera module (10) via a serializer (SER) or a connector (Conn.) (14).

[0086] FIG. 8 is a diagram illustrating that EIS is performed outside the camera module (10), and the serializer (14) within the camera module (10) can receive position information from the IMU (12) via SPI communication. The serializer (14) can receive an image frame from the image sensor (11) via MIPI communication. The serializer (14) can transmit the position information and the image frame to the deserializer (DES, 21) via GMSL (Globally Harmonized Mobile Serial Link) communication. GMSL may be a serial interface for high-speed data transmission.

[0087] Afterward, the deserializer (21) can transmit location information to the host AP (22) via SPI communication and transmit image frames to the host AP (22) via MIPI communication. The host AP (22) is configured to perform the same role as the image processor (13) described earlier, and the description of the image correction process performed at the host AP (22) is redundant and therefore omitted. The image corrected at the host AP (22) can be displayed on a display or stored in memory.

[0088]

[0089] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without changing its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive.

Claims

1. A position sensor that detects the position of a camera module and generates position information; An image sensor that generates an image frame; and It includes an image processor that corrects the image frame using the above location information, and The image processor is an image processing module that synchronizes the location information and the image frame.

2. In Paragraph 1, The above position sensor includes a gyroscope sensor that detects the attitude of the camera module, and The above location information is an image processing module including attitude information of the camera module.

3. In Paragraph 1, The image processor is an image processing module that generates shift information by calculating the accumulated position information between the start time of shooting and the time of image correction.

4. In Paragraph 3, The image processor above is an image processing module that warps and corrects the image frame using the shift information.

5. In Paragraph 3, The image processor above is an image processing module that crops and corrects the image frame using the shift information.

6. First body; A lens holder coupled to the first body above; A second body coupled to the first body above; A substrate assembly disposed within the second body above; The above substrate assembly comprises a plurality of substrates spaced apart from each other; A plurality of position sensors for detecting position information of a camera module on each of the plurality of substrates; An image sensor disposed on any one of the plurality of substrates above and generating an image frame; and It includes an image processor that corrects the image frame using the above location information, and The image processor above is a camera module that synchronizes the location information and the image frame.

7. In Paragraph 6, The above position sensor includes a gyroscope sensor that detects the attitude of the camera module, and The above location information is a camera module including attitude information of the above camera module.

8. In Paragraph 6, The image processor calculates the accumulated position information between the shooting start time and the image correction time to generate shift information, and The above image processor is a camera module that warps and corrects the image frame using the above shift information.

9. In Paragraph 6, The image processor calculates the accumulated position information between the shooting start time and the image correction time to generate shift information, and The above image processor is a camera module that crops and corrects the image frame using the above shift information.

Images