Optical image stabilization circuit, optical image stabilization device, and camera module

By integrating facial detection and gyroscope sensor in OIS circuits and devices, a composite position signal is generated to correct the position of the module of the lens module, which solves the problem of the traditional OIS technology that cannot effectively correct or shake. Essence

CN114554039BActive Publication Date: 2025-01-24SAMSUNG ELECTRO MECHANICS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110771602.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-11-10
Filing Date
2021-07-08
Publication Date
2025-01-24
Estimated Expiration
2041-07-08

AI Technical Summary

Technical Problem

Traditional optical image stabilization (OIS) technology can only correct hand shaking on the user's hand and cannot effectively correct image capture problems of the object under extreme jitter or moving conditions.

Method used

Design an OIS circuit and device, identify the facial coordinate information of the object through the facial detection unit, and combine the hand shaking information of the gyroscope sensor to generate a composite position signal to correct the position of the lens module.

Benefits of technology

The accurate correction of the object position is achieved to ensure that when the object moves or jitter, the quality of the image and photos is significantly improved, and the face of the object is always fixed in the center of the screen.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114554039B_ABST
    Figure CN114554039B_ABST
Patent Text Reader

Abstract

An optical image stabilization (OIS) circuit, an OIS device, and a camera module for object position correction are disclosed. The OIS circuit according to one embodiment includes a face detection unit that generates a face position signal including coordinate information of a face based on an image signal input from an image sensor; a hand shake detector that generates a hand shake position signal corresponding to hand shake based on a sensing signal input from a gyro sensor; an operation unit that generates a composite position signal based on the face position signal and the hand shake position signal; and a control unit that controls the position of a lens module based on the composite position signal.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of priority to Korean Patent Application No. 10-2020-0149367 filed in the Korean Intellectual Property Office on November 10, 2020, the disclosure of which is incorporated herein by reference in its entirety for all purposes. Technical Field

[0003] The following description relates to an optical image stabilization (OIS) circuit and an OIS device for subject position correction using face tracking. Background Art

[0004] Generally, as the competition for quality intensifies, optical image stabilization (OIS) applied to camera modules requires relatively high hand-shake correction performance. In the latest smartphones, the main goal is to improve the quality of photos and videos taken under extreme shaking conditions. To meet this, user's hand-shake information can be received from a gyro sensor installed on the camera phone and correction can be performed on it.

[0005] However, conventional OIS technology can only correct hand shaking of the user's hands. In addition, since there is no separate object position correction signal under the condition that the object moves in real time, there is a problem that the movement of the object is captured by the camera as it is. In addition, in order to minimize the movement of the object, the user should directly move the smartphone according to the movement of the object to capture the image. However, for extreme choreography videos or vibrations caused by external factors, it may be difficult to correct the movement of the object by moving the smartphone. Therefore, a technology for correcting the movement of the object is needed.

[0006] Conventional OIS technology can recognize vibrations applied to the camera by a gyro sensor and can perform hand shake correction. Therefore, even if the user's position is fixed, when the subject moves, there is always a problem that the camera may not be able to correctly follow the movement of the subject and the subject may be captured in a different position.

[0007] Therefore, there is a problem that the quality of images and photos is worse than expected in an environment where the subject is difficult to fix in the center part (such as an environment where the subject vibrates or moves greatly, an environment using a monopod using a rear camera, etc.). Summary of the invention

[0008] This Summary is provided to introduce a selection of concepts in a simplified form that are further described in the Detailed Description below. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

[0009] An OIS circuit and an OIS device for subject position correction not only perform hand-shake correction of a user but also perform OIS correction on the subject position using facial position (coordinate) information of a tracked subject's face.

[0010] In one general aspect, an optical image stabilization (OIS) circuit for object position correction includes: a face detection unit that generates a face position signal including coordinate information of a face based on an image signal input from an image sensor; a hand shake detector that generates a hand shake position signal corresponding to a hand shake based on a sensing signal input from a gyro sensor; an operation unit that generates a composite position signal based on the face position signal and the hand shake position signal; and a control unit that controls the position of a lens module based on the composite position signal.

[0011] The face detection unit may include: a face recognition unit configured to recognize a face from an image signal input from the image sensor; and a face position detector configured to generate a face position signal including coordinate information of the face after the face recognition unit recognizes the face.

[0012] The face position detector may be configured to generate a face position signal including coordinate information of a center face in the captured image among the plurality of faces after the face recognition unit recognizes the plurality of faces from the captured image.

[0013] The hand shake detector may include: a gyroscope filter configured to remove noise and DC offset from a sensing signal input by a gyroscope sensor and pass a filtered sensing signal including a hand shake frequency; and a gyroscope integrator configured to integrate the filtered sensing signal input to generate a hand shake position signal including angle information corresponding to the hand shake.

[0014] The operation unit may include an adder configured to add the face position signal and the hand-trembling position signal to generate a composite position signal.

[0015] The control unit may include: a feedback operator configured to generate an error signal based on a composite position signal and a feedback signal; a proportional-integral-derivative (PID) controller configured to perform PID control on the error signal to generate a position control signal; a drive unit configured to generate a drive signal based on the position control signal to drive the actuator; and an analog-to-digital A / D conversion unit configured to convert a position signal input from a position sensor associated with the actuator into a feedback signal as a digital signal, and output the feedback signal to the feedback operator.

[0016] The A / D conversion unit may include: an amplifier configured to amplify a position signal input from the position sensor; and an A / D converter configured to convert the signal amplified by the amplifier into a digital signal.

[0017] In another general aspect, an optical image stabilization (OIS) device for object position correction includes: an image sensor that captures a target screen to generate an image signal; a face detection unit that generates a face position signal including coordinate information of a face based on the image signal input from the image sensor; a gyroscope sensor that generates a sensing signal corresponding to a hand shake; a hand shake detector that generates a hand shake position signal corresponding to the hand shake based on the sensing signal input from the gyroscope sensor; an operation unit that generates a composite position signal based on the face position signal and the hand shake position signal; and a control unit that controls the position of a lens module based on the composite position signal.

[0018] The OIS apparatus may further include an actuator configured to adjust position movement of the lens module under control of the control unit.

[0019] The OIS apparatus may further include a position sensor configured to sense a position of the lens module moved by the actuator.

[0020] In another general aspect, a camera module includes: a lens module configured to capture an image; and an optical image stabilization device. The optical image stabilization device includes: an object detector configured to generate a first position signal, the first position signal including coordinate information of a target object included in an input image signal corresponding to the image; a shake detector configured to generate a second position signal based on an input sensing signal, the input sensing signal having a frequency component associated with a shake corresponding to the image; an operator to generate a composite position signal based on the first position signal and the second position signal; and a controller configured to generate a drive signal for driving the lens module based on the composite position signal.

[0021] The camera module may include an actuator configured to adjust positional movement of the lens module based on a driving signal.

[0022] The operator may be configured to generate a composite position signal by adding the first position signal and the second position signal.

[0023] The target object is the face.

[0024] Other features and aspects will become apparent from the following detailed description, drawings, and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 is a diagram of an OIS circuit for object position correction according to an example.

[0026] Figure 2 is a diagram of an OIS device for object position correction according to an example.

[0027] Figure 3 is a view of the face detection unit.

[0028] Figure 4 is a view of the hand shake detector.

[0029] Figure 5 is the view of the arithmetic unit.

[0030] Figure 6 It is the main signal diagram of the operation unit.

[0031] Figure 7 is a view of the control unit.

[0032] Fig. 8A and Figure 8B The states before and after applying face tracking are shown.

[0033] Fig.9A and Fig. 9B The states before and after applying face tracking are shown.

[0034] Throughout the drawings and detailed description, the same reference numerals denote the same elements. The drawings may not be to scale, and the relative sizes, proportions, and depictions of elements in the drawings may be exaggerated for clarity, illustration, and convenience. DETAILED DESCRIPTION

[0035] The following detailed description is provided to help the reader gain a comprehensive understanding of the methods, devices and / or systems described herein. However, various changes, modifications and equivalents of the methods, devices and / or systems described herein will be apparent to those of ordinary skill in the art. The order of operations described herein is merely exemplary and is not limited to those orders set forth herein, but may be changed as apparent to those of ordinary skill in the art, except for operations that must be performed in a particular order. In addition, for clarity and brevity, descriptions of functions and configurations known to those of ordinary skill in the art may be omitted.

[0036] The features described herein may be embodied in different forms and should not be construed as being limited to the examples described herein. Rather, the examples described herein are provided so that this disclosure will be comprehensive and complete, and will fully convey the scope of this disclosure to those of ordinary skill in the art.

[0037] In this document, it should be noted that the use of the term "may" with respect to an example or implementation (for example, with respect to a feature that an example or implementation may include or implement) means that there is at least one example or implementation that includes or implements such feature, and all examples and implementations are not limited to this.

[0038] Throughout the specification, when an element such as a layer, a region, or a substrate is described as being “located on”, “connected to”, or “coupled to” another element, it may be directly “located on”, “connected to”, or “coupled to” the other element, or one or more other elements may be interposed therebetween. Conversely, when an element is described as being “directly located on”, “directly connected to”, or “directly coupled to” another element, no other elements may be interposed therebetween.

[0039] As used herein, the term "and / or" includes any one of the associated listed items and any combination of any two or more.

[0040] Although terms such as "first", "second", and "third" may be used herein to describe various components, assemblies, regions, layers, or sections, these components, assemblies, regions, layers, or sections are not limited to these terms. Instead, these terms are only used to distinguish one component, part, region, layer, or section from another component, part, region, layer, or section. Therefore, without departing from the teachings of the examples described herein, the first component, component, region, layer, or section cited in the examples described herein may also be referred to as the second component, component, region, layer, or section.

[0041] For ease of description, spatially relative terms such as "above", "upper", "below", and "lower" may be used herein to describe the relationship of one element to another element shown in the figures. In addition to the orientation depicted in the drawings, such spatially relative terms are intended to include different orientations of the device in use or operation. For example, if the device in the drawings is turned over, an element described as being "above" or "upper" relative to another element will be "below" or "lower" relative to the other element. Therefore, depending on the spatial orientation of the device, the term "above" includes both upper and lower orientations. The device may have other orientations (e.g., rotated 90 degrees or in other orientations), and the spatially relative terms used herein should be interpreted accordingly.

[0042] The terms used herein are only used to describe various examples and are not used to limit the present disclosure. The articles "a", "an" and "the" are intended to also include plural forms unless the context clearly indicates otherwise. The terms "include", "comprise" and "have" specify the presence of the features, numbers, operations, components, elements and / or combinations thereof, but do not exclude the presence or addition of one or more other features, numbers, operations, components, elements and / or combinations thereof.

[0043] Due to manufacturing techniques and / or tolerances, the shapes shown in the drawings may vary. Therefore, the examples described herein are not limited to the specific shapes shown in the drawings, but include changes in shapes produced during manufacturing.

[0044] As will become apparent after understanding the disclosure of the present application, the features of the examples described herein can be combined in various ways. In addition, although the examples described herein have multiple configurations, other configurations are also possible, as will become apparent after understanding the disclosure of the present application.

[0045] Figure 1 is a diagram of an OIS circuit for object position correction according to an example, and Figure 2 is a diagram of an OIS device for object position correction according to an example.

[0046] Reference Figure 1 , the OIS circuit 20 for object position correction may include a face detection unit 200 , a hand shake detector 400 , an operation unit 500 , and a control unit 600 .

[0047] Reference Figure 2 , an OIS apparatus 10 for object position correction may include an image sensor 100 , a gyro sensor 300 , and an OIS circuit 20 .

[0048] The OIS apparatus 10 may further include an actuator 700 and a position sensor 800 .

[0049] Reference Figure 2 , the image sensor 100 may be mounted on the camera module. When operating the camera module, the image sensor 100 may capture a target screen to generate an image signal Ssen1 and output the image signal Ssen1 to the face detection unit 200. For example, the image signal Ssen1 may not include a person, or may include at least one person.

[0050] The gyro sensor 300 may be mounted on a camera or an electronic device equipped with a camera, and may generate a sensing signal Ssen2 having angular velocity (degrees per second (dps)) information corresponding to a hand shake of a user, and output the sensing signal Ssen2 to the hand shake detector 400. For example, the sensing signal Ssen2 output from the gyro sensor 300 may include a hand shake frequency component (e.g., 2 Hz to 20 Hz).

[0051] Reference Figure 1 and Figure 2, the face detection unit 200 may generate a face position signal Sfp including coordinate information of a face based on the image signal Ssen1 input from the image sensor 100. For example, the face detection unit 200 may recognize a face from the image signal Ssen1 and may provide a face position signal Sfp including coordinate (X and Y) information of the face.

[0052] The hand shake detector 400 may generate a hand shake position signal Shp corresponding to the hand shake based on the sensing signal Ssen2 input from the gyro sensor 300. For example, the hand shake detector 400 may extract a hand shake frequency component (e.g., 2 Hz to 20 Hz) from the sensing signal Ssen2 input from the gyro sensor 300, and may provide a hand shake position signal Shp based thereon.

[0053] The operation unit 500 may input / calculate the face position signal Sfp input from the face detection unit 200 and the hand-shake position signal Shp input from the hand-shake detector 400 to generate a composite position signal Ssum, and may output the composite position signal Ssum to the control unit 600. For example, the operation unit 500 may synthesize the face position signal Sfp and the hand-shake position signal Shp to generate the composite position signal Ssum.

[0054] In addition, the control unit 600 may control the actuator 700 to move the position of the lens module 5 based on the composite position signal Ssum input from the operation unit 500. For example, the control unit 600 may generate a driving signal for moving the position of the lens module 5 using the composite position signal Ssum and the feedback signal, and output the driving signal to the actuator 700.

[0055] In addition, refer to Figure 2 , the actuator 700 can adjust the position movement of the lens module 5 under the control of the control unit 600. For example, the actuator 700 may include a driving coil provided in the housing of the camera module, and a magnet provided in the lens module 5 movable within the housing. According to the driving signal of the control unit 600, the position movement of the lens module 5 to which the magnet is attached can be adjusted due to the effect of the driving force generated from the driving coil.

[0056] The position sensor 800 may sense the position of the lens module 5 moved by the actuator 700 to generate a position signal Spos, and output the position signal Spos to the control unit 600 .

[0057] For each drawing, unnecessary repeated description of the same reference numerals and components having the same function may be omitted, and possible differences in each drawing may be described.

[0058] Figure 3 is a view of the face detection unit.

[0059] Reference Figure 3 , the face detection unit 200 may include a face recognition unit 210 and a face position detector 220.

[0060] The facial recognition unit 210 may recognize a face based on the image signal Ssen1 input from the image sensor 100. For example, the facial recognition unit 210 may include a facial recognition function. In order to recognize a face from the image data of the image signal Ssen1, skin color information of the face, position estimation of the eyes, nose, mouth, etc. as components of the face, the composite angle of the eyes, nose, mouth, and the pattern of facial contrast, etc. may be sequentially detected to determine whether the face exists. For example, the facial recognition function may include a facial recognition program.

[0061] The face position detector 220 may generate a face position signal Sfp including coordinate information on the recognized face after the face recognition unit 210 recognizes the face.

[0062] For example, the face position detector 220 may generate a face position signal including coordinate information of a central face in a captured image among the recognized multiple faces after the face recognition unit 210 recognizes multiple faces from a captured image.

[0063] For example, in the face recognition operation of the object by the face recognition unit 210, the face position detector 220 may recognize the size and position of each of the recognized multiple faces. When multiple faces are recognized in the image signal, in order to control only one coordinate of the face closest to the central part, the face position signal Sfp including the coordinate signal of the central face may be output.

[0064] Figure 4 is a view of the hand shake detector.

[0065] Reference Figure 4 , the hand shake detector 400 may include a gyro filter 410 and a gyro integrator 420 .

[0066] The gyro filter 410 may remove noise and DC offset from the sensing signal Ssen2 input from the gyro sensor 300, and may pass the sensing signal including the hand-shake frequency. For example, when the gyro sensor 300 is a gyro based on a micro-electromechanical system (MEMS), error components such as DC offset, noise, drift, etc. may be included. Therefore, in order to ensure more accurate performance, the offset and noise included in the sensing signal Ssen2 may be removed by the gyro filter 410.

[0067] The gyro integrator 420 may integrate the sensing signal input from the gyro filter 410 to generate a hand-shake position signal Shp including angle information corresponding to the hand-shake. For example, the gyro integrator 420 may integrate the angular velocity (dps, ω=θ / t) information over time (t) to convert the integration result into angle (θ) information. Through this process, the angular velocity corresponding to the hand-shake information may be converted into a position signal.

[0068] Figure 5 is the view of the arithmetic unit, Figure 6 It is the main signal diagram of the operation unit.

[0069] Reference Figure 5 and Figure 6 For example, the operation unit 500 may include an adder 510. The adder 510 may add the face position signal Sfp and the hand-shake position signal Shp to generate a composite position signal Ssum.

[0070] Reference Figure 6 Since the composite position signal Ssum is generated by adding the face position signal Sfp and the hand shake position signal Shp through the operation unit 500, the OIS device according to various examples can perform a person's face position correction in addition to the user's hand shake correction.

[0071] For example, in the operation unit 500, the change amount (about 0.1 Hz to about 2 Hz) of the face position (coordinates) included in the face position signal Sfp may be relatively slow compared to the hand shake frequency of about 2 Hz to 20 Hz included in the hand shake position signal Shp. Therefore, in the calculation process of the operation unit 500, a low pass filter (LPF) capable of removing noise included in the face position (coordinates) may be additionally used.

[0072] Figure 7 is a view of the control unit.

[0073] Reference Figure 7 , the control unit 600 may include a feedback operator 610 , a proportional-integral-derivative (PID) controller 620 , a driving unit 630 and an analog / digital (A / D) conversion unit 640 .

[0074] The feedback operator 610 may input / calculate the composite position signal Ssum and the feedback signal Sfd to generate an error signal Serr.

[0075] The PID controller 620 may perform PID control on the error signal Serr to generate a position control signal SC.

[0076] The driving unit 630 may generate a driving signal Sdr to drive the actuator 700 based on the position control signal SC.

[0077] The A / D conversion unit 640 may convert the position signal Spos input from the position sensor 800 into a feedback signal Sfd as a digital signal, and output the converted feedback signal Sfd to the feedback operator 610 .

[0078] The A / D conversion unit 640 may include an amplifier 641 and an A / D converter 642 .

[0079] The amplifier 641 may amplify the position signal Spos input from the position sensor 800 .

[0080] The A / D converter 642 may convert the signal amplified by the amplifier 641 into a digital signal.

[0081] For example, the control unit 600 may receive the composite position signal Ssum calculated by the operation unit 500 to calculate the driving direction and distance of the actuator 700, and based on this, may change the driving current in the driving unit 630 for driving the actuator 700, and may use the driving current to drive the actuator 700.

[0082] The A / D conversion unit 640 can receive a signal from the position sensor 800 (e.g., a Hall sensor) to receive feedback on the current position of the lens module 5, can convert the received signal into a digital code, and can then output the digital code to the control unit 600 to start continuous feedback control.

[0083] The position sensor 800 may be provided in the actuator 700. For example, the position sensor 800 may be provided on a driving coil installed in the actuator 700, and may be a Hall sensor 810 that senses the position of the lens module 5.

[0084] Fig. 8A and Figure 8B shows the state before and after face tracking is applied, and Fig.9A and Fig. 9B The states before and after applying face tracking are shown.

[0085] Reference Fig. 8A and Fig.9A ,It can be seen that without applying face tracking, the object may deviate from the central part of the screen.

[0086] Reference Figure 8B and Fig. 9B , it can be seen that, with face tracking applied, the object can be located in the central part of the screen.

[0087] According to the face tracking OIS control of the various examples discussed herein, it can be seen that the position of the subject and the user's hand shake are corrected in real time, and the person's face is always located in the center even in an image where the subject is moving at high speed.

[0088] The above example may adopt a method of performing OIS control by adding a face position signal and a hand shake position signal, and thus may be advantageous for editing portraits and taking selfies on a tripod.

[0089] In addition, when a landscape in which the face of the subject is not recognized is captured, the same OIS as the conventional method can be performed, and when a person is captured, an optimal OIS effect can be obtained without affecting the conventional OIS performance.

[0090] The control unit 600 in the OIS circuit and OIS device according to various examples can be implemented in a computing environment (e.g., peripheral component interconnect (PCI), USB, firmware (IEEE 1394), optical bus structure, network, etc.), where processors (e.g., central processing unit (CPU), graphics processing unit (GPU), microprocessor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), etc.), memory (e.g., volatile memory (e.g., RAM, etc.), non-volatile memory (e.g., ROM, flash memory, etc.)), input devices (e.g., keyboard, mouse, pen, voice input device, touch input device, infrared camera, video input device, etc.), output devices (e.g., display, speaker, printer, etc.) and communication access devices (e.g., modem, network interface card (NIC), integrated network interface, radio frequency transmitter / receiver, infrared port, USB connection device, etc.) are interconnected with each other.

[0091] The computing environment may be implemented in a distributed computing environment including, but not limited to, personal computers, server computers, handheld or laptop devices, mobile devices (e.g., mobile phones, PDAs, media players, etc.), multiprocessor systems, consumer electronics, minicomputers, mainframe computers, or any of the above systems or devices.

[0092] According to various examples, not only hand shake correction of the user but also OIS correction of the object position using facial position (coordinate) information tracking the facial movement of the object may be performed, thereby correcting not only hand shake but also movement of the object.

[0093] Therefore, it is possible to produce an effect that the face of the subject is always fixed in the center of the screen when capturing a video. In particular, under conditions where the subject wants to be placed in the center (such as when shooting a video, taking a selfie on a tripod, etc.), the face of the subject is always fixed in the center of the screen, allowing the user to obtain high-quality images and photos that the user wants under any conditions.

[0094] In addition, if this function is used, when editing multiple images of the same person captured at different locations, since the position of the face is always fixed in the same position, it will be beneficial for cross-editing of images, and it will be beneficial for tracking objects with less movement, such as when capturing videos of idol performances with relatively high-speed movement.

[0095] Although the present disclosure includes specific examples, it will be apparent to those of ordinary skill in the art that various changes may be made to these examples in form and detail without departing from the spirit and scope of the claims and their equivalents. The examples described herein should be considered in a descriptive sense only, and not for limiting purposes. The description of features and aspects in each example should be considered applicable to similar features or aspects in other examples. Appropriate results may be obtained when the described techniques are performed in different orders and / or when the components in the described systems, architectures, devices, or circuits are combined in different ways, and / or the results may be replaced or substituted by other components or their equivalents. Therefore, the scope of the present disclosure is not limited by a detailed description, but by the claims and their equivalents, and all variations within the scope of the claims and their equivalents should be understood to be included in the present disclosure.

Claims

1. An optical image stabilization (OIS) circuit, comprising: a face detection unit configured to generate a face position signal including coordinate information of a face based on an image signal input from the image sensor; a hand shake detector configured to generate a hand shake position signal corresponding to the hand shake based on a sensing signal input from the gyro sensor; A computing unit configured to add the facial position signal and the hand-shake position signal to generate a composite position signal; as well as The control unit is configured to control the position of the lens module based on the composite position signal.

2. The optical image stabilization circuit according to claim 1, wherein: The face detection unit comprises: a face recognition unit configured to recognize the face from the image signal input from the image sensor; and A face position detector is configured to generate the face position signal including coordinate information of the face after the face recognition unit recognizes the face.

3. The optical image stabilization circuit according to claim 2, wherein: The face position detector is configured to generate the face position signal including coordinate information of a center face in the captured image among the plurality of faces after the face recognition unit recognizes a plurality of faces from the captured image.

4. The optical image stabilization circuit according to claim 1, wherein: The hand shaking detector comprises: a gyro filter configured to remove noise and DC offset from the sensing signal input from the gyro sensor and pass the filtered sensing signal including a hand-shake frequency; and A gyroscope integrator is configured to integrate the filtered sensing signal input to generate the hand shake position signal including angle information corresponding to the hand shake.

5. The optical image stabilization circuit according to claim 1, wherein: The arithmetic unit comprises an adder, Wherein, the adder is configured to add the facial position signal and the hand shake position signal to generate the composite position signal.

6. The optical image stabilization circuit according to claim 1, wherein: The control unit comprises: a feedback operator configured to generate an error signal based on the composite position signal and the feedback signal; a proportional-integral-derivative controller configured to perform proportional-integral-derivative control on the error signal to generate a position control signal; a driving unit configured to generate a driving signal based on the position control signal to drive an actuator; and The analog-to-digital conversion unit is configured to convert a position signal input from a position sensor associated with the actuator into the feedback signal as a digital signal, and output the feedback signal to the feedback operator.

7. An optical image stabilization device, comprising: an image sensor configured to capture a target screen to generate an image signal; a face detection unit configured to generate a face position signal including coordinate information of a face based on the image signal input from the image sensor; a gyro sensor configured to generate a sensing signal corresponding to hand shaking; a hand shake detector configured to generate a hand shake position signal corresponding to the hand shake based on the sensing signal input from the gyro sensor; A computing unit configured to add the facial position signal and the hand-shake position signal to generate a composite position signal; as well as The control unit is configured to control the position of the lens module based on the composite position signal.

8. The optical image stabilization device according to claim 7, wherein: The face detection unit comprises: a face recognition unit configured to recognize the face from the image signal input from the image sensor; and A face position detector is configured to generate the face position signal including coordinate information of the face after the face recognition unit recognizes the face.

9. The optical image stabilization device according to claim 8, wherein: The face position detector is configured to generate the face position signal including coordinate information of a center face in the captured image among the plurality of faces after the face recognition unit recognizes a plurality of faces from the captured image.

10. The optical image stabilization device according to claim 7, wherein: The hand shaking detector comprises: a gyro filter configured to remove noise and DC offset from the sensing signal input from the gyro sensor and pass the filtered sensing signal including a hand-shake frequency; and A gyroscope integrator is configured to integrate the filtered sensing signal input to generate the hand shake position signal including angle information corresponding to the hand shake.

11. The optical image stabilization device according to claim 7, wherein: The arithmetic unit comprises an adder, Wherein, the adder is configured to add the facial position signal and the hand shake position signal to generate the composite position signal. 12 . The optical image stabilization apparatus according to claim 7 , further comprising an actuator configured to adjust a position movement of the lens module under the control of the control unit. 13 . The optical image stabilization apparatus of claim 12 , further comprising a position sensor configured to sense a position of the lens module moved by the actuator.

14. The optical image stabilization device according to claim 13, wherein: The control unit comprises: a feedback operator configured to generate an error signal based on the composite position signal and the feedback signal; a proportional-integral-derivative controller configured to perform proportional-integral-derivative control on the error signal to generate a position control signal; a driving unit configured to generate a driving signal based on the position control signal to drive an actuator; and The analog-to-digital conversion unit is configured to convert the position signal input from the position sensor into the feedback signal as a digital signal, and output the feedback signal to the feedback operator.

15. The optical image stabilization device according to claim 13, wherein: The position sensor is a Hall sensor.

16. The optical image stabilization device according to claim 14, wherein: The analog-to-digital conversion unit comprises: an amplifier configured to amplify the position signal input from the position sensor; and The analog-to-digital converter is configured to convert the signal amplified by the amplifier into a digital signal.

17. A camera module, comprising: a lens module configured to capture an image; as well as Optical image stabilization equipment, including: an object detector configured to generate a first position signal including coordinate information of a target object included in an input image signal corresponding to the image; a jitter detector configured to generate a second position signal based on an input sensing signal having a frequency component associated with jitter corresponding to the image; an operator configured to add the first position signal and the second position signal to generate a composite position signal; and The controller is configured to generate a driving signal for driving the lens module based on the composite position signal. 18 . The camera module of claim 17 , further comprising an actuator configured to adjust a position movement of the lens module based on the driving signal.

19. The camera module according to claim 17, wherein: The operator is configured to generate the composite position signal by adding the first position signal and the second position signal.

20. The camera module according to claim 17, wherein: The target object is a face.

Citation Information

Patent Citations

  • Image blur correction device, control method thereof, and imaging device

    CN107920200A